Jun 03 15:46:17.428719 ip-10-0-141-30 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 03 15:46:17.428729 ip-10-0-141-30 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 03 15:46:17.428738 ip-10-0-141-30 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 03 15:46:17.429003 ip-10-0-141-30 systemd[1]: Failed to start Kubernetes Kubelet. Jun 03 15:46:27.595142 ip-10-0-141-30 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 03 15:46:27.595162 ip-10-0-141-30 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot c7f26845d3e043bdb4fa2bd872321810 -- Jun 03 15:48:59.525733 ip-10-0-141-30 systemd[1]: Starting Kubernetes Kubelet... Jun 03 15:48:59.977792 ip-10-0-141-30 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 15:48:59.977792 ip-10-0-141-30 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 15:48:59.977792 ip-10-0-141-30 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 15:48:59.977792 ip-10-0-141-30 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 15:48:59.977792 ip-10-0-141-30 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 15:48:59.980693 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.980554 2573 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 15:48:59.986598 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986577 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 15:48:59.986598 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986594 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 15:48:59.986598 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986598 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 15:48:59.986598 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986601 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 15:48:59.986598 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986604 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 15:48:59.986598 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986607 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 15:48:59.986830 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986610 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 15:48:59.986830 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986613 2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 15:48:59.986830 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986617 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 15:48:59.986830 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986620 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 15:48:59.986830 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986622 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 15:48:59.986830 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986625 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 15:48:59.986830 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986628 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 15:48:59.986830 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986631 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 15:48:59.986830 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986633 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 15:48:59.986830 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986636 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 15:48:59.986830 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986639 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 15:48:59.986830 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986642 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 15:48:59.986830 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986646 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 15:48:59.986830 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986649 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 15:48:59.986830 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986652 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 15:48:59.986830 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986655 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 15:48:59.986830 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986658 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 15:48:59.986830 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986660 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 15:48:59.986830 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986663 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 15:48:59.986830 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986665 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 15:48:59.987314 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986672 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 15:48:59.987314 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986675 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 15:48:59.987314 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986693 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 15:48:59.987314 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986696 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 15:48:59.987314 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986698 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 15:48:59.987314 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986701 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 15:48:59.987314 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986704 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 15:48:59.987314 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986707 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 15:48:59.987314 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986709 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 15:48:59.987314 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986712 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 15:48:59.987314 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986714 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 15:48:59.987314 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986717 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 15:48:59.987314 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986719 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 15:48:59.987314 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986723 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 15:48:59.987314 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986727 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 15:48:59.987314 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986731 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 15:48:59.987314 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986734 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 15:48:59.987314 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986737 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 15:48:59.987314 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986741 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 15:48:59.987805 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986744 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 15:48:59.987805 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986747 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 15:48:59.987805 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986750 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 15:48:59.987805 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986753 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 15:48:59.987805 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986756 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 15:48:59.987805 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986759 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 15:48:59.987805 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986761 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 15:48:59.987805 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986764 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 15:48:59.987805 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986768 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 15:48:59.987805 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986771 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 15:48:59.987805 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986774 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 15:48:59.987805 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986776 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 15:48:59.987805 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986779 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 15:48:59.987805 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986782 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 15:48:59.987805 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986784 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 15:48:59.987805 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986787 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 15:48:59.987805 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986789 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 15:48:59.987805 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986791 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 15:48:59.987805 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986794 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 15:48:59.988263 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986796 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 15:48:59.988263 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986799 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 15:48:59.988263 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986801 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 15:48:59.988263 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986804 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 15:48:59.988263 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986808 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 15:48:59.988263 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986810 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 15:48:59.988263 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986813 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 15:48:59.988263 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986816 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 15:48:59.988263 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986819 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 15:48:59.988263 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986821 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 15:48:59.988263 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986824 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 15:48:59.988263 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986826 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 15:48:59.988263 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986829 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 03 15:48:59.988263 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986832 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 15:48:59.988263 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986835 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 15:48:59.988263 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986838 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 15:48:59.988263 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986841 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 15:48:59.988263 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986843 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 15:48:59.988263 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986846 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 15:48:59.988263 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986849 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 15:48:59.988767 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986851 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 15:48:59.988767 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.986854 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 15:48:59.988767 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987231 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 15:48:59.988767 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987236 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 15:48:59.988767 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987240 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 15:48:59.988767 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987243 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 15:48:59.988767 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987247 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 15:48:59.988767 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987251 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 15:48:59.988767 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987254 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 15:48:59.988767 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987257 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 15:48:59.988767 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987260 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 15:48:59.988767 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987263 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 15:48:59.988767 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987266 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 15:48:59.988767 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987269 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 15:48:59.988767 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987271 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 15:48:59.988767 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987274 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 15:48:59.988767 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987276 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 15:48:59.988767 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987279 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 15:48:59.988767 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987281 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 15:48:59.988767 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987286 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 15:48:59.989242 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987288 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 15:48:59.989242 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987291 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 15:48:59.989242 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987294 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 15:48:59.989242 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987297 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 15:48:59.989242 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987300 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 15:48:59.989242 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987302 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 15:48:59.989242 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987306 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 15:48:59.989242 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987309 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 15:48:59.989242 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987311 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 15:48:59.989242 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987314 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 15:48:59.989242 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987316 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 15:48:59.989242 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987319 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 15:48:59.989242 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987322 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 15:48:59.989242 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987325 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 15:48:59.989242 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987328 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 15:48:59.989242 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987331 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 15:48:59.989242 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987333 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 15:48:59.989242 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987336 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 15:48:59.989242 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987338 2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 15:48:59.989242 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987341 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 15:48:59.989857 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987343 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 15:48:59.989857 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987346 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 15:48:59.989857 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987348 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 15:48:59.989857 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987351 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 15:48:59.989857 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987353 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 15:48:59.989857 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987356 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 15:48:59.989857 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987358 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 15:48:59.989857 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987361 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 15:48:59.989857 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987363 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 15:48:59.989857 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987366 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 15:48:59.989857 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987368 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 15:48:59.989857 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987371 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 15:48:59.989857 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987374 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 15:48:59.989857 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987376 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 15:48:59.989857 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987379 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 15:48:59.989857 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987382 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 15:48:59.989857 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987384 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 15:48:59.989857 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987387 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 15:48:59.989857 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987389 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 15:48:59.989857 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987392 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 15:48:59.990364 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987395 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 15:48:59.990364 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987398 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 15:48:59.990364 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987400 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 15:48:59.990364 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987405 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 15:48:59.990364 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987409 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 15:48:59.990364 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987411 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 15:48:59.990364 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987414 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 15:48:59.990364 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987416 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 15:48:59.990364 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987419 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 15:48:59.990364 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987422 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 15:48:59.990364 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987424 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 15:48:59.990364 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987426 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 15:48:59.990364 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987429 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 15:48:59.990364 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987431 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 03 15:48:59.990364 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987434 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 15:48:59.990364 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987437 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 15:48:59.990364 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987439 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 15:48:59.990364 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987442 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 15:48:59.990364 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987444 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 15:48:59.990864 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987447 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 15:48:59.990864 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987450 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 15:48:59.990864 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987453 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 15:48:59.990864 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987455 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 15:48:59.990864 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987458 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 15:48:59.990864 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987460 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 15:48:59.990864 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987463 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 15:48:59.990864 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987466 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 15:48:59.990864 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.987484 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 15:48:59.990864 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987558 2573 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 15:48:59.990864 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987569 2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 15:48:59.990864 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987577 2573 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 15:48:59.990864 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987583 2573 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 15:48:59.990864 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987593 2573 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 15:48:59.990864 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987599 2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 15:48:59.990864 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987604 2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 15:48:59.990864 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987608 2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 15:48:59.990864 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987611 2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 15:48:59.990864 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987614 2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 15:48:59.990864 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987618 2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 15:48:59.990864 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987623 2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 15:48:59.991376 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987627 2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 15:48:59.991376 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987632 2573 flags.go:64] FLAG: --cgroup-root="" Jun 03 15:48:59.991376 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987637 2573 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 15:48:59.991376 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987640 2573 flags.go:64] FLAG: --client-ca-file="" Jun 03 15:48:59.991376 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987643 2573 flags.go:64] FLAG: --cloud-config="" Jun 03 15:48:59.991376 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987646 2573 flags.go:64] FLAG: --cloud-provider="external" Jun 03 15:48:59.991376 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987649 2573 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 15:48:59.991376 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987653 2573 flags.go:64] FLAG: --cluster-domain="" Jun 03 15:48:59.991376 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987657 2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 15:48:59.991376 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987660 2573 flags.go:64] FLAG: --config-dir="" Jun 03 15:48:59.991376 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987663 2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 15:48:59.991376 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987667 2573 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 15:48:59.991376 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987671 2573 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 15:48:59.991376 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987674 2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 15:48:59.991376 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987677 2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 15:48:59.991376 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987680 2573 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 15:48:59.991376 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987684 2573 flags.go:64] FLAG: --contention-profiling="false" Jun 03 15:48:59.991376 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987687 2573 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 15:48:59.991376 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987690 2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 15:48:59.991376 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987693 2573 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 15:48:59.991376 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987697 2573 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 15:48:59.991376 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987701 2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 15:48:59.991376 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987704 2573 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 15:48:59.991376 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987706 2573 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 15:48:59.991376 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987709 2573 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 15:48:59.992005 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987713 2573 flags.go:64] FLAG: --enable-server="true" Jun 03 15:48:59.992005 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987716 2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 15:48:59.992005 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987720 2573 flags.go:64] FLAG: --event-burst="100" Jun 03 15:48:59.992005 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987723 2573 flags.go:64] FLAG: --event-qps="50" Jun 03 15:48:59.992005 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987726 2573 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 15:48:59.992005 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987729 2573 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 15:48:59.992005 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987732 2573 flags.go:64] FLAG: --eviction-hard="" Jun 03 15:48:59.992005 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987736 2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 15:48:59.992005 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987739 2573 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 15:48:59.992005 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987742 2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 15:48:59.992005 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987745 2573 flags.go:64] FLAG: --eviction-soft="" Jun 03 15:48:59.992005 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987748 2573 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 15:48:59.992005 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987750 2573 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 15:48:59.992005 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987753 2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 15:48:59.992005 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987756 2573 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 15:48:59.992005 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987760 2573 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 15:48:59.992005 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987763 2573 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 15:48:59.992005 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987766 2573 flags.go:64] FLAG: --feature-gates="" Jun 03 15:48:59.992005 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987770 2573 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 15:48:59.992005 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987772 2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 15:48:59.992005 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987775 2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 15:48:59.992005 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987778 2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 15:48:59.992005 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987781 2573 flags.go:64] FLAG: --healthz-port="10248" Jun 03 15:48:59.992005 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987784 2573 flags.go:64] FLAG: --help="false" Jun 03 15:48:59.992005 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987787 2573 flags.go:64] FLAG: --hostname-override="ip-10-0-141-30.ec2.internal" Jun 03 15:48:59.992641 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987790 2573 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 15:48:59.992641 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987793 2573 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 15:48:59.992641 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987796 2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 15:48:59.992641 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987799 2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 15:48:59.992641 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987802 2573 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 15:48:59.992641 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987805 2573 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 15:48:59.992641 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987808 2573 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 15:48:59.992641 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987811 2573 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 15:48:59.992641 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987815 2573 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 15:48:59.992641 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987818 2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 15:48:59.992641 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987821 2573 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 15:48:59.992641 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987824 2573 flags.go:64] FLAG: --kube-reserved="" Jun 03 15:48:59.992641 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987827 2573 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 15:48:59.992641 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987830 2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 15:48:59.992641 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987833 2573 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 15:48:59.992641 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987836 2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 15:48:59.992641 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987839 2573 flags.go:64] FLAG: --lock-file="" Jun 03 15:48:59.992641 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987841 2573 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 15:48:59.992641 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987845 2573 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 15:48:59.992641 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987847 2573 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 15:48:59.992641 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987853 2573 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 15:48:59.992641 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987859 2573 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 15:48:59.992641 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987862 2573 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 15:48:59.992641 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987865 2573 flags.go:64] FLAG: --logging-format="text" Jun 03 15:48:59.993222 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987868 2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 15:48:59.993222 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987871 2573 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 15:48:59.993222 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987874 2573 flags.go:64] FLAG: --manifest-url="" Jun 03 15:48:59.993222 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987877 2573 flags.go:64] FLAG: --manifest-url-header="" Jun 03 15:48:59.993222 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987881 2573 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 15:48:59.993222 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987884 2573 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 15:48:59.993222 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987888 2573 flags.go:64] FLAG: --max-pods="110" Jun 03 15:48:59.993222 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987891 2573 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 15:48:59.993222 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987894 2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 15:48:59.993222 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987897 2573 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 15:48:59.993222 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987900 2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 15:48:59.993222 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987903 2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 15:48:59.993222 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987906 2573 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 15:48:59.993222 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987909 2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 15:48:59.993222 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987917 2573 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 15:48:59.993222 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987920 2573 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 15:48:59.993222 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987923 2573 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 15:48:59.993222 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987927 2573 flags.go:64] FLAG: --pod-cidr="" Jun 03 15:48:59.993222 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987929 2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 03 15:48:59.993222 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987934 2573 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 15:48:59.993222 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987937 2573 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 15:48:59.993222 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987940 2573 flags.go:64] FLAG: --pods-per-core="0" Jun 03 15:48:59.993222 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987943 2573 flags.go:64] FLAG: --port="10250" Jun 03 15:48:59.993222 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987946 2573 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 15:48:59.993812 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987949 2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0873e9701938385e8" Jun 03 15:48:59.993812 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987952 2573 flags.go:64] FLAG: --qos-reserved="" Jun 03 15:48:59.993812 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987955 2573 flags.go:64] FLAG: --read-only-port="10255" Jun 03 15:48:59.993812 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987958 2573 flags.go:64] FLAG: --register-node="true" Jun 03 15:48:59.993812 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987961 2573 flags.go:64] FLAG: --register-schedulable="true" Jun 03 15:48:59.993812 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987966 2573 flags.go:64] FLAG: --register-with-taints="" Jun 03 15:48:59.993812 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987969 2573 flags.go:64] FLAG: --registry-burst="10" Jun 03 15:48:59.993812 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987972 2573 flags.go:64] FLAG: --registry-qps="5" Jun 03 15:48:59.993812 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987975 2573 flags.go:64] FLAG: --reserved-cpus="" Jun 03 15:48:59.993812 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987978 2573 flags.go:64] FLAG: --reserved-memory="" Jun 03 15:48:59.993812 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987982 2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 15:48:59.993812 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987986 2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 15:48:59.993812 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987989 2573 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 15:48:59.993812 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987992 2573 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 15:48:59.993812 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987995 2573 flags.go:64] FLAG: --runonce="false" Jun 03 15:48:59.993812 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.987998 2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 15:48:59.993812 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.988001 2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 15:48:59.993812 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.988004 2573 flags.go:64] FLAG: --seccomp-default="false" Jun 03 15:48:59.993812 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.988007 2573 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 15:48:59.993812 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.988009 2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 15:48:59.993812 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.988012 2573 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 15:48:59.993812 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.988015 2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 15:48:59.993812 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.988019 2573 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 15:48:59.993812 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.988021 2573 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 15:48:59.993812 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.988024 2573 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 15:48:59.993812 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.988027 2573 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 15:48:59.994437 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.988031 2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 15:48:59.994437 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.988034 2573 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 15:48:59.994437 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.988037 2573 flags.go:64] FLAG: --system-cgroups="" Jun 03 15:48:59.994437 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.988039 2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 15:48:59.994437 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.988045 2573 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 15:48:59.994437 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.988048 2573 flags.go:64] FLAG: --tls-cert-file="" Jun 03 15:48:59.994437 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.988050 2573 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 15:48:59.994437 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.988056 2573 flags.go:64] FLAG: --tls-min-version="" Jun 03 15:48:59.994437 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.988058 2573 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 15:48:59.994437 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.988061 2573 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 15:48:59.994437 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.988064 2573 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 15:48:59.994437 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.988068 2573 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 15:48:59.994437 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.988071 2573 flags.go:64] FLAG: --v="2" Jun 03 15:48:59.994437 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.988075 2573 flags.go:64] FLAG: --version="false" Jun 03 15:48:59.994437 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.988079 2573 flags.go:64] FLAG: --vmodule="" Jun 03 15:48:59.994437 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.988083 2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 15:48:59.994437 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.988087 2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 15:48:59.994437 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988175 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 15:48:59.994437 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988179 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 15:48:59.994437 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988182 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 15:48:59.994437 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988185 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 15:48:59.994437 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988188 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 15:48:59.994437 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988191 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 15:48:59.994437 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988194 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 15:48:59.995067 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988197 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 15:48:59.995067 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988200 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 15:48:59.995067 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988203 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 15:48:59.995067 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988206 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 15:48:59.995067 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988210 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 15:48:59.995067 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988213 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 15:48:59.995067 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988216 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 15:48:59.995067 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988219 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 15:48:59.995067 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988222 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 15:48:59.995067 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988225 2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 15:48:59.995067 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988228 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 15:48:59.995067 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988230 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 15:48:59.995067 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988234 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 15:48:59.995067 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988236 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 15:48:59.995067 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988242 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 15:48:59.995067 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988245 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 15:48:59.995067 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988248 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 15:48:59.995067 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988250 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 15:48:59.995067 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988253 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 15:48:59.995572 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988258 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 15:48:59.995572 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988260 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 15:48:59.995572 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988264 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 15:48:59.995572 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988268 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 15:48:59.995572 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988271 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 15:48:59.995572 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988273 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 15:48:59.995572 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988276 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 15:48:59.995572 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988279 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 15:48:59.995572 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988281 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 15:48:59.995572 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988284 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 15:48:59.995572 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988286 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 15:48:59.995572 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988289 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 15:48:59.995572 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988291 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 15:48:59.995572 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988294 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 15:48:59.995572 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988296 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 15:48:59.995572 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988299 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 15:48:59.995572 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988302 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 15:48:59.995572 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988304 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 15:48:59.995572 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988306 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 15:48:59.996077 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988309 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 15:48:59.996077 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988312 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 15:48:59.996077 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988314 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 15:48:59.996077 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988317 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 15:48:59.996077 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988320 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 03 15:48:59.996077 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988323 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 15:48:59.996077 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988325 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 15:48:59.996077 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988328 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 15:48:59.996077 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988332 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 15:48:59.996077 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988335 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 15:48:59.996077 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988338 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 15:48:59.996077 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988340 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 15:48:59.996077 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988343 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 15:48:59.996077 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988346 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 15:48:59.996077 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988349 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 15:48:59.996077 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988351 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 15:48:59.996077 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988354 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 15:48:59.996077 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988357 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 15:48:59.996077 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988359 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 15:48:59.996077 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988362 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 15:48:59.996631 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988364 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 15:48:59.996631 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988366 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 15:48:59.996631 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988369 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 15:48:59.996631 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988371 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 15:48:59.996631 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988374 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 15:48:59.996631 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988377 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 15:48:59.996631 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988379 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 15:48:59.996631 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988381 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 15:48:59.996631 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988384 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 15:48:59.996631 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988386 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 15:48:59.996631 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988389 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 15:48:59.996631 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988391 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 15:48:59.996631 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988394 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 15:48:59.996631 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988396 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 15:48:59.996631 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988399 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 15:48:59.996631 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988401 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 15:48:59.996631 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988404 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 15:48:59.996631 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988407 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 15:48:59.996631 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988409 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 15:48:59.996631 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988411 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 15:48:59.997136 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.988415 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 15:48:59.997136 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.989138 2573 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 15:48:59.997136 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.995233 2573 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 03 15:48:59.997136 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.995250 2573 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 15:48:59.997136 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995301 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 15:48:59.997136 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995306 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 15:48:59.997136 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995309 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 15:48:59.997136 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995312 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 15:48:59.997136 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995315 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 15:48:59.997136 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995319 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 15:48:59.997136 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995322 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 15:48:59.997136 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995325 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 15:48:59.997136 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995328 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 15:48:59.997136 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995331 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 15:48:59.997136 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995334 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 15:48:59.997136 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995337 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 15:48:59.997570 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995340 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 15:48:59.997570 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995343 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 15:48:59.997570 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995346 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 15:48:59.997570 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995349 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 15:48:59.997570 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995351 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 15:48:59.997570 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995354 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 15:48:59.997570 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995356 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 15:48:59.997570 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995359 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 15:48:59.997570 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995361 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 15:48:59.997570 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995364 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 15:48:59.997570 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995367 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 15:48:59.997570 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995370 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 15:48:59.997570 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995372 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 15:48:59.997570 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995376 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 15:48:59.997570 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995379 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 15:48:59.997570 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995382 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 15:48:59.997570 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995384 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 15:48:59.997570 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995387 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 15:48:59.997570 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995390 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 15:48:59.997570 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995393 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 15:48:59.998062 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995395 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 15:48:59.998062 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995398 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 15:48:59.998062 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995401 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 15:48:59.998062 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995405 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 15:48:59.998062 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995409 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 15:48:59.998062 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995412 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 15:48:59.998062 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995415 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 15:48:59.998062 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995418 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 15:48:59.998062 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995421 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 15:48:59.998062 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995423 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 15:48:59.998062 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995426 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 15:48:59.998062 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995429 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 15:48:59.998062 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995432 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 15:48:59.998062 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995434 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 15:48:59.998062 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995437 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 15:48:59.998062 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995439 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 15:48:59.998062 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995442 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 15:48:59.998062 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995445 2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 15:48:59.998062 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995447 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 15:48:59.998557 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995450 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 15:48:59.998557 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995452 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 15:48:59.998557 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995455 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 15:48:59.998557 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995458 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 15:48:59.998557 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995461 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 15:48:59.998557 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995464 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 15:48:59.998557 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995467 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 15:48:59.998557 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995489 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 15:48:59.998557 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995493 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 15:48:59.998557 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995495 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 15:48:59.998557 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995498 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 15:48:59.998557 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995500 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 15:48:59.998557 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995503 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 15:48:59.998557 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995506 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 15:48:59.998557 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995509 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 15:48:59.998557 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995511 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 15:48:59.998557 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995514 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 15:48:59.998557 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995516 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 15:48:59.998557 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995520 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 15:48:59.999032 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995524 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 15:48:59.999032 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995526 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 15:48:59.999032 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995529 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 15:48:59.999032 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995531 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 15:48:59.999032 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995534 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 15:48:59.999032 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995536 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 15:48:59.999032 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995539 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 15:48:59.999032 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995542 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 15:48:59.999032 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995544 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 15:48:59.999032 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995547 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 15:48:59.999032 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995550 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 15:48:59.999032 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995552 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 15:48:59.999032 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995554 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 15:48:59.999032 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995557 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 15:48:59.999032 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995559 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 15:48:59.999032 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995562 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 03 15:48:59.999531 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.995567 2573 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 15:48:59.999531 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995679 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 15:48:59.999531 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995683 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 15:48:59.999531 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995686 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 15:48:59.999531 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995689 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 15:48:59.999531 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995693 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 15:48:59.999531 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995696 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 15:48:59.999531 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995699 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 15:48:59.999531 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995702 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 15:48:59.999531 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995704 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 15:48:59.999531 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995707 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 15:48:59.999531 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995710 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 15:48:59.999531 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995712 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 15:48:59.999531 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995714 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 15:48:59.999531 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995717 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 15:48:59.999905 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995720 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 15:48:59.999905 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995722 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 15:48:59.999905 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995724 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 15:48:59.999905 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995727 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 15:48:59.999905 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995729 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 15:48:59.999905 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995732 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 15:48:59.999905 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995734 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 15:48:59.999905 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995737 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 15:48:59.999905 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995739 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 15:48:59.999905 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995742 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 15:48:59.999905 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995744 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 15:48:59.999905 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995747 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 15:48:59.999905 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995749 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 15:48:59.999905 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995752 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 15:48:59.999905 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995754 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 15:48:59.999905 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995757 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 15:48:59.999905 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995759 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 15:48:59.999905 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995762 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 15:48:59.999905 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995765 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 15:48:59.999905 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995767 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 15:49:00.000396 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995770 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 15:49:00.000396 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995772 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 15:49:00.000396 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995775 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 15:49:00.000396 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995778 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 15:49:00.000396 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995781 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 15:49:00.000396 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995784 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 15:49:00.000396 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995786 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 15:49:00.000396 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995788 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 15:49:00.000396 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995791 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 15:49:00.000396 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995793 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 15:49:00.000396 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995796 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 15:49:00.000396 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995798 2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 15:49:00.000396 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995801 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 15:49:00.000396 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995803 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 15:49:00.000396 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995806 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 15:49:00.000396 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995808 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 15:49:00.000396 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995811 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 15:49:00.000396 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995813 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 15:49:00.000396 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995816 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 15:49:00.000879 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995818 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 15:49:00.000879 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995821 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 15:49:00.000879 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995823 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 15:49:00.000879 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995825 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 15:49:00.000879 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995828 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 15:49:00.000879 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995830 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 15:49:00.000879 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995833 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 03 15:49:00.000879 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995835 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 15:49:00.000879 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995837 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 15:49:00.000879 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995840 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 15:49:00.000879 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995843 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 15:49:00.000879 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995846 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 15:49:00.000879 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995850 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 15:49:00.000879 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995852 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 15:49:00.000879 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995855 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 15:49:00.000879 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995858 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 15:49:00.000879 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995861 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 15:49:00.000879 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995864 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 15:49:00.000879 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995867 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 15:49:00.000879 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995870 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 15:49:00.001363 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995872 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 15:49:00.001363 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995875 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 15:49:00.001363 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995878 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 15:49:00.001363 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995881 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 15:49:00.001363 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995883 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 15:49:00.001363 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995886 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 15:49:00.001363 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995888 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 15:49:00.001363 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995891 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 15:49:00.001363 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995893 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 15:49:00.001363 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995896 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 15:49:00.001363 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995900 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 15:49:00.001363 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995903 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 15:49:00.001363 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:48:59.995905 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 15:49:00.001363 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.995910 2573 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 15:49:00.001363 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.996745 2573 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 15:49:00.001873 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:48:59.999255 2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 15:49:00.001873 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.000861 2573 server.go:1019] "Starting client certificate rotation" Jun 03 15:49:00.001873 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.000958 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 15:49:00.001873 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.000989 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 15:49:00.026945 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.026923 2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 15:49:00.030424 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.030407 2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 15:49:00.048693 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.048667 2573 log.go:25] "Validated CRI v1 runtime API" Jun 03 15:49:00.055127 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.055108 2573 log.go:25] "Validated CRI v1 image API" Jun 03 15:49:00.056248 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.056231 2573 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 15:49:00.058688 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.058661 2573 fs.go:135] Filesystem UUIDs: map[24ef3151-4bed-4aaf-9e09-ac85120626cf:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 d8c130a8-0645-4db9-9ea6-fe16bc7ae280:/dev/nvme0n1p3] Jun 03 15:49:00.058744 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.058687 2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 15:49:00.063259 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.063146 2573 manager.go:217] Machine: {Timestamp:2026-06-03 15:49:00.06260296 +0000 UTC m=+0.419598083 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097500 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec238fe2189660c98942ec809ac1cf98 SystemUUID:ec238fe2-1896-60c9-8942-ec809ac1cf98 BootID:c7f26845-d3e0-43bd-b4fa-2bd872321810 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e9:93:7b:71:e3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e9:93:7b:71:e3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:36:a9:fd:f1:9a:1c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 15:49:00.063341 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.063264 2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 15:49:00.063372 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.063345 2573 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 15:49:00.064702 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.064677 2573 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 15:49:00.064842 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.064703 2573 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-30.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 15:49:00.064895 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.064851 2573 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 15:49:00.064895 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.064859 2573 container_manager_linux.go:306] "Creating device plugin manager" Jun 03 15:49:00.064895 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.064866 2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 15:49:00.065615 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.065605 2573 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 15:49:00.065955 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.065940 2573 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 15:49:00.067170 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.067158 2573 state_mem.go:36] "Initialized new in-memory state store" Jun 03 15:49:00.067295 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.067286 2573 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 03 15:49:00.070013 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.070002 2573 kubelet.go:491] "Attempting to sync node with API server" Jun 03 15:49:00.070045 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.070024 2573 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 15:49:00.070045 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.070037 2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 15:49:00.070112 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.070047 2573 kubelet.go:397] "Adding apiserver pod source" Jun 03 15:49:00.070112 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.070057 2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 15:49:00.071100 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.071084 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 15:49:00.071100 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.071103 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 15:49:00.074831 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.074802 2573 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 03 15:49:00.076522 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.076506 2573 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 15:49:00.078316 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.078303 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 15:49:00.078378 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.078321 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 15:49:00.078378 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.078327 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 15:49:00.078378 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.078333 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 15:49:00.078378 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.078342 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 15:49:00.078378 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.078348 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 15:49:00.078378 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.078354 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 15:49:00.078378 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.078360 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 15:49:00.078378 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.078367 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 15:49:00.078378 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.078373 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 15:49:00.078378 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.078381 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 15:49:00.078655 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.078387 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 15:49:00.079201 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.079190 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 15:49:00.079230 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.079202 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 15:49:00.082031 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:00.082002 2573 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 15:49:00.082137 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:00.082080 2573 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-30.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 15:49:00.083053 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.083036 2573 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 03 15:49:00.083129 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.083088 2573 server.go:1295] "Started kubelet" Jun 03 15:49:00.083219 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.083150 2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 15:49:00.083255 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.083208 2573 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 15:49:00.083337 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.083309 2573 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 03 15:49:00.083893 ip-10-0-141-30 systemd[1]: Started Kubernetes Kubelet. Jun 03 15:49:00.084438 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.084418 2573 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 15:49:00.085337 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.085324 2573 server.go:317] "Adding debug handlers to kubelet server" Jun 03 15:49:00.088659 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.088637 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 15:49:00.089181 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.089165 2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 15:49:00.089325 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.089293 2573 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 03 15:49:00.089325 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.089308 2573 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 03 15:49:00.089440 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.089431 2573 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 03 15:49:00.089517 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.089507 2573 reconstruct.go:97] "Volume reconstruction finished" Jun 03 15:49:00.089517 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.089517 2573 reconciler.go:26] "Reconciler: start to sync state" Jun 03 15:49:00.089961 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.089944 2573 factory.go:55] Registering systemd factory Jun 03 15:49:00.089961 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.089963 2573 factory.go:223] Registration of the systemd container factory successfully Jun 03 15:49:00.090187 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:00.090169 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-30.ec2.internal\" not found" Jun 03 15:49:00.090255 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.090174 2573 factory.go:153] Registering CRI-O factory Jun 03 15:49:00.090255 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.090210 2573 factory.go:223] Registration of the crio container factory successfully Jun 03 15:49:00.090349 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.090259 2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 15:49:00.090349 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.090278 2573 factory.go:103] Registering Raw factory Jun 03 15:49:00.090349 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.090294 2573 manager.go:1196] Started watching for new ooms in manager Jun 03 15:49:00.091029 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.091009 2573 manager.go:319] Starting recovery of all containers Jun 03 15:49:00.091545 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.091520 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d9grl" Jun 03 15:49:00.091755 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.091736 2573 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-30.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 15:49:00.093321 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:00.093298 2573 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 15:49:00.094941 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:00.091821 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-30.ec2.internal.18b59ce62b9d7c8c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-30.ec2.internal,UID:ip-10-0-141-30.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-30.ec2.internal,},FirstTimestamp:2026-06-03 15:49:00.08305166 +0000 UTC m=+0.440046783,LastTimestamp:2026-06-03 15:49:00.08305166 +0000 UTC m=+0.440046783,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-30.ec2.internal,}" Jun 03 15:49:00.101945 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:00.101913 2573 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 03 15:49:00.102032 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:00.101972 2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-30.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 03 15:49:00.102107 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.102083 2573 manager.go:324] Recovery completed Jun 03 15:49:00.105063 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.104943 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d9grl" Jun 03 15:49:00.107570 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.107557 2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 15:49:00.109413 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.109398 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-30.ec2.internal" event="NodeHasSufficientMemory" Jun 03 15:49:00.109524 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.109427 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-30.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 15:49:00.109524 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.109441 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-30.ec2.internal" event="NodeHasSufficientPID" Jun 03 15:49:00.110004 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.109990 2573 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 15:49:00.110004 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.110004 2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 15:49:00.110115 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.110022 2573 state_mem.go:36] "Initialized new in-memory state store" Jun 03 15:49:00.112012 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.111998 2573 policy_none.go:49] "None policy: Start" Jun 03 15:49:00.112087 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.112017 2573 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 03 15:49:00.112087 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.112030 2573 state_mem.go:35] "Initializing new in-memory state store" Jun 03 15:49:00.113738 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:00.113649 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-30.ec2.internal.18b59ce62d2fbaed default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-30.ec2.internal,UID:ip-10-0-141-30.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-30.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-30.ec2.internal,},FirstTimestamp:2026-06-03 15:49:00.109413101 +0000 UTC m=+0.466408228,LastTimestamp:2026-06-03 15:49:00.109413101 +0000 UTC m=+0.466408228,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-30.ec2.internal,}" Jun 03 15:49:00.155089 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.155072 2573 manager.go:341] "Starting Device Plugin manager" Jun 03 15:49:00.156587 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:00.155113 2573 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 15:49:00.156587 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.155123 2573 server.go:85] "Starting device plugin registration server" Jun 03 15:49:00.156587 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.155345 2573 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 15:49:00.156587 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.155354 2573 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 15:49:00.156587 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.155452 2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 15:49:00.156587 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.155548 2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 15:49:00.156587 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.155561 2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 15:49:00.156587 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:00.156087 2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 15:49:00.156587 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:00.156116 2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-30.ec2.internal\" not found" Jun 03 15:49:00.228269 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.228172 2573 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 03 15:49:00.229446 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.229428 2573 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 03 15:49:00.229519 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.229461 2573 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 03 15:49:00.229519 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.229502 2573 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 15:49:00.229519 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.229512 2573 kubelet.go:2451] "Starting kubelet main sync loop" Jun 03 15:49:00.229664 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:00.229554 2573 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 15:49:00.232461 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.232441 2573 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 15:49:00.256098 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.256079 2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 15:49:00.256925 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.256908 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-30.ec2.internal" event="NodeHasSufficientMemory" Jun 03 15:49:00.257015 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.256938 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-30.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 15:49:00.257015 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.256950 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-30.ec2.internal" event="NodeHasSufficientPID" Jun 03 15:49:00.257015 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.256975 2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-30.ec2.internal" Jun 03 15:49:00.264515 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.264499 2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-30.ec2.internal" Jun 03 15:49:00.264601 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:00.264524 2573 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-30.ec2.internal\": node \"ip-10-0-141-30.ec2.internal\" not found" Jun 03 15:49:00.279608 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:00.279585 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-30.ec2.internal\" not found" Jun 03 15:49:00.330115 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.330081 2573 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-30.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-30.ec2.internal"] Jun 03 15:49:00.330290 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.330168 2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 15:49:00.333084 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.333065 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-30.ec2.internal" event="NodeHasSufficientMemory" Jun 03 15:49:00.333195 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.333094 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-30.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 15:49:00.333195 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.333108 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-30.ec2.internal" event="NodeHasSufficientPID" Jun 03 15:49:00.334326 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.334310 2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 15:49:00.334484 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.334452 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-30.ec2.internal" Jun 03 15:49:00.334546 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.334511 2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 15:49:00.335112 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.335091 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-30.ec2.internal" event="NodeHasSufficientMemory" Jun 03 15:49:00.335206 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.335124 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-30.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 15:49:00.335206 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.335136 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-30.ec2.internal" event="NodeHasSufficientPID" Jun 03 15:49:00.335206 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.335093 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-30.ec2.internal" event="NodeHasSufficientMemory" Jun 03 15:49:00.335206 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.335187 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-30.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 15:49:00.335206 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.335208 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-30.ec2.internal" event="NodeHasSufficientPID" Jun 03 15:49:00.336313 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.336298 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-30.ec2.internal" Jun 03 15:49:00.336352 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.336337 2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 15:49:00.337109 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.337094 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-30.ec2.internal" event="NodeHasSufficientMemory" Jun 03 15:49:00.337185 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.337120 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-30.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 15:49:00.337185 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.337132 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-30.ec2.internal" event="NodeHasSufficientPID" Jun 03 15:49:00.366072 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:00.366051 2573 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-30.ec2.internal\" not found" node="ip-10-0-141-30.ec2.internal" Jun 03 15:49:00.370432 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:00.370416 2573 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-30.ec2.internal\" not found" node="ip-10-0-141-30.ec2.internal" Jun 03 15:49:00.380452 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:00.380438 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-30.ec2.internal\" not found" Jun 03 15:49:00.391740 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.391724 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb474f5b54e62ac3180cf68c21914d92-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-30.ec2.internal\" (UID: \"eb474f5b54e62ac3180cf68c21914d92\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-30.ec2.internal" Jun 03 15:49:00.391816 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.391749 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1ea1fc29e200e4220b7c6bf0d70a6719-config\") pod \"kube-apiserver-proxy-ip-10-0-141-30.ec2.internal\" (UID: \"1ea1fc29e200e4220b7c6bf0d70a6719\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-30.ec2.internal" Jun 03 15:49:00.391816 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.391765 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/eb474f5b54e62ac3180cf68c21914d92-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-30.ec2.internal\" (UID: \"eb474f5b54e62ac3180cf68c21914d92\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-30.ec2.internal" Jun 03 15:49:00.481142 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:00.481066 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-30.ec2.internal\" not found" Jun 03 15:49:00.492484 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.492447 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/eb474f5b54e62ac3180cf68c21914d92-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-30.ec2.internal\" (UID: \"eb474f5b54e62ac3180cf68c21914d92\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-30.ec2.internal" Jun 03 15:49:00.492603 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.492486 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb474f5b54e62ac3180cf68c21914d92-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-30.ec2.internal\" (UID: \"eb474f5b54e62ac3180cf68c21914d92\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-30.ec2.internal" Jun 03 15:49:00.492603 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.492508 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1ea1fc29e200e4220b7c6bf0d70a6719-config\") pod \"kube-apiserver-proxy-ip-10-0-141-30.ec2.internal\" (UID: \"1ea1fc29e200e4220b7c6bf0d70a6719\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-30.ec2.internal" Jun 03 15:49:00.492603 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.492510 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/eb474f5b54e62ac3180cf68c21914d92-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-30.ec2.internal\" (UID: \"eb474f5b54e62ac3180cf68c21914d92\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-30.ec2.internal" Jun 03 15:49:00.492603 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.492539 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb474f5b54e62ac3180cf68c21914d92-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-30.ec2.internal\" (UID: \"eb474f5b54e62ac3180cf68c21914d92\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-30.ec2.internal" Jun 03 15:49:00.492603 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.492548 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1ea1fc29e200e4220b7c6bf0d70a6719-config\") pod \"kube-apiserver-proxy-ip-10-0-141-30.ec2.internal\" (UID: \"1ea1fc29e200e4220b7c6bf0d70a6719\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-30.ec2.internal" Jun 03 15:49:00.581527 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:00.581504 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-30.ec2.internal\" not found" Jun 03 15:49:00.669043 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.668999 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-30.ec2.internal" Jun 03 15:49:00.673755 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.673737 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-30.ec2.internal" Jun 03 15:49:00.682539 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:00.682516 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-30.ec2.internal\" not found" Jun 03 15:49:00.783105 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:00.783018 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-30.ec2.internal\" not found" Jun 03 15:49:00.883528 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:00.883497 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-30.ec2.internal\" not found" Jun 03 15:49:00.984140 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:00.984110 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-30.ec2.internal\" not found" Jun 03 15:49:00.991243 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.991222 2573 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 15:49:00.999875 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.999851 2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 15:49:00.999980 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:00.999964 2573 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 15:49:01.000044 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.000019 2573 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 15:49:01.071216 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.071190 2573 apiserver.go:52] "Watching apiserver" Jun 03 15:49:01.089204 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.089178 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 15:49:01.089337 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.089189 2573 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 15:49:01.089505 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.089492 2573 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-30.ec2.internal" Jun 03 15:49:01.091179 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.091160 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-tqbmw","openshift-ovn-kubernetes/ovnkube-node-4rkfz","openshift-cluster-node-tuning-operator/tuned-9sqjn","openshift-dns/node-resolver-nzf52","openshift-image-registry/node-ca-zqg8b","openshift-multus/multus-8dhbv","openshift-network-operator/iptables-alerter-2wb84","kube-system/konnectivity-agent-ntc9t","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ptnm6","openshift-multus/multus-additional-cni-plugins-mfjbh","openshift-multus/network-metrics-daemon-zl2xd"] Jun 03 15:49:01.092617 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.092597 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tqbmw" Jun 03 15:49:01.092750 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:01.092726 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tqbmw" podUID="53b1660f-0dbd-42e9-beab-6df46454d8a6" Jun 03 15:49:01.096102 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.096078 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9sqjn" Jun 03 15:49:01.097872 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.097844 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.098420 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.098402 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nzf52" Jun 03 15:49:01.099422 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.099407 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zqg8b" Jun 03 15:49:01.100357 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.100344 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8dhbv" Jun 03 15:49:01.101418 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.101401 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2wb84" Jun 03 15:49:01.102370 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.102355 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ntc9t" Jun 03 15:49:01.103567 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.103553 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ptnm6" Jun 03 15:49:01.104759 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.104743 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mfjbh" Jun 03 15:49:01.105776 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.105760 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zl2xd" Jun 03 15:49:01.105834 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:01.105816 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zl2xd" podUID="5aa0ffe1-5bf5-47f0-9814-d639c23b597f" Jun 03 15:49:01.107156 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.107133 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 15:44:00 +0000 UTC" deadline="2028-03-01 12:09:49.657010204 +0000 UTC" Jun 03 15:49:01.107205 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.107156 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15284h20m48.549856531s" Jun 03 15:49:01.107594 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.107578 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 15:49:01.108202 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.108057 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 15:49:01.108202 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.108081 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 15:49:01.108202 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.108093 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 15:49:01.108202 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.108114 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 15:49:01.108202 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.108143 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 15:49:01.108507 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.108209 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 15:49:01.108507 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.108271 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 15:49:01.108507 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.108376 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 15:49:01.108856 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.108825 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 15:49:01.108856 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.108848 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 15:49:01.108953 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.108833 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 15:49:01.108953 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.108828 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 15:49:01.109044 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.108989 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 15:49:01.109095 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.109051 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 15:49:01.109145 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.109116 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 15:49:01.109251 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.109233 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 15:49:01.109304 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.109275 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-f72f9\"" Jun 03 15:49:01.109304 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.109294 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9g5tn\"" Jun 03 15:49:01.109401 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.109242 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 15:49:01.109401 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.109341 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-h2nwq\"" Jun 03 15:49:01.109502 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.109403 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 15:49:01.109502 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.109486 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 15:49:01.109789 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.109776 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 15:49:01.109861 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.109843 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 15:49:01.109912 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.109872 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 15:49:01.109912 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.109895 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-d5tq9\"" Jun 03 15:49:01.112122 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.112106 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 15:49:01.113645 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.113629 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-30.ec2.internal"] Jun 03 15:49:01.117211 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.117187 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rpwz4\"" Jun 03 15:49:01.117304 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.117246 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 15:49:01.117304 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.117283 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6qd2k\"" Jun 03 15:49:01.117304 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.117250 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rf6qh\"" Jun 03 15:49:01.117446 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.117310 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-g8qkb\"" Jun 03 15:49:01.117446 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.117425 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kfxbg\"" Jun 03 15:49:01.117738 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.117724 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 15:49:01.117873 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.117855 2573 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 15:49:01.118003 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.117989 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 15:49:01.118061 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.118034 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 15:49:01.118114 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.118100 2573 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-30.ec2.internal" Jun 03 15:49:01.144487 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.144453 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 15:49:01.144589 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.144541 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-30.ec2.internal"] Jun 03 15:49:01.147000 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:49:01.146975 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ea1fc29e200e4220b7c6bf0d70a6719.slice/crio-af6d426798c21473f37f82b7e25bc59c19c299384e30e27f60d1ea6e39050994 WatchSource:0}: Error finding container af6d426798c21473f37f82b7e25bc59c19c299384e30e27f60d1ea6e39050994: Status 404 returned error can't find the container with id af6d426798c21473f37f82b7e25bc59c19c299384e30e27f60d1ea6e39050994 Jun 03 15:49:01.147247 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:49:01.147226 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb474f5b54e62ac3180cf68c21914d92.slice/crio-3c44b842f70cc6d11ddd8368a27776100312dd0ee2d7a179e70ea9b6bd067559 WatchSource:0}: Error finding container 3c44b842f70cc6d11ddd8368a27776100312dd0ee2d7a179e70ea9b6bd067559: Status 404 returned error can't find the container with id 3c44b842f70cc6d11ddd8368a27776100312dd0ee2d7a179e70ea9b6bd067559 Jun 03 15:49:01.150207 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.150192 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 15:49:01.190405 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.190389 2573 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 03 15:49:01.197956 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.197938 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/52874ebd-3611-402b-bc80-fa65b5ca8b54-run-ovn\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.198041 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.197970 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t67rn\" (UniqueName: \"kubernetes.io/projected/52874ebd-3611-402b-bc80-fa65b5ca8b54-kube-api-access-t67rn\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.198041 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.197994 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a09fb6d9-72f4-4139-b3ca-77c2889be355-socket-dir\") pod \"aws-ebs-csi-driver-node-ptnm6\" (UID: \"a09fb6d9-72f4-4139-b3ca-77c2889be355\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ptnm6" Jun 03 15:49:01.198041 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.198030 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1805c9c3-3e37-4b81-bd24-a6253025eed2-host-run-netns\") pod \"multus-8dhbv\" (UID: \"1805c9c3-3e37-4b81-bd24-a6253025eed2\") " pod="openshift-multus/multus-8dhbv" Jun 03 15:49:01.198150 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.198056 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx9d5\" (UniqueName: \"kubernetes.io/projected/af92e0dd-a3c0-4993-a37a-edd0d027a43f-kube-api-access-xx9d5\") pod \"node-ca-zqg8b\" (UID: \"af92e0dd-a3c0-4993-a37a-edd0d027a43f\") " pod="openshift-image-registry/node-ca-zqg8b" Jun 03 15:49:01.198150 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.198077 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a09fb6d9-72f4-4139-b3ca-77c2889be355-registration-dir\") pod \"aws-ebs-csi-driver-node-ptnm6\" (UID: \"a09fb6d9-72f4-4139-b3ca-77c2889be355\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ptnm6" Jun 03 15:49:01.198150 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.198101 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1075e32-8d0e-4ca6-8cd9-4d2d337ce213-etc-kubernetes\") pod \"tuned-9sqjn\" (UID: \"f1075e32-8d0e-4ca6-8cd9-4d2d337ce213\") " pod="openshift-cluster-node-tuning-operator/tuned-9sqjn" Jun 03 15:49:01.198150 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.198117 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65xkl\" (UniqueName: \"kubernetes.io/projected/f1075e32-8d0e-4ca6-8cd9-4d2d337ce213-kube-api-access-65xkl\") pod \"tuned-9sqjn\" (UID: \"f1075e32-8d0e-4ca6-8cd9-4d2d337ce213\") " pod="openshift-cluster-node-tuning-operator/tuned-9sqjn" Jun 03 15:49:01.198150 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.198130 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1805c9c3-3e37-4b81-bd24-a6253025eed2-multus-socket-dir-parent\") pod \"multus-8dhbv\" (UID: \"1805c9c3-3e37-4b81-bd24-a6253025eed2\") " pod="openshift-multus/multus-8dhbv" Jun 03 15:49:01.198150 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.198147 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1805c9c3-3e37-4b81-bd24-a6253025eed2-host-var-lib-cni-multus\") pod \"multus-8dhbv\" (UID: \"1805c9c3-3e37-4b81-bd24-a6253025eed2\") " pod="openshift-multus/multus-8dhbv" Jun 03 15:49:01.198332 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.198170 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b1c958f9-beb1-4a9f-9675-653a29fe49fd-cnibin\") pod \"multus-additional-cni-plugins-mfjbh\" (UID: \"b1c958f9-beb1-4a9f-9675-653a29fe49fd\") " pod="openshift-multus/multus-additional-cni-plugins-mfjbh" Jun 03 15:49:01.198332 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.198205 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b1c958f9-beb1-4a9f-9675-653a29fe49fd-cni-binary-copy\") pod \"multus-additional-cni-plugins-mfjbh\" (UID: \"b1c958f9-beb1-4a9f-9675-653a29fe49fd\") " pod="openshift-multus/multus-additional-cni-plugins-mfjbh" Jun 03 15:49:01.198332 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.198235 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1805c9c3-3e37-4b81-bd24-a6253025eed2-multus-conf-dir\") pod \"multus-8dhbv\" (UID: \"1805c9c3-3e37-4b81-bd24-a6253025eed2\") " pod="openshift-multus/multus-8dhbv" Jun 03 15:49:01.198332 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.198252 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/52874ebd-3611-402b-bc80-fa65b5ca8b54-host-kubelet\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.198332 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.198283 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52874ebd-3611-402b-bc80-fa65b5ca8b54-var-lib-openvswitch\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.198332 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.198311 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvs95\" (UniqueName: \"kubernetes.io/projected/a09fb6d9-72f4-4139-b3ca-77c2889be355-kube-api-access-fvs95\") pod \"aws-ebs-csi-driver-node-ptnm6\" (UID: \"a09fb6d9-72f4-4139-b3ca-77c2889be355\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ptnm6" Jun 03 15:49:01.198332 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.198329 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/52874ebd-3611-402b-bc80-fa65b5ca8b54-host-cni-bin\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.198569 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.198345 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f1075e32-8d0e-4ca6-8cd9-4d2d337ce213-etc-modprobe-d\") pod \"tuned-9sqjn\" (UID: \"f1075e32-8d0e-4ca6-8cd9-4d2d337ce213\") " pod="openshift-cluster-node-tuning-operator/tuned-9sqjn" Jun 03 15:49:01.198569 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.198361 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f1075e32-8d0e-4ca6-8cd9-4d2d337ce213-run\") pod \"tuned-9sqjn\" (UID: \"f1075e32-8d0e-4ca6-8cd9-4d2d337ce213\") " pod="openshift-cluster-node-tuning-operator/tuned-9sqjn" Jun 03 15:49:01.198569 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.198375 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f1075e32-8d0e-4ca6-8cd9-4d2d337ce213-host\") pod \"tuned-9sqjn\" (UID: \"f1075e32-8d0e-4ca6-8cd9-4d2d337ce213\") " pod="openshift-cluster-node-tuning-operator/tuned-9sqjn" Jun 03 15:49:01.198569 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.198404 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1805c9c3-3e37-4b81-bd24-a6253025eed2-multus-cni-dir\") pod \"multus-8dhbv\" (UID: \"1805c9c3-3e37-4b81-bd24-a6253025eed2\") " pod="openshift-multus/multus-8dhbv" Jun 03 15:49:01.198569 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.198426 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1805c9c3-3e37-4b81-bd24-a6253025eed2-etc-kubernetes\") pod \"multus-8dhbv\" (UID: \"1805c9c3-3e37-4b81-bd24-a6253025eed2\") " pod="openshift-multus/multus-8dhbv" Jun 03 15:49:01.198569 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.198441 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/af92e0dd-a3c0-4993-a37a-edd0d027a43f-host\") pod \"node-ca-zqg8b\" (UID: \"af92e0dd-a3c0-4993-a37a-edd0d027a43f\") " pod="openshift-image-registry/node-ca-zqg8b" Jun 03 15:49:01.198569 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.198456 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a09fb6d9-72f4-4139-b3ca-77c2889be355-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ptnm6\" (UID: \"a09fb6d9-72f4-4139-b3ca-77c2889be355\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ptnm6" Jun 03 15:49:01.198569 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.198488 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f1075e32-8d0e-4ca6-8cd9-4d2d337ce213-etc-sysconfig\") pod \"tuned-9sqjn\" (UID: \"f1075e32-8d0e-4ca6-8cd9-4d2d337ce213\") " pod="openshift-cluster-node-tuning-operator/tuned-9sqjn" Jun 03 15:49:01.198569 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.198511 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f1075e32-8d0e-4ca6-8cd9-4d2d337ce213-sys\") pod \"tuned-9sqjn\" (UID: \"f1075e32-8d0e-4ca6-8cd9-4d2d337ce213\") " pod="openshift-cluster-node-tuning-operator/tuned-9sqjn" Jun 03 15:49:01.198569 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.198528 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0bc1339f-a919-4ead-8f5f-272a36a862c2-tmp-dir\") pod \"node-resolver-nzf52\" (UID: \"0bc1339f-a919-4ead-8f5f-272a36a862c2\") " pod="openshift-dns/node-resolver-nzf52" Jun 03 15:49:01.198569 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.198543 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/52874ebd-3611-402b-bc80-fa65b5ca8b54-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.198569 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.198558 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/52874ebd-3611-402b-bc80-fa65b5ca8b54-env-overrides\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.199032 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.198589 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/52874ebd-3611-402b-bc80-fa65b5ca8b54-ovn-node-metrics-cert\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.199032 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.198619 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a09fb6d9-72f4-4139-b3ca-77c2889be355-etc-selinux\") pod \"aws-ebs-csi-driver-node-ptnm6\" (UID: \"a09fb6d9-72f4-4139-b3ca-77c2889be355\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ptnm6" Jun 03 15:49:01.199032 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.198644 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b1c958f9-beb1-4a9f-9675-653a29fe49fd-system-cni-dir\") pod \"multus-additional-cni-plugins-mfjbh\" (UID: \"b1c958f9-beb1-4a9f-9675-653a29fe49fd\") " pod="openshift-multus/multus-additional-cni-plugins-mfjbh" Jun 03 15:49:01.199032 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.198669 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f1075e32-8d0e-4ca6-8cd9-4d2d337ce213-etc-sysctl-d\") pod \"tuned-9sqjn\" (UID: \"f1075e32-8d0e-4ca6-8cd9-4d2d337ce213\") " pod="openshift-cluster-node-tuning-operator/tuned-9sqjn" Jun 03 15:49:01.199032 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.198702 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f1075e32-8d0e-4ca6-8cd9-4d2d337ce213-etc-tuned\") pod \"tuned-9sqjn\" (UID: \"f1075e32-8d0e-4ca6-8cd9-4d2d337ce213\") " pod="openshift-cluster-node-tuning-operator/tuned-9sqjn" Jun 03 15:49:01.199032 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.198734 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1805c9c3-3e37-4b81-bd24-a6253025eed2-host-run-k8s-cni-cncf-io\") pod \"multus-8dhbv\" (UID: \"1805c9c3-3e37-4b81-bd24-a6253025eed2\") " pod="openshift-multus/multus-8dhbv" Jun 03 15:49:01.199032 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.198757 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/52874ebd-3611-402b-bc80-fa65b5ca8b54-host-run-ovn-kubernetes\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.199032 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.198779 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a09fb6d9-72f4-4139-b3ca-77c2889be355-device-dir\") pod \"aws-ebs-csi-driver-node-ptnm6\" (UID: \"a09fb6d9-72f4-4139-b3ca-77c2889be355\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ptnm6" Jun 03 15:49:01.199032 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.198808 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f1075e32-8d0e-4ca6-8cd9-4d2d337ce213-lib-modules\") pod \"tuned-9sqjn\" (UID: \"f1075e32-8d0e-4ca6-8cd9-4d2d337ce213\") " pod="openshift-cluster-node-tuning-operator/tuned-9sqjn" Jun 03 15:49:01.199032 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.198825 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1805c9c3-3e37-4b81-bd24-a6253025eed2-cni-binary-copy\") pod \"multus-8dhbv\" (UID: \"1805c9c3-3e37-4b81-bd24-a6253025eed2\") " pod="openshift-multus/multus-8dhbv" Jun 03 15:49:01.199032 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.198839 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1805c9c3-3e37-4b81-bd24-a6253025eed2-multus-daemon-config\") pod \"multus-8dhbv\" (UID: \"1805c9c3-3e37-4b81-bd24-a6253025eed2\") " pod="openshift-multus/multus-8dhbv" Jun 03 15:49:01.199032 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.198862 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5aa0ffe1-5bf5-47f0-9814-d639c23b597f-metrics-certs\") pod \"network-metrics-daemon-zl2xd\" (UID: \"5aa0ffe1-5bf5-47f0-9814-d639c23b597f\") " pod="openshift-multus/network-metrics-daemon-zl2xd" Jun 03 15:49:01.199032 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.198880 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b1c958f9-beb1-4a9f-9675-653a29fe49fd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mfjbh\" (UID: \"b1c958f9-beb1-4a9f-9675-653a29fe49fd\") " pod="openshift-multus/multus-additional-cni-plugins-mfjbh" Jun 03 15:49:01.199032 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.198896 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b1c958f9-beb1-4a9f-9675-653a29fe49fd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mfjbh\" (UID: \"b1c958f9-beb1-4a9f-9675-653a29fe49fd\") " pod="openshift-multus/multus-additional-cni-plugins-mfjbh" Jun 03 15:49:01.199032 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.198914 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7vw9\" (UniqueName: \"kubernetes.io/projected/0bc1339f-a919-4ead-8f5f-272a36a862c2-kube-api-access-v7vw9\") pod \"node-resolver-nzf52\" (UID: \"0bc1339f-a919-4ead-8f5f-272a36a862c2\") " pod="openshift-dns/node-resolver-nzf52" Jun 03 15:49:01.199032 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.198946 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1805c9c3-3e37-4b81-bd24-a6253025eed2-os-release\") pod \"multus-8dhbv\" (UID: \"1805c9c3-3e37-4b81-bd24-a6253025eed2\") " pod="openshift-multus/multus-8dhbv" Jun 03 15:49:01.199498 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.198964 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1805c9c3-3e37-4b81-bd24-a6253025eed2-hostroot\") pod \"multus-8dhbv\" (UID: \"1805c9c3-3e37-4b81-bd24-a6253025eed2\") " pod="openshift-multus/multus-8dhbv" Jun 03 15:49:01.199498 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.198978 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/52874ebd-3611-402b-bc80-fa65b5ca8b54-host-run-netns\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.199498 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.198991 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/52874ebd-3611-402b-bc80-fa65b5ca8b54-ovnkube-config\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.199498 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.199009 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3d08c149-ddb9-494c-9e84-5d4b8192035f-host-slash\") pod \"iptables-alerter-2wb84\" (UID: \"3d08c149-ddb9-494c-9e84-5d4b8192035f\") " pod="openshift-network-operator/iptables-alerter-2wb84" Jun 03 15:49:01.199498 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.199038 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a09fb6d9-72f4-4139-b3ca-77c2889be355-sys-fs\") pod \"aws-ebs-csi-driver-node-ptnm6\" (UID: \"a09fb6d9-72f4-4139-b3ca-77c2889be355\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ptnm6" Jun 03 15:49:01.199498 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.199053 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh68w\" (UniqueName: \"kubernetes.io/projected/53b1660f-0dbd-42e9-beab-6df46454d8a6-kube-api-access-dh68w\") pod \"network-check-target-tqbmw\" (UID: \"53b1660f-0dbd-42e9-beab-6df46454d8a6\") " pod="openshift-network-diagnostics/network-check-target-tqbmw" Jun 03 15:49:01.199498 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.199070 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/52874ebd-3611-402b-bc80-fa65b5ca8b54-run-systemd\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.199498 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.199093 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f1075e32-8d0e-4ca6-8cd9-4d2d337ce213-etc-systemd\") pod \"tuned-9sqjn\" (UID: \"f1075e32-8d0e-4ca6-8cd9-4d2d337ce213\") " pod="openshift-cluster-node-tuning-operator/tuned-9sqjn" Jun 03 15:49:01.199498 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.199112 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/738f714c-1988-41e8-9eb6-8ee92d4f07d5-konnectivity-ca\") pod \"konnectivity-agent-ntc9t\" (UID: \"738f714c-1988-41e8-9eb6-8ee92d4f07d5\") " pod="kube-system/konnectivity-agent-ntc9t" Jun 03 15:49:01.199498 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.199126 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1075e32-8d0e-4ca6-8cd9-4d2d337ce213-var-lib-kubelet\") pod \"tuned-9sqjn\" (UID: \"f1075e32-8d0e-4ca6-8cd9-4d2d337ce213\") " pod="openshift-cluster-node-tuning-operator/tuned-9sqjn" Jun 03 15:49:01.199498 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.199141 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1805c9c3-3e37-4b81-bd24-a6253025eed2-cnibin\") pod \"multus-8dhbv\" (UID: \"1805c9c3-3e37-4b81-bd24-a6253025eed2\") " pod="openshift-multus/multus-8dhbv" Jun 03 15:49:01.199498 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.199165 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/52874ebd-3611-402b-bc80-fa65b5ca8b54-systemd-units\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.199498 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.199187 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/52874ebd-3611-402b-bc80-fa65b5ca8b54-log-socket\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.199498 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.199208 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/af92e0dd-a3c0-4993-a37a-edd0d027a43f-serviceca\") pod \"node-ca-zqg8b\" (UID: \"af92e0dd-a3c0-4993-a37a-edd0d027a43f\") " pod="openshift-image-registry/node-ca-zqg8b" Jun 03 15:49:01.199498 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.199237 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b1c958f9-beb1-4a9f-9675-653a29fe49fd-os-release\") pod \"multus-additional-cni-plugins-mfjbh\" (UID: \"b1c958f9-beb1-4a9f-9675-653a29fe49fd\") " pod="openshift-multus/multus-additional-cni-plugins-mfjbh" Jun 03 15:49:01.199498 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.199257 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rvrj\" (UniqueName: \"kubernetes.io/projected/5aa0ffe1-5bf5-47f0-9814-d639c23b597f-kube-api-access-7rvrj\") pod \"network-metrics-daemon-zl2xd\" (UID: \"5aa0ffe1-5bf5-47f0-9814-d639c23b597f\") " pod="openshift-multus/network-metrics-daemon-zl2xd" Jun 03 15:49:01.199931 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.199273 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/52874ebd-3611-402b-bc80-fa65b5ca8b54-node-log\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.199931 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.199287 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/52874ebd-3611-402b-bc80-fa65b5ca8b54-host-cni-netd\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.199931 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.199301 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1075e32-8d0e-4ca6-8cd9-4d2d337ce213-tmp\") pod \"tuned-9sqjn\" (UID: \"f1075e32-8d0e-4ca6-8cd9-4d2d337ce213\") " pod="openshift-cluster-node-tuning-operator/tuned-9sqjn" Jun 03 15:49:01.199931 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.199316 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1805c9c3-3e37-4b81-bd24-a6253025eed2-host-run-multus-certs\") pod \"multus-8dhbv\" (UID: \"1805c9c3-3e37-4b81-bd24-a6253025eed2\") " pod="openshift-multus/multus-8dhbv" Jun 03 15:49:01.199931 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.199343 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/738f714c-1988-41e8-9eb6-8ee92d4f07d5-agent-certs\") pod \"konnectivity-agent-ntc9t\" (UID: \"738f714c-1988-41e8-9eb6-8ee92d4f07d5\") " pod="kube-system/konnectivity-agent-ntc9t" Jun 03 15:49:01.199931 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.199364 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f1075e32-8d0e-4ca6-8cd9-4d2d337ce213-etc-sysctl-conf\") pod \"tuned-9sqjn\" (UID: \"f1075e32-8d0e-4ca6-8cd9-4d2d337ce213\") " pod="openshift-cluster-node-tuning-operator/tuned-9sqjn" Jun 03 15:49:01.199931 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.199382 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0bc1339f-a919-4ead-8f5f-272a36a862c2-hosts-file\") pod \"node-resolver-nzf52\" (UID: \"0bc1339f-a919-4ead-8f5f-272a36a862c2\") " pod="openshift-dns/node-resolver-nzf52" Jun 03 15:49:01.199931 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.199407 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1805c9c3-3e37-4b81-bd24-a6253025eed2-system-cni-dir\") pod \"multus-8dhbv\" (UID: \"1805c9c3-3e37-4b81-bd24-a6253025eed2\") " pod="openshift-multus/multus-8dhbv" Jun 03 15:49:01.199931 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.199421 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdz2m\" (UniqueName: \"kubernetes.io/projected/1805c9c3-3e37-4b81-bd24-a6253025eed2-kube-api-access-sdz2m\") pod \"multus-8dhbv\" (UID: \"1805c9c3-3e37-4b81-bd24-a6253025eed2\") " pod="openshift-multus/multus-8dhbv" Jun 03 15:49:01.199931 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.199436 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52874ebd-3611-402b-bc80-fa65b5ca8b54-run-openvswitch\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.199931 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.199454 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6cx2\" (UniqueName: \"kubernetes.io/projected/b1c958f9-beb1-4a9f-9675-653a29fe49fd-kube-api-access-c6cx2\") pod \"multus-additional-cni-plugins-mfjbh\" (UID: \"b1c958f9-beb1-4a9f-9675-653a29fe49fd\") " pod="openshift-multus/multus-additional-cni-plugins-mfjbh" Jun 03 15:49:01.199931 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.199494 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1805c9c3-3e37-4b81-bd24-a6253025eed2-host-var-lib-cni-bin\") pod \"multus-8dhbv\" (UID: \"1805c9c3-3e37-4b81-bd24-a6253025eed2\") " pod="openshift-multus/multus-8dhbv" Jun 03 15:49:01.199931 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.199513 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1805c9c3-3e37-4b81-bd24-a6253025eed2-host-var-lib-kubelet\") pod \"multus-8dhbv\" (UID: \"1805c9c3-3e37-4b81-bd24-a6253025eed2\") " pod="openshift-multus/multus-8dhbv" Jun 03 15:49:01.199931 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.199527 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/52874ebd-3611-402b-bc80-fa65b5ca8b54-host-slash\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.199931 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.199541 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52874ebd-3611-402b-bc80-fa65b5ca8b54-etc-openvswitch\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.199931 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.199560 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/52874ebd-3611-402b-bc80-fa65b5ca8b54-ovnkube-script-lib\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.200386 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.199586 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3d08c149-ddb9-494c-9e84-5d4b8192035f-iptables-alerter-script\") pod \"iptables-alerter-2wb84\" (UID: \"3d08c149-ddb9-494c-9e84-5d4b8192035f\") " pod="openshift-network-operator/iptables-alerter-2wb84" Jun 03 15:49:01.200386 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.199608 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2jcz\" (UniqueName: \"kubernetes.io/projected/3d08c149-ddb9-494c-9e84-5d4b8192035f-kube-api-access-q2jcz\") pod \"iptables-alerter-2wb84\" (UID: \"3d08c149-ddb9-494c-9e84-5d4b8192035f\") " pod="openshift-network-operator/iptables-alerter-2wb84" Jun 03 15:49:01.200386 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.199621 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b1c958f9-beb1-4a9f-9675-653a29fe49fd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mfjbh\" (UID: \"b1c958f9-beb1-4a9f-9675-653a29fe49fd\") " pod="openshift-multus/multus-additional-cni-plugins-mfjbh" Jun 03 15:49:01.232810 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.232771 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-30.ec2.internal" event={"ID":"1ea1fc29e200e4220b7c6bf0d70a6719","Type":"ContainerStarted","Data":"af6d426798c21473f37f82b7e25bc59c19c299384e30e27f60d1ea6e39050994"} Jun 03 15:49:01.233713 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.233693 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-30.ec2.internal" event={"ID":"eb474f5b54e62ac3180cf68c21914d92","Type":"ContainerStarted","Data":"3c44b842f70cc6d11ddd8368a27776100312dd0ee2d7a179e70ea9b6bd067559"} Jun 03 15:49:01.234539 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.234526 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4ss94" Jun 03 15:49:01.246891 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.246871 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4ss94" Jun 03 15:49:01.300072 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300012 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/52874ebd-3611-402b-bc80-fa65b5ca8b54-run-ovn\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.300072 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300037 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t67rn\" (UniqueName: \"kubernetes.io/projected/52874ebd-3611-402b-bc80-fa65b5ca8b54-kube-api-access-t67rn\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.300072 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300054 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a09fb6d9-72f4-4139-b3ca-77c2889be355-socket-dir\") pod \"aws-ebs-csi-driver-node-ptnm6\" (UID: \"a09fb6d9-72f4-4139-b3ca-77c2889be355\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ptnm6" Jun 03 15:49:01.300072 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300070 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1805c9c3-3e37-4b81-bd24-a6253025eed2-host-run-netns\") pod \"multus-8dhbv\" (UID: \"1805c9c3-3e37-4b81-bd24-a6253025eed2\") " pod="openshift-multus/multus-8dhbv" Jun 03 15:49:01.300321 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300084 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xx9d5\" (UniqueName: \"kubernetes.io/projected/af92e0dd-a3c0-4993-a37a-edd0d027a43f-kube-api-access-xx9d5\") pod \"node-ca-zqg8b\" (UID: \"af92e0dd-a3c0-4993-a37a-edd0d027a43f\") " pod="openshift-image-registry/node-ca-zqg8b" Jun 03 15:49:01.300321 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300141 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a09fb6d9-72f4-4139-b3ca-77c2889be355-registration-dir\") pod \"aws-ebs-csi-driver-node-ptnm6\" (UID: \"a09fb6d9-72f4-4139-b3ca-77c2889be355\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ptnm6" Jun 03 15:49:01.300321 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300150 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/52874ebd-3611-402b-bc80-fa65b5ca8b54-run-ovn\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.300321 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300170 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1075e32-8d0e-4ca6-8cd9-4d2d337ce213-etc-kubernetes\") pod \"tuned-9sqjn\" (UID: \"f1075e32-8d0e-4ca6-8cd9-4d2d337ce213\") " pod="openshift-cluster-node-tuning-operator/tuned-9sqjn" Jun 03 15:49:01.300321 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300196 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-65xkl\" (UniqueName: \"kubernetes.io/projected/f1075e32-8d0e-4ca6-8cd9-4d2d337ce213-kube-api-access-65xkl\") pod \"tuned-9sqjn\" (UID: \"f1075e32-8d0e-4ca6-8cd9-4d2d337ce213\") " pod="openshift-cluster-node-tuning-operator/tuned-9sqjn" Jun 03 15:49:01.300321 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300211 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a09fb6d9-72f4-4139-b3ca-77c2889be355-socket-dir\") pod \"aws-ebs-csi-driver-node-ptnm6\" (UID: \"a09fb6d9-72f4-4139-b3ca-77c2889be355\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ptnm6" Jun 03 15:49:01.300321 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300219 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1805c9c3-3e37-4b81-bd24-a6253025eed2-multus-socket-dir-parent\") pod \"multus-8dhbv\" (UID: \"1805c9c3-3e37-4b81-bd24-a6253025eed2\") " pod="openshift-multus/multus-8dhbv" Jun 03 15:49:01.300321 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300244 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1805c9c3-3e37-4b81-bd24-a6253025eed2-host-var-lib-cni-multus\") pod \"multus-8dhbv\" (UID: \"1805c9c3-3e37-4b81-bd24-a6253025eed2\") " pod="openshift-multus/multus-8dhbv" Jun 03 15:49:01.300321 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300258 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a09fb6d9-72f4-4139-b3ca-77c2889be355-registration-dir\") pod \"aws-ebs-csi-driver-node-ptnm6\" (UID: \"a09fb6d9-72f4-4139-b3ca-77c2889be355\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ptnm6" Jun 03 15:49:01.300321 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300269 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b1c958f9-beb1-4a9f-9675-653a29fe49fd-cnibin\") pod \"multus-additional-cni-plugins-mfjbh\" (UID: \"b1c958f9-beb1-4a9f-9675-653a29fe49fd\") " pod="openshift-multus/multus-additional-cni-plugins-mfjbh" Jun 03 15:49:01.300321 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300305 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1805c9c3-3e37-4b81-bd24-a6253025eed2-host-var-lib-cni-multus\") pod \"multus-8dhbv\" (UID: \"1805c9c3-3e37-4b81-bd24-a6253025eed2\") " pod="openshift-multus/multus-8dhbv" Jun 03 15:49:01.300321 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300315 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b1c958f9-beb1-4a9f-9675-653a29fe49fd-cnibin\") pod \"multus-additional-cni-plugins-mfjbh\" (UID: \"b1c958f9-beb1-4a9f-9675-653a29fe49fd\") " pod="openshift-multus/multus-additional-cni-plugins-mfjbh" Jun 03 15:49:01.300321 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300301 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1805c9c3-3e37-4b81-bd24-a6253025eed2-multus-socket-dir-parent\") pod \"multus-8dhbv\" (UID: \"1805c9c3-3e37-4b81-bd24-a6253025eed2\") " pod="openshift-multus/multus-8dhbv" Jun 03 15:49:01.300990 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300334 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b1c958f9-beb1-4a9f-9675-653a29fe49fd-cni-binary-copy\") pod \"multus-additional-cni-plugins-mfjbh\" (UID: \"b1c958f9-beb1-4a9f-9675-653a29fe49fd\") " pod="openshift-multus/multus-additional-cni-plugins-mfjbh" Jun 03 15:49:01.300990 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300330 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1075e32-8d0e-4ca6-8cd9-4d2d337ce213-etc-kubernetes\") pod \"tuned-9sqjn\" (UID: \"f1075e32-8d0e-4ca6-8cd9-4d2d337ce213\") " pod="openshift-cluster-node-tuning-operator/tuned-9sqjn" Jun 03 15:49:01.300990 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300351 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1805c9c3-3e37-4b81-bd24-a6253025eed2-host-run-netns\") pod \"multus-8dhbv\" (UID: \"1805c9c3-3e37-4b81-bd24-a6253025eed2\") " pod="openshift-multus/multus-8dhbv" Jun 03 15:49:01.300990 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300367 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1805c9c3-3e37-4b81-bd24-a6253025eed2-multus-conf-dir\") pod \"multus-8dhbv\" (UID: \"1805c9c3-3e37-4b81-bd24-a6253025eed2\") " pod="openshift-multus/multus-8dhbv" Jun 03 15:49:01.300990 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300392 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/52874ebd-3611-402b-bc80-fa65b5ca8b54-host-kubelet\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.300990 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300402 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1805c9c3-3e37-4b81-bd24-a6253025eed2-multus-conf-dir\") pod \"multus-8dhbv\" (UID: \"1805c9c3-3e37-4b81-bd24-a6253025eed2\") " pod="openshift-multus/multus-8dhbv" Jun 03 15:49:01.300990 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300416 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52874ebd-3611-402b-bc80-fa65b5ca8b54-var-lib-openvswitch\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.300990 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300443 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fvs95\" (UniqueName: \"kubernetes.io/projected/a09fb6d9-72f4-4139-b3ca-77c2889be355-kube-api-access-fvs95\") pod \"aws-ebs-csi-driver-node-ptnm6\" (UID: \"a09fb6d9-72f4-4139-b3ca-77c2889be355\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ptnm6" Jun 03 15:49:01.300990 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300447 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/52874ebd-3611-402b-bc80-fa65b5ca8b54-host-kubelet\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.300990 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300484 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/52874ebd-3611-402b-bc80-fa65b5ca8b54-host-cni-bin\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.300990 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300510 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f1075e32-8d0e-4ca6-8cd9-4d2d337ce213-etc-modprobe-d\") pod \"tuned-9sqjn\" (UID: \"f1075e32-8d0e-4ca6-8cd9-4d2d337ce213\") " pod="openshift-cluster-node-tuning-operator/tuned-9sqjn" Jun 03 15:49:01.300990 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300515 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52874ebd-3611-402b-bc80-fa65b5ca8b54-var-lib-openvswitch\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.300990 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300534 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f1075e32-8d0e-4ca6-8cd9-4d2d337ce213-run\") pod \"tuned-9sqjn\" (UID: \"f1075e32-8d0e-4ca6-8cd9-4d2d337ce213\") " pod="openshift-cluster-node-tuning-operator/tuned-9sqjn" Jun 03 15:49:01.300990 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300556 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f1075e32-8d0e-4ca6-8cd9-4d2d337ce213-host\") pod \"tuned-9sqjn\" (UID: \"f1075e32-8d0e-4ca6-8cd9-4d2d337ce213\") " pod="openshift-cluster-node-tuning-operator/tuned-9sqjn" Jun 03 15:49:01.300990 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300561 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/52874ebd-3611-402b-bc80-fa65b5ca8b54-host-cni-bin\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.300990 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300580 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1805c9c3-3e37-4b81-bd24-a6253025eed2-multus-cni-dir\") pod \"multus-8dhbv\" (UID: \"1805c9c3-3e37-4b81-bd24-a6253025eed2\") " pod="openshift-multus/multus-8dhbv" Jun 03 15:49:01.300990 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300598 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f1075e32-8d0e-4ca6-8cd9-4d2d337ce213-run\") pod \"tuned-9sqjn\" (UID: \"f1075e32-8d0e-4ca6-8cd9-4d2d337ce213\") " pod="openshift-cluster-node-tuning-operator/tuned-9sqjn" Jun 03 15:49:01.300990 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300605 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1805c9c3-3e37-4b81-bd24-a6253025eed2-etc-kubernetes\") pod \"multus-8dhbv\" (UID: \"1805c9c3-3e37-4b81-bd24-a6253025eed2\") " pod="openshift-multus/multus-8dhbv" Jun 03 15:49:01.301778 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300614 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f1075e32-8d0e-4ca6-8cd9-4d2d337ce213-host\") pod \"tuned-9sqjn\" (UID: \"f1075e32-8d0e-4ca6-8cd9-4d2d337ce213\") " pod="openshift-cluster-node-tuning-operator/tuned-9sqjn" Jun 03 15:49:01.301778 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300628 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/af92e0dd-a3c0-4993-a37a-edd0d027a43f-host\") pod \"node-ca-zqg8b\" (UID: \"af92e0dd-a3c0-4993-a37a-edd0d027a43f\") " pod="openshift-image-registry/node-ca-zqg8b" Jun 03 15:49:01.301778 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300629 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f1075e32-8d0e-4ca6-8cd9-4d2d337ce213-etc-modprobe-d\") pod \"tuned-9sqjn\" (UID: \"f1075e32-8d0e-4ca6-8cd9-4d2d337ce213\") " pod="openshift-cluster-node-tuning-operator/tuned-9sqjn" Jun 03 15:49:01.301778 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300651 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a09fb6d9-72f4-4139-b3ca-77c2889be355-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ptnm6\" (UID: \"a09fb6d9-72f4-4139-b3ca-77c2889be355\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ptnm6" Jun 03 15:49:01.301778 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300675 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f1075e32-8d0e-4ca6-8cd9-4d2d337ce213-etc-sysconfig\") pod \"tuned-9sqjn\" (UID: \"f1075e32-8d0e-4ca6-8cd9-4d2d337ce213\") " pod="openshift-cluster-node-tuning-operator/tuned-9sqjn" Jun 03 15:49:01.301778 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300654 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1805c9c3-3e37-4b81-bd24-a6253025eed2-etc-kubernetes\") pod \"multus-8dhbv\" (UID: \"1805c9c3-3e37-4b81-bd24-a6253025eed2\") " pod="openshift-multus/multus-8dhbv" Jun 03 15:49:01.301778 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300691 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a09fb6d9-72f4-4139-b3ca-77c2889be355-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ptnm6\" (UID: \"a09fb6d9-72f4-4139-b3ca-77c2889be355\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ptnm6" Jun 03 15:49:01.301778 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300700 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f1075e32-8d0e-4ca6-8cd9-4d2d337ce213-sys\") pod \"tuned-9sqjn\" (UID: \"f1075e32-8d0e-4ca6-8cd9-4d2d337ce213\") " pod="openshift-cluster-node-tuning-operator/tuned-9sqjn" Jun 03 15:49:01.301778 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300677 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/af92e0dd-a3c0-4993-a37a-edd0d027a43f-host\") pod \"node-ca-zqg8b\" (UID: \"af92e0dd-a3c0-4993-a37a-edd0d027a43f\") " pod="openshift-image-registry/node-ca-zqg8b" Jun 03 15:49:01.301778 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300715 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f1075e32-8d0e-4ca6-8cd9-4d2d337ce213-etc-sysconfig\") pod \"tuned-9sqjn\" (UID: \"f1075e32-8d0e-4ca6-8cd9-4d2d337ce213\") " pod="openshift-cluster-node-tuning-operator/tuned-9sqjn" Jun 03 15:49:01.301778 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300723 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0bc1339f-a919-4ead-8f5f-272a36a862c2-tmp-dir\") pod \"node-resolver-nzf52\" (UID: \"0bc1339f-a919-4ead-8f5f-272a36a862c2\") " pod="openshift-dns/node-resolver-nzf52" Jun 03 15:49:01.301778 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300738 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1805c9c3-3e37-4b81-bd24-a6253025eed2-multus-cni-dir\") pod \"multus-8dhbv\" (UID: \"1805c9c3-3e37-4b81-bd24-a6253025eed2\") " pod="openshift-multus/multus-8dhbv" Jun 03 15:49:01.301778 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300756 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f1075e32-8d0e-4ca6-8cd9-4d2d337ce213-sys\") pod \"tuned-9sqjn\" (UID: \"f1075e32-8d0e-4ca6-8cd9-4d2d337ce213\") " pod="openshift-cluster-node-tuning-operator/tuned-9sqjn" Jun 03 15:49:01.301778 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300755 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/52874ebd-3611-402b-bc80-fa65b5ca8b54-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.301778 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300788 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/52874ebd-3611-402b-bc80-fa65b5ca8b54-env-overrides\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.301778 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300799 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/52874ebd-3611-402b-bc80-fa65b5ca8b54-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.301778 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300803 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/52874ebd-3611-402b-bc80-fa65b5ca8b54-ovn-node-metrics-cert\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.301778 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300844 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a09fb6d9-72f4-4139-b3ca-77c2889be355-etc-selinux\") pod \"aws-ebs-csi-driver-node-ptnm6\" (UID: \"a09fb6d9-72f4-4139-b3ca-77c2889be355\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ptnm6" Jun 03 15:49:01.302537 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300868 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b1c958f9-beb1-4a9f-9675-653a29fe49fd-system-cni-dir\") pod \"multus-additional-cni-plugins-mfjbh\" (UID: \"b1c958f9-beb1-4a9f-9675-653a29fe49fd\") " pod="openshift-multus/multus-additional-cni-plugins-mfjbh" Jun 03 15:49:01.302537 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300894 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f1075e32-8d0e-4ca6-8cd9-4d2d337ce213-etc-sysctl-d\") pod \"tuned-9sqjn\" (UID: \"f1075e32-8d0e-4ca6-8cd9-4d2d337ce213\") " pod="openshift-cluster-node-tuning-operator/tuned-9sqjn" Jun 03 15:49:01.302537 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300918 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f1075e32-8d0e-4ca6-8cd9-4d2d337ce213-etc-tuned\") pod \"tuned-9sqjn\" (UID: \"f1075e32-8d0e-4ca6-8cd9-4d2d337ce213\") " pod="openshift-cluster-node-tuning-operator/tuned-9sqjn" Jun 03 15:49:01.302537 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300915 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b1c958f9-beb1-4a9f-9675-653a29fe49fd-cni-binary-copy\") pod \"multus-additional-cni-plugins-mfjbh\" (UID: \"b1c958f9-beb1-4a9f-9675-653a29fe49fd\") " pod="openshift-multus/multus-additional-cni-plugins-mfjbh" Jun 03 15:49:01.302537 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.300986 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a09fb6d9-72f4-4139-b3ca-77c2889be355-etc-selinux\") pod \"aws-ebs-csi-driver-node-ptnm6\" (UID: \"a09fb6d9-72f4-4139-b3ca-77c2889be355\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ptnm6" Jun 03 15:49:01.302537 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.301005 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0bc1339f-a919-4ead-8f5f-272a36a862c2-tmp-dir\") pod \"node-resolver-nzf52\" (UID: \"0bc1339f-a919-4ead-8f5f-272a36a862c2\") " pod="openshift-dns/node-resolver-nzf52" Jun 03 15:49:01.302537 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.301013 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1805c9c3-3e37-4b81-bd24-a6253025eed2-host-run-k8s-cni-cncf-io\") pod \"multus-8dhbv\" (UID: \"1805c9c3-3e37-4b81-bd24-a6253025eed2\") " pod="openshift-multus/multus-8dhbv" Jun 03 15:49:01.302537 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.301037 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f1075e32-8d0e-4ca6-8cd9-4d2d337ce213-etc-sysctl-d\") pod \"tuned-9sqjn\" (UID: \"f1075e32-8d0e-4ca6-8cd9-4d2d337ce213\") " pod="openshift-cluster-node-tuning-operator/tuned-9sqjn" Jun 03 15:49:01.302537 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.301046 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/52874ebd-3611-402b-bc80-fa65b5ca8b54-host-run-ovn-kubernetes\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.302537 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.301085 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a09fb6d9-72f4-4139-b3ca-77c2889be355-device-dir\") pod \"aws-ebs-csi-driver-node-ptnm6\" (UID: \"a09fb6d9-72f4-4139-b3ca-77c2889be355\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ptnm6" Jun 03 15:49:01.302537 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.301088 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1805c9c3-3e37-4b81-bd24-a6253025eed2-host-run-k8s-cni-cncf-io\") pod \"multus-8dhbv\" (UID: \"1805c9c3-3e37-4b81-bd24-a6253025eed2\") " pod="openshift-multus/multus-8dhbv" Jun 03 15:49:01.302537 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.301090 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/52874ebd-3611-402b-bc80-fa65b5ca8b54-host-run-ovn-kubernetes\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.302537 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.301114 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f1075e32-8d0e-4ca6-8cd9-4d2d337ce213-lib-modules\") pod \"tuned-9sqjn\" (UID: \"f1075e32-8d0e-4ca6-8cd9-4d2d337ce213\") " pod="openshift-cluster-node-tuning-operator/tuned-9sqjn" Jun 03 15:49:01.302537 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.301140 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a09fb6d9-72f4-4139-b3ca-77c2889be355-device-dir\") pod \"aws-ebs-csi-driver-node-ptnm6\" (UID: \"a09fb6d9-72f4-4139-b3ca-77c2889be355\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ptnm6" Jun 03 15:49:01.302537 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.301122 2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 15:49:01.302537 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.301145 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1805c9c3-3e37-4b81-bd24-a6253025eed2-cni-binary-copy\") pod \"multus-8dhbv\" (UID: \"1805c9c3-3e37-4b81-bd24-a6253025eed2\") " pod="openshift-multus/multus-8dhbv" Jun 03 15:49:01.302537 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.301183 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1805c9c3-3e37-4b81-bd24-a6253025eed2-multus-daemon-config\") pod \"multus-8dhbv\" (UID: \"1805c9c3-3e37-4b81-bd24-a6253025eed2\") " pod="openshift-multus/multus-8dhbv" Jun 03 15:49:01.302537 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.301195 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f1075e32-8d0e-4ca6-8cd9-4d2d337ce213-lib-modules\") pod \"tuned-9sqjn\" (UID: \"f1075e32-8d0e-4ca6-8cd9-4d2d337ce213\") " pod="openshift-cluster-node-tuning-operator/tuned-9sqjn" Jun 03 15:49:01.303364 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.301209 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5aa0ffe1-5bf5-47f0-9814-d639c23b597f-metrics-certs\") pod \"network-metrics-daemon-zl2xd\" (UID: \"5aa0ffe1-5bf5-47f0-9814-d639c23b597f\") " pod="openshift-multus/network-metrics-daemon-zl2xd" Jun 03 15:49:01.303364 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.301240 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b1c958f9-beb1-4a9f-9675-653a29fe49fd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mfjbh\" (UID: \"b1c958f9-beb1-4a9f-9675-653a29fe49fd\") " pod="openshift-multus/multus-additional-cni-plugins-mfjbh" Jun 03 15:49:01.303364 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.301269 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b1c958f9-beb1-4a9f-9675-653a29fe49fd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mfjbh\" (UID: \"b1c958f9-beb1-4a9f-9675-653a29fe49fd\") " pod="openshift-multus/multus-additional-cni-plugins-mfjbh" Jun 03 15:49:01.303364 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.301301 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v7vw9\" (UniqueName: \"kubernetes.io/projected/0bc1339f-a919-4ead-8f5f-272a36a862c2-kube-api-access-v7vw9\") pod \"node-resolver-nzf52\" (UID: \"0bc1339f-a919-4ead-8f5f-272a36a862c2\") " pod="openshift-dns/node-resolver-nzf52" Jun 03 15:49:01.303364 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.301328 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1805c9c3-3e37-4b81-bd24-a6253025eed2-os-release\") pod \"multus-8dhbv\" (UID: \"1805c9c3-3e37-4b81-bd24-a6253025eed2\") " pod="openshift-multus/multus-8dhbv" Jun 03 15:49:01.303364 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.301353 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1805c9c3-3e37-4b81-bd24-a6253025eed2-hostroot\") pod \"multus-8dhbv\" (UID: \"1805c9c3-3e37-4b81-bd24-a6253025eed2\") " pod="openshift-multus/multus-8dhbv" Jun 03 15:49:01.303364 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:01.301377 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:49:01.303364 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.301406 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/52874ebd-3611-402b-bc80-fa65b5ca8b54-env-overrides\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.303364 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.301421 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/52874ebd-3611-402b-bc80-fa65b5ca8b54-host-run-netns\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.303364 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:01.301457 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5aa0ffe1-5bf5-47f0-9814-d639c23b597f-metrics-certs podName:5aa0ffe1-5bf5-47f0-9814-d639c23b597f nodeName:}" failed. No retries permitted until 2026-06-03 15:49:01.80142175 +0000 UTC m=+2.158416876 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5aa0ffe1-5bf5-47f0-9814-d639c23b597f-metrics-certs") pod "network-metrics-daemon-zl2xd" (UID: "5aa0ffe1-5bf5-47f0-9814-d639c23b597f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:49:01.303364 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.301379 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/52874ebd-3611-402b-bc80-fa65b5ca8b54-host-run-netns\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.303364 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.301506 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1805c9c3-3e37-4b81-bd24-a6253025eed2-os-release\") pod \"multus-8dhbv\" (UID: \"1805c9c3-3e37-4b81-bd24-a6253025eed2\") " pod="openshift-multus/multus-8dhbv" Jun 03 15:49:01.303364 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.301529 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/52874ebd-3611-402b-bc80-fa65b5ca8b54-ovnkube-config\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.303364 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.301558 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3d08c149-ddb9-494c-9e84-5d4b8192035f-host-slash\") pod \"iptables-alerter-2wb84\" (UID: \"3d08c149-ddb9-494c-9e84-5d4b8192035f\") " pod="openshift-network-operator/iptables-alerter-2wb84" Jun 03 15:49:01.303364 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.301583 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a09fb6d9-72f4-4139-b3ca-77c2889be355-sys-fs\") pod \"aws-ebs-csi-driver-node-ptnm6\" (UID: \"a09fb6d9-72f4-4139-b3ca-77c2889be355\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ptnm6" Jun 03 15:49:01.303364 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.301610 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dh68w\" (UniqueName: \"kubernetes.io/projected/53b1660f-0dbd-42e9-beab-6df46454d8a6-kube-api-access-dh68w\") pod \"network-check-target-tqbmw\" (UID: \"53b1660f-0dbd-42e9-beab-6df46454d8a6\") " pod="openshift-network-diagnostics/network-check-target-tqbmw" Jun 03 15:49:01.303364 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.301638 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/52874ebd-3611-402b-bc80-fa65b5ca8b54-run-systemd\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.304196 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.301664 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f1075e32-8d0e-4ca6-8cd9-4d2d337ce213-etc-systemd\") pod \"tuned-9sqjn\" (UID: \"f1075e32-8d0e-4ca6-8cd9-4d2d337ce213\") " pod="openshift-cluster-node-tuning-operator/tuned-9sqjn" Jun 03 15:49:01.304196 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.301689 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/738f714c-1988-41e8-9eb6-8ee92d4f07d5-konnectivity-ca\") pod \"konnectivity-agent-ntc9t\" (UID: \"738f714c-1988-41e8-9eb6-8ee92d4f07d5\") " pod="kube-system/konnectivity-agent-ntc9t" Jun 03 15:49:01.304196 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.301716 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1075e32-8d0e-4ca6-8cd9-4d2d337ce213-var-lib-kubelet\") pod \"tuned-9sqjn\" (UID: \"f1075e32-8d0e-4ca6-8cd9-4d2d337ce213\") " pod="openshift-cluster-node-tuning-operator/tuned-9sqjn" Jun 03 15:49:01.304196 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.301735 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1805c9c3-3e37-4b81-bd24-a6253025eed2-cni-binary-copy\") pod \"multus-8dhbv\" (UID: \"1805c9c3-3e37-4b81-bd24-a6253025eed2\") " pod="openshift-multus/multus-8dhbv" Jun 03 15:49:01.304196 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.301745 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1805c9c3-3e37-4b81-bd24-a6253025eed2-cnibin\") pod \"multus-8dhbv\" (UID: \"1805c9c3-3e37-4b81-bd24-a6253025eed2\") " pod="openshift-multus/multus-8dhbv" Jun 03 15:49:01.304196 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.301768 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1805c9c3-3e37-4b81-bd24-a6253025eed2-multus-daemon-config\") pod \"multus-8dhbv\" (UID: \"1805c9c3-3e37-4b81-bd24-a6253025eed2\") " pod="openshift-multus/multus-8dhbv" Jun 03 15:49:01.304196 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.301770 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/52874ebd-3611-402b-bc80-fa65b5ca8b54-systemd-units\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.304196 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.301809 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/52874ebd-3611-402b-bc80-fa65b5ca8b54-systemd-units\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.304196 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.301814 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/52874ebd-3611-402b-bc80-fa65b5ca8b54-log-socket\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.304196 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.301840 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/af92e0dd-a3c0-4993-a37a-edd0d027a43f-serviceca\") pod \"node-ca-zqg8b\" (UID: \"af92e0dd-a3c0-4993-a37a-edd0d027a43f\") " pod="openshift-image-registry/node-ca-zqg8b" Jun 03 15:49:01.304196 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.301736 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1805c9c3-3e37-4b81-bd24-a6253025eed2-hostroot\") pod \"multus-8dhbv\" (UID: \"1805c9c3-3e37-4b81-bd24-a6253025eed2\") " pod="openshift-multus/multus-8dhbv" Jun 03 15:49:01.304196 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.301865 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f1075e32-8d0e-4ca6-8cd9-4d2d337ce213-etc-systemd\") pod \"tuned-9sqjn\" (UID: \"f1075e32-8d0e-4ca6-8cd9-4d2d337ce213\") " pod="openshift-cluster-node-tuning-operator/tuned-9sqjn" Jun 03 15:49:01.304196 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.301876 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b1c958f9-beb1-4a9f-9675-653a29fe49fd-os-release\") pod \"multus-additional-cni-plugins-mfjbh\" (UID: \"b1c958f9-beb1-4a9f-9675-653a29fe49fd\") " pod="openshift-multus/multus-additional-cni-plugins-mfjbh" Jun 03 15:49:01.304196 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.301888 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b1c958f9-beb1-4a9f-9675-653a29fe49fd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mfjbh\" (UID: \"b1c958f9-beb1-4a9f-9675-653a29fe49fd\") " pod="openshift-multus/multus-additional-cni-plugins-mfjbh" Jun 03 15:49:01.304196 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.301902 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7rvrj\" (UniqueName: \"kubernetes.io/projected/5aa0ffe1-5bf5-47f0-9814-d639c23b597f-kube-api-access-7rvrj\") pod \"network-metrics-daemon-zl2xd\" (UID: \"5aa0ffe1-5bf5-47f0-9814-d639c23b597f\") " pod="openshift-multus/network-metrics-daemon-zl2xd" Jun 03 15:49:01.304196 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.301939 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/52874ebd-3611-402b-bc80-fa65b5ca8b54-node-log\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.304196 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.301964 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b1c958f9-beb1-4a9f-9675-653a29fe49fd-os-release\") pod \"multus-additional-cni-plugins-mfjbh\" (UID: \"b1c958f9-beb1-4a9f-9675-653a29fe49fd\") " pod="openshift-multus/multus-additional-cni-plugins-mfjbh" Jun 03 15:49:01.304196 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.301968 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/52874ebd-3611-402b-bc80-fa65b5ca8b54-host-cni-netd\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.304811 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.301995 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1075e32-8d0e-4ca6-8cd9-4d2d337ce213-tmp\") pod \"tuned-9sqjn\" (UID: \"f1075e32-8d0e-4ca6-8cd9-4d2d337ce213\") " pod="openshift-cluster-node-tuning-operator/tuned-9sqjn" Jun 03 15:49:01.304811 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.302020 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1805c9c3-3e37-4b81-bd24-a6253025eed2-host-run-multus-certs\") pod \"multus-8dhbv\" (UID: \"1805c9c3-3e37-4b81-bd24-a6253025eed2\") " pod="openshift-multus/multus-8dhbv" Jun 03 15:49:01.304811 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.302032 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a09fb6d9-72f4-4139-b3ca-77c2889be355-sys-fs\") pod \"aws-ebs-csi-driver-node-ptnm6\" (UID: \"a09fb6d9-72f4-4139-b3ca-77c2889be355\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ptnm6" Jun 03 15:49:01.304811 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.302049 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/738f714c-1988-41e8-9eb6-8ee92d4f07d5-agent-certs\") pod \"konnectivity-agent-ntc9t\" (UID: \"738f714c-1988-41e8-9eb6-8ee92d4f07d5\") " pod="kube-system/konnectivity-agent-ntc9t" Jun 03 15:49:01.304811 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.302081 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f1075e32-8d0e-4ca6-8cd9-4d2d337ce213-etc-sysctl-conf\") pod \"tuned-9sqjn\" (UID: \"f1075e32-8d0e-4ca6-8cd9-4d2d337ce213\") " pod="openshift-cluster-node-tuning-operator/tuned-9sqjn" Jun 03 15:49:01.304811 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.302110 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0bc1339f-a919-4ead-8f5f-272a36a862c2-hosts-file\") pod \"node-resolver-nzf52\" (UID: \"0bc1339f-a919-4ead-8f5f-272a36a862c2\") " pod="openshift-dns/node-resolver-nzf52" Jun 03 15:49:01.304811 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.302137 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1805c9c3-3e37-4b81-bd24-a6253025eed2-system-cni-dir\") pod \"multus-8dhbv\" (UID: \"1805c9c3-3e37-4b81-bd24-a6253025eed2\") " pod="openshift-multus/multus-8dhbv" Jun 03 15:49:01.304811 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.302163 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sdz2m\" (UniqueName: \"kubernetes.io/projected/1805c9c3-3e37-4b81-bd24-a6253025eed2-kube-api-access-sdz2m\") pod \"multus-8dhbv\" (UID: \"1805c9c3-3e37-4b81-bd24-a6253025eed2\") " pod="openshift-multus/multus-8dhbv" Jun 03 15:49:01.304811 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.302188 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52874ebd-3611-402b-bc80-fa65b5ca8b54-run-openvswitch\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.304811 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.302218 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c6cx2\" (UniqueName: \"kubernetes.io/projected/b1c958f9-beb1-4a9f-9675-653a29fe49fd-kube-api-access-c6cx2\") pod \"multus-additional-cni-plugins-mfjbh\" (UID: \"b1c958f9-beb1-4a9f-9675-653a29fe49fd\") " pod="openshift-multus/multus-additional-cni-plugins-mfjbh" Jun 03 15:49:01.304811 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.302230 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/af92e0dd-a3c0-4993-a37a-edd0d027a43f-serviceca\") pod \"node-ca-zqg8b\" (UID: \"af92e0dd-a3c0-4993-a37a-edd0d027a43f\") " pod="openshift-image-registry/node-ca-zqg8b" Jun 03 15:49:01.304811 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.302251 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1805c9c3-3e37-4b81-bd24-a6253025eed2-host-var-lib-cni-bin\") pod \"multus-8dhbv\" (UID: \"1805c9c3-3e37-4b81-bd24-a6253025eed2\") " pod="openshift-multus/multus-8dhbv" Jun 03 15:49:01.304811 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.302282 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1805c9c3-3e37-4b81-bd24-a6253025eed2-host-var-lib-kubelet\") pod \"multus-8dhbv\" (UID: \"1805c9c3-3e37-4b81-bd24-a6253025eed2\") " pod="openshift-multus/multus-8dhbv" Jun 03 15:49:01.304811 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.302290 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/52874ebd-3611-402b-bc80-fa65b5ca8b54-log-socket\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.304811 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.302310 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/52874ebd-3611-402b-bc80-fa65b5ca8b54-host-slash\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.304811 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.302328 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/52874ebd-3611-402b-bc80-fa65b5ca8b54-run-systemd\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.304811 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.302337 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52874ebd-3611-402b-bc80-fa65b5ca8b54-etc-openvswitch\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.304811 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.302340 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/738f714c-1988-41e8-9eb6-8ee92d4f07d5-konnectivity-ca\") pod \"konnectivity-agent-ntc9t\" (UID: \"738f714c-1988-41e8-9eb6-8ee92d4f07d5\") " pod="kube-system/konnectivity-agent-ntc9t" Jun 03 15:49:01.305288 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.302384 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1075e32-8d0e-4ca6-8cd9-4d2d337ce213-var-lib-kubelet\") pod \"tuned-9sqjn\" (UID: \"f1075e32-8d0e-4ca6-8cd9-4d2d337ce213\") " pod="openshift-cluster-node-tuning-operator/tuned-9sqjn" Jun 03 15:49:01.305288 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.302413 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/52874ebd-3611-402b-bc80-fa65b5ca8b54-host-cni-netd\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.305288 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.302415 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/52874ebd-3611-402b-bc80-fa65b5ca8b54-ovnkube-script-lib\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.305288 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.302454 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3d08c149-ddb9-494c-9e84-5d4b8192035f-iptables-alerter-script\") pod \"iptables-alerter-2wb84\" (UID: \"3d08c149-ddb9-494c-9e84-5d4b8192035f\") " pod="openshift-network-operator/iptables-alerter-2wb84" Jun 03 15:49:01.305288 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.302464 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b1c958f9-beb1-4a9f-9675-653a29fe49fd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mfjbh\" (UID: \"b1c958f9-beb1-4a9f-9675-653a29fe49fd\") " pod="openshift-multus/multus-additional-cni-plugins-mfjbh" Jun 03 15:49:01.305288 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.302503 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q2jcz\" (UniqueName: \"kubernetes.io/projected/3d08c149-ddb9-494c-9e84-5d4b8192035f-kube-api-access-q2jcz\") pod \"iptables-alerter-2wb84\" (UID: \"3d08c149-ddb9-494c-9e84-5d4b8192035f\") " pod="openshift-network-operator/iptables-alerter-2wb84" Jun 03 15:49:01.305288 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.302533 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b1c958f9-beb1-4a9f-9675-653a29fe49fd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mfjbh\" (UID: \"b1c958f9-beb1-4a9f-9675-653a29fe49fd\") " pod="openshift-multus/multus-additional-cni-plugins-mfjbh" Jun 03 15:49:01.305288 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.302531 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/52874ebd-3611-402b-bc80-fa65b5ca8b54-node-log\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.305288 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.302692 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b1c958f9-beb1-4a9f-9675-653a29fe49fd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mfjbh\" (UID: \"b1c958f9-beb1-4a9f-9675-653a29fe49fd\") " pod="openshift-multus/multus-additional-cni-plugins-mfjbh" Jun 03 15:49:01.305288 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.302914 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/52874ebd-3611-402b-bc80-fa65b5ca8b54-ovnkube-script-lib\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.305288 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.302986 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1805c9c3-3e37-4b81-bd24-a6253025eed2-cnibin\") pod \"multus-8dhbv\" (UID: \"1805c9c3-3e37-4b81-bd24-a6253025eed2\") " pod="openshift-multus/multus-8dhbv" Jun 03 15:49:01.305288 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.303011 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3d08c149-ddb9-494c-9e84-5d4b8192035f-host-slash\") pod \"iptables-alerter-2wb84\" (UID: \"3d08c149-ddb9-494c-9e84-5d4b8192035f\") " pod="openshift-network-operator/iptables-alerter-2wb84" Jun 03 15:49:01.305288 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.303032 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1805c9c3-3e37-4b81-bd24-a6253025eed2-host-run-multus-certs\") pod \"multus-8dhbv\" (UID: \"1805c9c3-3e37-4b81-bd24-a6253025eed2\") " pod="openshift-multus/multus-8dhbv" Jun 03 15:49:01.305288 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.303112 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/52874ebd-3611-402b-bc80-fa65b5ca8b54-ovnkube-config\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.305288 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.303219 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0bc1339f-a919-4ead-8f5f-272a36a862c2-hosts-file\") pod \"node-resolver-nzf52\" (UID: \"0bc1339f-a919-4ead-8f5f-272a36a862c2\") " pod="openshift-dns/node-resolver-nzf52" Jun 03 15:49:01.305288 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.303252 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1805c9c3-3e37-4b81-bd24-a6253025eed2-system-cni-dir\") pod \"multus-8dhbv\" (UID: \"1805c9c3-3e37-4b81-bd24-a6253025eed2\") " pod="openshift-multus/multus-8dhbv" Jun 03 15:49:01.305288 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.303257 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/52874ebd-3611-402b-bc80-fa65b5ca8b54-host-slash\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.305762 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.303277 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f1075e32-8d0e-4ca6-8cd9-4d2d337ce213-etc-sysctl-conf\") pod \"tuned-9sqjn\" (UID: \"f1075e32-8d0e-4ca6-8cd9-4d2d337ce213\") " pod="openshift-cluster-node-tuning-operator/tuned-9sqjn" Jun 03 15:49:01.305762 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.303318 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1805c9c3-3e37-4b81-bd24-a6253025eed2-host-var-lib-kubelet\") pod \"multus-8dhbv\" (UID: \"1805c9c3-3e37-4b81-bd24-a6253025eed2\") " pod="openshift-multus/multus-8dhbv" Jun 03 15:49:01.305762 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.303354 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1805c9c3-3e37-4b81-bd24-a6253025eed2-host-var-lib-cni-bin\") pod \"multus-8dhbv\" (UID: \"1805c9c3-3e37-4b81-bd24-a6253025eed2\") " pod="openshift-multus/multus-8dhbv" Jun 03 15:49:01.305762 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.303393 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52874ebd-3611-402b-bc80-fa65b5ca8b54-run-openvswitch\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.305762 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.303544 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52874ebd-3611-402b-bc80-fa65b5ca8b54-etc-openvswitch\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.305762 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.303625 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b1c958f9-beb1-4a9f-9675-653a29fe49fd-system-cni-dir\") pod \"multus-additional-cni-plugins-mfjbh\" (UID: \"b1c958f9-beb1-4a9f-9675-653a29fe49fd\") " pod="openshift-multus/multus-additional-cni-plugins-mfjbh" Jun 03 15:49:01.305762 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.303892 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3d08c149-ddb9-494c-9e84-5d4b8192035f-iptables-alerter-script\") pod \"iptables-alerter-2wb84\" (UID: \"3d08c149-ddb9-494c-9e84-5d4b8192035f\") " pod="openshift-network-operator/iptables-alerter-2wb84" Jun 03 15:49:01.305762 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.304725 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f1075e32-8d0e-4ca6-8cd9-4d2d337ce213-etc-tuned\") pod \"tuned-9sqjn\" (UID: \"f1075e32-8d0e-4ca6-8cd9-4d2d337ce213\") " pod="openshift-cluster-node-tuning-operator/tuned-9sqjn" Jun 03 15:49:01.305762 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.304759 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/52874ebd-3611-402b-bc80-fa65b5ca8b54-ovn-node-metrics-cert\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.305762 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.305269 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1075e32-8d0e-4ca6-8cd9-4d2d337ce213-tmp\") pod \"tuned-9sqjn\" (UID: \"f1075e32-8d0e-4ca6-8cd9-4d2d337ce213\") " pod="openshift-cluster-node-tuning-operator/tuned-9sqjn" Jun 03 15:49:01.305762 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.305334 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/738f714c-1988-41e8-9eb6-8ee92d4f07d5-agent-certs\") pod \"konnectivity-agent-ntc9t\" (UID: \"738f714c-1988-41e8-9eb6-8ee92d4f07d5\") " pod="kube-system/konnectivity-agent-ntc9t" Jun 03 15:49:01.314103 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.314080 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7vw9\" (UniqueName: \"kubernetes.io/projected/0bc1339f-a919-4ead-8f5f-272a36a862c2-kube-api-access-v7vw9\") pod \"node-resolver-nzf52\" (UID: \"0bc1339f-a919-4ead-8f5f-272a36a862c2\") " pod="openshift-dns/node-resolver-nzf52" Jun 03 15:49:01.315608 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:01.315589 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:49:01.315705 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:01.315612 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:49:01.315705 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:01.315625 2573 projected.go:194] Error preparing data for projected volume kube-api-access-dh68w for pod openshift-network-diagnostics/network-check-target-tqbmw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:49:01.315810 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:01.315728 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53b1660f-0dbd-42e9-beab-6df46454d8a6-kube-api-access-dh68w podName:53b1660f-0dbd-42e9-beab-6df46454d8a6 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:01.815709191 +0000 UTC m=+2.172704304 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dh68w" (UniqueName: "kubernetes.io/projected/53b1660f-0dbd-42e9-beab-6df46454d8a6-kube-api-access-dh68w") pod "network-check-target-tqbmw" (UID: "53b1660f-0dbd-42e9-beab-6df46454d8a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:49:01.316934 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.316914 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx9d5\" (UniqueName: \"kubernetes.io/projected/af92e0dd-a3c0-4993-a37a-edd0d027a43f-kube-api-access-xx9d5\") pod \"node-ca-zqg8b\" (UID: \"af92e0dd-a3c0-4993-a37a-edd0d027a43f\") " pod="openshift-image-registry/node-ca-zqg8b" Jun 03 15:49:01.317243 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.317214 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t67rn\" (UniqueName: \"kubernetes.io/projected/52874ebd-3611-402b-bc80-fa65b5ca8b54-kube-api-access-t67rn\") pod \"ovnkube-node-4rkfz\" (UID: \"52874ebd-3611-402b-bc80-fa65b5ca8b54\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.317328 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.317222 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6cx2\" (UniqueName: \"kubernetes.io/projected/b1c958f9-beb1-4a9f-9675-653a29fe49fd-kube-api-access-c6cx2\") pod \"multus-additional-cni-plugins-mfjbh\" (UID: \"b1c958f9-beb1-4a9f-9675-653a29fe49fd\") " pod="openshift-multus/multus-additional-cni-plugins-mfjbh" Jun 03 15:49:01.317413 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.317394 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvs95\" (UniqueName: \"kubernetes.io/projected/a09fb6d9-72f4-4139-b3ca-77c2889be355-kube-api-access-fvs95\") pod \"aws-ebs-csi-driver-node-ptnm6\" (UID: \"a09fb6d9-72f4-4139-b3ca-77c2889be355\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ptnm6" Jun 03 15:49:01.317637 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.317618 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65xkl\" (UniqueName: \"kubernetes.io/projected/f1075e32-8d0e-4ca6-8cd9-4d2d337ce213-kube-api-access-65xkl\") pod \"tuned-9sqjn\" (UID: \"f1075e32-8d0e-4ca6-8cd9-4d2d337ce213\") " pod="openshift-cluster-node-tuning-operator/tuned-9sqjn" Jun 03 15:49:01.317756 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.317738 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rvrj\" (UniqueName: \"kubernetes.io/projected/5aa0ffe1-5bf5-47f0-9814-d639c23b597f-kube-api-access-7rvrj\") pod \"network-metrics-daemon-zl2xd\" (UID: \"5aa0ffe1-5bf5-47f0-9814-d639c23b597f\") " pod="openshift-multus/network-metrics-daemon-zl2xd" Jun 03 15:49:01.318764 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.318749 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2jcz\" (UniqueName: \"kubernetes.io/projected/3d08c149-ddb9-494c-9e84-5d4b8192035f-kube-api-access-q2jcz\") pod \"iptables-alerter-2wb84\" (UID: \"3d08c149-ddb9-494c-9e84-5d4b8192035f\") " pod="openshift-network-operator/iptables-alerter-2wb84" Jun 03 15:49:01.318836 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.318821 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdz2m\" (UniqueName: \"kubernetes.io/projected/1805c9c3-3e37-4b81-bd24-a6253025eed2-kube-api-access-sdz2m\") pod \"multus-8dhbv\" (UID: \"1805c9c3-3e37-4b81-bd24-a6253025eed2\") " pod="openshift-multus/multus-8dhbv" Jun 03 15:49:01.340119 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.340099 2573 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 15:49:01.425356 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.425328 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9sqjn" Jun 03 15:49:01.431922 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:49:01.431895 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1075e32_8d0e_4ca6_8cd9_4d2d337ce213.slice/crio-2f74b89bdccb2428cc3fef3d87a7d3e2b6137ec9b24a06d14666368590ac0150 WatchSource:0}: Error finding container 2f74b89bdccb2428cc3fef3d87a7d3e2b6137ec9b24a06d14666368590ac0150: Status 404 returned error can't find the container with id 2f74b89bdccb2428cc3fef3d87a7d3e2b6137ec9b24a06d14666368590ac0150 Jun 03 15:49:01.451104 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.451082 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:01.456944 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:49:01.456919 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52874ebd_3611_402b_bc80_fa65b5ca8b54.slice/crio-3c33d338abc104d1b24e6238ad450d7c16e34939ccf6205513e4c5cd9cfae797 WatchSource:0}: Error finding container 3c33d338abc104d1b24e6238ad450d7c16e34939ccf6205513e4c5cd9cfae797: Status 404 returned error can't find the container with id 3c33d338abc104d1b24e6238ad450d7c16e34939ccf6205513e4c5cd9cfae797 Jun 03 15:49:01.457526 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.457509 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nzf52" Jun 03 15:49:01.462312 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.462293 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zqg8b" Jun 03 15:49:01.466485 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:49:01.466455 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bc1339f_a919_4ead_8f5f_272a36a862c2.slice/crio-77603a55436014d5aea733a237a0f46287f5c46900f39dd1ab76e102bda5a3b2 WatchSource:0}: Error finding container 77603a55436014d5aea733a237a0f46287f5c46900f39dd1ab76e102bda5a3b2: Status 404 returned error can't find the container with id 77603a55436014d5aea733a237a0f46287f5c46900f39dd1ab76e102bda5a3b2 Jun 03 15:49:01.468378 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.468354 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8dhbv" Jun 03 15:49:01.468764 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:49:01.468741 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf92e0dd_a3c0_4993_a37a_edd0d027a43f.slice/crio-1e7ce4216bca880f34c87da2cc09161ca1b28e322d84dbdbb13a504bc875fb3f WatchSource:0}: Error finding container 1e7ce4216bca880f34c87da2cc09161ca1b28e322d84dbdbb13a504bc875fb3f: Status 404 returned error can't find the container with id 1e7ce4216bca880f34c87da2cc09161ca1b28e322d84dbdbb13a504bc875fb3f Jun 03 15:49:01.474664 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.474641 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2wb84" Jun 03 15:49:01.474885 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:49:01.474862 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1805c9c3_3e37_4b81_bd24_a6253025eed2.slice/crio-292309d57e4b6d5af496ab853beff681d6675bbd6782f7a1938ae232f41c7356 WatchSource:0}: Error finding container 292309d57e4b6d5af496ab853beff681d6675bbd6782f7a1938ae232f41c7356: Status 404 returned error can't find the container with id 292309d57e4b6d5af496ab853beff681d6675bbd6782f7a1938ae232f41c7356 Jun 03 15:49:01.480005 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.479942 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ntc9t" Jun 03 15:49:01.482113 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:49:01.482092 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d08c149_ddb9_494c_9e84_5d4b8192035f.slice/crio-1f6f5cd26fddedaec338c37e401b5457d1aa7484a98677fcc7c5aede3cca8636 WatchSource:0}: Error finding container 1f6f5cd26fddedaec338c37e401b5457d1aa7484a98677fcc7c5aede3cca8636: Status 404 returned error can't find the container with id 1f6f5cd26fddedaec338c37e401b5457d1aa7484a98677fcc7c5aede3cca8636 Jun 03 15:49:01.485720 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.485703 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ptnm6" Jun 03 15:49:01.488005 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:49:01.487986 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod738f714c_1988_41e8_9eb6_8ee92d4f07d5.slice/crio-28812752f0670b58e7e085d003e0bb157dcfd3a82fddb814a21affe6197a96d6 WatchSource:0}: Error finding container 28812752f0670b58e7e085d003e0bb157dcfd3a82fddb814a21affe6197a96d6: Status 404 returned error can't find the container with id 28812752f0670b58e7e085d003e0bb157dcfd3a82fddb814a21affe6197a96d6 Jun 03 15:49:01.490027 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.490007 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mfjbh" Jun 03 15:49:01.494261 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:49:01.494241 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda09fb6d9_72f4_4139_b3ca_77c2889be355.slice/crio-45d150d31cf78875dc2e2e790aa144cfed75b9a44cbcd64ca2fddd2392929819 WatchSource:0}: Error finding container 45d150d31cf78875dc2e2e790aa144cfed75b9a44cbcd64ca2fddd2392929819: Status 404 returned error can't find the container with id 45d150d31cf78875dc2e2e790aa144cfed75b9a44cbcd64ca2fddd2392929819 Jun 03 15:49:01.499633 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:49:01.499610 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1c958f9_beb1_4a9f_9675_653a29fe49fd.slice/crio-6c5783343994f03067af0d72ea69b511a67fdfbb63c0187acf36a8ae6a25fdd1 WatchSource:0}: Error finding container 6c5783343994f03067af0d72ea69b511a67fdfbb63c0187acf36a8ae6a25fdd1: Status 404 returned error can't find the container with id 6c5783343994f03067af0d72ea69b511a67fdfbb63c0187acf36a8ae6a25fdd1 Jun 03 15:49:01.639174 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.638997 2573 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 15:49:01.806982 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.806379 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5aa0ffe1-5bf5-47f0-9814-d639c23b597f-metrics-certs\") pod \"network-metrics-daemon-zl2xd\" (UID: \"5aa0ffe1-5bf5-47f0-9814-d639c23b597f\") " pod="openshift-multus/network-metrics-daemon-zl2xd" Jun 03 15:49:01.806982 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:01.806540 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:49:01.806982 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:01.806616 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5aa0ffe1-5bf5-47f0-9814-d639c23b597f-metrics-certs podName:5aa0ffe1-5bf5-47f0-9814-d639c23b597f nodeName:}" failed. No retries permitted until 2026-06-03 15:49:02.806596104 +0000 UTC m=+3.163591221 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5aa0ffe1-5bf5-47f0-9814-d639c23b597f-metrics-certs") pod "network-metrics-daemon-zl2xd" (UID: "5aa0ffe1-5bf5-47f0-9814-d639c23b597f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:49:01.906923 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:01.906848 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dh68w\" (UniqueName: \"kubernetes.io/projected/53b1660f-0dbd-42e9-beab-6df46454d8a6-kube-api-access-dh68w\") pod \"network-check-target-tqbmw\" (UID: \"53b1660f-0dbd-42e9-beab-6df46454d8a6\") " pod="openshift-network-diagnostics/network-check-target-tqbmw" Jun 03 15:49:01.907086 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:01.907051 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:49:01.907086 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:01.907072 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:49:01.907086 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:01.907084 2573 projected.go:194] Error preparing data for projected volume kube-api-access-dh68w for pod openshift-network-diagnostics/network-check-target-tqbmw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:49:01.907240 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:01.907139 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53b1660f-0dbd-42e9-beab-6df46454d8a6-kube-api-access-dh68w podName:53b1660f-0dbd-42e9-beab-6df46454d8a6 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:02.907121339 +0000 UTC m=+3.264116454 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dh68w" (UniqueName: "kubernetes.io/projected/53b1660f-0dbd-42e9-beab-6df46454d8a6-kube-api-access-dh68w") pod "network-check-target-tqbmw" (UID: "53b1660f-0dbd-42e9-beab-6df46454d8a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:49:02.123996 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:02.123747 2573 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 15:49:02.230206 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:02.230125 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zl2xd" Jun 03 15:49:02.230363 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:02.230258 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zl2xd" podUID="5aa0ffe1-5bf5-47f0-9814-d639c23b597f" Jun 03 15:49:02.248299 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:02.248261 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 15:44:01 +0000 UTC" deadline="2027-12-15 00:09:50.613820193 +0000 UTC" Jun 03 15:49:02.248299 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:02.248296 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13424h20m48.365527305s" Jun 03 15:49:02.255744 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:02.255679 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ntc9t" event={"ID":"738f714c-1988-41e8-9eb6-8ee92d4f07d5","Type":"ContainerStarted","Data":"28812752f0670b58e7e085d003e0bb157dcfd3a82fddb814a21affe6197a96d6"} Jun 03 15:49:02.277686 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:02.277655 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zqg8b" event={"ID":"af92e0dd-a3c0-4993-a37a-edd0d027a43f","Type":"ContainerStarted","Data":"1e7ce4216bca880f34c87da2cc09161ca1b28e322d84dbdbb13a504bc875fb3f"} Jun 03 15:49:02.285782 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:02.285753 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nzf52" event={"ID":"0bc1339f-a919-4ead-8f5f-272a36a862c2","Type":"ContainerStarted","Data":"77603a55436014d5aea733a237a0f46287f5c46900f39dd1ab76e102bda5a3b2"} Jun 03 15:49:02.296791 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:02.296598 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ptnm6" event={"ID":"a09fb6d9-72f4-4139-b3ca-77c2889be355","Type":"ContainerStarted","Data":"45d150d31cf78875dc2e2e790aa144cfed75b9a44cbcd64ca2fddd2392929819"} Jun 03 15:49:02.316781 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:02.316747 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2wb84" event={"ID":"3d08c149-ddb9-494c-9e84-5d4b8192035f","Type":"ContainerStarted","Data":"1f6f5cd26fddedaec338c37e401b5457d1aa7484a98677fcc7c5aede3cca8636"} Jun 03 15:49:02.329345 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:02.329314 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8dhbv" event={"ID":"1805c9c3-3e37-4b81-bd24-a6253025eed2","Type":"ContainerStarted","Data":"292309d57e4b6d5af496ab853beff681d6675bbd6782f7a1938ae232f41c7356"} Jun 03 15:49:02.346223 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:02.346190 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" event={"ID":"52874ebd-3611-402b-bc80-fa65b5ca8b54","Type":"ContainerStarted","Data":"3c33d338abc104d1b24e6238ad450d7c16e34939ccf6205513e4c5cd9cfae797"} Jun 03 15:49:02.359525 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:02.359498 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9sqjn" event={"ID":"f1075e32-8d0e-4ca6-8cd9-4d2d337ce213","Type":"ContainerStarted","Data":"2f74b89bdccb2428cc3fef3d87a7d3e2b6137ec9b24a06d14666368590ac0150"} Jun 03 15:49:02.379638 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:02.379613 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mfjbh" event={"ID":"b1c958f9-beb1-4a9f-9675-653a29fe49fd","Type":"ContainerStarted","Data":"6c5783343994f03067af0d72ea69b511a67fdfbb63c0187acf36a8ae6a25fdd1"} Jun 03 15:49:02.817911 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:02.817294 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5aa0ffe1-5bf5-47f0-9814-d639c23b597f-metrics-certs\") pod \"network-metrics-daemon-zl2xd\" (UID: \"5aa0ffe1-5bf5-47f0-9814-d639c23b597f\") " pod="openshift-multus/network-metrics-daemon-zl2xd" Jun 03 15:49:02.817911 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:02.817498 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:49:02.817911 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:02.817561 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5aa0ffe1-5bf5-47f0-9814-d639c23b597f-metrics-certs podName:5aa0ffe1-5bf5-47f0-9814-d639c23b597f nodeName:}" failed. No retries permitted until 2026-06-03 15:49:04.817543158 +0000 UTC m=+5.174538271 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5aa0ffe1-5bf5-47f0-9814-d639c23b597f-metrics-certs") pod "network-metrics-daemon-zl2xd" (UID: "5aa0ffe1-5bf5-47f0-9814-d639c23b597f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:49:02.918717 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:02.918670 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dh68w\" (UniqueName: \"kubernetes.io/projected/53b1660f-0dbd-42e9-beab-6df46454d8a6-kube-api-access-dh68w\") pod \"network-check-target-tqbmw\" (UID: \"53b1660f-0dbd-42e9-beab-6df46454d8a6\") " pod="openshift-network-diagnostics/network-check-target-tqbmw" Jun 03 15:49:02.918903 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:02.918885 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:49:02.918980 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:02.918906 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:49:02.918980 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:02.918919 2573 projected.go:194] Error preparing data for projected volume kube-api-access-dh68w for pod openshift-network-diagnostics/network-check-target-tqbmw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:49:02.918980 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:02.918978 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53b1660f-0dbd-42e9-beab-6df46454d8a6-kube-api-access-dh68w podName:53b1660f-0dbd-42e9-beab-6df46454d8a6 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:04.918959011 +0000 UTC m=+5.275954125 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-dh68w" (UniqueName: "kubernetes.io/projected/53b1660f-0dbd-42e9-beab-6df46454d8a6-kube-api-access-dh68w") pod "network-check-target-tqbmw" (UID: "53b1660f-0dbd-42e9-beab-6df46454d8a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:49:03.230494 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:03.229922 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tqbmw" Jun 03 15:49:03.230494 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:03.230047 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tqbmw" podUID="53b1660f-0dbd-42e9-beab-6df46454d8a6" Jun 03 15:49:03.249305 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:03.249241 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 15:44:01 +0000 UTC" deadline="2028-01-13 03:59:46.651543565 +0000 UTC" Jun 03 15:49:03.249305 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:03.249274 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14124h10m43.402272596s" Jun 03 15:49:03.289401 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:03.289201 2573 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 15:49:04.231321 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:04.230766 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zl2xd" Jun 03 15:49:04.231321 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:04.230908 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zl2xd" podUID="5aa0ffe1-5bf5-47f0-9814-d639c23b597f" Jun 03 15:49:04.242023 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:04.240949 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-gnf9x"] Jun 03 15:49:04.243264 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:04.243237 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnf9x" Jun 03 15:49:04.243373 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:04.243312 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnf9x" podUID="dd3517b6-8b26-4614-a559-162258f28dbf" Jun 03 15:49:04.329657 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:04.329620 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dd3517b6-8b26-4614-a559-162258f28dbf-kubelet-config\") pod \"global-pull-secret-syncer-gnf9x\" (UID: \"dd3517b6-8b26-4614-a559-162258f28dbf\") " pod="kube-system/global-pull-secret-syncer-gnf9x" Jun 03 15:49:04.329850 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:04.329673 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dd3517b6-8b26-4614-a559-162258f28dbf-dbus\") pod \"global-pull-secret-syncer-gnf9x\" (UID: \"dd3517b6-8b26-4614-a559-162258f28dbf\") " pod="kube-system/global-pull-secret-syncer-gnf9x" Jun 03 15:49:04.329850 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:04.329708 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd3517b6-8b26-4614-a559-162258f28dbf-original-pull-secret\") pod \"global-pull-secret-syncer-gnf9x\" (UID: \"dd3517b6-8b26-4614-a559-162258f28dbf\") " pod="kube-system/global-pull-secret-syncer-gnf9x" Jun 03 15:49:04.430845 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:04.430808 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dd3517b6-8b26-4614-a559-162258f28dbf-kubelet-config\") pod \"global-pull-secret-syncer-gnf9x\" (UID: \"dd3517b6-8b26-4614-a559-162258f28dbf\") " pod="kube-system/global-pull-secret-syncer-gnf9x" Jun 03 15:49:04.431027 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:04.430857 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dd3517b6-8b26-4614-a559-162258f28dbf-dbus\") pod \"global-pull-secret-syncer-gnf9x\" (UID: \"dd3517b6-8b26-4614-a559-162258f28dbf\") " pod="kube-system/global-pull-secret-syncer-gnf9x" Jun 03 15:49:04.431027 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:04.430887 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd3517b6-8b26-4614-a559-162258f28dbf-original-pull-secret\") pod \"global-pull-secret-syncer-gnf9x\" (UID: \"dd3517b6-8b26-4614-a559-162258f28dbf\") " pod="kube-system/global-pull-secret-syncer-gnf9x" Jun 03 15:49:04.431137 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:04.431050 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 15:49:04.431137 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:04.431114 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd3517b6-8b26-4614-a559-162258f28dbf-original-pull-secret podName:dd3517b6-8b26-4614-a559-162258f28dbf nodeName:}" failed. No retries permitted until 2026-06-03 15:49:04.931094875 +0000 UTC m=+5.288089993 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd3517b6-8b26-4614-a559-162258f28dbf-original-pull-secret") pod "global-pull-secret-syncer-gnf9x" (UID: "dd3517b6-8b26-4614-a559-162258f28dbf") : object "kube-system"/"original-pull-secret" not registered Jun 03 15:49:04.431241 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:04.431185 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dd3517b6-8b26-4614-a559-162258f28dbf-kubelet-config\") pod \"global-pull-secret-syncer-gnf9x\" (UID: \"dd3517b6-8b26-4614-a559-162258f28dbf\") " pod="kube-system/global-pull-secret-syncer-gnf9x" Jun 03 15:49:04.431628 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:04.431328 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dd3517b6-8b26-4614-a559-162258f28dbf-dbus\") pod \"global-pull-secret-syncer-gnf9x\" (UID: \"dd3517b6-8b26-4614-a559-162258f28dbf\") " pod="kube-system/global-pull-secret-syncer-gnf9x" Jun 03 15:49:04.834023 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:04.833902 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5aa0ffe1-5bf5-47f0-9814-d639c23b597f-metrics-certs\") pod \"network-metrics-daemon-zl2xd\" (UID: \"5aa0ffe1-5bf5-47f0-9814-d639c23b597f\") " pod="openshift-multus/network-metrics-daemon-zl2xd" Jun 03 15:49:04.834204 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:04.834039 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:49:04.834204 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:04.834121 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5aa0ffe1-5bf5-47f0-9814-d639c23b597f-metrics-certs podName:5aa0ffe1-5bf5-47f0-9814-d639c23b597f nodeName:}" failed. No retries permitted until 2026-06-03 15:49:08.834100534 +0000 UTC m=+9.191095647 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5aa0ffe1-5bf5-47f0-9814-d639c23b597f-metrics-certs") pod "network-metrics-daemon-zl2xd" (UID: "5aa0ffe1-5bf5-47f0-9814-d639c23b597f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:49:04.935010 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:04.934965 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd3517b6-8b26-4614-a559-162258f28dbf-original-pull-secret\") pod \"global-pull-secret-syncer-gnf9x\" (UID: \"dd3517b6-8b26-4614-a559-162258f28dbf\") " pod="kube-system/global-pull-secret-syncer-gnf9x" Jun 03 15:49:04.935179 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:04.935071 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dh68w\" (UniqueName: \"kubernetes.io/projected/53b1660f-0dbd-42e9-beab-6df46454d8a6-kube-api-access-dh68w\") pod \"network-check-target-tqbmw\" (UID: \"53b1660f-0dbd-42e9-beab-6df46454d8a6\") " pod="openshift-network-diagnostics/network-check-target-tqbmw" Jun 03 15:49:04.935253 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:04.935206 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:49:04.935253 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:04.935225 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:49:04.935253 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:04.935239 2573 projected.go:194] Error preparing data for projected volume kube-api-access-dh68w for pod openshift-network-diagnostics/network-check-target-tqbmw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:49:04.935401 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:04.935299 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53b1660f-0dbd-42e9-beab-6df46454d8a6-kube-api-access-dh68w podName:53b1660f-0dbd-42e9-beab-6df46454d8a6 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:08.935280834 +0000 UTC m=+9.292275950 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-dh68w" (UniqueName: "kubernetes.io/projected/53b1660f-0dbd-42e9-beab-6df46454d8a6-kube-api-access-dh68w") pod "network-check-target-tqbmw" (UID: "53b1660f-0dbd-42e9-beab-6df46454d8a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:49:04.935744 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:04.935721 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 15:49:04.935837 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:04.935779 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd3517b6-8b26-4614-a559-162258f28dbf-original-pull-secret podName:dd3517b6-8b26-4614-a559-162258f28dbf nodeName:}" failed. No retries permitted until 2026-06-03 15:49:05.935762991 +0000 UTC m=+6.292758101 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd3517b6-8b26-4614-a559-162258f28dbf-original-pull-secret") pod "global-pull-secret-syncer-gnf9x" (UID: "dd3517b6-8b26-4614-a559-162258f28dbf") : object "kube-system"/"original-pull-secret" not registered Jun 03 15:49:05.230844 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:05.230280 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tqbmw" Jun 03 15:49:05.230844 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:05.230417 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tqbmw" podUID="53b1660f-0dbd-42e9-beab-6df46454d8a6" Jun 03 15:49:05.946627 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:05.946254 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd3517b6-8b26-4614-a559-162258f28dbf-original-pull-secret\") pod \"global-pull-secret-syncer-gnf9x\" (UID: \"dd3517b6-8b26-4614-a559-162258f28dbf\") " pod="kube-system/global-pull-secret-syncer-gnf9x" Jun 03 15:49:05.946627 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:05.946424 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 15:49:05.946627 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:05.946508 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd3517b6-8b26-4614-a559-162258f28dbf-original-pull-secret podName:dd3517b6-8b26-4614-a559-162258f28dbf nodeName:}" failed. No retries permitted until 2026-06-03 15:49:07.946488397 +0000 UTC m=+8.303483511 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd3517b6-8b26-4614-a559-162258f28dbf-original-pull-secret") pod "global-pull-secret-syncer-gnf9x" (UID: "dd3517b6-8b26-4614-a559-162258f28dbf") : object "kube-system"/"original-pull-secret" not registered Jun 03 15:49:06.230661 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:06.230520 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnf9x" Jun 03 15:49:06.230835 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:06.230665 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnf9x" podUID="dd3517b6-8b26-4614-a559-162258f28dbf" Jun 03 15:49:06.230962 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:06.230941 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zl2xd" Jun 03 15:49:06.231122 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:06.231072 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zl2xd" podUID="5aa0ffe1-5bf5-47f0-9814-d639c23b597f" Jun 03 15:49:07.229766 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:07.229728 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tqbmw" Jun 03 15:49:07.230214 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:07.229847 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tqbmw" podUID="53b1660f-0dbd-42e9-beab-6df46454d8a6" Jun 03 15:49:07.963867 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:07.963828 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd3517b6-8b26-4614-a559-162258f28dbf-original-pull-secret\") pod \"global-pull-secret-syncer-gnf9x\" (UID: \"dd3517b6-8b26-4614-a559-162258f28dbf\") " pod="kube-system/global-pull-secret-syncer-gnf9x" Jun 03 15:49:07.964054 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:07.963994 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 15:49:07.964132 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:07.964061 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd3517b6-8b26-4614-a559-162258f28dbf-original-pull-secret podName:dd3517b6-8b26-4614-a559-162258f28dbf nodeName:}" failed. No retries permitted until 2026-06-03 15:49:11.964043021 +0000 UTC m=+12.321038137 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd3517b6-8b26-4614-a559-162258f28dbf-original-pull-secret") pod "global-pull-secret-syncer-gnf9x" (UID: "dd3517b6-8b26-4614-a559-162258f28dbf") : object "kube-system"/"original-pull-secret" not registered Jun 03 15:49:08.230173 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:08.230099 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnf9x" Jun 03 15:49:08.230608 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:08.230230 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnf9x" podUID="dd3517b6-8b26-4614-a559-162258f28dbf" Jun 03 15:49:08.230608 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:08.230425 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zl2xd" Jun 03 15:49:08.230608 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:08.230538 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zl2xd" podUID="5aa0ffe1-5bf5-47f0-9814-d639c23b597f" Jun 03 15:49:08.871035 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:08.870971 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5aa0ffe1-5bf5-47f0-9814-d639c23b597f-metrics-certs\") pod \"network-metrics-daemon-zl2xd\" (UID: \"5aa0ffe1-5bf5-47f0-9814-d639c23b597f\") " pod="openshift-multus/network-metrics-daemon-zl2xd" Jun 03 15:49:08.871224 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:08.871111 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:49:08.871224 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:08.871188 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5aa0ffe1-5bf5-47f0-9814-d639c23b597f-metrics-certs podName:5aa0ffe1-5bf5-47f0-9814-d639c23b597f nodeName:}" failed. No retries permitted until 2026-06-03 15:49:16.871168133 +0000 UTC m=+17.228163249 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5aa0ffe1-5bf5-47f0-9814-d639c23b597f-metrics-certs") pod "network-metrics-daemon-zl2xd" (UID: "5aa0ffe1-5bf5-47f0-9814-d639c23b597f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:49:08.972183 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:08.972079 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dh68w\" (UniqueName: \"kubernetes.io/projected/53b1660f-0dbd-42e9-beab-6df46454d8a6-kube-api-access-dh68w\") pod \"network-check-target-tqbmw\" (UID: \"53b1660f-0dbd-42e9-beab-6df46454d8a6\") " pod="openshift-network-diagnostics/network-check-target-tqbmw" Jun 03 15:49:08.972351 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:08.972293 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:49:08.972351 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:08.972319 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:49:08.972351 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:08.972332 2573 projected.go:194] Error preparing data for projected volume kube-api-access-dh68w for pod openshift-network-diagnostics/network-check-target-tqbmw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:49:08.972483 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:08.972407 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53b1660f-0dbd-42e9-beab-6df46454d8a6-kube-api-access-dh68w podName:53b1660f-0dbd-42e9-beab-6df46454d8a6 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:16.972379772 +0000 UTC m=+17.329374888 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-dh68w" (UniqueName: "kubernetes.io/projected/53b1660f-0dbd-42e9-beab-6df46454d8a6-kube-api-access-dh68w") pod "network-check-target-tqbmw" (UID: "53b1660f-0dbd-42e9-beab-6df46454d8a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:49:09.230706 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:09.230614 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tqbmw" Jun 03 15:49:09.231136 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:09.230797 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tqbmw" podUID="53b1660f-0dbd-42e9-beab-6df46454d8a6" Jun 03 15:49:10.230857 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:10.230779 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zl2xd" Jun 03 15:49:10.231282 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:10.230909 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zl2xd" podUID="5aa0ffe1-5bf5-47f0-9814-d639c23b597f" Jun 03 15:49:10.231282 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:10.231164 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnf9x" Jun 03 15:49:10.231408 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:10.231290 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnf9x" podUID="dd3517b6-8b26-4614-a559-162258f28dbf" Jun 03 15:49:11.230067 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:11.230026 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tqbmw" Jun 03 15:49:11.230223 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:11.230164 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tqbmw" podUID="53b1660f-0dbd-42e9-beab-6df46454d8a6" Jun 03 15:49:11.995135 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:11.995096 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd3517b6-8b26-4614-a559-162258f28dbf-original-pull-secret\") pod \"global-pull-secret-syncer-gnf9x\" (UID: \"dd3517b6-8b26-4614-a559-162258f28dbf\") " pod="kube-system/global-pull-secret-syncer-gnf9x" Jun 03 15:49:11.995538 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:11.995239 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 15:49:11.995538 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:11.995314 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd3517b6-8b26-4614-a559-162258f28dbf-original-pull-secret podName:dd3517b6-8b26-4614-a559-162258f28dbf nodeName:}" failed. No retries permitted until 2026-06-03 15:49:19.995293046 +0000 UTC m=+20.352288162 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd3517b6-8b26-4614-a559-162258f28dbf-original-pull-secret") pod "global-pull-secret-syncer-gnf9x" (UID: "dd3517b6-8b26-4614-a559-162258f28dbf") : object "kube-system"/"original-pull-secret" not registered Jun 03 15:49:12.230792 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:12.230762 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnf9x" Jun 03 15:49:12.230930 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:12.230807 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zl2xd" Jun 03 15:49:12.230930 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:12.230875 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnf9x" podUID="dd3517b6-8b26-4614-a559-162258f28dbf" Jun 03 15:49:12.231039 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:12.230997 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zl2xd" podUID="5aa0ffe1-5bf5-47f0-9814-d639c23b597f" Jun 03 15:49:13.229719 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:13.229685 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tqbmw" Jun 03 15:49:13.230165 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:13.229801 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tqbmw" podUID="53b1660f-0dbd-42e9-beab-6df46454d8a6" Jun 03 15:49:14.230043 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:14.230010 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zl2xd" Jun 03 15:49:14.230549 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:14.230009 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnf9x" Jun 03 15:49:14.230549 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:14.230137 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zl2xd" podUID="5aa0ffe1-5bf5-47f0-9814-d639c23b597f" Jun 03 15:49:14.230549 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:14.230269 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnf9x" podUID="dd3517b6-8b26-4614-a559-162258f28dbf" Jun 03 15:49:15.230553 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:15.230519 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tqbmw" Jun 03 15:49:15.231028 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:15.230653 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tqbmw" podUID="53b1660f-0dbd-42e9-beab-6df46454d8a6" Jun 03 15:49:16.230259 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:16.230217 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnf9x" Jun 03 15:49:16.230418 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:16.230262 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zl2xd" Jun 03 15:49:16.230418 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:16.230346 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnf9x" podUID="dd3517b6-8b26-4614-a559-162258f28dbf" Jun 03 15:49:16.230532 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:16.230497 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zl2xd" podUID="5aa0ffe1-5bf5-47f0-9814-d639c23b597f" Jun 03 15:49:16.936117 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:16.936077 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5aa0ffe1-5bf5-47f0-9814-d639c23b597f-metrics-certs\") pod \"network-metrics-daemon-zl2xd\" (UID: \"5aa0ffe1-5bf5-47f0-9814-d639c23b597f\") " pod="openshift-multus/network-metrics-daemon-zl2xd" Jun 03 15:49:16.936574 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:16.936213 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:49:16.936574 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:16.936284 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5aa0ffe1-5bf5-47f0-9814-d639c23b597f-metrics-certs podName:5aa0ffe1-5bf5-47f0-9814-d639c23b597f nodeName:}" failed. No retries permitted until 2026-06-03 15:49:32.936262125 +0000 UTC m=+33.293257238 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5aa0ffe1-5bf5-47f0-9814-d639c23b597f-metrics-certs") pod "network-metrics-daemon-zl2xd" (UID: "5aa0ffe1-5bf5-47f0-9814-d639c23b597f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:49:17.037159 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:17.037118 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dh68w\" (UniqueName: \"kubernetes.io/projected/53b1660f-0dbd-42e9-beab-6df46454d8a6-kube-api-access-dh68w\") pod \"network-check-target-tqbmw\" (UID: \"53b1660f-0dbd-42e9-beab-6df46454d8a6\") " pod="openshift-network-diagnostics/network-check-target-tqbmw" Jun 03 15:49:17.037332 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:17.037283 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:49:17.037332 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:17.037303 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:49:17.037332 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:17.037318 2573 projected.go:194] Error preparing data for projected volume kube-api-access-dh68w for pod openshift-network-diagnostics/network-check-target-tqbmw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:49:17.037532 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:17.037385 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53b1660f-0dbd-42e9-beab-6df46454d8a6-kube-api-access-dh68w podName:53b1660f-0dbd-42e9-beab-6df46454d8a6 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:33.037365133 +0000 UTC m=+33.394360259 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-dh68w" (UniqueName: "kubernetes.io/projected/53b1660f-0dbd-42e9-beab-6df46454d8a6-kube-api-access-dh68w") pod "network-check-target-tqbmw" (UID: "53b1660f-0dbd-42e9-beab-6df46454d8a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:49:17.229991 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:17.229915 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tqbmw" Jun 03 15:49:17.230155 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:17.230030 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tqbmw" podUID="53b1660f-0dbd-42e9-beab-6df46454d8a6" Jun 03 15:49:18.230543 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:18.230506 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnf9x" Jun 03 15:49:18.230543 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:18.230551 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zl2xd" Jun 03 15:49:18.231042 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:18.230642 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnf9x" podUID="dd3517b6-8b26-4614-a559-162258f28dbf" Jun 03 15:49:18.231042 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:18.230793 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zl2xd" podUID="5aa0ffe1-5bf5-47f0-9814-d639c23b597f" Jun 03 15:49:19.230763 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:19.230709 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tqbmw" Jun 03 15:49:19.231319 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:19.230850 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tqbmw" podUID="53b1660f-0dbd-42e9-beab-6df46454d8a6" Jun 03 15:49:20.060196 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:20.059944 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd3517b6-8b26-4614-a559-162258f28dbf-original-pull-secret\") pod \"global-pull-secret-syncer-gnf9x\" (UID: \"dd3517b6-8b26-4614-a559-162258f28dbf\") " pod="kube-system/global-pull-secret-syncer-gnf9x" Jun 03 15:49:20.060298 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:20.060075 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 15:49:20.060298 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:20.060296 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd3517b6-8b26-4614-a559-162258f28dbf-original-pull-secret podName:dd3517b6-8b26-4614-a559-162258f28dbf nodeName:}" failed. No retries permitted until 2026-06-03 15:49:36.060274369 +0000 UTC m=+36.417269482 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd3517b6-8b26-4614-a559-162258f28dbf-original-pull-secret") pod "global-pull-secret-syncer-gnf9x" (UID: "dd3517b6-8b26-4614-a559-162258f28dbf") : object "kube-system"/"original-pull-secret" not registered Jun 03 15:49:20.230539 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:20.230515 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zl2xd" Jun 03 15:49:20.230625 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:20.230516 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnf9x" Jun 03 15:49:20.230695 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:20.230669 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnf9x" podUID="dd3517b6-8b26-4614-a559-162258f28dbf" Jun 03 15:49:20.230732 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:20.230603 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zl2xd" podUID="5aa0ffe1-5bf5-47f0-9814-d639c23b597f" Jun 03 15:49:21.230583 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:21.230547 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tqbmw" Jun 03 15:49:21.231260 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:21.230689 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tqbmw" podUID="53b1660f-0dbd-42e9-beab-6df46454d8a6" Jun 03 15:49:21.421390 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:21.421298 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-30.ec2.internal" event={"ID":"1ea1fc29e200e4220b7c6bf0d70a6719","Type":"ContainerStarted","Data":"7aeee748b708254a3c0f8666205e1918d2b5566654be7d4282852a7ed950fb72"} Jun 03 15:49:21.422940 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:21.422908 2573 generic.go:358] "Generic (PLEG): container finished" podID="eb474f5b54e62ac3180cf68c21914d92" containerID="ed876d82a6c92288d455a01ede0fc39f032099573d37306c4e137ca8d4e82187" exitCode=0 Jun 03 15:49:21.423070 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:21.422988 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-30.ec2.internal" event={"ID":"eb474f5b54e62ac3180cf68c21914d92","Type":"ContainerDied","Data":"ed876d82a6c92288d455a01ede0fc39f032099573d37306c4e137ca8d4e82187"} Jun 03 15:49:21.424598 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:21.424572 2573 generic.go:358] "Generic (PLEG): container finished" podID="b1c958f9-beb1-4a9f-9675-653a29fe49fd" containerID="e6c1d4b850aa648b5715ca1fb75afeb05a72e1d0546fc548b0c44319b5b809e0" exitCode=0 Jun 03 15:49:21.424684 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:21.424636 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mfjbh" event={"ID":"b1c958f9-beb1-4a9f-9675-653a29fe49fd","Type":"ContainerDied","Data":"e6c1d4b850aa648b5715ca1fb75afeb05a72e1d0546fc548b0c44319b5b809e0"} Jun 03 15:49:21.426031 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:21.426008 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ntc9t" event={"ID":"738f714c-1988-41e8-9eb6-8ee92d4f07d5","Type":"ContainerStarted","Data":"0b4a1436e6a37171edd303d7a6578f05442b51a6ab8b611d11af0e75f6d8974c"} Jun 03 15:49:21.427569 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:21.427547 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zqg8b" event={"ID":"af92e0dd-a3c0-4993-a37a-edd0d027a43f","Type":"ContainerStarted","Data":"d13c105a3a499632b7edce70ae88e7200026f4d34e011a8995dd68e011f440a1"} Jun 03 15:49:21.428894 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:21.428874 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nzf52" event={"ID":"0bc1339f-a919-4ead-8f5f-272a36a862c2","Type":"ContainerStarted","Data":"05c2521370013c1360d6c6460d160acdbb1353d73b29575a67d31b46287652c9"} Jun 03 15:49:21.430187 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:21.430165 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ptnm6" event={"ID":"a09fb6d9-72f4-4139-b3ca-77c2889be355","Type":"ContainerStarted","Data":"4391ad83754f819a9bd6e7a2b8b08c146a9172b81da38858b25c1e6fd306c280"} Jun 03 15:49:21.431584 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:21.431539 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8dhbv" event={"ID":"1805c9c3-3e37-4b81-bd24-a6253025eed2","Type":"ContainerStarted","Data":"e9123b5e18878958213639c940117eafd96466faefdbcfb0538df02b0aa10616"} Jun 03 15:49:21.434517 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:21.434495 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" event={"ID":"52874ebd-3611-402b-bc80-fa65b5ca8b54","Type":"ContainerStarted","Data":"200f1f587eb031c03be3e8e30f7372b5c9c16a19e8add9b8c544600ebde9cc2a"} Jun 03 15:49:21.434610 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:21.434524 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" event={"ID":"52874ebd-3611-402b-bc80-fa65b5ca8b54","Type":"ContainerStarted","Data":"f8a58c82be071df6867948a2c860fe5bf1992e89f57bce4a3576939cc5faf745"} Jun 03 15:49:21.434610 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:21.434541 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" event={"ID":"52874ebd-3611-402b-bc80-fa65b5ca8b54","Type":"ContainerStarted","Data":"f9aa4e7a62462494d8fec5639a51734b3045be29d10c34793e5f9318f90ddcfc"} Jun 03 15:49:21.434610 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:21.434554 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" event={"ID":"52874ebd-3611-402b-bc80-fa65b5ca8b54","Type":"ContainerStarted","Data":"199d3aa782874976f491c395db0163daeecde41d0f8762f21f88d272dd988421"} Jun 03 15:49:21.434610 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:21.434566 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" event={"ID":"52874ebd-3611-402b-bc80-fa65b5ca8b54","Type":"ContainerStarted","Data":"f99c58192b23d80e78910ab40cd288a26805a1278c47ee04367641e3bb4aa16d"} Jun 03 15:49:21.434610 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:21.434578 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" event={"ID":"52874ebd-3611-402b-bc80-fa65b5ca8b54","Type":"ContainerStarted","Data":"214014a7bf3d89b41a45ba998e4af8746e4d5eac1b9d0e923f3f29beeab1fbb1"} Jun 03 15:49:21.435883 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:21.435846 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9sqjn" event={"ID":"f1075e32-8d0e-4ca6-8cd9-4d2d337ce213","Type":"ContainerStarted","Data":"3c91e73fb9098ea35aabb018b99d13dc879f55ec1e93bcb655f9e144fd53af81"} Jun 03 15:49:21.437289 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:21.437238 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-30.ec2.internal" podStartSLOduration=20.43722057 podStartE2EDuration="20.43722057s" podCreationTimestamp="2026-06-03 15:49:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:49:21.436646583 +0000 UTC m=+21.793641716" watchObservedRunningTime="2026-06-03 15:49:21.43722057 +0000 UTC m=+21.794215703" Jun 03 15:49:21.452409 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:21.452369 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-nzf52" podStartSLOduration=2.850661113 podStartE2EDuration="21.452353116s" podCreationTimestamp="2026-06-03 15:49:00 +0000 UTC" firstStartedPulling="2026-06-03 15:49:01.468897063 +0000 UTC m=+1.825892177" lastFinishedPulling="2026-06-03 15:49:20.070589056 +0000 UTC m=+20.427584180" observedRunningTime="2026-06-03 15:49:21.452116673 +0000 UTC m=+21.809111805" watchObservedRunningTime="2026-06-03 15:49:21.452353116 +0000 UTC m=+21.809348307" Jun 03 15:49:21.495266 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:21.495220 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zqg8b" podStartSLOduration=2.896393544 podStartE2EDuration="21.495206354s" podCreationTimestamp="2026-06-03 15:49:00 +0000 UTC" firstStartedPulling="2026-06-03 15:49:01.47162562 +0000 UTC m=+1.828620733" lastFinishedPulling="2026-06-03 15:49:20.070438418 +0000 UTC m=+20.427433543" observedRunningTime="2026-06-03 15:49:21.494577326 +0000 UTC m=+21.851572457" watchObservedRunningTime="2026-06-03 15:49:21.495206354 +0000 UTC m=+21.852201486" Jun 03 15:49:21.495376 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:21.495321 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-8dhbv" podStartSLOduration=2.609010451 podStartE2EDuration="21.495313796s" podCreationTimestamp="2026-06-03 15:49:00 +0000 UTC" firstStartedPulling="2026-06-03 15:49:01.478535712 +0000 UTC m=+1.835530825" lastFinishedPulling="2026-06-03 15:49:20.364839056 +0000 UTC m=+20.721834170" observedRunningTime="2026-06-03 15:49:21.4735662 +0000 UTC m=+21.830561330" watchObservedRunningTime="2026-06-03 15:49:21.495313796 +0000 UTC m=+21.852308928" Jun 03 15:49:21.514046 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:21.513994 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ntc9t" podStartSLOduration=3.01154839 podStartE2EDuration="21.513978571s" podCreationTimestamp="2026-06-03 15:49:00 +0000 UTC" firstStartedPulling="2026-06-03 15:49:01.48987836 +0000 UTC m=+1.846873483" lastFinishedPulling="2026-06-03 15:49:19.99230854 +0000 UTC m=+20.349303664" observedRunningTime="2026-06-03 15:49:21.513424704 +0000 UTC m=+21.870419837" watchObservedRunningTime="2026-06-03 15:49:21.513978571 +0000 UTC m=+21.870973704" Jun 03 15:49:21.694749 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:21.694723 2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 15:49:22.166847 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:22.166748 2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T15:49:21.694742103Z","UUID":"7855a4c2-8eb1-4b12-904d-1deca394261e","Handler":null,"Name":"","Endpoint":""} Jun 03 15:49:22.169811 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:22.169790 2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 15:49:22.169811 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:22.169815 2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 15:49:22.230110 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:22.230085 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zl2xd" Jun 03 15:49:22.230273 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:22.230090 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnf9x" Jun 03 15:49:22.230273 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:22.230190 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zl2xd" podUID="5aa0ffe1-5bf5-47f0-9814-d639c23b597f" Jun 03 15:49:22.230368 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:22.230271 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnf9x" podUID="dd3517b6-8b26-4614-a559-162258f28dbf" Jun 03 15:49:22.439876 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:22.439797 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ptnm6" event={"ID":"a09fb6d9-72f4-4139-b3ca-77c2889be355","Type":"ContainerStarted","Data":"cda67473cef0bdbe95a5a63a0f65d69303368a4fc9cd74a861ec686139de64b4"} Jun 03 15:49:22.441423 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:22.441395 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2wb84" event={"ID":"3d08c149-ddb9-494c-9e84-5d4b8192035f","Type":"ContainerStarted","Data":"42a2094591260f7df36e997ab49266eed9fd6589a58295d57a68fee50159df6e"} Jun 03 15:49:22.443529 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:22.443448 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-30.ec2.internal" event={"ID":"eb474f5b54e62ac3180cf68c21914d92","Type":"ContainerStarted","Data":"24865e7756426af94f4aba2e40d58f5e5b50c2bd3349c31dea4101b715843d01"} Jun 03 15:49:22.479707 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:22.479640 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9sqjn" podStartSLOduration=3.77768969 podStartE2EDuration="22.479623921s" podCreationTimestamp="2026-06-03 15:49:00 +0000 UTC" firstStartedPulling="2026-06-03 15:49:01.434072052 +0000 UTC m=+1.791067162" lastFinishedPulling="2026-06-03 15:49:20.136006269 +0000 UTC m=+20.493001393" observedRunningTime="2026-06-03 15:49:21.578255574 +0000 UTC m=+21.935250707" watchObservedRunningTime="2026-06-03 15:49:22.479623921 +0000 UTC m=+22.836619054" Jun 03 15:49:22.510747 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:22.510699 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-30.ec2.internal" podStartSLOduration=21.510686409 podStartE2EDuration="21.510686409s" podCreationTimestamp="2026-06-03 15:49:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:49:22.509516106 +0000 UTC m=+22.866511238" watchObservedRunningTime="2026-06-03 15:49:22.510686409 +0000 UTC m=+22.867681538" Jun 03 15:49:22.510961 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:22.510942 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2wb84" podStartSLOduration=3.8574592340000002 podStartE2EDuration="22.510937534s" podCreationTimestamp="2026-06-03 15:49:00 +0000 UTC" firstStartedPulling="2026-06-03 15:49:01.485841252 +0000 UTC m=+1.842836363" lastFinishedPulling="2026-06-03 15:49:20.139319543 +0000 UTC m=+20.496314663" observedRunningTime="2026-06-03 15:49:22.47920004 +0000 UTC m=+22.836195172" watchObservedRunningTime="2026-06-03 15:49:22.510937534 +0000 UTC m=+22.867932712" Jun 03 15:49:23.230403 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:23.230368 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tqbmw" Jun 03 15:49:23.230653 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:23.230516 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tqbmw" podUID="53b1660f-0dbd-42e9-beab-6df46454d8a6" Jun 03 15:49:23.447955 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:23.447861 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ptnm6" event={"ID":"a09fb6d9-72f4-4139-b3ca-77c2889be355","Type":"ContainerStarted","Data":"c649a08befd08f6d9efcc50db74c4e98c949d31a48122a279bffea0f334c27ac"} Jun 03 15:49:23.450520 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:23.450496 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" event={"ID":"52874ebd-3611-402b-bc80-fa65b5ca8b54","Type":"ContainerStarted","Data":"b8884973664880f01380f455ea30cbe451e58399cc250ba2f94b90db4b20ab1f"} Jun 03 15:49:23.930607 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:23.930573 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ntc9t" Jun 03 15:49:23.931310 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:23.931277 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ntc9t" Jun 03 15:49:23.951198 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:23.951147 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ptnm6" podStartSLOduration=2.697481118 podStartE2EDuration="23.951129625s" podCreationTimestamp="2026-06-03 15:49:00 +0000 UTC" firstStartedPulling="2026-06-03 15:49:01.496641267 +0000 UTC m=+1.853636391" lastFinishedPulling="2026-06-03 15:49:22.750289742 +0000 UTC m=+23.107284898" observedRunningTime="2026-06-03 15:49:23.48088222 +0000 UTC m=+23.837877351" watchObservedRunningTime="2026-06-03 15:49:23.951129625 +0000 UTC m=+24.308124758" Jun 03 15:49:24.230544 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:24.230493 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnf9x" Jun 03 15:49:24.230723 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:24.230697 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnf9x" podUID="dd3517b6-8b26-4614-a559-162258f28dbf" Jun 03 15:49:24.230776 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:24.230741 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zl2xd" Jun 03 15:49:24.230922 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:24.230882 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zl2xd" podUID="5aa0ffe1-5bf5-47f0-9814-d639c23b597f" Jun 03 15:49:24.452544 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:24.452515 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ntc9t" Jun 03 15:49:24.452945 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:24.452815 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ntc9t" Jun 03 15:49:25.230006 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:25.229974 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tqbmw" Jun 03 15:49:25.230164 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:25.230103 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tqbmw" podUID="53b1660f-0dbd-42e9-beab-6df46454d8a6" Jun 03 15:49:26.230927 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:26.230726 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnf9x" Jun 03 15:49:26.231342 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:26.230799 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zl2xd" Jun 03 15:49:26.231342 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:26.231040 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnf9x" podUID="dd3517b6-8b26-4614-a559-162258f28dbf" Jun 03 15:49:26.231342 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:26.231115 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zl2xd" podUID="5aa0ffe1-5bf5-47f0-9814-d639c23b597f" Jun 03 15:49:26.458826 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:26.458784 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" event={"ID":"52874ebd-3611-402b-bc80-fa65b5ca8b54","Type":"ContainerStarted","Data":"4618f4c4078f3649b04fe43cf92105c29e209e22f1a643e6b1da31cd4c8b9291"} Jun 03 15:49:26.459056 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:26.459039 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:26.459143 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:26.459064 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:26.460542 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:26.460515 2573 generic.go:358] "Generic (PLEG): container finished" podID="b1c958f9-beb1-4a9f-9675-653a29fe49fd" containerID="63c7a953e98d1bbc1f631dafe4fa1a7f5c578275060a9bb691f10c645cc41f28" exitCode=0 Jun 03 15:49:26.460651 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:26.460594 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mfjbh" event={"ID":"b1c958f9-beb1-4a9f-9675-653a29fe49fd","Type":"ContainerDied","Data":"63c7a953e98d1bbc1f631dafe4fa1a7f5c578275060a9bb691f10c645cc41f28"} Jun 03 15:49:26.474457 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:26.474400 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:26.604075 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:26.603992 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" podStartSLOduration=7.573072166 podStartE2EDuration="26.603976566s" podCreationTimestamp="2026-06-03 15:49:00 +0000 UTC" firstStartedPulling="2026-06-03 15:49:01.458426374 +0000 UTC m=+1.815421484" lastFinishedPulling="2026-06-03 15:49:20.489330773 +0000 UTC m=+20.846325884" observedRunningTime="2026-06-03 15:49:26.53098037 +0000 UTC m=+26.887975501" watchObservedRunningTime="2026-06-03 15:49:26.603976566 +0000 UTC m=+26.960971699" Jun 03 15:49:27.230245 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:27.230215 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tqbmw" Jun 03 15:49:27.230548 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:27.230338 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tqbmw" podUID="53b1660f-0dbd-42e9-beab-6df46454d8a6" Jun 03 15:49:27.464454 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:27.464419 2573 generic.go:358] "Generic (PLEG): container finished" podID="b1c958f9-beb1-4a9f-9675-653a29fe49fd" containerID="1aeded900ff9428945f78bb01d640d6edc1b6b27e6e425fa21d4d804fa97c10e" exitCode=0 Jun 03 15:49:27.464955 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:27.464513 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mfjbh" event={"ID":"b1c958f9-beb1-4a9f-9675-653a29fe49fd","Type":"ContainerDied","Data":"1aeded900ff9428945f78bb01d640d6edc1b6b27e6e425fa21d4d804fa97c10e"} Jun 03 15:49:27.465027 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:27.465003 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:27.479698 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:27.479679 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:28.230073 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:28.229892 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zl2xd" Jun 03 15:49:28.230244 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:28.229933 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnf9x" Jun 03 15:49:28.230244 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:28.230150 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zl2xd" podUID="5aa0ffe1-5bf5-47f0-9814-d639c23b597f" Jun 03 15:49:28.230244 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:28.230213 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnf9x" podUID="dd3517b6-8b26-4614-a559-162258f28dbf" Jun 03 15:49:28.358796 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:28.358770 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gnf9x"] Jun 03 15:49:28.371040 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:28.371018 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zl2xd"] Jun 03 15:49:28.372052 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:28.371991 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tqbmw"] Jun 03 15:49:28.372158 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:28.372106 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tqbmw" Jun 03 15:49:28.372233 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:28.372205 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tqbmw" podUID="53b1660f-0dbd-42e9-beab-6df46454d8a6" Jun 03 15:49:28.468795 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:28.468761 2573 generic.go:358] "Generic (PLEG): container finished" podID="b1c958f9-beb1-4a9f-9675-653a29fe49fd" containerID="989ca7e75546058103798d2e0fa0bc588e7c8d46708ceba3f17b41995fd9ac74" exitCode=0 Jun 03 15:49:28.469229 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:28.468816 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mfjbh" event={"ID":"b1c958f9-beb1-4a9f-9675-653a29fe49fd","Type":"ContainerDied","Data":"989ca7e75546058103798d2e0fa0bc588e7c8d46708ceba3f17b41995fd9ac74"} Jun 03 15:49:28.469229 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:28.468991 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnf9x" Jun 03 15:49:28.469229 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:28.469090 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zl2xd" Jun 03 15:49:28.469229 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:28.469090 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnf9x" podUID="dd3517b6-8b26-4614-a559-162258f28dbf" Jun 03 15:49:28.469229 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:28.469178 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zl2xd" podUID="5aa0ffe1-5bf5-47f0-9814-d639c23b597f" Jun 03 15:49:30.231021 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:30.230986 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zl2xd" Jun 03 15:49:30.231436 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:30.231074 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tqbmw" Jun 03 15:49:30.231436 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:30.231100 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnf9x" Jun 03 15:49:30.231436 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:30.231122 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zl2xd" podUID="5aa0ffe1-5bf5-47f0-9814-d639c23b597f" Jun 03 15:49:30.231436 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:30.231147 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnf9x" podUID="dd3517b6-8b26-4614-a559-162258f28dbf" Jun 03 15:49:30.231436 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:30.231243 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tqbmw" podUID="53b1660f-0dbd-42e9-beab-6df46454d8a6" Jun 03 15:49:32.230160 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:32.230128 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tqbmw" Jun 03 15:49:32.230669 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:32.230130 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnf9x" Jun 03 15:49:32.230669 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:32.230232 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tqbmw" podUID="53b1660f-0dbd-42e9-beab-6df46454d8a6" Jun 03 15:49:32.230669 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:32.230130 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zl2xd" Jun 03 15:49:32.230669 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:32.230316 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnf9x" podUID="dd3517b6-8b26-4614-a559-162258f28dbf" Jun 03 15:49:32.230669 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:32.230404 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zl2xd" podUID="5aa0ffe1-5bf5-47f0-9814-d639c23b597f" Jun 03 15:49:32.961358 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:32.961334 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5aa0ffe1-5bf5-47f0-9814-d639c23b597f-metrics-certs\") pod \"network-metrics-daemon-zl2xd\" (UID: \"5aa0ffe1-5bf5-47f0-9814-d639c23b597f\") " pod="openshift-multus/network-metrics-daemon-zl2xd" Jun 03 15:49:32.961536 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:32.961516 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:49:32.961590 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:32.961584 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5aa0ffe1-5bf5-47f0-9814-d639c23b597f-metrics-certs podName:5aa0ffe1-5bf5-47f0-9814-d639c23b597f nodeName:}" failed. No retries permitted until 2026-06-03 15:50:04.961568671 +0000 UTC m=+65.318563781 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5aa0ffe1-5bf5-47f0-9814-d639c23b597f-metrics-certs") pod "network-metrics-daemon-zl2xd" (UID: "5aa0ffe1-5bf5-47f0-9814-d639c23b597f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:49:33.062231 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.062180 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dh68w\" (UniqueName: \"kubernetes.io/projected/53b1660f-0dbd-42e9-beab-6df46454d8a6-kube-api-access-dh68w\") pod \"network-check-target-tqbmw\" (UID: \"53b1660f-0dbd-42e9-beab-6df46454d8a6\") " pod="openshift-network-diagnostics/network-check-target-tqbmw" Jun 03 15:49:33.062420 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:33.062372 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:49:33.062420 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:33.062395 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:49:33.062420 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:33.062408 2573 projected.go:194] Error preparing data for projected volume kube-api-access-dh68w for pod openshift-network-diagnostics/network-check-target-tqbmw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:49:33.062582 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:33.062495 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53b1660f-0dbd-42e9-beab-6df46454d8a6-kube-api-access-dh68w podName:53b1660f-0dbd-42e9-beab-6df46454d8a6 nodeName:}" failed. No retries permitted until 2026-06-03 15:50:05.062456514 +0000 UTC m=+65.419451628 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-dh68w" (UniqueName: "kubernetes.io/projected/53b1660f-0dbd-42e9-beab-6df46454d8a6-kube-api-access-dh68w") pod "network-check-target-tqbmw" (UID: "53b1660f-0dbd-42e9-beab-6df46454d8a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:49:33.511044 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.511019 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-30.ec2.internal" event="NodeReady" Jun 03 15:49:33.511530 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.511157 2573 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 03 15:49:33.656691 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.656658 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6b56bd68f7-rvm5v"] Jun 03 15:49:33.682488 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.682446 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b56bd68f7-rvm5v" Jun 03 15:49:33.706159 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.706122 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-q22fp\"" Jun 03 15:49:33.706532 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.706502 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 03 15:49:33.706714 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.706694 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 03 15:49:33.706843 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.706823 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 03 15:49:33.715981 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.715955 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b56bd68f7-rvm5v"] Jun 03 15:49:33.717142 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.717118 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 03 15:49:33.719421 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.719398 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8sgrl"] Jun 03 15:49:33.735156 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.735129 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tp8vd"] Jun 03 15:49:33.735156 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.735147 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8sgrl" Jun 03 15:49:33.740875 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.740854 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 15:49:33.741369 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.741146 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 15:49:33.741369 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.741224 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9fs7s\"" Jun 03 15:49:33.741543 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.741510 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 15:49:33.751340 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.751321 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tp8vd" Jun 03 15:49:33.755421 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.755404 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 15:49:33.755598 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.755581 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5tk8p\"" Jun 03 15:49:33.755598 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.755595 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 15:49:33.759449 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.759423 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8sgrl"] Jun 03 15:49:33.767085 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.767037 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tp8vd"] Jun 03 15:49:33.868369 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.868332 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2298cc45-cdd7-4fca-a51e-94a79e892855-config-volume\") pod \"dns-default-tp8vd\" (UID: \"2298cc45-cdd7-4fca-a51e-94a79e892855\") " pod="openshift-dns/dns-default-tp8vd" Jun 03 15:49:33.868369 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.868366 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2298cc45-cdd7-4fca-a51e-94a79e892855-tmp-dir\") pod \"dns-default-tp8vd\" (UID: \"2298cc45-cdd7-4fca-a51e-94a79e892855\") " pod="openshift-dns/dns-default-tp8vd" Jun 03 15:49:33.868638 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.868385 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/88eb993b-a44b-4f59-ab46-94d0e28b29d3-bound-sa-token\") pod \"image-registry-6b56bd68f7-rvm5v\" (UID: \"88eb993b-a44b-4f59-ab46-94d0e28b29d3\") " pod="openshift-image-registry/image-registry-6b56bd68f7-rvm5v" Jun 03 15:49:33.868638 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.868408 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac827321-cac1-4344-a714-31cb7d92d0b1-cert\") pod \"ingress-canary-8sgrl\" (UID: \"ac827321-cac1-4344-a714-31cb7d92d0b1\") " pod="openshift-ingress-canary/ingress-canary-8sgrl" Jun 03 15:49:33.868638 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.868430 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2298cc45-cdd7-4fca-a51e-94a79e892855-metrics-tls\") pod \"dns-default-tp8vd\" (UID: \"2298cc45-cdd7-4fca-a51e-94a79e892855\") " pod="openshift-dns/dns-default-tp8vd" Jun 03 15:49:33.868638 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.868498 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vt2ln\" (UniqueName: \"kubernetes.io/projected/2298cc45-cdd7-4fca-a51e-94a79e892855-kube-api-access-vt2ln\") pod \"dns-default-tp8vd\" (UID: \"2298cc45-cdd7-4fca-a51e-94a79e892855\") " pod="openshift-dns/dns-default-tp8vd" Jun 03 15:49:33.868638 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.868569 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/88eb993b-a44b-4f59-ab46-94d0e28b29d3-ca-trust-extracted\") pod \"image-registry-6b56bd68f7-rvm5v\" (UID: \"88eb993b-a44b-4f59-ab46-94d0e28b29d3\") " pod="openshift-image-registry/image-registry-6b56bd68f7-rvm5v" Jun 03 15:49:33.868638 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.868603 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/88eb993b-a44b-4f59-ab46-94d0e28b29d3-registry-tls\") pod \"image-registry-6b56bd68f7-rvm5v\" (UID: \"88eb993b-a44b-4f59-ab46-94d0e28b29d3\") " pod="openshift-image-registry/image-registry-6b56bd68f7-rvm5v" Jun 03 15:49:33.868938 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.868649 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/88eb993b-a44b-4f59-ab46-94d0e28b29d3-registry-certificates\") pod \"image-registry-6b56bd68f7-rvm5v\" (UID: \"88eb993b-a44b-4f59-ab46-94d0e28b29d3\") " pod="openshift-image-registry/image-registry-6b56bd68f7-rvm5v" Jun 03 15:49:33.868938 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.868684 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/88eb993b-a44b-4f59-ab46-94d0e28b29d3-installation-pull-secrets\") pod \"image-registry-6b56bd68f7-rvm5v\" (UID: \"88eb993b-a44b-4f59-ab46-94d0e28b29d3\") " pod="openshift-image-registry/image-registry-6b56bd68f7-rvm5v" Jun 03 15:49:33.868938 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.868727 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/88eb993b-a44b-4f59-ab46-94d0e28b29d3-trusted-ca\") pod \"image-registry-6b56bd68f7-rvm5v\" (UID: \"88eb993b-a44b-4f59-ab46-94d0e28b29d3\") " pod="openshift-image-registry/image-registry-6b56bd68f7-rvm5v" Jun 03 15:49:33.868938 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.868766 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/88eb993b-a44b-4f59-ab46-94d0e28b29d3-image-registry-private-configuration\") pod \"image-registry-6b56bd68f7-rvm5v\" (UID: \"88eb993b-a44b-4f59-ab46-94d0e28b29d3\") " pod="openshift-image-registry/image-registry-6b56bd68f7-rvm5v" Jun 03 15:49:33.868938 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.868815 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncn6x\" (UniqueName: \"kubernetes.io/projected/88eb993b-a44b-4f59-ab46-94d0e28b29d3-kube-api-access-ncn6x\") pod \"image-registry-6b56bd68f7-rvm5v\" (UID: \"88eb993b-a44b-4f59-ab46-94d0e28b29d3\") " pod="openshift-image-registry/image-registry-6b56bd68f7-rvm5v" Jun 03 15:49:33.868938 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.868832 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttkfx\" (UniqueName: \"kubernetes.io/projected/ac827321-cac1-4344-a714-31cb7d92d0b1-kube-api-access-ttkfx\") pod \"ingress-canary-8sgrl\" (UID: \"ac827321-cac1-4344-a714-31cb7d92d0b1\") " pod="openshift-ingress-canary/ingress-canary-8sgrl" Jun 03 15:49:33.969790 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.969753 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/88eb993b-a44b-4f59-ab46-94d0e28b29d3-installation-pull-secrets\") pod \"image-registry-6b56bd68f7-rvm5v\" (UID: \"88eb993b-a44b-4f59-ab46-94d0e28b29d3\") " pod="openshift-image-registry/image-registry-6b56bd68f7-rvm5v" Jun 03 15:49:33.969967 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.969807 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/88eb993b-a44b-4f59-ab46-94d0e28b29d3-trusted-ca\") pod \"image-registry-6b56bd68f7-rvm5v\" (UID: \"88eb993b-a44b-4f59-ab46-94d0e28b29d3\") " pod="openshift-image-registry/image-registry-6b56bd68f7-rvm5v" Jun 03 15:49:33.969967 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.969860 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/88eb993b-a44b-4f59-ab46-94d0e28b29d3-image-registry-private-configuration\") pod \"image-registry-6b56bd68f7-rvm5v\" (UID: \"88eb993b-a44b-4f59-ab46-94d0e28b29d3\") " pod="openshift-image-registry/image-registry-6b56bd68f7-rvm5v" Jun 03 15:49:33.969967 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.969912 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ncn6x\" (UniqueName: \"kubernetes.io/projected/88eb993b-a44b-4f59-ab46-94d0e28b29d3-kube-api-access-ncn6x\") pod \"image-registry-6b56bd68f7-rvm5v\" (UID: \"88eb993b-a44b-4f59-ab46-94d0e28b29d3\") " pod="openshift-image-registry/image-registry-6b56bd68f7-rvm5v" Jun 03 15:49:33.970125 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.969941 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ttkfx\" (UniqueName: \"kubernetes.io/projected/ac827321-cac1-4344-a714-31cb7d92d0b1-kube-api-access-ttkfx\") pod \"ingress-canary-8sgrl\" (UID: \"ac827321-cac1-4344-a714-31cb7d92d0b1\") " pod="openshift-ingress-canary/ingress-canary-8sgrl" Jun 03 15:49:33.970201 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.970185 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2298cc45-cdd7-4fca-a51e-94a79e892855-config-volume\") pod \"dns-default-tp8vd\" (UID: \"2298cc45-cdd7-4fca-a51e-94a79e892855\") " pod="openshift-dns/dns-default-tp8vd" Jun 03 15:49:33.970240 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.970220 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2298cc45-cdd7-4fca-a51e-94a79e892855-tmp-dir\") pod \"dns-default-tp8vd\" (UID: \"2298cc45-cdd7-4fca-a51e-94a79e892855\") " pod="openshift-dns/dns-default-tp8vd" Jun 03 15:49:33.970278 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.970249 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/88eb993b-a44b-4f59-ab46-94d0e28b29d3-bound-sa-token\") pod \"image-registry-6b56bd68f7-rvm5v\" (UID: \"88eb993b-a44b-4f59-ab46-94d0e28b29d3\") " pod="openshift-image-registry/image-registry-6b56bd68f7-rvm5v" Jun 03 15:49:33.970278 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.970272 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac827321-cac1-4344-a714-31cb7d92d0b1-cert\") pod \"ingress-canary-8sgrl\" (UID: \"ac827321-cac1-4344-a714-31cb7d92d0b1\") " pod="openshift-ingress-canary/ingress-canary-8sgrl" Jun 03 15:49:33.970375 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.970295 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2298cc45-cdd7-4fca-a51e-94a79e892855-metrics-tls\") pod \"dns-default-tp8vd\" (UID: \"2298cc45-cdd7-4fca-a51e-94a79e892855\") " pod="openshift-dns/dns-default-tp8vd" Jun 03 15:49:33.970375 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.970325 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vt2ln\" (UniqueName: \"kubernetes.io/projected/2298cc45-cdd7-4fca-a51e-94a79e892855-kube-api-access-vt2ln\") pod \"dns-default-tp8vd\" (UID: \"2298cc45-cdd7-4fca-a51e-94a79e892855\") " pod="openshift-dns/dns-default-tp8vd" Jun 03 15:49:33.970482 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.970388 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/88eb993b-a44b-4f59-ab46-94d0e28b29d3-ca-trust-extracted\") pod \"image-registry-6b56bd68f7-rvm5v\" (UID: \"88eb993b-a44b-4f59-ab46-94d0e28b29d3\") " pod="openshift-image-registry/image-registry-6b56bd68f7-rvm5v" Jun 03 15:49:33.970482 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:33.970413 2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 15:49:33.970590 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:33.970509 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac827321-cac1-4344-a714-31cb7d92d0b1-cert podName:ac827321-cac1-4344-a714-31cb7d92d0b1 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:34.47048716 +0000 UTC m=+34.827482291 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ac827321-cac1-4344-a714-31cb7d92d0b1-cert") pod "ingress-canary-8sgrl" (UID: "ac827321-cac1-4344-a714-31cb7d92d0b1") : secret "canary-serving-cert" not found Jun 03 15:49:33.970590 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:33.970509 2573 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 15:49:33.970590 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:33.970530 2573 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b56bd68f7-rvm5v: secret "image-registry-tls" not found Jun 03 15:49:33.970590 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:33.970566 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/88eb993b-a44b-4f59-ab46-94d0e28b29d3-registry-tls podName:88eb993b-a44b-4f59-ab46-94d0e28b29d3 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:34.470555179 +0000 UTC m=+34.827550295 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/88eb993b-a44b-4f59-ab46-94d0e28b29d3-registry-tls") pod "image-registry-6b56bd68f7-rvm5v" (UID: "88eb993b-a44b-4f59-ab46-94d0e28b29d3") : secret "image-registry-tls" not found Jun 03 15:49:33.970590 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:33.970568 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 15:49:33.970838 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.970615 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2298cc45-cdd7-4fca-a51e-94a79e892855-tmp-dir\") pod \"dns-default-tp8vd\" (UID: \"2298cc45-cdd7-4fca-a51e-94a79e892855\") " pod="openshift-dns/dns-default-tp8vd" Jun 03 15:49:33.970838 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:33.970638 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2298cc45-cdd7-4fca-a51e-94a79e892855-metrics-tls podName:2298cc45-cdd7-4fca-a51e-94a79e892855 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:34.470626675 +0000 UTC m=+34.827621802 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2298cc45-cdd7-4fca-a51e-94a79e892855-metrics-tls") pod "dns-default-tp8vd" (UID: "2298cc45-cdd7-4fca-a51e-94a79e892855") : secret "dns-default-metrics-tls" not found Jun 03 15:49:33.970838 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.970418 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/88eb993b-a44b-4f59-ab46-94d0e28b29d3-registry-tls\") pod \"image-registry-6b56bd68f7-rvm5v\" (UID: \"88eb993b-a44b-4f59-ab46-94d0e28b29d3\") " pod="openshift-image-registry/image-registry-6b56bd68f7-rvm5v" Jun 03 15:49:33.970838 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.970689 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/88eb993b-a44b-4f59-ab46-94d0e28b29d3-registry-certificates\") pod \"image-registry-6b56bd68f7-rvm5v\" (UID: \"88eb993b-a44b-4f59-ab46-94d0e28b29d3\") " pod="openshift-image-registry/image-registry-6b56bd68f7-rvm5v" Jun 03 15:49:33.971032 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.970855 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/88eb993b-a44b-4f59-ab46-94d0e28b29d3-trusted-ca\") pod \"image-registry-6b56bd68f7-rvm5v\" (UID: \"88eb993b-a44b-4f59-ab46-94d0e28b29d3\") " pod="openshift-image-registry/image-registry-6b56bd68f7-rvm5v" Jun 03 15:49:33.971032 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.970859 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2298cc45-cdd7-4fca-a51e-94a79e892855-config-volume\") pod \"dns-default-tp8vd\" (UID: \"2298cc45-cdd7-4fca-a51e-94a79e892855\") " pod="openshift-dns/dns-default-tp8vd" Jun 03 15:49:33.971032 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.971028 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/88eb993b-a44b-4f59-ab46-94d0e28b29d3-ca-trust-extracted\") pod \"image-registry-6b56bd68f7-rvm5v\" (UID: \"88eb993b-a44b-4f59-ab46-94d0e28b29d3\") " pod="openshift-image-registry/image-registry-6b56bd68f7-rvm5v" Jun 03 15:49:33.971187 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.971111 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/88eb993b-a44b-4f59-ab46-94d0e28b29d3-registry-certificates\") pod \"image-registry-6b56bd68f7-rvm5v\" (UID: \"88eb993b-a44b-4f59-ab46-94d0e28b29d3\") " pod="openshift-image-registry/image-registry-6b56bd68f7-rvm5v" Jun 03 15:49:33.974288 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.974266 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/88eb993b-a44b-4f59-ab46-94d0e28b29d3-installation-pull-secrets\") pod \"image-registry-6b56bd68f7-rvm5v\" (UID: \"88eb993b-a44b-4f59-ab46-94d0e28b29d3\") " pod="openshift-image-registry/image-registry-6b56bd68f7-rvm5v" Jun 03 15:49:33.974388 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.974271 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/88eb993b-a44b-4f59-ab46-94d0e28b29d3-image-registry-private-configuration\") pod \"image-registry-6b56bd68f7-rvm5v\" (UID: \"88eb993b-a44b-4f59-ab46-94d0e28b29d3\") " pod="openshift-image-registry/image-registry-6b56bd68f7-rvm5v" Jun 03 15:49:33.984345 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.984317 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncn6x\" (UniqueName: \"kubernetes.io/projected/88eb993b-a44b-4f59-ab46-94d0e28b29d3-kube-api-access-ncn6x\") pod \"image-registry-6b56bd68f7-rvm5v\" (UID: \"88eb993b-a44b-4f59-ab46-94d0e28b29d3\") " pod="openshift-image-registry/image-registry-6b56bd68f7-rvm5v" Jun 03 15:49:33.984518 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.984495 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vt2ln\" (UniqueName: \"kubernetes.io/projected/2298cc45-cdd7-4fca-a51e-94a79e892855-kube-api-access-vt2ln\") pod \"dns-default-tp8vd\" (UID: \"2298cc45-cdd7-4fca-a51e-94a79e892855\") " pod="openshift-dns/dns-default-tp8vd" Jun 03 15:49:33.984747 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.984726 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/88eb993b-a44b-4f59-ab46-94d0e28b29d3-bound-sa-token\") pod \"image-registry-6b56bd68f7-rvm5v\" (UID: \"88eb993b-a44b-4f59-ab46-94d0e28b29d3\") " pod="openshift-image-registry/image-registry-6b56bd68f7-rvm5v" Jun 03 15:49:33.986123 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:33.986101 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttkfx\" (UniqueName: \"kubernetes.io/projected/ac827321-cac1-4344-a714-31cb7d92d0b1-kube-api-access-ttkfx\") pod \"ingress-canary-8sgrl\" (UID: \"ac827321-cac1-4344-a714-31cb7d92d0b1\") " pod="openshift-ingress-canary/ingress-canary-8sgrl" Jun 03 15:49:34.230100 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:34.230056 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnf9x" Jun 03 15:49:34.230100 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:34.230056 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zl2xd" Jun 03 15:49:34.230398 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:34.230070 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tqbmw" Jun 03 15:49:34.234528 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:34.234502 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 15:49:34.234702 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:34.234575 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4qlwk\"" Jun 03 15:49:34.235259 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:34.235109 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 15:49:34.235259 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:34.235173 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 15:49:34.235259 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:34.235204 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nhwds\"" Jun 03 15:49:34.235259 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:34.235212 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 15:49:34.474896 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:34.474858 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac827321-cac1-4344-a714-31cb7d92d0b1-cert\") pod \"ingress-canary-8sgrl\" (UID: \"ac827321-cac1-4344-a714-31cb7d92d0b1\") " pod="openshift-ingress-canary/ingress-canary-8sgrl" Jun 03 15:49:34.475116 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:34.474912 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2298cc45-cdd7-4fca-a51e-94a79e892855-metrics-tls\") pod \"dns-default-tp8vd\" (UID: \"2298cc45-cdd7-4fca-a51e-94a79e892855\") " pod="openshift-dns/dns-default-tp8vd" Jun 03 15:49:34.475116 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:34.474976 2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 15:49:34.475116 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:34.475046 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac827321-cac1-4344-a714-31cb7d92d0b1-cert podName:ac827321-cac1-4344-a714-31cb7d92d0b1 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:35.475027396 +0000 UTC m=+35.832022508 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ac827321-cac1-4344-a714-31cb7d92d0b1-cert") pod "ingress-canary-8sgrl" (UID: "ac827321-cac1-4344-a714-31cb7d92d0b1") : secret "canary-serving-cert" not found Jun 03 15:49:34.475116 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:34.474977 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/88eb993b-a44b-4f59-ab46-94d0e28b29d3-registry-tls\") pod \"image-registry-6b56bd68f7-rvm5v\" (UID: \"88eb993b-a44b-4f59-ab46-94d0e28b29d3\") " pod="openshift-image-registry/image-registry-6b56bd68f7-rvm5v" Jun 03 15:49:34.475116 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:34.475072 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 15:49:34.475333 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:34.475136 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2298cc45-cdd7-4fca-a51e-94a79e892855-metrics-tls podName:2298cc45-cdd7-4fca-a51e-94a79e892855 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:35.47511899 +0000 UTC m=+35.832114101 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2298cc45-cdd7-4fca-a51e-94a79e892855-metrics-tls") pod "dns-default-tp8vd" (UID: "2298cc45-cdd7-4fca-a51e-94a79e892855") : secret "dns-default-metrics-tls" not found Jun 03 15:49:34.475333 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:34.475074 2573 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 15:49:34.475333 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:34.475182 2573 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b56bd68f7-rvm5v: secret "image-registry-tls" not found Jun 03 15:49:34.475333 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:34.475227 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/88eb993b-a44b-4f59-ab46-94d0e28b29d3-registry-tls podName:88eb993b-a44b-4f59-ab46-94d0e28b29d3 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:35.475212889 +0000 UTC m=+35.832208005 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/88eb993b-a44b-4f59-ab46-94d0e28b29d3-registry-tls") pod "image-registry-6b56bd68f7-rvm5v" (UID: "88eb993b-a44b-4f59-ab46-94d0e28b29d3") : secret "image-registry-tls" not found Jun 03 15:49:35.483779 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:35.483752 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mfjbh" event={"ID":"b1c958f9-beb1-4a9f-9675-653a29fe49fd","Type":"ContainerStarted","Data":"4bbfa9707925a0f342a6237c6a0d1af326561ccda78d6a22ed9cf239e4b6be79"} Jun 03 15:49:35.484973 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:35.484950 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/88eb993b-a44b-4f59-ab46-94d0e28b29d3-registry-tls\") pod \"image-registry-6b56bd68f7-rvm5v\" (UID: \"88eb993b-a44b-4f59-ab46-94d0e28b29d3\") " pod="openshift-image-registry/image-registry-6b56bd68f7-rvm5v" Jun 03 15:49:35.485066 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:35.485055 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac827321-cac1-4344-a714-31cb7d92d0b1-cert\") pod \"ingress-canary-8sgrl\" (UID: \"ac827321-cac1-4344-a714-31cb7d92d0b1\") " pod="openshift-ingress-canary/ingress-canary-8sgrl" Jun 03 15:49:35.485125 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:35.485083 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2298cc45-cdd7-4fca-a51e-94a79e892855-metrics-tls\") pod \"dns-default-tp8vd\" (UID: \"2298cc45-cdd7-4fca-a51e-94a79e892855\") " pod="openshift-dns/dns-default-tp8vd" Jun 03 15:49:35.485125 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:35.485090 2573 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 15:49:35.485125 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:35.485105 2573 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b56bd68f7-rvm5v: secret "image-registry-tls" not found Jun 03 15:49:35.485259 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:35.485148 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/88eb993b-a44b-4f59-ab46-94d0e28b29d3-registry-tls podName:88eb993b-a44b-4f59-ab46-94d0e28b29d3 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:37.485134029 +0000 UTC m=+37.842129139 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/88eb993b-a44b-4f59-ab46-94d0e28b29d3-registry-tls") pod "image-registry-6b56bd68f7-rvm5v" (UID: "88eb993b-a44b-4f59-ab46-94d0e28b29d3") : secret "image-registry-tls" not found Jun 03 15:49:35.485259 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:35.485208 2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 15:49:35.485343 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:35.485263 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac827321-cac1-4344-a714-31cb7d92d0b1-cert podName:ac827321-cac1-4344-a714-31cb7d92d0b1 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:37.485245885 +0000 UTC m=+37.842241015 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ac827321-cac1-4344-a714-31cb7d92d0b1-cert") pod "ingress-canary-8sgrl" (UID: "ac827321-cac1-4344-a714-31cb7d92d0b1") : secret "canary-serving-cert" not found Jun 03 15:49:35.485343 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:35.485214 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 15:49:35.485343 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:35.485308 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2298cc45-cdd7-4fca-a51e-94a79e892855-metrics-tls podName:2298cc45-cdd7-4fca-a51e-94a79e892855 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:37.485298921 +0000 UTC m=+37.842294036 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2298cc45-cdd7-4fca-a51e-94a79e892855-metrics-tls") pod "dns-default-tp8vd" (UID: "2298cc45-cdd7-4fca-a51e-94a79e892855") : secret "dns-default-metrics-tls" not found Jun 03 15:49:36.089868 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:36.089832 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd3517b6-8b26-4614-a559-162258f28dbf-original-pull-secret\") pod \"global-pull-secret-syncer-gnf9x\" (UID: \"dd3517b6-8b26-4614-a559-162258f28dbf\") " pod="kube-system/global-pull-secret-syncer-gnf9x" Jun 03 15:49:36.092311 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:36.092281 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd3517b6-8b26-4614-a559-162258f28dbf-original-pull-secret\") pod \"global-pull-secret-syncer-gnf9x\" (UID: \"dd3517b6-8b26-4614-a559-162258f28dbf\") " pod="kube-system/global-pull-secret-syncer-gnf9x" Jun 03 15:49:36.342243 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:36.342166 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnf9x" Jun 03 15:49:36.487441 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:36.487394 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gnf9x"] Jun 03 15:49:36.488375 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:36.488355 2573 generic.go:358] "Generic (PLEG): container finished" podID="b1c958f9-beb1-4a9f-9675-653a29fe49fd" containerID="4bbfa9707925a0f342a6237c6a0d1af326561ccda78d6a22ed9cf239e4b6be79" exitCode=0 Jun 03 15:49:36.488447 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:36.488394 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mfjbh" event={"ID":"b1c958f9-beb1-4a9f-9675-653a29fe49fd","Type":"ContainerDied","Data":"4bbfa9707925a0f342a6237c6a0d1af326561ccda78d6a22ed9cf239e4b6be79"} Jun 03 15:49:36.491309 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:49:36.491280 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd3517b6_8b26_4614_a559_162258f28dbf.slice/crio-3f5f56ca3b7984ad344458e266e815f3b704f3b3438d9d7892e90911b2c5704b WatchSource:0}: Error finding container 3f5f56ca3b7984ad344458e266e815f3b704f3b3438d9d7892e90911b2c5704b: Status 404 returned error can't find the container with id 3f5f56ca3b7984ad344458e266e815f3b704f3b3438d9d7892e90911b2c5704b Jun 03 15:49:37.492239 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:37.491985 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gnf9x" event={"ID":"dd3517b6-8b26-4614-a559-162258f28dbf","Type":"ContainerStarted","Data":"3f5f56ca3b7984ad344458e266e815f3b704f3b3438d9d7892e90911b2c5704b"} Jun 03 15:49:37.495120 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:37.495079 2573 generic.go:358] "Generic (PLEG): container finished" podID="b1c958f9-beb1-4a9f-9675-653a29fe49fd" containerID="69d34f4c941db5054f97ac46ddac701ce217e90c23c6c08cc4332a07212b0c75" exitCode=0 Jun 03 15:49:37.495254 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:37.495129 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mfjbh" event={"ID":"b1c958f9-beb1-4a9f-9675-653a29fe49fd","Type":"ContainerDied","Data":"69d34f4c941db5054f97ac46ddac701ce217e90c23c6c08cc4332a07212b0c75"} Jun 03 15:49:37.500312 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:37.500158 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac827321-cac1-4344-a714-31cb7d92d0b1-cert\") pod \"ingress-canary-8sgrl\" (UID: \"ac827321-cac1-4344-a714-31cb7d92d0b1\") " pod="openshift-ingress-canary/ingress-canary-8sgrl" Jun 03 15:49:37.500312 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:37.500198 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2298cc45-cdd7-4fca-a51e-94a79e892855-metrics-tls\") pod \"dns-default-tp8vd\" (UID: \"2298cc45-cdd7-4fca-a51e-94a79e892855\") " pod="openshift-dns/dns-default-tp8vd" Jun 03 15:49:37.500312 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:37.500262 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/88eb993b-a44b-4f59-ab46-94d0e28b29d3-registry-tls\") pod \"image-registry-6b56bd68f7-rvm5v\" (UID: \"88eb993b-a44b-4f59-ab46-94d0e28b29d3\") " pod="openshift-image-registry/image-registry-6b56bd68f7-rvm5v" Jun 03 15:49:37.500312 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:37.500308 2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 15:49:37.500606 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:37.500365 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac827321-cac1-4344-a714-31cb7d92d0b1-cert podName:ac827321-cac1-4344-a714-31cb7d92d0b1 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:41.50034555 +0000 UTC m=+41.857340667 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ac827321-cac1-4344-a714-31cb7d92d0b1-cert") pod "ingress-canary-8sgrl" (UID: "ac827321-cac1-4344-a714-31cb7d92d0b1") : secret "canary-serving-cert" not found Jun 03 15:49:37.500606 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:37.500382 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 15:49:37.500606 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:37.500455 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2298cc45-cdd7-4fca-a51e-94a79e892855-metrics-tls podName:2298cc45-cdd7-4fca-a51e-94a79e892855 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:41.500433137 +0000 UTC m=+41.857428252 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2298cc45-cdd7-4fca-a51e-94a79e892855-metrics-tls") pod "dns-default-tp8vd" (UID: "2298cc45-cdd7-4fca-a51e-94a79e892855") : secret "dns-default-metrics-tls" not found Jun 03 15:49:37.500606 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:37.500484 2573 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 15:49:37.500606 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:37.500499 2573 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b56bd68f7-rvm5v: secret "image-registry-tls" not found Jun 03 15:49:37.500606 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:37.500548 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/88eb993b-a44b-4f59-ab46-94d0e28b29d3-registry-tls podName:88eb993b-a44b-4f59-ab46-94d0e28b29d3 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:41.500531506 +0000 UTC m=+41.857526631 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/88eb993b-a44b-4f59-ab46-94d0e28b29d3-registry-tls") pod "image-registry-6b56bd68f7-rvm5v" (UID: "88eb993b-a44b-4f59-ab46-94d0e28b29d3") : secret "image-registry-tls" not found Jun 03 15:49:38.501111 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:38.501075 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mfjbh" event={"ID":"b1c958f9-beb1-4a9f-9675-653a29fe49fd","Type":"ContainerStarted","Data":"b65e74741008b0ef0e87ebfb8262478fc5efea383fccdf4b6c7fa8d4fe26538d"} Jun 03 15:49:38.533525 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:38.533457 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mfjbh" podStartSLOduration=4.70921916 podStartE2EDuration="38.533442735s" podCreationTimestamp="2026-06-03 15:49:00 +0000 UTC" firstStartedPulling="2026-06-03 15:49:01.501729646 +0000 UTC m=+1.858724759" lastFinishedPulling="2026-06-03 15:49:35.325953224 +0000 UTC m=+35.682948334" observedRunningTime="2026-06-03 15:49:38.530744469 +0000 UTC m=+38.887739604" watchObservedRunningTime="2026-06-03 15:49:38.533442735 +0000 UTC m=+38.890437866" Jun 03 15:49:41.508272 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:41.508237 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gnf9x" event={"ID":"dd3517b6-8b26-4614-a559-162258f28dbf","Type":"ContainerStarted","Data":"19f0c890a1fdc1331a9066206c38fefa28b39706301e859b611b08ebd4d141ab"} Jun 03 15:49:41.533859 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:41.533834 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac827321-cac1-4344-a714-31cb7d92d0b1-cert\") pod \"ingress-canary-8sgrl\" (UID: \"ac827321-cac1-4344-a714-31cb7d92d0b1\") " pod="openshift-ingress-canary/ingress-canary-8sgrl" Jun 03 15:49:41.533859 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:41.533862 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2298cc45-cdd7-4fca-a51e-94a79e892855-metrics-tls\") pod \"dns-default-tp8vd\" (UID: \"2298cc45-cdd7-4fca-a51e-94a79e892855\") " pod="openshift-dns/dns-default-tp8vd" Jun 03 15:49:41.534017 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:41.533897 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/88eb993b-a44b-4f59-ab46-94d0e28b29d3-registry-tls\") pod \"image-registry-6b56bd68f7-rvm5v\" (UID: \"88eb993b-a44b-4f59-ab46-94d0e28b29d3\") " pod="openshift-image-registry/image-registry-6b56bd68f7-rvm5v" Jun 03 15:49:41.534017 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:41.533978 2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 15:49:41.534017 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:41.533989 2573 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 15:49:41.534017 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:41.533996 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 15:49:41.534180 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:41.534039 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac827321-cac1-4344-a714-31cb7d92d0b1-cert podName:ac827321-cac1-4344-a714-31cb7d92d0b1 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:49.534020597 +0000 UTC m=+49.891015708 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ac827321-cac1-4344-a714-31cb7d92d0b1-cert") pod "ingress-canary-8sgrl" (UID: "ac827321-cac1-4344-a714-31cb7d92d0b1") : secret "canary-serving-cert" not found Jun 03 15:49:41.534180 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:41.533999 2573 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b56bd68f7-rvm5v: secret "image-registry-tls" not found Jun 03 15:49:41.534180 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:41.534056 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2298cc45-cdd7-4fca-a51e-94a79e892855-metrics-tls podName:2298cc45-cdd7-4fca-a51e-94a79e892855 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:49.53404738 +0000 UTC m=+49.891042490 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2298cc45-cdd7-4fca-a51e-94a79e892855-metrics-tls") pod "dns-default-tp8vd" (UID: "2298cc45-cdd7-4fca-a51e-94a79e892855") : secret "dns-default-metrics-tls" not found Jun 03 15:49:41.534180 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:41.534087 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/88eb993b-a44b-4f59-ab46-94d0e28b29d3-registry-tls podName:88eb993b-a44b-4f59-ab46-94d0e28b29d3 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:49.534069757 +0000 UTC m=+49.891064873 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/88eb993b-a44b-4f59-ab46-94d0e28b29d3-registry-tls") pod "image-registry-6b56bd68f7-rvm5v" (UID: "88eb993b-a44b-4f59-ab46-94d0e28b29d3") : secret "image-registry-tls" not found Jun 03 15:49:49.590607 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:49.590563 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac827321-cac1-4344-a714-31cb7d92d0b1-cert\") pod \"ingress-canary-8sgrl\" (UID: \"ac827321-cac1-4344-a714-31cb7d92d0b1\") " pod="openshift-ingress-canary/ingress-canary-8sgrl" Jun 03 15:49:49.590607 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:49.590610 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2298cc45-cdd7-4fca-a51e-94a79e892855-metrics-tls\") pod \"dns-default-tp8vd\" (UID: \"2298cc45-cdd7-4fca-a51e-94a79e892855\") " pod="openshift-dns/dns-default-tp8vd" Jun 03 15:49:49.591177 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:49.590659 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/88eb993b-a44b-4f59-ab46-94d0e28b29d3-registry-tls\") pod \"image-registry-6b56bd68f7-rvm5v\" (UID: \"88eb993b-a44b-4f59-ab46-94d0e28b29d3\") " pod="openshift-image-registry/image-registry-6b56bd68f7-rvm5v" Jun 03 15:49:49.591177 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:49.590719 2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 15:49:49.591177 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:49.590767 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 15:49:49.591177 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:49.590784 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac827321-cac1-4344-a714-31cb7d92d0b1-cert podName:ac827321-cac1-4344-a714-31cb7d92d0b1 nodeName:}" failed. No retries permitted until 2026-06-03 15:50:05.59076716 +0000 UTC m=+65.947762286 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ac827321-cac1-4344-a714-31cb7d92d0b1-cert") pod "ingress-canary-8sgrl" (UID: "ac827321-cac1-4344-a714-31cb7d92d0b1") : secret "canary-serving-cert" not found Jun 03 15:49:49.591177 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:49.590825 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2298cc45-cdd7-4fca-a51e-94a79e892855-metrics-tls podName:2298cc45-cdd7-4fca-a51e-94a79e892855 nodeName:}" failed. No retries permitted until 2026-06-03 15:50:05.590808313 +0000 UTC m=+65.947803440 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2298cc45-cdd7-4fca-a51e-94a79e892855-metrics-tls") pod "dns-default-tp8vd" (UID: "2298cc45-cdd7-4fca-a51e-94a79e892855") : secret "dns-default-metrics-tls" not found Jun 03 15:49:49.591177 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:49.590769 2573 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 15:49:49.591177 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:49.590850 2573 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b56bd68f7-rvm5v: secret "image-registry-tls" not found Jun 03 15:49:49.591177 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:49:49.590898 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/88eb993b-a44b-4f59-ab46-94d0e28b29d3-registry-tls podName:88eb993b-a44b-4f59-ab46-94d0e28b29d3 nodeName:}" failed. No retries permitted until 2026-06-03 15:50:05.590884393 +0000 UTC m=+65.947879525 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/88eb993b-a44b-4f59-ab46-94d0e28b29d3-registry-tls") pod "image-registry-6b56bd68f7-rvm5v" (UID: "88eb993b-a44b-4f59-ab46-94d0e28b29d3") : secret "image-registry-tls" not found Jun 03 15:49:54.324798 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:54.324763 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nzf52_0bc1339f-a919-4ead-8f5f-272a36a862c2/dns-node-resolver/0.log" Jun 03 15:49:55.522606 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:55.522578 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zqg8b_af92e0dd-a3c0-4993-a37a-edd0d027a43f/node-ca/0.log" Jun 03 15:49:59.481132 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:59.481105 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4rkfz" Jun 03 15:49:59.512554 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:49:59.512504 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-gnf9x" podStartSLOduration=51.187805211 podStartE2EDuration="55.512491127s" podCreationTimestamp="2026-06-03 15:49:04 +0000 UTC" firstStartedPulling="2026-06-03 15:49:36.492973085 +0000 UTC m=+36.849968223" lastFinishedPulling="2026-06-03 15:49:40.817659025 +0000 UTC m=+41.174654139" observedRunningTime="2026-06-03 15:49:41.547074865 +0000 UTC m=+41.904069998" watchObservedRunningTime="2026-06-03 15:49:59.512491127 +0000 UTC m=+59.869486255" Jun 03 15:50:05.004271 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:05.004234 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5aa0ffe1-5bf5-47f0-9814-d639c23b597f-metrics-certs\") pod \"network-metrics-daemon-zl2xd\" (UID: \"5aa0ffe1-5bf5-47f0-9814-d639c23b597f\") " pod="openshift-multus/network-metrics-daemon-zl2xd" Jun 03 15:50:05.007011 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:05.006993 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 15:50:05.015361 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:50:05.015345 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 15:50:05.015417 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:50:05.015403 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5aa0ffe1-5bf5-47f0-9814-d639c23b597f-metrics-certs podName:5aa0ffe1-5bf5-47f0-9814-d639c23b597f nodeName:}" failed. No retries permitted until 2026-06-03 15:51:09.015387849 +0000 UTC m=+129.372382958 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5aa0ffe1-5bf5-47f0-9814-d639c23b597f-metrics-certs") pod "network-metrics-daemon-zl2xd" (UID: "5aa0ffe1-5bf5-47f0-9814-d639c23b597f") : secret "metrics-daemon-secret" not found Jun 03 15:50:05.104979 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:05.104952 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dh68w\" (UniqueName: \"kubernetes.io/projected/53b1660f-0dbd-42e9-beab-6df46454d8a6-kube-api-access-dh68w\") pod \"network-check-target-tqbmw\" (UID: \"53b1660f-0dbd-42e9-beab-6df46454d8a6\") " pod="openshift-network-diagnostics/network-check-target-tqbmw" Jun 03 15:50:05.108260 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:05.108241 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 15:50:05.117917 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:05.117903 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 15:50:05.129403 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:05.129382 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh68w\" (UniqueName: \"kubernetes.io/projected/53b1660f-0dbd-42e9-beab-6df46454d8a6-kube-api-access-dh68w\") pod \"network-check-target-tqbmw\" (UID: \"53b1660f-0dbd-42e9-beab-6df46454d8a6\") " pod="openshift-network-diagnostics/network-check-target-tqbmw" Jun 03 15:50:05.151461 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:05.151438 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nhwds\"" Jun 03 15:50:05.159437 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:05.159415 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tqbmw" Jun 03 15:50:05.280212 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:05.280140 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tqbmw"] Jun 03 15:50:05.284072 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:50:05.284039 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53b1660f_0dbd_42e9_beab_6df46454d8a6.slice/crio-b1252b7583927e7ea910295acd5797c1b6987084759ec794b5806610ad4f3cb2 WatchSource:0}: Error finding container b1252b7583927e7ea910295acd5797c1b6987084759ec794b5806610ad4f3cb2: Status 404 returned error can't find the container with id b1252b7583927e7ea910295acd5797c1b6987084759ec794b5806610ad4f3cb2 Jun 03 15:50:05.551617 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:05.551533 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tqbmw" event={"ID":"53b1660f-0dbd-42e9-beab-6df46454d8a6","Type":"ContainerStarted","Data":"b1252b7583927e7ea910295acd5797c1b6987084759ec794b5806610ad4f3cb2"} Jun 03 15:50:05.608424 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:05.608394 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac827321-cac1-4344-a714-31cb7d92d0b1-cert\") pod \"ingress-canary-8sgrl\" (UID: \"ac827321-cac1-4344-a714-31cb7d92d0b1\") " pod="openshift-ingress-canary/ingress-canary-8sgrl" Jun 03 15:50:05.608424 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:05.608430 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2298cc45-cdd7-4fca-a51e-94a79e892855-metrics-tls\") pod \"dns-default-tp8vd\" (UID: \"2298cc45-cdd7-4fca-a51e-94a79e892855\") " pod="openshift-dns/dns-default-tp8vd" Jun 03 15:50:05.608623 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:05.608459 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/88eb993b-a44b-4f59-ab46-94d0e28b29d3-registry-tls\") pod \"image-registry-6b56bd68f7-rvm5v\" (UID: \"88eb993b-a44b-4f59-ab46-94d0e28b29d3\") " pod="openshift-image-registry/image-registry-6b56bd68f7-rvm5v" Jun 03 15:50:05.610765 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:05.610734 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2298cc45-cdd7-4fca-a51e-94a79e892855-metrics-tls\") pod \"dns-default-tp8vd\" (UID: \"2298cc45-cdd7-4fca-a51e-94a79e892855\") " pod="openshift-dns/dns-default-tp8vd" Jun 03 15:50:05.610909 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:05.610864 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac827321-cac1-4344-a714-31cb7d92d0b1-cert\") pod \"ingress-canary-8sgrl\" (UID: \"ac827321-cac1-4344-a714-31cb7d92d0b1\") " pod="openshift-ingress-canary/ingress-canary-8sgrl" Jun 03 15:50:05.610971 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:05.610919 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/88eb993b-a44b-4f59-ab46-94d0e28b29d3-registry-tls\") pod \"image-registry-6b56bd68f7-rvm5v\" (UID: \"88eb993b-a44b-4f59-ab46-94d0e28b29d3\") " pod="openshift-image-registry/image-registry-6b56bd68f7-rvm5v" Jun 03 15:50:05.796132 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:05.796103 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-q22fp\"" Jun 03 15:50:05.803547 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:05.803467 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b56bd68f7-rvm5v" Jun 03 15:50:05.847603 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:05.847569 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9fs7s\"" Jun 03 15:50:05.855668 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:05.855644 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8sgrl" Jun 03 15:50:05.868229 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:05.868191 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5tk8p\"" Jun 03 15:50:05.871895 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:05.871685 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tp8vd" Jun 03 15:50:05.963343 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:05.963302 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b56bd68f7-rvm5v"] Jun 03 15:50:05.981878 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:50:05.981847 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88eb993b_a44b_4f59_ab46_94d0e28b29d3.slice/crio-05c5e6977d587afac4143abbbd82e5c5f7b6b73bbbe8fcebad90bb8dbf06ee02 WatchSource:0}: Error finding container 05c5e6977d587afac4143abbbd82e5c5f7b6b73bbbe8fcebad90bb8dbf06ee02: Status 404 returned error can't find the container with id 05c5e6977d587afac4143abbbd82e5c5f7b6b73bbbe8fcebad90bb8dbf06ee02 Jun 03 15:50:06.010433 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:06.010405 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8sgrl"] Jun 03 15:50:06.014303 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:50:06.014275 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac827321_cac1_4344_a714_31cb7d92d0b1.slice/crio-7da87cfb742537a9a90913387f59e6ae1263417d44007d0585541a0cc845c58e WatchSource:0}: Error finding container 7da87cfb742537a9a90913387f59e6ae1263417d44007d0585541a0cc845c58e: Status 404 returned error can't find the container with id 7da87cfb742537a9a90913387f59e6ae1263417d44007d0585541a0cc845c58e Jun 03 15:50:06.033451 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:06.033429 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tp8vd"] Jun 03 15:50:06.039551 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:50:06.039517 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2298cc45_cdd7_4fca_a51e_94a79e892855.slice/crio-e203fc55d87613934b10c531207a0f0c9ded60c5b66741a5c3583d4afb9908f3 WatchSource:0}: Error finding container e203fc55d87613934b10c531207a0f0c9ded60c5b66741a5c3583d4afb9908f3: Status 404 returned error can't find the container with id e203fc55d87613934b10c531207a0f0c9ded60c5b66741a5c3583d4afb9908f3 Jun 03 15:50:06.555888 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:06.555821 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8sgrl" event={"ID":"ac827321-cac1-4344-a714-31cb7d92d0b1","Type":"ContainerStarted","Data":"7da87cfb742537a9a90913387f59e6ae1263417d44007d0585541a0cc845c58e"} Jun 03 15:50:06.557427 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:06.557365 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b56bd68f7-rvm5v" event={"ID":"88eb993b-a44b-4f59-ab46-94d0e28b29d3","Type":"ContainerStarted","Data":"67e1dcbfd87159b1c0abc1d73cc237c7ebb9504d3bc9dbedcdcbe823f94be102"} Jun 03 15:50:06.557427 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:06.557397 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b56bd68f7-rvm5v" event={"ID":"88eb993b-a44b-4f59-ab46-94d0e28b29d3","Type":"ContainerStarted","Data":"05c5e6977d587afac4143abbbd82e5c5f7b6b73bbbe8fcebad90bb8dbf06ee02"} Jun 03 15:50:06.557795 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:06.557758 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6b56bd68f7-rvm5v" Jun 03 15:50:06.558940 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:06.558910 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tp8vd" event={"ID":"2298cc45-cdd7-4fca-a51e-94a79e892855","Type":"ContainerStarted","Data":"e203fc55d87613934b10c531207a0f0c9ded60c5b66741a5c3583d4afb9908f3"} Jun 03 15:50:06.584516 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:06.584196 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6b56bd68f7-rvm5v" podStartSLOduration=59.584180322 podStartE2EDuration="59.584180322s" podCreationTimestamp="2026-06-03 15:49:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:50:06.581156683 +0000 UTC m=+66.938151816" watchObservedRunningTime="2026-06-03 15:50:06.584180322 +0000 UTC m=+66.941175455" Jun 03 15:50:09.567054 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:09.566934 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8sgrl" event={"ID":"ac827321-cac1-4344-a714-31cb7d92d0b1","Type":"ContainerStarted","Data":"4643fe1412438fcb33338ad35e62df922fca7bb6a90a29d3a231bfceec74bda6"} Jun 03 15:50:09.568513 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:09.568490 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tp8vd" event={"ID":"2298cc45-cdd7-4fca-a51e-94a79e892855","Type":"ContainerStarted","Data":"55df6f460373352bdf362c1fb82b60aa2bbe5b6a4ecdcac44cc807a94eef88c5"} Jun 03 15:50:09.568643 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:09.568518 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tp8vd" event={"ID":"2298cc45-cdd7-4fca-a51e-94a79e892855","Type":"ContainerStarted","Data":"cdd2e13cece3f8cec3dac6ed8ce03285a7c6a1e6d939bf133576a8d22a6aa041"} Jun 03 15:50:09.568643 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:09.568605 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tp8vd" Jun 03 15:50:09.569767 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:09.569749 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tqbmw" event={"ID":"53b1660f-0dbd-42e9-beab-6df46454d8a6","Type":"ContainerStarted","Data":"73bf740ff68517311252e3f25f52416f10e5dae23a444d4b7cfd886dca7466e4"} Jun 03 15:50:09.569895 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:09.569884 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tqbmw" Jun 03 15:50:09.621860 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:09.621812 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-tp8vd" podStartSLOduration=33.593805143 podStartE2EDuration="36.621796666s" podCreationTimestamp="2026-06-03 15:49:33 +0000 UTC" firstStartedPulling="2026-06-03 15:50:06.052642827 +0000 UTC m=+66.409637939" lastFinishedPulling="2026-06-03 15:50:09.080634338 +0000 UTC m=+69.437629462" observedRunningTime="2026-06-03 15:50:09.621577724 +0000 UTC m=+69.978572853" watchObservedRunningTime="2026-06-03 15:50:09.621796666 +0000 UTC m=+69.978791799" Jun 03 15:50:09.622101 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:09.622080 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8sgrl" podStartSLOduration=33.55495786 podStartE2EDuration="36.622075286s" podCreationTimestamp="2026-06-03 15:49:33 +0000 UTC" firstStartedPulling="2026-06-03 15:50:06.016296634 +0000 UTC m=+66.373291744" lastFinishedPulling="2026-06-03 15:50:09.083414051 +0000 UTC m=+69.440409170" observedRunningTime="2026-06-03 15:50:09.596210953 +0000 UTC m=+69.953206084" watchObservedRunningTime="2026-06-03 15:50:09.622075286 +0000 UTC m=+69.979070419" Jun 03 15:50:09.639895 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:09.639849 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tqbmw" podStartSLOduration=65.833588982 podStartE2EDuration="1m9.639835725s" podCreationTimestamp="2026-06-03 15:49:00 +0000 UTC" firstStartedPulling="2026-06-03 15:50:05.285496565 +0000 UTC m=+65.642491674" lastFinishedPulling="2026-06-03 15:50:09.091743307 +0000 UTC m=+69.448738417" observedRunningTime="2026-06-03 15:50:09.639013163 +0000 UTC m=+69.996008295" watchObservedRunningTime="2026-06-03 15:50:09.639835725 +0000 UTC m=+69.996830850" Jun 03 15:50:17.420857 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:17.420723 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6b56bd68f7-rvm5v"] Jun 03 15:50:17.505647 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:17.505608 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-g4kt7"] Jun 03 15:50:17.508650 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:17.508634 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-g4kt7" Jun 03 15:50:17.518820 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:17.518800 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 15:50:17.519549 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:17.519535 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 15:50:17.523143 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:17.523124 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 15:50:17.523236 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:17.523156 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-n5dkg\"" Jun 03 15:50:17.533237 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:17.533212 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 15:50:17.537982 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:17.537958 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-g4kt7"] Jun 03 15:50:17.567499 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:17.566009 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5db8b96774-pqm6h"] Jun 03 15:50:17.569625 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:17.569606 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5db8b96774-pqm6h" Jun 03 15:50:17.594941 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:17.594916 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qd2x2\" (UniqueName: \"kubernetes.io/projected/d302c9e0-652d-40e2-867d-932429dfc947-kube-api-access-qd2x2\") pod \"insights-runtime-extractor-g4kt7\" (UID: \"d302c9e0-652d-40e2-867d-932429dfc947\") " pod="openshift-insights/insights-runtime-extractor-g4kt7" Jun 03 15:50:17.595024 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:17.594947 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d302c9e0-652d-40e2-867d-932429dfc947-data-volume\") pod \"insights-runtime-extractor-g4kt7\" (UID: \"d302c9e0-652d-40e2-867d-932429dfc947\") " pod="openshift-insights/insights-runtime-extractor-g4kt7" Jun 03 15:50:17.595024 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:17.594967 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d302c9e0-652d-40e2-867d-932429dfc947-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g4kt7\" (UID: \"d302c9e0-652d-40e2-867d-932429dfc947\") " pod="openshift-insights/insights-runtime-extractor-g4kt7" Jun 03 15:50:17.595024 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:17.595016 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d302c9e0-652d-40e2-867d-932429dfc947-crio-socket\") pod \"insights-runtime-extractor-g4kt7\" (UID: \"d302c9e0-652d-40e2-867d-932429dfc947\") " pod="openshift-insights/insights-runtime-extractor-g4kt7" Jun 03 15:50:17.595128 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:17.595048 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d302c9e0-652d-40e2-867d-932429dfc947-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g4kt7\" (UID: \"d302c9e0-652d-40e2-867d-932429dfc947\") " pod="openshift-insights/insights-runtime-extractor-g4kt7" Jun 03 15:50:17.669313 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:17.669285 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5db8b96774-pqm6h"] Jun 03 15:50:17.695651 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:17.695589 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d302c9e0-652d-40e2-867d-932429dfc947-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g4kt7\" (UID: \"d302c9e0-652d-40e2-867d-932429dfc947\") " pod="openshift-insights/insights-runtime-extractor-g4kt7" Jun 03 15:50:17.695651 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:17.695626 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/de836ecf-5281-488f-af12-1db87063ef15-installation-pull-secrets\") pod \"image-registry-5db8b96774-pqm6h\" (UID: \"de836ecf-5281-488f-af12-1db87063ef15\") " pod="openshift-image-registry/image-registry-5db8b96774-pqm6h" Jun 03 15:50:17.695651 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:17.695647 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d302c9e0-652d-40e2-867d-932429dfc947-data-volume\") pod \"insights-runtime-extractor-g4kt7\" (UID: \"d302c9e0-652d-40e2-867d-932429dfc947\") " pod="openshift-insights/insights-runtime-extractor-g4kt7" Jun 03 15:50:17.695826 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:17.695697 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/de836ecf-5281-488f-af12-1db87063ef15-ca-trust-extracted\") pod \"image-registry-5db8b96774-pqm6h\" (UID: \"de836ecf-5281-488f-af12-1db87063ef15\") " pod="openshift-image-registry/image-registry-5db8b96774-pqm6h" Jun 03 15:50:17.695826 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:17.695728 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d302c9e0-652d-40e2-867d-932429dfc947-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g4kt7\" (UID: \"d302c9e0-652d-40e2-867d-932429dfc947\") " pod="openshift-insights/insights-runtime-extractor-g4kt7" Jun 03 15:50:17.695826 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:17.695753 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/de836ecf-5281-488f-af12-1db87063ef15-bound-sa-token\") pod \"image-registry-5db8b96774-pqm6h\" (UID: \"de836ecf-5281-488f-af12-1db87063ef15\") " pod="openshift-image-registry/image-registry-5db8b96774-pqm6h" Jun 03 15:50:17.695826 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:17.695779 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/de836ecf-5281-488f-af12-1db87063ef15-trusted-ca\") pod \"image-registry-5db8b96774-pqm6h\" (UID: \"de836ecf-5281-488f-af12-1db87063ef15\") " pod="openshift-image-registry/image-registry-5db8b96774-pqm6h" Jun 03 15:50:17.695967 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:17.695851 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/de836ecf-5281-488f-af12-1db87063ef15-registry-certificates\") pod \"image-registry-5db8b96774-pqm6h\" (UID: \"de836ecf-5281-488f-af12-1db87063ef15\") " pod="openshift-image-registry/image-registry-5db8b96774-pqm6h" Jun 03 15:50:17.695967 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:17.695883 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-896qz\" (UniqueName: \"kubernetes.io/projected/de836ecf-5281-488f-af12-1db87063ef15-kube-api-access-896qz\") pod \"image-registry-5db8b96774-pqm6h\" (UID: \"de836ecf-5281-488f-af12-1db87063ef15\") " pod="openshift-image-registry/image-registry-5db8b96774-pqm6h" Jun 03 15:50:17.695967 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:17.695909 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qd2x2\" (UniqueName: \"kubernetes.io/projected/d302c9e0-652d-40e2-867d-932429dfc947-kube-api-access-qd2x2\") pod \"insights-runtime-extractor-g4kt7\" (UID: \"d302c9e0-652d-40e2-867d-932429dfc947\") " pod="openshift-insights/insights-runtime-extractor-g4kt7" Jun 03 15:50:17.695967 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:17.695936 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/de836ecf-5281-488f-af12-1db87063ef15-registry-tls\") pod \"image-registry-5db8b96774-pqm6h\" (UID: \"de836ecf-5281-488f-af12-1db87063ef15\") " pod="openshift-image-registry/image-registry-5db8b96774-pqm6h" Jun 03 15:50:17.696119 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:17.695963 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/de836ecf-5281-488f-af12-1db87063ef15-image-registry-private-configuration\") pod \"image-registry-5db8b96774-pqm6h\" (UID: \"de836ecf-5281-488f-af12-1db87063ef15\") " pod="openshift-image-registry/image-registry-5db8b96774-pqm6h" Jun 03 15:50:17.696119 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:17.696000 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d302c9e0-652d-40e2-867d-932429dfc947-crio-socket\") pod \"insights-runtime-extractor-g4kt7\" (UID: \"d302c9e0-652d-40e2-867d-932429dfc947\") " pod="openshift-insights/insights-runtime-extractor-g4kt7" Jun 03 15:50:17.696119 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:17.695986 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d302c9e0-652d-40e2-867d-932429dfc947-data-volume\") pod \"insights-runtime-extractor-g4kt7\" (UID: \"d302c9e0-652d-40e2-867d-932429dfc947\") " pod="openshift-insights/insights-runtime-extractor-g4kt7" Jun 03 15:50:17.696119 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:17.696099 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d302c9e0-652d-40e2-867d-932429dfc947-crio-socket\") pod \"insights-runtime-extractor-g4kt7\" (UID: \"d302c9e0-652d-40e2-867d-932429dfc947\") " pod="openshift-insights/insights-runtime-extractor-g4kt7" Jun 03 15:50:17.696296 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:17.696278 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d302c9e0-652d-40e2-867d-932429dfc947-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g4kt7\" (UID: \"d302c9e0-652d-40e2-867d-932429dfc947\") " pod="openshift-insights/insights-runtime-extractor-g4kt7" Jun 03 15:50:17.697948 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:17.697932 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d302c9e0-652d-40e2-867d-932429dfc947-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g4kt7\" (UID: \"d302c9e0-652d-40e2-867d-932429dfc947\") " pod="openshift-insights/insights-runtime-extractor-g4kt7" Jun 03 15:50:17.709144 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:17.709120 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qd2x2\" (UniqueName: \"kubernetes.io/projected/d302c9e0-652d-40e2-867d-932429dfc947-kube-api-access-qd2x2\") pod \"insights-runtime-extractor-g4kt7\" (UID: \"d302c9e0-652d-40e2-867d-932429dfc947\") " pod="openshift-insights/insights-runtime-extractor-g4kt7" Jun 03 15:50:17.797063 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:17.797035 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/de836ecf-5281-488f-af12-1db87063ef15-trusted-ca\") pod \"image-registry-5db8b96774-pqm6h\" (UID: \"de836ecf-5281-488f-af12-1db87063ef15\") " pod="openshift-image-registry/image-registry-5db8b96774-pqm6h" Jun 03 15:50:17.797189 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:17.797072 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/de836ecf-5281-488f-af12-1db87063ef15-registry-certificates\") pod \"image-registry-5db8b96774-pqm6h\" (UID: \"de836ecf-5281-488f-af12-1db87063ef15\") " pod="openshift-image-registry/image-registry-5db8b96774-pqm6h" Jun 03 15:50:17.797189 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:17.797093 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-896qz\" (UniqueName: \"kubernetes.io/projected/de836ecf-5281-488f-af12-1db87063ef15-kube-api-access-896qz\") pod \"image-registry-5db8b96774-pqm6h\" (UID: \"de836ecf-5281-488f-af12-1db87063ef15\") " pod="openshift-image-registry/image-registry-5db8b96774-pqm6h" Jun 03 15:50:17.797189 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:17.797110 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/de836ecf-5281-488f-af12-1db87063ef15-registry-tls\") pod \"image-registry-5db8b96774-pqm6h\" (UID: \"de836ecf-5281-488f-af12-1db87063ef15\") " pod="openshift-image-registry/image-registry-5db8b96774-pqm6h" Jun 03 15:50:17.797189 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:17.797131 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/de836ecf-5281-488f-af12-1db87063ef15-image-registry-private-configuration\") pod \"image-registry-5db8b96774-pqm6h\" (UID: \"de836ecf-5281-488f-af12-1db87063ef15\") " pod="openshift-image-registry/image-registry-5db8b96774-pqm6h" Jun 03 15:50:17.797189 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:17.797177 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/de836ecf-5281-488f-af12-1db87063ef15-installation-pull-secrets\") pod \"image-registry-5db8b96774-pqm6h\" (UID: \"de836ecf-5281-488f-af12-1db87063ef15\") " pod="openshift-image-registry/image-registry-5db8b96774-pqm6h" Jun 03 15:50:17.797442 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:17.797232 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/de836ecf-5281-488f-af12-1db87063ef15-ca-trust-extracted\") pod \"image-registry-5db8b96774-pqm6h\" (UID: \"de836ecf-5281-488f-af12-1db87063ef15\") " pod="openshift-image-registry/image-registry-5db8b96774-pqm6h" Jun 03 15:50:17.797442 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:17.797264 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/de836ecf-5281-488f-af12-1db87063ef15-bound-sa-token\") pod \"image-registry-5db8b96774-pqm6h\" (UID: \"de836ecf-5281-488f-af12-1db87063ef15\") " pod="openshift-image-registry/image-registry-5db8b96774-pqm6h" Jun 03 15:50:17.797804 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:17.797771 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/de836ecf-5281-488f-af12-1db87063ef15-ca-trust-extracted\") pod \"image-registry-5db8b96774-pqm6h\" (UID: \"de836ecf-5281-488f-af12-1db87063ef15\") " pod="openshift-image-registry/image-registry-5db8b96774-pqm6h" Jun 03 15:50:17.797999 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:17.797978 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/de836ecf-5281-488f-af12-1db87063ef15-trusted-ca\") pod \"image-registry-5db8b96774-pqm6h\" (UID: \"de836ecf-5281-488f-af12-1db87063ef15\") " pod="openshift-image-registry/image-registry-5db8b96774-pqm6h" Jun 03 15:50:17.798097 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:17.797978 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/de836ecf-5281-488f-af12-1db87063ef15-registry-certificates\") pod \"image-registry-5db8b96774-pqm6h\" (UID: \"de836ecf-5281-488f-af12-1db87063ef15\") " pod="openshift-image-registry/image-registry-5db8b96774-pqm6h" Jun 03 15:50:17.799709 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:17.799686 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/de836ecf-5281-488f-af12-1db87063ef15-registry-tls\") pod \"image-registry-5db8b96774-pqm6h\" (UID: \"de836ecf-5281-488f-af12-1db87063ef15\") " pod="openshift-image-registry/image-registry-5db8b96774-pqm6h" Jun 03 15:50:17.800124 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:17.800106 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/de836ecf-5281-488f-af12-1db87063ef15-installation-pull-secrets\") pod \"image-registry-5db8b96774-pqm6h\" (UID: \"de836ecf-5281-488f-af12-1db87063ef15\") " pod="openshift-image-registry/image-registry-5db8b96774-pqm6h" Jun 03 15:50:17.800167 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:17.800124 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/de836ecf-5281-488f-af12-1db87063ef15-image-registry-private-configuration\") pod \"image-registry-5db8b96774-pqm6h\" (UID: \"de836ecf-5281-488f-af12-1db87063ef15\") " pod="openshift-image-registry/image-registry-5db8b96774-pqm6h" Jun 03 15:50:17.817013 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:17.816991 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-g4kt7" Jun 03 15:50:17.824346 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:17.824318 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-896qz\" (UniqueName: \"kubernetes.io/projected/de836ecf-5281-488f-af12-1db87063ef15-kube-api-access-896qz\") pod \"image-registry-5db8b96774-pqm6h\" (UID: \"de836ecf-5281-488f-af12-1db87063ef15\") " pod="openshift-image-registry/image-registry-5db8b96774-pqm6h" Jun 03 15:50:17.826252 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:17.826231 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/de836ecf-5281-488f-af12-1db87063ef15-bound-sa-token\") pod \"image-registry-5db8b96774-pqm6h\" (UID: \"de836ecf-5281-488f-af12-1db87063ef15\") " pod="openshift-image-registry/image-registry-5db8b96774-pqm6h" Jun 03 15:50:17.877611 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:17.877574 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5db8b96774-pqm6h" Jun 03 15:50:17.967210 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:17.967180 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-g4kt7"] Jun 03 15:50:17.972862 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:50:17.972835 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd302c9e0_652d_40e2_867d_932429dfc947.slice/crio-42bff76d7154b0983b9a8c20db803fa54c6f1c08d6365d5e9b6ca11e9bc005f7 WatchSource:0}: Error finding container 42bff76d7154b0983b9a8c20db803fa54c6f1c08d6365d5e9b6ca11e9bc005f7: Status 404 returned error can't find the container with id 42bff76d7154b0983b9a8c20db803fa54c6f1c08d6365d5e9b6ca11e9bc005f7 Jun 03 15:50:18.022779 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:18.022733 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5db8b96774-pqm6h"] Jun 03 15:50:18.024393 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:50:18.024369 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde836ecf_5281_488f_af12_1db87063ef15.slice/crio-d1ef80f9e9153115c6b1a25248322b775cd79ffa28fd1b9f3fcbdc98c9bca1f6 WatchSource:0}: Error finding container d1ef80f9e9153115c6b1a25248322b775cd79ffa28fd1b9f3fcbdc98c9bca1f6: Status 404 returned error can't find the container with id d1ef80f9e9153115c6b1a25248322b775cd79ffa28fd1b9f3fcbdc98c9bca1f6 Jun 03 15:50:18.594557 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:18.594522 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g4kt7" event={"ID":"d302c9e0-652d-40e2-867d-932429dfc947","Type":"ContainerStarted","Data":"8498aaf4841c62db1680a44036b21a401ddd8376a8fd9cdc5b178a7802748296"} Jun 03 15:50:18.594557 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:18.594558 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g4kt7" event={"ID":"d302c9e0-652d-40e2-867d-932429dfc947","Type":"ContainerStarted","Data":"42bff76d7154b0983b9a8c20db803fa54c6f1c08d6365d5e9b6ca11e9bc005f7"} Jun 03 15:50:18.595979 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:18.595953 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5db8b96774-pqm6h" event={"ID":"de836ecf-5281-488f-af12-1db87063ef15","Type":"ContainerStarted","Data":"97d1135517b28b6be95ef675e3545e8e0f2048fa2c8f2a6969108c2e4ca8a00b"} Jun 03 15:50:18.595979 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:18.595982 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5db8b96774-pqm6h" event={"ID":"de836ecf-5281-488f-af12-1db87063ef15","Type":"ContainerStarted","Data":"d1ef80f9e9153115c6b1a25248322b775cd79ffa28fd1b9f3fcbdc98c9bca1f6"} Jun 03 15:50:18.596171 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:18.596096 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5db8b96774-pqm6h" Jun 03 15:50:18.621614 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:18.621567 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5db8b96774-pqm6h" podStartSLOduration=1.621553137 podStartE2EDuration="1.621553137s" podCreationTimestamp="2026-06-03 15:50:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:50:18.620145638 +0000 UTC m=+78.977140808" watchObservedRunningTime="2026-06-03 15:50:18.621553137 +0000 UTC m=+78.978548266" Jun 03 15:50:19.575260 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:19.575228 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tp8vd" Jun 03 15:50:19.600711 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:19.600670 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g4kt7" event={"ID":"d302c9e0-652d-40e2-867d-932429dfc947","Type":"ContainerStarted","Data":"3cac60da6af9c252966068fd9aaffe9db600975c89b5bb8637ebab9083ceea17"} Jun 03 15:50:20.604523 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:20.604415 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g4kt7" event={"ID":"d302c9e0-652d-40e2-867d-932429dfc947","Type":"ContainerStarted","Data":"dfbe0362421bef6b62f933390acff635a5d42e23a5832cf54112686ffb899f2d"} Jun 03 15:50:20.626293 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:20.626249 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-g4kt7" podStartSLOduration=1.310390255 podStartE2EDuration="3.626237567s" podCreationTimestamp="2026-06-03 15:50:17 +0000 UTC" firstStartedPulling="2026-06-03 15:50:18.021131654 +0000 UTC m=+78.378126763" lastFinishedPulling="2026-06-03 15:50:20.336978962 +0000 UTC m=+80.693974075" observedRunningTime="2026-06-03 15:50:20.625647213 +0000 UTC m=+80.982642345" watchObservedRunningTime="2026-06-03 15:50:20.626237567 +0000 UTC m=+80.983232699" Jun 03 15:50:27.426516 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:27.426482 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6b56bd68f7-rvm5v" Jun 03 15:50:39.605205 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:39.605170 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5db8b96774-pqm6h" Jun 03 15:50:40.576439 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:40.576409 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tqbmw" Jun 03 15:50:42.439794 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:42.439752 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6b56bd68f7-rvm5v" podUID="88eb993b-a44b-4f59-ab46-94d0e28b29d3" containerName="registry" containerID="cri-o://67e1dcbfd87159b1c0abc1d73cc237c7ebb9504d3bc9dbedcdcbe823f94be102" gracePeriod=30 Jun 03 15:50:42.663121 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:42.663091 2573 generic.go:358] "Generic (PLEG): container finished" podID="88eb993b-a44b-4f59-ab46-94d0e28b29d3" containerID="67e1dcbfd87159b1c0abc1d73cc237c7ebb9504d3bc9dbedcdcbe823f94be102" exitCode=0 Jun 03 15:50:42.663256 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:42.663174 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b56bd68f7-rvm5v" event={"ID":"88eb993b-a44b-4f59-ab46-94d0e28b29d3","Type":"ContainerDied","Data":"67e1dcbfd87159b1c0abc1d73cc237c7ebb9504d3bc9dbedcdcbe823f94be102"} Jun 03 15:50:42.682092 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:42.682072 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b56bd68f7-rvm5v" Jun 03 15:50:42.775059 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:42.774975 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/88eb993b-a44b-4f59-ab46-94d0e28b29d3-installation-pull-secrets\") pod \"88eb993b-a44b-4f59-ab46-94d0e28b29d3\" (UID: \"88eb993b-a44b-4f59-ab46-94d0e28b29d3\") " Jun 03 15:50:42.775059 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:42.775017 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/88eb993b-a44b-4f59-ab46-94d0e28b29d3-trusted-ca\") pod \"88eb993b-a44b-4f59-ab46-94d0e28b29d3\" (UID: \"88eb993b-a44b-4f59-ab46-94d0e28b29d3\") " Jun 03 15:50:42.775059 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:42.775056 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/88eb993b-a44b-4f59-ab46-94d0e28b29d3-ca-trust-extracted\") pod \"88eb993b-a44b-4f59-ab46-94d0e28b29d3\" (UID: \"88eb993b-a44b-4f59-ab46-94d0e28b29d3\") " Jun 03 15:50:42.775283 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:42.775240 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/88eb993b-a44b-4f59-ab46-94d0e28b29d3-image-registry-private-configuration\") pod \"88eb993b-a44b-4f59-ab46-94d0e28b29d3\" (UID: \"88eb993b-a44b-4f59-ab46-94d0e28b29d3\") " Jun 03 15:50:42.775327 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:42.775283 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/88eb993b-a44b-4f59-ab46-94d0e28b29d3-bound-sa-token\") pod \"88eb993b-a44b-4f59-ab46-94d0e28b29d3\" (UID: \"88eb993b-a44b-4f59-ab46-94d0e28b29d3\") " Jun 03 15:50:42.775327 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:42.775313 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ncn6x\" (UniqueName: \"kubernetes.io/projected/88eb993b-a44b-4f59-ab46-94d0e28b29d3-kube-api-access-ncn6x\") pod \"88eb993b-a44b-4f59-ab46-94d0e28b29d3\" (UID: \"88eb993b-a44b-4f59-ab46-94d0e28b29d3\") " Jun 03 15:50:42.775423 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:42.775337 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/88eb993b-a44b-4f59-ab46-94d0e28b29d3-registry-certificates\") pod \"88eb993b-a44b-4f59-ab46-94d0e28b29d3\" (UID: \"88eb993b-a44b-4f59-ab46-94d0e28b29d3\") " Jun 03 15:50:42.775423 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:42.775360 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/88eb993b-a44b-4f59-ab46-94d0e28b29d3-registry-tls\") pod \"88eb993b-a44b-4f59-ab46-94d0e28b29d3\" (UID: \"88eb993b-a44b-4f59-ab46-94d0e28b29d3\") " Jun 03 15:50:42.775554 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:42.775462 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88eb993b-a44b-4f59-ab46-94d0e28b29d3-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "88eb993b-a44b-4f59-ab46-94d0e28b29d3" (UID: "88eb993b-a44b-4f59-ab46-94d0e28b29d3"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:50:42.775609 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:42.775598 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/88eb993b-a44b-4f59-ab46-94d0e28b29d3-trusted-ca\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Jun 03 15:50:42.776000 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:42.775977 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88eb993b-a44b-4f59-ab46-94d0e28b29d3-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "88eb993b-a44b-4f59-ab46-94d0e28b29d3" (UID: "88eb993b-a44b-4f59-ab46-94d0e28b29d3"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:50:42.777958 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:42.777839 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88eb993b-a44b-4f59-ab46-94d0e28b29d3-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "88eb993b-a44b-4f59-ab46-94d0e28b29d3" (UID: "88eb993b-a44b-4f59-ab46-94d0e28b29d3"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:50:42.777958 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:42.777901 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88eb993b-a44b-4f59-ab46-94d0e28b29d3-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "88eb993b-a44b-4f59-ab46-94d0e28b29d3" (UID: "88eb993b-a44b-4f59-ab46-94d0e28b29d3"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:50:42.777958 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:42.777952 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88eb993b-a44b-4f59-ab46-94d0e28b29d3-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "88eb993b-a44b-4f59-ab46-94d0e28b29d3" (UID: "88eb993b-a44b-4f59-ab46-94d0e28b29d3"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:50:42.778132 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:42.777960 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88eb993b-a44b-4f59-ab46-94d0e28b29d3-kube-api-access-ncn6x" (OuterVolumeSpecName: "kube-api-access-ncn6x") pod "88eb993b-a44b-4f59-ab46-94d0e28b29d3" (UID: "88eb993b-a44b-4f59-ab46-94d0e28b29d3"). InnerVolumeSpecName "kube-api-access-ncn6x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:50:42.778132 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:42.778009 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88eb993b-a44b-4f59-ab46-94d0e28b29d3-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "88eb993b-a44b-4f59-ab46-94d0e28b29d3" (UID: "88eb993b-a44b-4f59-ab46-94d0e28b29d3"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:50:42.785790 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:42.785763 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88eb993b-a44b-4f59-ab46-94d0e28b29d3-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "88eb993b-a44b-4f59-ab46-94d0e28b29d3" (UID: "88eb993b-a44b-4f59-ab46-94d0e28b29d3"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:50:42.876494 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:42.876444 2573 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/88eb993b-a44b-4f59-ab46-94d0e28b29d3-ca-trust-extracted\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Jun 03 15:50:42.876494 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:42.876492 2573 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/88eb993b-a44b-4f59-ab46-94d0e28b29d3-image-registry-private-configuration\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Jun 03 15:50:42.876494 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:42.876503 2573 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/88eb993b-a44b-4f59-ab46-94d0e28b29d3-bound-sa-token\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Jun 03 15:50:42.876712 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:42.876512 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ncn6x\" (UniqueName: \"kubernetes.io/projected/88eb993b-a44b-4f59-ab46-94d0e28b29d3-kube-api-access-ncn6x\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Jun 03 15:50:42.876712 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:42.876524 2573 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/88eb993b-a44b-4f59-ab46-94d0e28b29d3-registry-certificates\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Jun 03 15:50:42.876712 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:42.876533 2573 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/88eb993b-a44b-4f59-ab46-94d0e28b29d3-registry-tls\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Jun 03 15:50:42.876712 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:42.876543 2573 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/88eb993b-a44b-4f59-ab46-94d0e28b29d3-installation-pull-secrets\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Jun 03 15:50:43.666542 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:43.666514 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b56bd68f7-rvm5v" Jun 03 15:50:43.667033 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:43.666512 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b56bd68f7-rvm5v" event={"ID":"88eb993b-a44b-4f59-ab46-94d0e28b29d3","Type":"ContainerDied","Data":"05c5e6977d587afac4143abbbd82e5c5f7b6b73bbbe8fcebad90bb8dbf06ee02"} Jun 03 15:50:43.667033 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:43.666621 2573 scope.go:117] "RemoveContainer" containerID="67e1dcbfd87159b1c0abc1d73cc237c7ebb9504d3bc9dbedcdcbe823f94be102" Jun 03 15:50:43.699844 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:43.699819 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6b56bd68f7-rvm5v"] Jun 03 15:50:43.709570 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:43.709549 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6b56bd68f7-rvm5v"] Jun 03 15:50:43.848190 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:43.848159 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-c65b8dc4b-6hwfq"] Jun 03 15:50:43.848391 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:43.848381 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88eb993b-a44b-4f59-ab46-94d0e28b29d3" containerName="registry" Jun 03 15:50:43.848432 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:43.848393 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="88eb993b-a44b-4f59-ab46-94d0e28b29d3" containerName="registry" Jun 03 15:50:43.848464 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:43.848435 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="88eb993b-a44b-4f59-ab46-94d0e28b29d3" containerName="registry" Jun 03 15:50:43.851238 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:43.851219 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-6hwfq" Jun 03 15:50:43.854579 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:43.854556 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-7cnct\"" Jun 03 15:50:43.854687 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:43.854643 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 03 15:50:43.855062 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:43.855045 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 03 15:50:43.864636 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:43.864612 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-6hwfq"] Jun 03 15:50:43.984077 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:43.983990 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dhmc\" (UniqueName: \"kubernetes.io/projected/a2ed9416-2213-4243-97ae-995553f3e968-kube-api-access-5dhmc\") pod \"downloads-c65b8dc4b-6hwfq\" (UID: \"a2ed9416-2213-4243-97ae-995553f3e968\") " pod="openshift-console/downloads-c65b8dc4b-6hwfq" Jun 03 15:50:44.084629 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:44.084592 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5dhmc\" (UniqueName: \"kubernetes.io/projected/a2ed9416-2213-4243-97ae-995553f3e968-kube-api-access-5dhmc\") pod \"downloads-c65b8dc4b-6hwfq\" (UID: \"a2ed9416-2213-4243-97ae-995553f3e968\") " pod="openshift-console/downloads-c65b8dc4b-6hwfq" Jun 03 15:50:44.095768 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:44.095739 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dhmc\" (UniqueName: \"kubernetes.io/projected/a2ed9416-2213-4243-97ae-995553f3e968-kube-api-access-5dhmc\") pod \"downloads-c65b8dc4b-6hwfq\" (UID: \"a2ed9416-2213-4243-97ae-995553f3e968\") " pod="openshift-console/downloads-c65b8dc4b-6hwfq" Jun 03 15:50:44.159655 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:44.159623 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-6hwfq" Jun 03 15:50:44.233482 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:44.233436 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88eb993b-a44b-4f59-ab46-94d0e28b29d3" path="/var/lib/kubelet/pods/88eb993b-a44b-4f59-ab46-94d0e28b29d3/volumes" Jun 03 15:50:44.288232 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:44.288196 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-6hwfq"] Jun 03 15:50:44.292488 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:50:44.292453 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2ed9416_2213_4243_97ae_995553f3e968.slice/crio-b233dcbfae39c7232fa9f1b65dd57ad09324f3bdc07105290b4c1cae6f972689 WatchSource:0}: Error finding container b233dcbfae39c7232fa9f1b65dd57ad09324f3bdc07105290b4c1cae6f972689: Status 404 returned error can't find the container with id b233dcbfae39c7232fa9f1b65dd57ad09324f3bdc07105290b4c1cae6f972689 Jun 03 15:50:44.670687 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:44.670652 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-6hwfq" event={"ID":"a2ed9416-2213-4243-97ae-995553f3e968","Type":"ContainerStarted","Data":"b233dcbfae39c7232fa9f1b65dd57ad09324f3bdc07105290b4c1cae6f972689"} Jun 03 15:50:48.945301 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:48.945267 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-gfxp6"] Jun 03 15:50:48.947736 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:48.947716 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-gfxp6" Jun 03 15:50:48.952077 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:48.952049 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 15:50:48.952191 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:48.952153 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 03 15:50:48.952191 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:48.952177 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 03 15:50:48.953958 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:48.953917 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 15:50:48.954161 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:48.954143 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-28hrm\"" Jun 03 15:50:48.954361 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:48.954339 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 15:50:48.955321 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:48.955214 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 03 15:50:48.961345 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:48.961325 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2zfg9"] Jun 03 15:50:48.963306 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:48.963285 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2zfg9" Jun 03 15:50:48.966339 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:48.966205 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 15:50:48.966434 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:48.966364 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 15:50:48.966434 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:48.966404 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 15:50:48.968311 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:48.968276 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-gfxp6"] Jun 03 15:50:48.969384 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:48.969367 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-66bjq\"" Jun 03 15:50:49.122771 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:49.122735 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b55da440-3026-4e63-bde6-c9970eaf8f87-node-exporter-accelerators-collector-config\") pod \"node-exporter-2zfg9\" (UID: \"b55da440-3026-4e63-bde6-c9970eaf8f87\") " pod="openshift-monitoring/node-exporter-2zfg9" Jun 03 15:50:49.122771 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:49.122772 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b55da440-3026-4e63-bde6-c9970eaf8f87-metrics-client-ca\") pod \"node-exporter-2zfg9\" (UID: \"b55da440-3026-4e63-bde6-c9970eaf8f87\") " pod="openshift-monitoring/node-exporter-2zfg9" Jun 03 15:50:49.123060 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:49.122797 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2a82cd14-8e94-458d-9e44-e5ca4f1743df-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-gfxp6\" (UID: \"2a82cd14-8e94-458d-9e44-e5ca4f1743df\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-gfxp6" Jun 03 15:50:49.123060 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:49.122843 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqdz2\" (UniqueName: \"kubernetes.io/projected/b55da440-3026-4e63-bde6-c9970eaf8f87-kube-api-access-pqdz2\") pod \"node-exporter-2zfg9\" (UID: \"b55da440-3026-4e63-bde6-c9970eaf8f87\") " pod="openshift-monitoring/node-exporter-2zfg9" Jun 03 15:50:49.123060 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:49.122944 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b55da440-3026-4e63-bde6-c9970eaf8f87-node-exporter-wtmp\") pod \"node-exporter-2zfg9\" (UID: \"b55da440-3026-4e63-bde6-c9970eaf8f87\") " pod="openshift-monitoring/node-exporter-2zfg9" Jun 03 15:50:49.123060 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:49.122972 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b55da440-3026-4e63-bde6-c9970eaf8f87-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2zfg9\" (UID: \"b55da440-3026-4e63-bde6-c9970eaf8f87\") " pod="openshift-monitoring/node-exporter-2zfg9" Jun 03 15:50:49.123060 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:49.123010 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a82cd14-8e94-458d-9e44-e5ca4f1743df-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-gfxp6\" (UID: \"2a82cd14-8e94-458d-9e44-e5ca4f1743df\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-gfxp6" Jun 03 15:50:49.123060 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:49.123039 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b55da440-3026-4e63-bde6-c9970eaf8f87-sys\") pod \"node-exporter-2zfg9\" (UID: \"b55da440-3026-4e63-bde6-c9970eaf8f87\") " pod="openshift-monitoring/node-exporter-2zfg9" Jun 03 15:50:49.123060 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:49.123063 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b55da440-3026-4e63-bde6-c9970eaf8f87-root\") pod \"node-exporter-2zfg9\" (UID: \"b55da440-3026-4e63-bde6-c9970eaf8f87\") " pod="openshift-monitoring/node-exporter-2zfg9" Jun 03 15:50:49.123438 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:49.123084 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b55da440-3026-4e63-bde6-c9970eaf8f87-node-exporter-textfile\") pod \"node-exporter-2zfg9\" (UID: \"b55da440-3026-4e63-bde6-c9970eaf8f87\") " pod="openshift-monitoring/node-exporter-2zfg9" Jun 03 15:50:49.123438 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:49.123115 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b55da440-3026-4e63-bde6-c9970eaf8f87-node-exporter-tls\") pod \"node-exporter-2zfg9\" (UID: \"b55da440-3026-4e63-bde6-c9970eaf8f87\") " pod="openshift-monitoring/node-exporter-2zfg9" Jun 03 15:50:49.123438 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:49.123138 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2a82cd14-8e94-458d-9e44-e5ca4f1743df-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-gfxp6\" (UID: \"2a82cd14-8e94-458d-9e44-e5ca4f1743df\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-gfxp6" Jun 03 15:50:49.123438 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:49.123194 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a82cd14-8e94-458d-9e44-e5ca4f1743df-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-gfxp6\" (UID: \"2a82cd14-8e94-458d-9e44-e5ca4f1743df\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-gfxp6" Jun 03 15:50:49.123438 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:49.123233 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzc44\" (UniqueName: \"kubernetes.io/projected/2a82cd14-8e94-458d-9e44-e5ca4f1743df-kube-api-access-qzc44\") pod \"kube-state-metrics-8469c486bb-gfxp6\" (UID: \"2a82cd14-8e94-458d-9e44-e5ca4f1743df\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-gfxp6" Jun 03 15:50:49.123438 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:49.123272 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a82cd14-8e94-458d-9e44-e5ca4f1743df-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-gfxp6\" (UID: \"2a82cd14-8e94-458d-9e44-e5ca4f1743df\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-gfxp6" Jun 03 15:50:49.224089 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:49.224011 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b55da440-3026-4e63-bde6-c9970eaf8f87-node-exporter-wtmp\") pod \"node-exporter-2zfg9\" (UID: \"b55da440-3026-4e63-bde6-c9970eaf8f87\") " pod="openshift-monitoring/node-exporter-2zfg9" Jun 03 15:50:49.224089 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:49.224053 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b55da440-3026-4e63-bde6-c9970eaf8f87-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2zfg9\" (UID: \"b55da440-3026-4e63-bde6-c9970eaf8f87\") " pod="openshift-monitoring/node-exporter-2zfg9" Jun 03 15:50:49.224290 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:49.224086 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a82cd14-8e94-458d-9e44-e5ca4f1743df-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-gfxp6\" (UID: \"2a82cd14-8e94-458d-9e44-e5ca4f1743df\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-gfxp6" Jun 03 15:50:49.224290 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:49.224129 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b55da440-3026-4e63-bde6-c9970eaf8f87-sys\") pod \"node-exporter-2zfg9\" (UID: \"b55da440-3026-4e63-bde6-c9970eaf8f87\") " pod="openshift-monitoring/node-exporter-2zfg9" Jun 03 15:50:49.224290 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:49.224150 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b55da440-3026-4e63-bde6-c9970eaf8f87-root\") pod \"node-exporter-2zfg9\" (UID: \"b55da440-3026-4e63-bde6-c9970eaf8f87\") " pod="openshift-monitoring/node-exporter-2zfg9" Jun 03 15:50:49.224290 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:49.224172 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b55da440-3026-4e63-bde6-c9970eaf8f87-node-exporter-textfile\") pod \"node-exporter-2zfg9\" (UID: \"b55da440-3026-4e63-bde6-c9970eaf8f87\") " pod="openshift-monitoring/node-exporter-2zfg9" Jun 03 15:50:49.224290 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:49.224209 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b55da440-3026-4e63-bde6-c9970eaf8f87-node-exporter-wtmp\") pod \"node-exporter-2zfg9\" (UID: \"b55da440-3026-4e63-bde6-c9970eaf8f87\") " pod="openshift-monitoring/node-exporter-2zfg9" Jun 03 15:50:49.224585 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:49.224380 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b55da440-3026-4e63-bde6-c9970eaf8f87-root\") pod \"node-exporter-2zfg9\" (UID: \"b55da440-3026-4e63-bde6-c9970eaf8f87\") " pod="openshift-monitoring/node-exporter-2zfg9" Jun 03 15:50:49.224585 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:49.224439 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b55da440-3026-4e63-bde6-c9970eaf8f87-sys\") pod \"node-exporter-2zfg9\" (UID: \"b55da440-3026-4e63-bde6-c9970eaf8f87\") " pod="openshift-monitoring/node-exporter-2zfg9" Jun 03 15:50:49.224585 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:49.224214 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b55da440-3026-4e63-bde6-c9970eaf8f87-node-exporter-tls\") pod \"node-exporter-2zfg9\" (UID: \"b55da440-3026-4e63-bde6-c9970eaf8f87\") " pod="openshift-monitoring/node-exporter-2zfg9" Jun 03 15:50:49.224585 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:49.224540 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2a82cd14-8e94-458d-9e44-e5ca4f1743df-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-gfxp6\" (UID: \"2a82cd14-8e94-458d-9e44-e5ca4f1743df\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-gfxp6" Jun 03 15:50:49.224791 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:49.224598 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a82cd14-8e94-458d-9e44-e5ca4f1743df-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-gfxp6\" (UID: \"2a82cd14-8e94-458d-9e44-e5ca4f1743df\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-gfxp6" Jun 03 15:50:49.224791 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:49.224636 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qzc44\" (UniqueName: \"kubernetes.io/projected/2a82cd14-8e94-458d-9e44-e5ca4f1743df-kube-api-access-qzc44\") pod \"kube-state-metrics-8469c486bb-gfxp6\" (UID: \"2a82cd14-8e94-458d-9e44-e5ca4f1743df\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-gfxp6" Jun 03 15:50:49.224791 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:49.224680 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a82cd14-8e94-458d-9e44-e5ca4f1743df-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-gfxp6\" (UID: \"2a82cd14-8e94-458d-9e44-e5ca4f1743df\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-gfxp6" Jun 03 15:50:49.224791 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:49.224731 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b55da440-3026-4e63-bde6-c9970eaf8f87-node-exporter-accelerators-collector-config\") pod \"node-exporter-2zfg9\" (UID: \"b55da440-3026-4e63-bde6-c9970eaf8f87\") " pod="openshift-monitoring/node-exporter-2zfg9" Jun 03 15:50:49.224791 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:49.224751 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b55da440-3026-4e63-bde6-c9970eaf8f87-node-exporter-textfile\") pod \"node-exporter-2zfg9\" (UID: \"b55da440-3026-4e63-bde6-c9970eaf8f87\") " pod="openshift-monitoring/node-exporter-2zfg9" Jun 03 15:50:49.224791 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:49.224761 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b55da440-3026-4e63-bde6-c9970eaf8f87-metrics-client-ca\") pod \"node-exporter-2zfg9\" (UID: \"b55da440-3026-4e63-bde6-c9970eaf8f87\") " pod="openshift-monitoring/node-exporter-2zfg9" Jun 03 15:50:49.225073 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:49.224809 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2a82cd14-8e94-458d-9e44-e5ca4f1743df-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-gfxp6\" (UID: \"2a82cd14-8e94-458d-9e44-e5ca4f1743df\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-gfxp6" Jun 03 15:50:49.225073 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:49.224842 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pqdz2\" (UniqueName: \"kubernetes.io/projected/b55da440-3026-4e63-bde6-c9970eaf8f87-kube-api-access-pqdz2\") pod \"node-exporter-2zfg9\" (UID: \"b55da440-3026-4e63-bde6-c9970eaf8f87\") " pod="openshift-monitoring/node-exporter-2zfg9" Jun 03 15:50:49.225073 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:49.224887 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2a82cd14-8e94-458d-9e44-e5ca4f1743df-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-gfxp6\" (UID: \"2a82cd14-8e94-458d-9e44-e5ca4f1743df\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-gfxp6" Jun 03 15:50:49.225639 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:49.225285 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b55da440-3026-4e63-bde6-c9970eaf8f87-metrics-client-ca\") pod \"node-exporter-2zfg9\" (UID: \"b55da440-3026-4e63-bde6-c9970eaf8f87\") " pod="openshift-monitoring/node-exporter-2zfg9" Jun 03 15:50:49.225753 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:49.225676 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a82cd14-8e94-458d-9e44-e5ca4f1743df-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-gfxp6\" (UID: \"2a82cd14-8e94-458d-9e44-e5ca4f1743df\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-gfxp6" Jun 03 15:50:49.225753 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:49.225698 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2a82cd14-8e94-458d-9e44-e5ca4f1743df-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-gfxp6\" (UID: \"2a82cd14-8e94-458d-9e44-e5ca4f1743df\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-gfxp6" Jun 03 15:50:49.225923 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:49.225903 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b55da440-3026-4e63-bde6-c9970eaf8f87-node-exporter-accelerators-collector-config\") pod \"node-exporter-2zfg9\" (UID: \"b55da440-3026-4e63-bde6-c9970eaf8f87\") " pod="openshift-monitoring/node-exporter-2zfg9" Jun 03 15:50:49.226907 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:49.226876 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b55da440-3026-4e63-bde6-c9970eaf8f87-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2zfg9\" (UID: \"b55da440-3026-4e63-bde6-c9970eaf8f87\") " pod="openshift-monitoring/node-exporter-2zfg9" Jun 03 15:50:49.227129 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:49.227107 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b55da440-3026-4e63-bde6-c9970eaf8f87-node-exporter-tls\") pod \"node-exporter-2zfg9\" (UID: \"b55da440-3026-4e63-bde6-c9970eaf8f87\") " pod="openshift-monitoring/node-exporter-2zfg9" Jun 03 15:50:49.227812 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:49.227788 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a82cd14-8e94-458d-9e44-e5ca4f1743df-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-gfxp6\" (UID: \"2a82cd14-8e94-458d-9e44-e5ca4f1743df\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-gfxp6" Jun 03 15:50:49.227911 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:49.227811 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a82cd14-8e94-458d-9e44-e5ca4f1743df-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-gfxp6\" (UID: \"2a82cd14-8e94-458d-9e44-e5ca4f1743df\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-gfxp6" Jun 03 15:50:49.234608 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:49.234584 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqdz2\" (UniqueName: \"kubernetes.io/projected/b55da440-3026-4e63-bde6-c9970eaf8f87-kube-api-access-pqdz2\") pod \"node-exporter-2zfg9\" (UID: \"b55da440-3026-4e63-bde6-c9970eaf8f87\") " pod="openshift-monitoring/node-exporter-2zfg9" Jun 03 15:50:49.235143 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:49.235123 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzc44\" (UniqueName: \"kubernetes.io/projected/2a82cd14-8e94-458d-9e44-e5ca4f1743df-kube-api-access-qzc44\") pod \"kube-state-metrics-8469c486bb-gfxp6\" (UID: \"2a82cd14-8e94-458d-9e44-e5ca4f1743df\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-gfxp6" Jun 03 15:50:49.258044 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:49.258020 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-gfxp6" Jun 03 15:50:49.273713 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:49.273693 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2zfg9" Jun 03 15:50:49.280880 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:50:49.280848 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb55da440_3026_4e63_bde6_c9970eaf8f87.slice/crio-17f0bc7cc4fdee489b2ca3ff7e8c7fe0b38ef8b0491c924a43d8f4945ac3b84d WatchSource:0}: Error finding container 17f0bc7cc4fdee489b2ca3ff7e8c7fe0b38ef8b0491c924a43d8f4945ac3b84d: Status 404 returned error can't find the container with id 17f0bc7cc4fdee489b2ca3ff7e8c7fe0b38ef8b0491c924a43d8f4945ac3b84d Jun 03 15:50:49.423517 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:49.423482 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-gfxp6"] Jun 03 15:50:49.427310 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:50:49.427282 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a82cd14_8e94_458d_9e44_e5ca4f1743df.slice/crio-790603a6ecdebe9484384aaa27870c10583bb30516095119cd182b0d6e8992e5 WatchSource:0}: Error finding container 790603a6ecdebe9484384aaa27870c10583bb30516095119cd182b0d6e8992e5: Status 404 returned error can't find the container with id 790603a6ecdebe9484384aaa27870c10583bb30516095119cd182b0d6e8992e5 Jun 03 15:50:49.684713 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:49.684676 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2zfg9" event={"ID":"b55da440-3026-4e63-bde6-c9970eaf8f87","Type":"ContainerStarted","Data":"17f0bc7cc4fdee489b2ca3ff7e8c7fe0b38ef8b0491c924a43d8f4945ac3b84d"} Jun 03 15:50:49.685796 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:49.685765 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-gfxp6" event={"ID":"2a82cd14-8e94-458d-9e44-e5ca4f1743df","Type":"ContainerStarted","Data":"790603a6ecdebe9484384aaa27870c10583bb30516095119cd182b0d6e8992e5"} Jun 03 15:50:50.010708 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.010626 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 15:50:50.012999 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.012974 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:50:50.016929 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.016904 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 03 15:50:50.016929 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.016913 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 03 15:50:50.017122 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.016943 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 03 15:50:50.017122 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.016975 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 03 15:50:50.017122 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.016904 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 03 15:50:50.017578 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.017396 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 03 15:50:50.017578 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.017407 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vtvt5\"" Jun 03 15:50:50.017578 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.017414 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 03 15:50:50.017578 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.017448 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 03 15:50:50.017817 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.017747 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 03 15:50:50.041127 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.041092 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 15:50:50.135591 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.135063 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/96076b50-057c-4d09-9222-ef4a6cf473ef-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"96076b50-057c-4d09-9222-ef4a6cf473ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:50:50.135591 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.135111 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/96076b50-057c-4d09-9222-ef4a6cf473ef-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"96076b50-057c-4d09-9222-ef4a6cf473ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:50:50.135591 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.135143 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/96076b50-057c-4d09-9222-ef4a6cf473ef-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"96076b50-057c-4d09-9222-ef4a6cf473ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:50:50.135591 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.135188 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/96076b50-057c-4d09-9222-ef4a6cf473ef-tls-assets\") pod \"alertmanager-main-0\" (UID: \"96076b50-057c-4d09-9222-ef4a6cf473ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:50:50.135591 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.135214 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/96076b50-057c-4d09-9222-ef4a6cf473ef-config-out\") pod \"alertmanager-main-0\" (UID: \"96076b50-057c-4d09-9222-ef4a6cf473ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:50:50.135591 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.135242 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/96076b50-057c-4d09-9222-ef4a6cf473ef-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"96076b50-057c-4d09-9222-ef4a6cf473ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:50:50.135591 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.135268 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96076b50-057c-4d09-9222-ef4a6cf473ef-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"96076b50-057c-4d09-9222-ef4a6cf473ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:50:50.135591 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.135298 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/96076b50-057c-4d09-9222-ef4a6cf473ef-config-volume\") pod \"alertmanager-main-0\" (UID: \"96076b50-057c-4d09-9222-ef4a6cf473ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:50:50.135591 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.135326 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/96076b50-057c-4d09-9222-ef4a6cf473ef-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"96076b50-057c-4d09-9222-ef4a6cf473ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:50:50.135591 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.135354 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9rlw\" (UniqueName: \"kubernetes.io/projected/96076b50-057c-4d09-9222-ef4a6cf473ef-kube-api-access-g9rlw\") pod \"alertmanager-main-0\" (UID: \"96076b50-057c-4d09-9222-ef4a6cf473ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:50:50.135591 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.135402 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/96076b50-057c-4d09-9222-ef4a6cf473ef-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"96076b50-057c-4d09-9222-ef4a6cf473ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:50:50.135591 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.135427 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96076b50-057c-4d09-9222-ef4a6cf473ef-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"96076b50-057c-4d09-9222-ef4a6cf473ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:50:50.135591 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.135456 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/96076b50-057c-4d09-9222-ef4a6cf473ef-web-config\") pod \"alertmanager-main-0\" (UID: \"96076b50-057c-4d09-9222-ef4a6cf473ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:50:50.237637 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.236708 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/96076b50-057c-4d09-9222-ef4a6cf473ef-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"96076b50-057c-4d09-9222-ef4a6cf473ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:50:50.237637 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.236759 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96076b50-057c-4d09-9222-ef4a6cf473ef-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"96076b50-057c-4d09-9222-ef4a6cf473ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:50:50.237637 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.236796 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/96076b50-057c-4d09-9222-ef4a6cf473ef-config-volume\") pod \"alertmanager-main-0\" (UID: \"96076b50-057c-4d09-9222-ef4a6cf473ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:50:50.237637 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.236827 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/96076b50-057c-4d09-9222-ef4a6cf473ef-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"96076b50-057c-4d09-9222-ef4a6cf473ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:50:50.237637 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.236858 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g9rlw\" (UniqueName: \"kubernetes.io/projected/96076b50-057c-4d09-9222-ef4a6cf473ef-kube-api-access-g9rlw\") pod \"alertmanager-main-0\" (UID: \"96076b50-057c-4d09-9222-ef4a6cf473ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:50:50.237637 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.236906 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/96076b50-057c-4d09-9222-ef4a6cf473ef-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"96076b50-057c-4d09-9222-ef4a6cf473ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:50:50.237637 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.236931 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96076b50-057c-4d09-9222-ef4a6cf473ef-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"96076b50-057c-4d09-9222-ef4a6cf473ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:50:50.237637 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.236960 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/96076b50-057c-4d09-9222-ef4a6cf473ef-web-config\") pod \"alertmanager-main-0\" (UID: \"96076b50-057c-4d09-9222-ef4a6cf473ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:50:50.237637 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.237028 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/96076b50-057c-4d09-9222-ef4a6cf473ef-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"96076b50-057c-4d09-9222-ef4a6cf473ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:50:50.237637 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.237056 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/96076b50-057c-4d09-9222-ef4a6cf473ef-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"96076b50-057c-4d09-9222-ef4a6cf473ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:50:50.237637 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.237085 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/96076b50-057c-4d09-9222-ef4a6cf473ef-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"96076b50-057c-4d09-9222-ef4a6cf473ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:50:50.237637 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.237135 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/96076b50-057c-4d09-9222-ef4a6cf473ef-tls-assets\") pod \"alertmanager-main-0\" (UID: \"96076b50-057c-4d09-9222-ef4a6cf473ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:50:50.237637 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.237162 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/96076b50-057c-4d09-9222-ef4a6cf473ef-config-out\") pod \"alertmanager-main-0\" (UID: \"96076b50-057c-4d09-9222-ef4a6cf473ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:50:50.237637 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:50:50.237526 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/96076b50-057c-4d09-9222-ef4a6cf473ef-alertmanager-trusted-ca-bundle podName:96076b50-057c-4d09-9222-ef4a6cf473ef nodeName:}" failed. No retries permitted until 2026-06-03 15:50:50.737502913 +0000 UTC m=+111.094498025 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/96076b50-057c-4d09-9222-ef4a6cf473ef-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "96076b50-057c-4d09-9222-ef4a6cf473ef") : configmap references non-existent config key: ca-bundle.crt Jun 03 15:50:50.238597 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.237751 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96076b50-057c-4d09-9222-ef4a6cf473ef-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"96076b50-057c-4d09-9222-ef4a6cf473ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:50:50.240393 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.239692 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/96076b50-057c-4d09-9222-ef4a6cf473ef-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"96076b50-057c-4d09-9222-ef4a6cf473ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:50:50.240393 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.240106 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/96076b50-057c-4d09-9222-ef4a6cf473ef-config-out\") pod \"alertmanager-main-0\" (UID: \"96076b50-057c-4d09-9222-ef4a6cf473ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:50:50.243560 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.243535 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/96076b50-057c-4d09-9222-ef4a6cf473ef-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"96076b50-057c-4d09-9222-ef4a6cf473ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:50:50.247193 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.246777 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/96076b50-057c-4d09-9222-ef4a6cf473ef-web-config\") pod \"alertmanager-main-0\" (UID: \"96076b50-057c-4d09-9222-ef4a6cf473ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:50:50.247193 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.247102 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/96076b50-057c-4d09-9222-ef4a6cf473ef-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"96076b50-057c-4d09-9222-ef4a6cf473ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:50:50.247193 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.247153 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/96076b50-057c-4d09-9222-ef4a6cf473ef-tls-assets\") pod \"alertmanager-main-0\" (UID: \"96076b50-057c-4d09-9222-ef4a6cf473ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:50:50.247193 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.247168 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/96076b50-057c-4d09-9222-ef4a6cf473ef-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"96076b50-057c-4d09-9222-ef4a6cf473ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:50:50.247486 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.247195 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/96076b50-057c-4d09-9222-ef4a6cf473ef-config-volume\") pod \"alertmanager-main-0\" (UID: \"96076b50-057c-4d09-9222-ef4a6cf473ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:50:50.247776 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.247753 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/96076b50-057c-4d09-9222-ef4a6cf473ef-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"96076b50-057c-4d09-9222-ef4a6cf473ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:50:50.249688 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.249650 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/96076b50-057c-4d09-9222-ef4a6cf473ef-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"96076b50-057c-4d09-9222-ef4a6cf473ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:50:50.251218 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.251195 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9rlw\" (UniqueName: \"kubernetes.io/projected/96076b50-057c-4d09-9222-ef4a6cf473ef-kube-api-access-g9rlw\") pod \"alertmanager-main-0\" (UID: \"96076b50-057c-4d09-9222-ef4a6cf473ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:50:50.690752 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.690651 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2zfg9" event={"ID":"b55da440-3026-4e63-bde6-c9970eaf8f87","Type":"ContainerStarted","Data":"32ce282a1000eacd42aa03314cf039e3e584c45f38b538772a82fd22efbef2ba"} Jun 03 15:50:50.741401 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.741365 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96076b50-057c-4d09-9222-ef4a6cf473ef-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"96076b50-057c-4d09-9222-ef4a6cf473ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:50:50.742354 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.742330 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96076b50-057c-4d09-9222-ef4a6cf473ef-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"96076b50-057c-4d09-9222-ef4a6cf473ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:50:50.924351 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:50.924324 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:50:51.101339 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:51.101309 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 15:50:51.104637 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:50:51.104598 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96076b50_057c_4d09_9222_ef4a6cf473ef.slice/crio-cd2cd3ea9460bd6895df28926d4029b2c47739602e59c1edbf49f6b38858ab17 WatchSource:0}: Error finding container cd2cd3ea9460bd6895df28926d4029b2c47739602e59c1edbf49f6b38858ab17: Status 404 returned error can't find the container with id cd2cd3ea9460bd6895df28926d4029b2c47739602e59c1edbf49f6b38858ab17 Jun 03 15:50:51.694646 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:51.694610 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96076b50-057c-4d09-9222-ef4a6cf473ef","Type":"ContainerStarted","Data":"cd2cd3ea9460bd6895df28926d4029b2c47739602e59c1edbf49f6b38858ab17"} Jun 03 15:50:51.695802 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:51.695776 2573 generic.go:358] "Generic (PLEG): container finished" podID="b55da440-3026-4e63-bde6-c9970eaf8f87" containerID="32ce282a1000eacd42aa03314cf039e3e584c45f38b538772a82fd22efbef2ba" exitCode=0 Jun 03 15:50:51.695923 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:51.695837 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2zfg9" event={"ID":"b55da440-3026-4e63-bde6-c9970eaf8f87","Type":"ContainerDied","Data":"32ce282a1000eacd42aa03314cf039e3e584c45f38b538772a82fd22efbef2ba"} Jun 03 15:50:51.697553 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:51.697531 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-gfxp6" event={"ID":"2a82cd14-8e94-458d-9e44-e5ca4f1743df","Type":"ContainerStarted","Data":"0e496628566568182e553b5f355dbd0373f4e5755b775a237b60fe6431a176b9"} Jun 03 15:50:51.697631 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:51.697560 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-gfxp6" event={"ID":"2a82cd14-8e94-458d-9e44-e5ca4f1743df","Type":"ContainerStarted","Data":"0e737f0d9edad6d1202f371d5a2e19853b525ecd65b158ea3f5488ecd5405b52"} Jun 03 15:50:51.697631 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:51.697574 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-gfxp6" event={"ID":"2a82cd14-8e94-458d-9e44-e5ca4f1743df","Type":"ContainerStarted","Data":"07e49755ffeff82f32c16c2db0fe423578abda54aa70daa390ebb219180086f2"} Jun 03 15:50:51.739547 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:51.739506 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-8469c486bb-gfxp6" podStartSLOduration=2.364389874 podStartE2EDuration="3.739491203s" podCreationTimestamp="2026-06-03 15:50:48 +0000 UTC" firstStartedPulling="2026-06-03 15:50:49.429824381 +0000 UTC m=+109.786819497" lastFinishedPulling="2026-06-03 15:50:50.804925701 +0000 UTC m=+111.161920826" observedRunningTime="2026-06-03 15:50:51.738031771 +0000 UTC m=+112.095026904" watchObservedRunningTime="2026-06-03 15:50:51.739491203 +0000 UTC m=+112.096486331" Jun 03 15:50:52.702221 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:52.702165 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2zfg9" event={"ID":"b55da440-3026-4e63-bde6-c9970eaf8f87","Type":"ContainerStarted","Data":"d83616b6451b36840a83b9e686268090a0cdac06535657a828ebe2a67e1d4f97"} Jun 03 15:50:52.702221 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:52.702226 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2zfg9" event={"ID":"b55da440-3026-4e63-bde6-c9970eaf8f87","Type":"ContainerStarted","Data":"4dd4484e736dd7c25a9f54fd9365a1647de66dda777631dd7a87c3dbb5b4ae4f"} Jun 03 15:50:52.703773 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:52.703743 2573 generic.go:358] "Generic (PLEG): container finished" podID="96076b50-057c-4d09-9222-ef4a6cf473ef" containerID="646e6c6befdf3d37cdb737bb3d8089af2dfad3eba69cc8b19561152314744af1" exitCode=0 Jun 03 15:50:52.703947 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:52.703918 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96076b50-057c-4d09-9222-ef4a6cf473ef","Type":"ContainerDied","Data":"646e6c6befdf3d37cdb737bb3d8089af2dfad3eba69cc8b19561152314744af1"} Jun 03 15:50:52.733685 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:52.733633 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2zfg9" podStartSLOduration=3.6293599 podStartE2EDuration="4.733620074s" podCreationTimestamp="2026-06-03 15:50:48 +0000 UTC" firstStartedPulling="2026-06-03 15:50:49.282458689 +0000 UTC m=+109.639453800" lastFinishedPulling="2026-06-03 15:50:50.38671886 +0000 UTC m=+110.743713974" observedRunningTime="2026-06-03 15:50:52.732975602 +0000 UTC m=+113.089970734" watchObservedRunningTime="2026-06-03 15:50:52.733620074 +0000 UTC m=+113.090615206" Jun 03 15:50:53.337248 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:53.337214 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-667dcd4-rr79q"] Jun 03 15:50:53.341013 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:53.340977 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-667dcd4-rr79q" Jun 03 15:50:53.346215 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:53.346187 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 03 15:50:53.346373 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:53.346344 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-nmk6z\"" Jun 03 15:50:53.346508 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:53.346428 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 03 15:50:53.347595 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:53.347414 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 03 15:50:53.347595 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:53.347505 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-3i35tllr4ggui\"" Jun 03 15:50:53.347595 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:53.347515 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 03 15:50:53.355447 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:53.355424 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-667dcd4-rr79q"] Jun 03 15:50:53.366774 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:53.366753 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b299018e-c4d4-488b-b6e4-8475c1dfb24e-secret-metrics-server-tls\") pod \"metrics-server-667dcd4-rr79q\" (UID: \"b299018e-c4d4-488b-b6e4-8475c1dfb24e\") " pod="openshift-monitoring/metrics-server-667dcd4-rr79q" Jun 03 15:50:53.366874 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:53.366782 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b299018e-c4d4-488b-b6e4-8475c1dfb24e-secret-metrics-server-client-certs\") pod \"metrics-server-667dcd4-rr79q\" (UID: \"b299018e-c4d4-488b-b6e4-8475c1dfb24e\") " pod="openshift-monitoring/metrics-server-667dcd4-rr79q" Jun 03 15:50:53.366874 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:53.366802 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b299018e-c4d4-488b-b6e4-8475c1dfb24e-audit-log\") pod \"metrics-server-667dcd4-rr79q\" (UID: \"b299018e-c4d4-488b-b6e4-8475c1dfb24e\") " pod="openshift-monitoring/metrics-server-667dcd4-rr79q" Jun 03 15:50:53.366874 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:53.366858 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b299018e-c4d4-488b-b6e4-8475c1dfb24e-client-ca-bundle\") pod \"metrics-server-667dcd4-rr79q\" (UID: \"b299018e-c4d4-488b-b6e4-8475c1dfb24e\") " pod="openshift-monitoring/metrics-server-667dcd4-rr79q" Jun 03 15:50:53.366977 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:53.366897 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b299018e-c4d4-488b-b6e4-8475c1dfb24e-metrics-server-audit-profiles\") pod \"metrics-server-667dcd4-rr79q\" (UID: \"b299018e-c4d4-488b-b6e4-8475c1dfb24e\") " pod="openshift-monitoring/metrics-server-667dcd4-rr79q" Jun 03 15:50:53.366977 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:53.366935 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b299018e-c4d4-488b-b6e4-8475c1dfb24e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-667dcd4-rr79q\" (UID: \"b299018e-c4d4-488b-b6e4-8475c1dfb24e\") " pod="openshift-monitoring/metrics-server-667dcd4-rr79q" Jun 03 15:50:53.366977 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:53.366971 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz5hf\" (UniqueName: \"kubernetes.io/projected/b299018e-c4d4-488b-b6e4-8475c1dfb24e-kube-api-access-qz5hf\") pod \"metrics-server-667dcd4-rr79q\" (UID: \"b299018e-c4d4-488b-b6e4-8475c1dfb24e\") " pod="openshift-monitoring/metrics-server-667dcd4-rr79q" Jun 03 15:50:53.467589 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:53.467544 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qz5hf\" (UniqueName: \"kubernetes.io/projected/b299018e-c4d4-488b-b6e4-8475c1dfb24e-kube-api-access-qz5hf\") pod \"metrics-server-667dcd4-rr79q\" (UID: \"b299018e-c4d4-488b-b6e4-8475c1dfb24e\") " pod="openshift-monitoring/metrics-server-667dcd4-rr79q" Jun 03 15:50:53.467759 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:53.467652 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b299018e-c4d4-488b-b6e4-8475c1dfb24e-secret-metrics-server-tls\") pod \"metrics-server-667dcd4-rr79q\" (UID: \"b299018e-c4d4-488b-b6e4-8475c1dfb24e\") " pod="openshift-monitoring/metrics-server-667dcd4-rr79q" Jun 03 15:50:53.467833 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:53.467759 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b299018e-c4d4-488b-b6e4-8475c1dfb24e-secret-metrics-server-client-certs\") pod \"metrics-server-667dcd4-rr79q\" (UID: \"b299018e-c4d4-488b-b6e4-8475c1dfb24e\") " pod="openshift-monitoring/metrics-server-667dcd4-rr79q" Jun 03 15:50:53.467833 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:53.467788 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b299018e-c4d4-488b-b6e4-8475c1dfb24e-audit-log\") pod \"metrics-server-667dcd4-rr79q\" (UID: \"b299018e-c4d4-488b-b6e4-8475c1dfb24e\") " pod="openshift-monitoring/metrics-server-667dcd4-rr79q" Jun 03 15:50:53.467833 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:53.467822 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b299018e-c4d4-488b-b6e4-8475c1dfb24e-client-ca-bundle\") pod \"metrics-server-667dcd4-rr79q\" (UID: \"b299018e-c4d4-488b-b6e4-8475c1dfb24e\") " pod="openshift-monitoring/metrics-server-667dcd4-rr79q" Jun 03 15:50:53.467991 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:53.467852 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b299018e-c4d4-488b-b6e4-8475c1dfb24e-metrics-server-audit-profiles\") pod \"metrics-server-667dcd4-rr79q\" (UID: \"b299018e-c4d4-488b-b6e4-8475c1dfb24e\") " pod="openshift-monitoring/metrics-server-667dcd4-rr79q" Jun 03 15:50:53.467991 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:53.467892 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b299018e-c4d4-488b-b6e4-8475c1dfb24e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-667dcd4-rr79q\" (UID: \"b299018e-c4d4-488b-b6e4-8475c1dfb24e\") " pod="openshift-monitoring/metrics-server-667dcd4-rr79q" Jun 03 15:50:53.469194 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:53.468201 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b299018e-c4d4-488b-b6e4-8475c1dfb24e-audit-log\") pod \"metrics-server-667dcd4-rr79q\" (UID: \"b299018e-c4d4-488b-b6e4-8475c1dfb24e\") " pod="openshift-monitoring/metrics-server-667dcd4-rr79q" Jun 03 15:50:53.469194 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:53.468612 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b299018e-c4d4-488b-b6e4-8475c1dfb24e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-667dcd4-rr79q\" (UID: \"b299018e-c4d4-488b-b6e4-8475c1dfb24e\") " pod="openshift-monitoring/metrics-server-667dcd4-rr79q" Jun 03 15:50:53.469194 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:53.469147 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b299018e-c4d4-488b-b6e4-8475c1dfb24e-metrics-server-audit-profiles\") pod \"metrics-server-667dcd4-rr79q\" (UID: \"b299018e-c4d4-488b-b6e4-8475c1dfb24e\") " pod="openshift-monitoring/metrics-server-667dcd4-rr79q" Jun 03 15:50:53.471310 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:53.471287 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b299018e-c4d4-488b-b6e4-8475c1dfb24e-secret-metrics-server-tls\") pod \"metrics-server-667dcd4-rr79q\" (UID: \"b299018e-c4d4-488b-b6e4-8475c1dfb24e\") " pod="openshift-monitoring/metrics-server-667dcd4-rr79q" Jun 03 15:50:53.471486 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:53.471443 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b299018e-c4d4-488b-b6e4-8475c1dfb24e-client-ca-bundle\") pod \"metrics-server-667dcd4-rr79q\" (UID: \"b299018e-c4d4-488b-b6e4-8475c1dfb24e\") " pod="openshift-monitoring/metrics-server-667dcd4-rr79q" Jun 03 15:50:53.471602 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:53.471590 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b299018e-c4d4-488b-b6e4-8475c1dfb24e-secret-metrics-server-client-certs\") pod \"metrics-server-667dcd4-rr79q\" (UID: \"b299018e-c4d4-488b-b6e4-8475c1dfb24e\") " pod="openshift-monitoring/metrics-server-667dcd4-rr79q" Jun 03 15:50:53.478648 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:53.478607 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz5hf\" (UniqueName: \"kubernetes.io/projected/b299018e-c4d4-488b-b6e4-8475c1dfb24e-kube-api-access-qz5hf\") pod \"metrics-server-667dcd4-rr79q\" (UID: \"b299018e-c4d4-488b-b6e4-8475c1dfb24e\") " pod="openshift-monitoring/metrics-server-667dcd4-rr79q" Jun 03 15:50:53.652338 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:53.651827 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-667dcd4-rr79q" Jun 03 15:50:53.720898 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:53.720579 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-7qftz"] Jun 03 15:50:53.728252 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:53.728226 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-7qftz" Jun 03 15:50:53.734106 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:53.734069 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-w5cfj\"" Jun 03 15:50:53.734404 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:53.734069 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 03 15:50:53.738233 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:53.738206 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-7qftz"] Jun 03 15:50:53.774045 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:53.774010 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/72f174a8-f17c-4662-bb30-a7f38f5680f4-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-7qftz\" (UID: \"72f174a8-f17c-4662-bb30-a7f38f5680f4\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-7qftz" Jun 03 15:50:53.825062 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:53.824935 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-667dcd4-rr79q"] Jun 03 15:50:53.827566 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:50:53.827530 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb299018e_c4d4_488b_b6e4_8475c1dfb24e.slice/crio-605ebb5b2ebc6e2dee4a65446b741aa939ddbab63aa6d7218d65197df64fa220 WatchSource:0}: Error finding container 605ebb5b2ebc6e2dee4a65446b741aa939ddbab63aa6d7218d65197df64fa220: Status 404 returned error can't find the container with id 605ebb5b2ebc6e2dee4a65446b741aa939ddbab63aa6d7218d65197df64fa220 Jun 03 15:50:53.875446 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:53.875280 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/72f174a8-f17c-4662-bb30-a7f38f5680f4-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-7qftz\" (UID: \"72f174a8-f17c-4662-bb30-a7f38f5680f4\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-7qftz" Jun 03 15:50:53.875611 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:50:53.875459 2573 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 03 15:50:53.875611 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:50:53.875578 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72f174a8-f17c-4662-bb30-a7f38f5680f4-monitoring-plugin-cert podName:72f174a8-f17c-4662-bb30-a7f38f5680f4 nodeName:}" failed. No retries permitted until 2026-06-03 15:50:54.375555436 +0000 UTC m=+114.732550549 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/72f174a8-f17c-4662-bb30-a7f38f5680f4-monitoring-plugin-cert") pod "monitoring-plugin-5768fcc9dd-7qftz" (UID: "72f174a8-f17c-4662-bb30-a7f38f5680f4") : secret "monitoring-plugin-cert" not found Jun 03 15:50:54.380002 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:54.379959 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/72f174a8-f17c-4662-bb30-a7f38f5680f4-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-7qftz\" (UID: \"72f174a8-f17c-4662-bb30-a7f38f5680f4\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-7qftz" Jun 03 15:50:54.382825 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:54.382788 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/72f174a8-f17c-4662-bb30-a7f38f5680f4-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-7qftz\" (UID: \"72f174a8-f17c-4662-bb30-a7f38f5680f4\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-7qftz" Jun 03 15:50:54.642390 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:54.642217 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-7qftz" Jun 03 15:50:54.712981 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:54.712935 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-667dcd4-rr79q" event={"ID":"b299018e-c4d4-488b-b6e4-8475c1dfb24e","Type":"ContainerStarted","Data":"605ebb5b2ebc6e2dee4a65446b741aa939ddbab63aa6d7218d65197df64fa220"} Jun 03 15:50:54.717569 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:54.717462 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96076b50-057c-4d09-9222-ef4a6cf473ef","Type":"ContainerStarted","Data":"7853df1b72abbce4dd8e4ad89788f997bd7ae994f61c60c88551fcf83bbfaee2"} Jun 03 15:50:54.717569 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:54.717514 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96076b50-057c-4d09-9222-ef4a6cf473ef","Type":"ContainerStarted","Data":"ddd1c71773aab377c44786063b4dac92e0e5411108e2cf26e2f2c6af52b03a84"} Jun 03 15:50:54.717569 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:54.717527 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96076b50-057c-4d09-9222-ef4a6cf473ef","Type":"ContainerStarted","Data":"93fef6e271c0ea791f4502ac35128495cca5762d8930a0b7e9d490000d0ac781"} Jun 03 15:50:54.717569 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:54.717541 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96076b50-057c-4d09-9222-ef4a6cf473ef","Type":"ContainerStarted","Data":"19b69ab18eeb9426558ee2d315f44180550f71c10961be9afb4434677b232f3b"} Jun 03 15:50:54.798459 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:54.798401 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-7qftz"] Jun 03 15:50:54.802092 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:50:54.802061 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72f174a8_f17c_4662_bb30_a7f38f5680f4.slice/crio-da41a171e6b56852946eb560541b6dfe613afa13229979144a77d9ccb8897a6c WatchSource:0}: Error finding container da41a171e6b56852946eb560541b6dfe613afa13229979144a77d9ccb8897a6c: Status 404 returned error can't find the container with id da41a171e6b56852946eb560541b6dfe613afa13229979144a77d9ccb8897a6c Jun 03 15:50:55.168989 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.168300 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 15:50:55.171951 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.171928 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.175336 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.174967 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 03 15:50:55.175894 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.175771 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 03 15:50:55.176362 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.176174 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-4vw59\"" Jun 03 15:50:55.176362 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.176179 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 03 15:50:55.176745 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.176574 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 03 15:50:55.176745 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.176629 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 03 15:50:55.177503 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.176906 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 03 15:50:55.177503 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.177190 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 03 15:50:55.177634 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.177529 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 03 15:50:55.181714 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.178338 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6fb9peue5hu97\"" Jun 03 15:50:55.181714 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.178836 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 03 15:50:55.181714 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.179143 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 03 15:50:55.181714 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.179165 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 03 15:50:55.185566 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.185542 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 03 15:50:55.189451 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.189428 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dd451b12-b8ac-4c93-9872-c99bfca851c4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.189557 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.189490 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd451b12-b8ac-4c93-9872-c99bfca851c4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.189557 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.189524 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dd451b12-b8ac-4c93-9872-c99bfca851c4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.189664 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.189560 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dd451b12-b8ac-4c93-9872-c99bfca851c4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.189664 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.189588 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dd451b12-b8ac-4c93-9872-c99bfca851c4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.189664 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.189621 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd451b12-b8ac-4c93-9872-c99bfca851c4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.189664 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.189651 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dd451b12-b8ac-4c93-9872-c99bfca851c4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.189827 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.189748 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g75m7\" (UniqueName: \"kubernetes.io/projected/dd451b12-b8ac-4c93-9872-c99bfca851c4-kube-api-access-g75m7\") pod \"prometheus-k8s-0\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.189827 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.189794 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dd451b12-b8ac-4c93-9872-c99bfca851c4-config-out\") pod \"prometheus-k8s-0\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.189886 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.189828 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd451b12-b8ac-4c93-9872-c99bfca851c4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.189931 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.189881 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dd451b12-b8ac-4c93-9872-c99bfca851c4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.189974 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.189925 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dd451b12-b8ac-4c93-9872-c99bfca851c4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.189974 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.189953 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/dd451b12-b8ac-4c93-9872-c99bfca851c4-config\") pod \"prometheus-k8s-0\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.190039 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.189987 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd451b12-b8ac-4c93-9872-c99bfca851c4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.190039 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.190012 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dd451b12-b8ac-4c93-9872-c99bfca851c4-web-config\") pod \"prometheus-k8s-0\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.190097 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.190059 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dd451b12-b8ac-4c93-9872-c99bfca851c4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.190097 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.190083 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dd451b12-b8ac-4c93-9872-c99bfca851c4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.190168 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.190109 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dd451b12-b8ac-4c93-9872-c99bfca851c4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.198910 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.198885 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 15:50:55.291183 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.291150 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd451b12-b8ac-4c93-9872-c99bfca851c4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.291183 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.291187 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dd451b12-b8ac-4c93-9872-c99bfca851c4-web-config\") pod \"prometheus-k8s-0\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.291428 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.291231 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dd451b12-b8ac-4c93-9872-c99bfca851c4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.291428 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.291257 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dd451b12-b8ac-4c93-9872-c99bfca851c4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.291428 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.291279 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dd451b12-b8ac-4c93-9872-c99bfca851c4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.291428 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.291330 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dd451b12-b8ac-4c93-9872-c99bfca851c4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.291428 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.291369 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd451b12-b8ac-4c93-9872-c99bfca851c4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.291428 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.291397 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dd451b12-b8ac-4c93-9872-c99bfca851c4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.291748 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.291437 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dd451b12-b8ac-4c93-9872-c99bfca851c4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.291748 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.291464 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dd451b12-b8ac-4c93-9872-c99bfca851c4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.291748 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.291541 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd451b12-b8ac-4c93-9872-c99bfca851c4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.291748 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.291567 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dd451b12-b8ac-4c93-9872-c99bfca851c4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.291748 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.291604 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g75m7\" (UniqueName: \"kubernetes.io/projected/dd451b12-b8ac-4c93-9872-c99bfca851c4-kube-api-access-g75m7\") pod \"prometheus-k8s-0\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.291748 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.291629 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dd451b12-b8ac-4c93-9872-c99bfca851c4-config-out\") pod \"prometheus-k8s-0\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.291748 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.291653 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd451b12-b8ac-4c93-9872-c99bfca851c4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.291748 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.291684 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dd451b12-b8ac-4c93-9872-c99bfca851c4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.291748 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.291682 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dd451b12-b8ac-4c93-9872-c99bfca851c4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.292167 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.292030 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd451b12-b8ac-4c93-9872-c99bfca851c4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.292950 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.292640 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd451b12-b8ac-4c93-9872-c99bfca851c4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.294597 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.294564 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dd451b12-b8ac-4c93-9872-c99bfca851c4-web-config\") pod \"prometheus-k8s-0\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.294691 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.294646 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dd451b12-b8ac-4c93-9872-c99bfca851c4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.295350 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.295014 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dd451b12-b8ac-4c93-9872-c99bfca851c4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.295350 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.295242 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dd451b12-b8ac-4c93-9872-c99bfca851c4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.295350 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.295294 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dd451b12-b8ac-4c93-9872-c99bfca851c4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.295350 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.295317 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dd451b12-b8ac-4c93-9872-c99bfca851c4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.295350 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.295337 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/dd451b12-b8ac-4c93-9872-c99bfca851c4-config\") pod \"prometheus-k8s-0\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.295350 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.295343 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dd451b12-b8ac-4c93-9872-c99bfca851c4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.295705 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.295345 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dd451b12-b8ac-4c93-9872-c99bfca851c4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.295705 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.295600 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd451b12-b8ac-4c93-9872-c99bfca851c4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.296109 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.296063 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd451b12-b8ac-4c93-9872-c99bfca851c4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.297633 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.297584 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dd451b12-b8ac-4c93-9872-c99bfca851c4-config-out\") pod \"prometheus-k8s-0\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.298369 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.298176 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dd451b12-b8ac-4c93-9872-c99bfca851c4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.298369 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.298329 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dd451b12-b8ac-4c93-9872-c99bfca851c4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.298829 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.298808 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/dd451b12-b8ac-4c93-9872-c99bfca851c4-config\") pod \"prometheus-k8s-0\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.299405 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.299375 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dd451b12-b8ac-4c93-9872-c99bfca851c4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.306115 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.306088 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g75m7\" (UniqueName: \"kubernetes.io/projected/dd451b12-b8ac-4c93-9872-c99bfca851c4-kube-api-access-g75m7\") pod \"prometheus-k8s-0\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.489203 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.489121 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:50:55.728257 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.728215 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-7qftz" event={"ID":"72f174a8-f17c-4662-bb30-a7f38f5680f4","Type":"ContainerStarted","Data":"da41a171e6b56852946eb560541b6dfe613afa13229979144a77d9ccb8897a6c"} Jun 03 15:50:55.732710 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.732685 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96076b50-057c-4d09-9222-ef4a6cf473ef","Type":"ContainerStarted","Data":"8d87c9adb821586af3e12f73603d01bf1f6fbf397d0558a68af58614aad3007c"} Jun 03 15:50:55.890048 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:55.890014 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 15:50:55.893963 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:50:55.893930 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd451b12_b8ac_4c93_9872_c99bfca851c4.slice/crio-42efa0dee1ed79f4ea1238c7a461d93da304f1e388a479cde6e0a61f2b912e2e WatchSource:0}: Error finding container 42efa0dee1ed79f4ea1238c7a461d93da304f1e388a479cde6e0a61f2b912e2e: Status 404 returned error can't find the container with id 42efa0dee1ed79f4ea1238c7a461d93da304f1e388a479cde6e0a61f2b912e2e Jun 03 15:50:56.738340 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:56.738298 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-667dcd4-rr79q" event={"ID":"b299018e-c4d4-488b-b6e4-8475c1dfb24e","Type":"ContainerStarted","Data":"ad1b654a6f5b9326c094afaa2ecb41fcde385a9b58ed921e5afdb49276be1e29"} Jun 03 15:50:56.739897 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:56.739868 2573 generic.go:358] "Generic (PLEG): container finished" podID="dd451b12-b8ac-4c93-9872-c99bfca851c4" containerID="d4b15466672b1cd62b3b0b5fa3d3efe6d298b3c5dab42b7df9f5cecf401fc71f" exitCode=0 Jun 03 15:50:56.740010 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:56.739909 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd451b12-b8ac-4c93-9872-c99bfca851c4","Type":"ContainerDied","Data":"d4b15466672b1cd62b3b0b5fa3d3efe6d298b3c5dab42b7df9f5cecf401fc71f"} Jun 03 15:50:56.740010 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:56.739946 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd451b12-b8ac-4c93-9872-c99bfca851c4","Type":"ContainerStarted","Data":"42efa0dee1ed79f4ea1238c7a461d93da304f1e388a479cde6e0a61f2b912e2e"} Jun 03 15:50:56.743601 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:56.743580 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96076b50-057c-4d09-9222-ef4a6cf473ef","Type":"ContainerStarted","Data":"29dc8164fe12a121ea7270e64506492d23b4cfe2c42e86afa0cbfecd6e3d8dbd"} Jun 03 15:50:56.767264 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:56.767205 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-667dcd4-rr79q" podStartSLOduration=1.868549823 podStartE2EDuration="3.76718655s" podCreationTimestamp="2026-06-03 15:50:53 +0000 UTC" firstStartedPulling="2026-06-03 15:50:53.830087149 +0000 UTC m=+114.187082260" lastFinishedPulling="2026-06-03 15:50:55.728723865 +0000 UTC m=+116.085718987" observedRunningTime="2026-06-03 15:50:56.766594368 +0000 UTC m=+117.123589501" watchObservedRunningTime="2026-06-03 15:50:56.76718655 +0000 UTC m=+117.124181759" Jun 03 15:50:56.853507 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:50:56.853419 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.231190052 podStartE2EDuration="7.853402258s" podCreationTimestamp="2026-06-03 15:50:49 +0000 UTC" firstStartedPulling="2026-06-03 15:50:51.107092334 +0000 UTC m=+111.464087458" lastFinishedPulling="2026-06-03 15:50:55.72930455 +0000 UTC m=+116.086299664" observedRunningTime="2026-06-03 15:50:56.852882405 +0000 UTC m=+117.209877574" watchObservedRunningTime="2026-06-03 15:50:56.853402258 +0000 UTC m=+117.210397390" Jun 03 15:51:03.766399 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:03.766302 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-7qftz" event={"ID":"72f174a8-f17c-4662-bb30-a7f38f5680f4","Type":"ContainerStarted","Data":"4d93fb94cc799fc314b6bc5c8459982cf11837114ded6c36fcc6609af721cc76"} Jun 03 15:51:03.766833 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:03.766682 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-7qftz" Jun 03 15:51:03.768397 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:03.768349 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-6hwfq" event={"ID":"a2ed9416-2213-4243-97ae-995553f3e968","Type":"ContainerStarted","Data":"38c615315a45ad7328375285f1ebfd37a587401dc8605b10826086c05c6d21df"} Jun 03 15:51:03.768635 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:03.768610 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-c65b8dc4b-6hwfq" Jun 03 15:51:03.769712 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:03.769675 2573 patch_prober.go:28] interesting pod/downloads-c65b8dc4b-6hwfq container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.11:8080/\": dial tcp 10.133.0.11:8080: connect: connection refused" start-of-body= Jun 03 15:51:03.770084 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:03.769777 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-c65b8dc4b-6hwfq" podUID="a2ed9416-2213-4243-97ae-995553f3e968" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.11:8080/\": dial tcp 10.133.0.11:8080: connect: connection refused" Jun 03 15:51:03.772846 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:03.772827 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-7qftz" Jun 03 15:51:03.791966 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:03.791919 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-7qftz" podStartSLOduration=2.123167196 podStartE2EDuration="10.791903596s" podCreationTimestamp="2026-06-03 15:50:53 +0000 UTC" firstStartedPulling="2026-06-03 15:50:54.804625536 +0000 UTC m=+115.161620647" lastFinishedPulling="2026-06-03 15:51:03.47336193 +0000 UTC m=+123.830357047" observedRunningTime="2026-06-03 15:51:03.79057136 +0000 UTC m=+124.147566505" watchObservedRunningTime="2026-06-03 15:51:03.791903596 +0000 UTC m=+124.148898727" Jun 03 15:51:03.812488 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:03.812437 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-c65b8dc4b-6hwfq" podStartSLOduration=1.589010926 podStartE2EDuration="20.812422436s" podCreationTimestamp="2026-06-03 15:50:43 +0000 UTC" firstStartedPulling="2026-06-03 15:50:44.294248142 +0000 UTC m=+104.651243251" lastFinishedPulling="2026-06-03 15:51:03.51765965 +0000 UTC m=+123.874654761" observedRunningTime="2026-06-03 15:51:03.811663509 +0000 UTC m=+124.168658660" watchObservedRunningTime="2026-06-03 15:51:03.812422436 +0000 UTC m=+124.169417568" Jun 03 15:51:04.777026 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:04.776971 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-c65b8dc4b-6hwfq" Jun 03 15:51:07.781949 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:07.781906 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd451b12-b8ac-4c93-9872-c99bfca851c4","Type":"ContainerStarted","Data":"61a21d8054068b925577cf3b2049980ff26683483521f3f327659a9e3fef0d52"} Jun 03 15:51:07.781949 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:07.781954 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd451b12-b8ac-4c93-9872-c99bfca851c4","Type":"ContainerStarted","Data":"6d80401c9e7e508023fe4754b121e132f390dcb631bfb2ebbc98284f46845ca8"} Jun 03 15:51:09.033056 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:09.033009 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5aa0ffe1-5bf5-47f0-9814-d639c23b597f-metrics-certs\") pod \"network-metrics-daemon-zl2xd\" (UID: \"5aa0ffe1-5bf5-47f0-9814-d639c23b597f\") " pod="openshift-multus/network-metrics-daemon-zl2xd" Jun 03 15:51:09.035792 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:09.035739 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5aa0ffe1-5bf5-47f0-9814-d639c23b597f-metrics-certs\") pod \"network-metrics-daemon-zl2xd\" (UID: \"5aa0ffe1-5bf5-47f0-9814-d639c23b597f\") " pod="openshift-multus/network-metrics-daemon-zl2xd" Jun 03 15:51:09.057961 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:09.057939 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4qlwk\"" Jun 03 15:51:09.064977 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:09.064951 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zl2xd" Jun 03 15:51:09.768828 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:09.768798 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zl2xd"] Jun 03 15:51:09.772409 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:51:09.772360 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5aa0ffe1_5bf5_47f0_9814_d639c23b597f.slice/crio-c5517448fdbdc90fa64f4c419ae1c36392d1574c8fe0bd0ff4c7d72f170da82f WatchSource:0}: Error finding container c5517448fdbdc90fa64f4c419ae1c36392d1574c8fe0bd0ff4c7d72f170da82f: Status 404 returned error can't find the container with id c5517448fdbdc90fa64f4c419ae1c36392d1574c8fe0bd0ff4c7d72f170da82f Jun 03 15:51:09.789860 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:09.789824 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zl2xd" event={"ID":"5aa0ffe1-5bf5-47f0-9814-d639c23b597f","Type":"ContainerStarted","Data":"c5517448fdbdc90fa64f4c419ae1c36392d1574c8fe0bd0ff4c7d72f170da82f"} Jun 03 15:51:10.804838 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:10.804794 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd451b12-b8ac-4c93-9872-c99bfca851c4","Type":"ContainerStarted","Data":"eb94dab44037e0321eeba1566feb0c80c6853a114bb422ac50474d16324ab8f7"} Jun 03 15:51:10.804838 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:10.804842 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd451b12-b8ac-4c93-9872-c99bfca851c4","Type":"ContainerStarted","Data":"c631d3a8fb534bd0dc24cad4f5a917363ec04bb3063837ea4f2d3be0caf6eee3"} Jun 03 15:51:10.805448 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:10.804855 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd451b12-b8ac-4c93-9872-c99bfca851c4","Type":"ContainerStarted","Data":"2bb18fcc794ba4649e60b53c488dafd181aa0e6a48e3f136a63884f01f4c3d9f"} Jun 03 15:51:10.805448 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:10.804867 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd451b12-b8ac-4c93-9872-c99bfca851c4","Type":"ContainerStarted","Data":"1e0aa63e5db6a95a18c3edcdbf811810a1b61141749fe5e08885469ca840278d"} Jun 03 15:51:10.843360 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:10.842054 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.585567784 podStartE2EDuration="15.842034828s" podCreationTimestamp="2026-06-03 15:50:55 +0000 UTC" firstStartedPulling="2026-06-03 15:50:56.741247039 +0000 UTC m=+117.098242164" lastFinishedPulling="2026-06-03 15:51:09.997714096 +0000 UTC m=+130.354709208" observedRunningTime="2026-06-03 15:51:10.840384415 +0000 UTC m=+131.197379562" watchObservedRunningTime="2026-06-03 15:51:10.842034828 +0000 UTC m=+131.199029958" Jun 03 15:51:11.628047 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:11.628015 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_96076b50-057c-4d09-9222-ef4a6cf473ef/init-config-reloader/0.log" Jun 03 15:51:11.637904 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:11.637878 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_96076b50-057c-4d09-9222-ef4a6cf473ef/alertmanager/0.log" Jun 03 15:51:11.723134 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:11.723072 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_96076b50-057c-4d09-9222-ef4a6cf473ef/config-reloader/0.log" Jun 03 15:51:11.809718 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:11.809682 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zl2xd" event={"ID":"5aa0ffe1-5bf5-47f0-9814-d639c23b597f","Type":"ContainerStarted","Data":"14cf7c72cec18cf58041ede8e1f3bc740f163334ac13328cf3b53b5538c8259a"} Jun 03 15:51:11.810183 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:11.809723 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zl2xd" event={"ID":"5aa0ffe1-5bf5-47f0-9814-d639c23b597f","Type":"ContainerStarted","Data":"3a555eef01fd30895244ff5a27a96c6b477e6ab0ed600cee391d005f6fa75d8c"} Jun 03 15:51:11.830571 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:11.830496 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zl2xd" podStartSLOduration=130.196863131 podStartE2EDuration="2m11.830441762s" podCreationTimestamp="2026-06-03 15:49:00 +0000 UTC" firstStartedPulling="2026-06-03 15:51:09.774853165 +0000 UTC m=+130.131848289" lastFinishedPulling="2026-06-03 15:51:11.408431808 +0000 UTC m=+131.765426920" observedRunningTime="2026-06-03 15:51:11.829971294 +0000 UTC m=+132.186966426" watchObservedRunningTime="2026-06-03 15:51:11.830441762 +0000 UTC m=+132.187436892" Jun 03 15:51:11.930172 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:11.930091 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_96076b50-057c-4d09-9222-ef4a6cf473ef/kube-rbac-proxy-web/0.log" Jun 03 15:51:12.124077 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:12.124051 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_96076b50-057c-4d09-9222-ef4a6cf473ef/kube-rbac-proxy/0.log" Jun 03 15:51:12.324682 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:12.324652 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_96076b50-057c-4d09-9222-ef4a6cf473ef/kube-rbac-proxy-metric/0.log" Jun 03 15:51:12.524882 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:12.524853 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_96076b50-057c-4d09-9222-ef4a6cf473ef/prom-label-proxy/0.log" Jun 03 15:51:12.922851 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:12.922816 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-gfxp6_2a82cd14-8e94-458d-9e44-e5ca4f1743df/kube-state-metrics/0.log" Jun 03 15:51:13.123395 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:13.123367 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-gfxp6_2a82cd14-8e94-458d-9e44-e5ca4f1743df/kube-rbac-proxy-main/0.log" Jun 03 15:51:13.328420 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:13.328397 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-gfxp6_2a82cd14-8e94-458d-9e44-e5ca4f1743df/kube-rbac-proxy-self/0.log" Jun 03 15:51:13.524074 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:13.524051 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-667dcd4-rr79q_b299018e-c4d4-488b-b6e4-8475c1dfb24e/metrics-server/0.log" Jun 03 15:51:13.653278 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:13.653199 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-667dcd4-rr79q" Jun 03 15:51:13.653278 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:13.653238 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-667dcd4-rr79q" Jun 03 15:51:13.726198 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:13.726172 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5768fcc9dd-7qftz_72f174a8-f17c-4662-bb30-a7f38f5680f4/monitoring-plugin/0.log" Jun 03 15:51:13.923758 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:13.923679 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2zfg9_b55da440-3026-4e63-bde6-c9970eaf8f87/init-textfile/0.log" Jun 03 15:51:14.123798 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:14.123761 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2zfg9_b55da440-3026-4e63-bde6-c9970eaf8f87/node-exporter/0.log" Jun 03 15:51:14.322693 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:14.322669 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2zfg9_b55da440-3026-4e63-bde6-c9970eaf8f87/kube-rbac-proxy/0.log" Jun 03 15:51:15.489264 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:15.489219 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:51:16.322887 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:16.322852 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_dd451b12-b8ac-4c93-9872-c99bfca851c4/init-config-reloader/0.log" Jun 03 15:51:16.529052 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:16.529017 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_dd451b12-b8ac-4c93-9872-c99bfca851c4/prometheus/0.log" Jun 03 15:51:16.724707 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:16.724625 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_dd451b12-b8ac-4c93-9872-c99bfca851c4/config-reloader/0.log" Jun 03 15:51:16.923419 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:16.923393 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_dd451b12-b8ac-4c93-9872-c99bfca851c4/thanos-sidecar/0.log" Jun 03 15:51:17.131907 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:17.131876 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_dd451b12-b8ac-4c93-9872-c99bfca851c4/kube-rbac-proxy-web/0.log" Jun 03 15:51:17.323519 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:17.323496 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_dd451b12-b8ac-4c93-9872-c99bfca851c4/kube-rbac-proxy/0.log" Jun 03 15:51:17.523450 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:17.523377 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_dd451b12-b8ac-4c93-9872-c99bfca851c4/kube-rbac-proxy-thanos/0.log" Jun 03 15:51:20.523926 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:20.523881 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-c65b8dc4b-6hwfq_a2ed9416-2213-4243-97ae-995553f3e968/download-server/0.log" Jun 03 15:51:33.658013 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:33.657984 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-667dcd4-rr79q" Jun 03 15:51:33.661802 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:33.661783 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-667dcd4-rr79q" Jun 03 15:51:55.489862 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:55.489770 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:51:55.508809 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:55.508786 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:51:55.964293 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:51:55.964257 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:09.359159 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:09.359125 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 15:52:09.359712 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:09.359575 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="96076b50-057c-4d09-9222-ef4a6cf473ef" containerName="alertmanager" containerID="cri-o://19b69ab18eeb9426558ee2d315f44180550f71c10961be9afb4434677b232f3b" gracePeriod=120 Jun 03 15:52:09.359712 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:09.359642 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="96076b50-057c-4d09-9222-ef4a6cf473ef" containerName="kube-rbac-proxy-metric" containerID="cri-o://8d87c9adb821586af3e12f73603d01bf1f6fbf397d0558a68af58614aad3007c" gracePeriod=120 Jun 03 15:52:09.359712 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:09.359706 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="96076b50-057c-4d09-9222-ef4a6cf473ef" containerName="config-reloader" containerID="cri-o://93fef6e271c0ea791f4502ac35128495cca5762d8930a0b7e9d490000d0ac781" gracePeriod=120 Jun 03 15:52:09.359880 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:09.359687 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="96076b50-057c-4d09-9222-ef4a6cf473ef" containerName="kube-rbac-proxy-web" containerID="cri-o://ddd1c71773aab377c44786063b4dac92e0e5411108e2cf26e2f2c6af52b03a84" gracePeriod=120 Jun 03 15:52:09.359880 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:09.359707 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="96076b50-057c-4d09-9222-ef4a6cf473ef" containerName="kube-rbac-proxy" containerID="cri-o://7853df1b72abbce4dd8e4ad89788f997bd7ae994f61c60c88551fcf83bbfaee2" gracePeriod=120 Jun 03 15:52:09.359880 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:09.359684 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="96076b50-057c-4d09-9222-ef4a6cf473ef" containerName="prom-label-proxy" containerID="cri-o://29dc8164fe12a121ea7270e64506492d23b4cfe2c42e86afa0cbfecd6e3d8dbd" gracePeriod=120 Jun 03 15:52:09.989302 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:09.989271 2573 generic.go:358] "Generic (PLEG): container finished" podID="96076b50-057c-4d09-9222-ef4a6cf473ef" containerID="29dc8164fe12a121ea7270e64506492d23b4cfe2c42e86afa0cbfecd6e3d8dbd" exitCode=0 Jun 03 15:52:09.989302 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:09.989294 2573 generic.go:358] "Generic (PLEG): container finished" podID="96076b50-057c-4d09-9222-ef4a6cf473ef" containerID="7853df1b72abbce4dd8e4ad89788f997bd7ae994f61c60c88551fcf83bbfaee2" exitCode=0 Jun 03 15:52:09.989302 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:09.989301 2573 generic.go:358] "Generic (PLEG): container finished" podID="96076b50-057c-4d09-9222-ef4a6cf473ef" containerID="93fef6e271c0ea791f4502ac35128495cca5762d8930a0b7e9d490000d0ac781" exitCode=0 Jun 03 15:52:09.989302 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:09.989307 2573 generic.go:358] "Generic (PLEG): container finished" podID="96076b50-057c-4d09-9222-ef4a6cf473ef" containerID="19b69ab18eeb9426558ee2d315f44180550f71c10961be9afb4434677b232f3b" exitCode=0 Jun 03 15:52:09.989608 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:09.989343 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96076b50-057c-4d09-9222-ef4a6cf473ef","Type":"ContainerDied","Data":"29dc8164fe12a121ea7270e64506492d23b4cfe2c42e86afa0cbfecd6e3d8dbd"} Jun 03 15:52:09.989608 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:09.989377 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96076b50-057c-4d09-9222-ef4a6cf473ef","Type":"ContainerDied","Data":"7853df1b72abbce4dd8e4ad89788f997bd7ae994f61c60c88551fcf83bbfaee2"} Jun 03 15:52:09.989608 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:09.989387 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96076b50-057c-4d09-9222-ef4a6cf473ef","Type":"ContainerDied","Data":"93fef6e271c0ea791f4502ac35128495cca5762d8930a0b7e9d490000d0ac781"} Jun 03 15:52:09.989608 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:09.989396 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96076b50-057c-4d09-9222-ef4a6cf473ef","Type":"ContainerDied","Data":"19b69ab18eeb9426558ee2d315f44180550f71c10961be9afb4434677b232f3b"} Jun 03 15:52:10.599536 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:10.599511 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:52:10.754898 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:10.754808 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/96076b50-057c-4d09-9222-ef4a6cf473ef-web-config\") pod \"96076b50-057c-4d09-9222-ef4a6cf473ef\" (UID: \"96076b50-057c-4d09-9222-ef4a6cf473ef\") " Jun 03 15:52:10.754898 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:10.754846 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g9rlw\" (UniqueName: \"kubernetes.io/projected/96076b50-057c-4d09-9222-ef4a6cf473ef-kube-api-access-g9rlw\") pod \"96076b50-057c-4d09-9222-ef4a6cf473ef\" (UID: \"96076b50-057c-4d09-9222-ef4a6cf473ef\") " Jun 03 15:52:10.754898 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:10.754887 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/96076b50-057c-4d09-9222-ef4a6cf473ef-config-volume\") pod \"96076b50-057c-4d09-9222-ef4a6cf473ef\" (UID: \"96076b50-057c-4d09-9222-ef4a6cf473ef\") " Jun 03 15:52:10.755167 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:10.754913 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/96076b50-057c-4d09-9222-ef4a6cf473ef-secret-alertmanager-kube-rbac-proxy-web\") pod \"96076b50-057c-4d09-9222-ef4a6cf473ef\" (UID: \"96076b50-057c-4d09-9222-ef4a6cf473ef\") " Jun 03 15:52:10.755167 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:10.754930 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96076b50-057c-4d09-9222-ef4a6cf473ef-alertmanager-trusted-ca-bundle\") pod \"96076b50-057c-4d09-9222-ef4a6cf473ef\" (UID: \"96076b50-057c-4d09-9222-ef4a6cf473ef\") " Jun 03 15:52:10.755167 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:10.754948 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/96076b50-057c-4d09-9222-ef4a6cf473ef-cluster-tls-config\") pod \"96076b50-057c-4d09-9222-ef4a6cf473ef\" (UID: \"96076b50-057c-4d09-9222-ef4a6cf473ef\") " Jun 03 15:52:10.755167 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:10.754971 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/96076b50-057c-4d09-9222-ef4a6cf473ef-secret-alertmanager-kube-rbac-proxy-metric\") pod \"96076b50-057c-4d09-9222-ef4a6cf473ef\" (UID: \"96076b50-057c-4d09-9222-ef4a6cf473ef\") " Jun 03 15:52:10.755167 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:10.755041 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/96076b50-057c-4d09-9222-ef4a6cf473ef-tls-assets\") pod \"96076b50-057c-4d09-9222-ef4a6cf473ef\" (UID: \"96076b50-057c-4d09-9222-ef4a6cf473ef\") " Jun 03 15:52:10.755167 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:10.755080 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96076b50-057c-4d09-9222-ef4a6cf473ef-metrics-client-ca\") pod \"96076b50-057c-4d09-9222-ef4a6cf473ef\" (UID: \"96076b50-057c-4d09-9222-ef4a6cf473ef\") " Jun 03 15:52:10.755167 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:10.755111 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/96076b50-057c-4d09-9222-ef4a6cf473ef-config-out\") pod \"96076b50-057c-4d09-9222-ef4a6cf473ef\" (UID: \"96076b50-057c-4d09-9222-ef4a6cf473ef\") " Jun 03 15:52:10.755167 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:10.755138 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/96076b50-057c-4d09-9222-ef4a6cf473ef-alertmanager-main-db\") pod \"96076b50-057c-4d09-9222-ef4a6cf473ef\" (UID: \"96076b50-057c-4d09-9222-ef4a6cf473ef\") " Jun 03 15:52:10.755167 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:10.755160 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/96076b50-057c-4d09-9222-ef4a6cf473ef-secret-alertmanager-main-tls\") pod \"96076b50-057c-4d09-9222-ef4a6cf473ef\" (UID: \"96076b50-057c-4d09-9222-ef4a6cf473ef\") " Jun 03 15:52:10.755629 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:10.755203 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/96076b50-057c-4d09-9222-ef4a6cf473ef-secret-alertmanager-kube-rbac-proxy\") pod \"96076b50-057c-4d09-9222-ef4a6cf473ef\" (UID: \"96076b50-057c-4d09-9222-ef4a6cf473ef\") " Jun 03 15:52:10.755629 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:10.755398 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96076b50-057c-4d09-9222-ef4a6cf473ef-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "96076b50-057c-4d09-9222-ef4a6cf473ef" (UID: "96076b50-057c-4d09-9222-ef4a6cf473ef"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:52:10.755629 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:10.755567 2573 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96076b50-057c-4d09-9222-ef4a6cf473ef-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Jun 03 15:52:10.755861 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:10.755837 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96076b50-057c-4d09-9222-ef4a6cf473ef-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "96076b50-057c-4d09-9222-ef4a6cf473ef" (UID: "96076b50-057c-4d09-9222-ef4a6cf473ef"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:52:10.757463 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:10.757437 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96076b50-057c-4d09-9222-ef4a6cf473ef-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "96076b50-057c-4d09-9222-ef4a6cf473ef" (UID: "96076b50-057c-4d09-9222-ef4a6cf473ef"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:52:10.757884 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:10.757843 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96076b50-057c-4d09-9222-ef4a6cf473ef-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "96076b50-057c-4d09-9222-ef4a6cf473ef" (UID: "96076b50-057c-4d09-9222-ef4a6cf473ef"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:52:10.757992 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:10.757884 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96076b50-057c-4d09-9222-ef4a6cf473ef-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "96076b50-057c-4d09-9222-ef4a6cf473ef" (UID: "96076b50-057c-4d09-9222-ef4a6cf473ef"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:52:10.758129 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:10.758110 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96076b50-057c-4d09-9222-ef4a6cf473ef-config-out" (OuterVolumeSpecName: "config-out") pod "96076b50-057c-4d09-9222-ef4a6cf473ef" (UID: "96076b50-057c-4d09-9222-ef4a6cf473ef"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:52:10.758378 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:10.758349 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96076b50-057c-4d09-9222-ef4a6cf473ef-config-volume" (OuterVolumeSpecName: "config-volume") pod "96076b50-057c-4d09-9222-ef4a6cf473ef" (UID: "96076b50-057c-4d09-9222-ef4a6cf473ef"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:52:10.758546 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:10.758526 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96076b50-057c-4d09-9222-ef4a6cf473ef-kube-api-access-g9rlw" (OuterVolumeSpecName: "kube-api-access-g9rlw") pod "96076b50-057c-4d09-9222-ef4a6cf473ef" (UID: "96076b50-057c-4d09-9222-ef4a6cf473ef"). InnerVolumeSpecName "kube-api-access-g9rlw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:52:10.758711 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:10.758694 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96076b50-057c-4d09-9222-ef4a6cf473ef-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "96076b50-057c-4d09-9222-ef4a6cf473ef" (UID: "96076b50-057c-4d09-9222-ef4a6cf473ef"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:52:10.759663 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:10.759644 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96076b50-057c-4d09-9222-ef4a6cf473ef-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "96076b50-057c-4d09-9222-ef4a6cf473ef" (UID: "96076b50-057c-4d09-9222-ef4a6cf473ef"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:52:10.759886 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:10.759861 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96076b50-057c-4d09-9222-ef4a6cf473ef-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "96076b50-057c-4d09-9222-ef4a6cf473ef" (UID: "96076b50-057c-4d09-9222-ef4a6cf473ef"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:52:10.762930 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:10.762907 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96076b50-057c-4d09-9222-ef4a6cf473ef-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "96076b50-057c-4d09-9222-ef4a6cf473ef" (UID: "96076b50-057c-4d09-9222-ef4a6cf473ef"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:52:10.767930 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:10.767910 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96076b50-057c-4d09-9222-ef4a6cf473ef-web-config" (OuterVolumeSpecName: "web-config") pod "96076b50-057c-4d09-9222-ef4a6cf473ef" (UID: "96076b50-057c-4d09-9222-ef4a6cf473ef"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:52:10.856118 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:10.856084 2573 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/96076b50-057c-4d09-9222-ef4a6cf473ef-tls-assets\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Jun 03 15:52:10.856118 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:10.856111 2573 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96076b50-057c-4d09-9222-ef4a6cf473ef-metrics-client-ca\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Jun 03 15:52:10.856118 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:10.856121 2573 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/96076b50-057c-4d09-9222-ef4a6cf473ef-config-out\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Jun 03 15:52:10.856118 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:10.856130 2573 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/96076b50-057c-4d09-9222-ef4a6cf473ef-alertmanager-main-db\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Jun 03 15:52:10.856360 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:10.856139 2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/96076b50-057c-4d09-9222-ef4a6cf473ef-secret-alertmanager-main-tls\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Jun 03 15:52:10.856360 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:10.856150 2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/96076b50-057c-4d09-9222-ef4a6cf473ef-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Jun 03 15:52:10.856360 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:10.856159 2573 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/96076b50-057c-4d09-9222-ef4a6cf473ef-web-config\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Jun 03 15:52:10.856360 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:10.856168 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g9rlw\" (UniqueName: \"kubernetes.io/projected/96076b50-057c-4d09-9222-ef4a6cf473ef-kube-api-access-g9rlw\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Jun 03 15:52:10.856360 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:10.856176 2573 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/96076b50-057c-4d09-9222-ef4a6cf473ef-config-volume\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Jun 03 15:52:10.856360 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:10.856186 2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/96076b50-057c-4d09-9222-ef4a6cf473ef-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Jun 03 15:52:10.856360 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:10.856195 2573 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/96076b50-057c-4d09-9222-ef4a6cf473ef-cluster-tls-config\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Jun 03 15:52:10.856360 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:10.856205 2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/96076b50-057c-4d09-9222-ef4a6cf473ef-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Jun 03 15:52:10.994378 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:10.994346 2573 generic.go:358] "Generic (PLEG): container finished" podID="96076b50-057c-4d09-9222-ef4a6cf473ef" containerID="8d87c9adb821586af3e12f73603d01bf1f6fbf397d0558a68af58614aad3007c" exitCode=0 Jun 03 15:52:10.994378 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:10.994370 2573 generic.go:358] "Generic (PLEG): container finished" podID="96076b50-057c-4d09-9222-ef4a6cf473ef" containerID="ddd1c71773aab377c44786063b4dac92e0e5411108e2cf26e2f2c6af52b03a84" exitCode=0 Jun 03 15:52:10.994657 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:10.994427 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96076b50-057c-4d09-9222-ef4a6cf473ef","Type":"ContainerDied","Data":"8d87c9adb821586af3e12f73603d01bf1f6fbf397d0558a68af58614aad3007c"} Jun 03 15:52:10.994657 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:10.994483 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96076b50-057c-4d09-9222-ef4a6cf473ef","Type":"ContainerDied","Data":"ddd1c71773aab377c44786063b4dac92e0e5411108e2cf26e2f2c6af52b03a84"} Jun 03 15:52:10.994657 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:10.994493 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:52:10.994657 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:10.994498 2573 scope.go:117] "RemoveContainer" containerID="29dc8164fe12a121ea7270e64506492d23b4cfe2c42e86afa0cbfecd6e3d8dbd" Jun 03 15:52:10.994657 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:10.994498 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96076b50-057c-4d09-9222-ef4a6cf473ef","Type":"ContainerDied","Data":"cd2cd3ea9460bd6895df28926d4029b2c47739602e59c1edbf49f6b38858ab17"} Jun 03 15:52:11.003891 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.003868 2573 scope.go:117] "RemoveContainer" containerID="8d87c9adb821586af3e12f73603d01bf1f6fbf397d0558a68af58614aad3007c" Jun 03 15:52:11.010303 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.010285 2573 scope.go:117] "RemoveContainer" containerID="7853df1b72abbce4dd8e4ad89788f997bd7ae994f61c60c88551fcf83bbfaee2" Jun 03 15:52:11.016412 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.016397 2573 scope.go:117] "RemoveContainer" containerID="ddd1c71773aab377c44786063b4dac92e0e5411108e2cf26e2f2c6af52b03a84" Jun 03 15:52:11.022556 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.022532 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 15:52:11.023038 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.023022 2573 scope.go:117] "RemoveContainer" containerID="93fef6e271c0ea791f4502ac35128495cca5762d8930a0b7e9d490000d0ac781" Jun 03 15:52:11.034611 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.032829 2573 scope.go:117] "RemoveContainer" containerID="19b69ab18eeb9426558ee2d315f44180550f71c10961be9afb4434677b232f3b" Jun 03 15:52:11.035236 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.035216 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 15:52:11.041299 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.041281 2573 scope.go:117] "RemoveContainer" containerID="646e6c6befdf3d37cdb737bb3d8089af2dfad3eba69cc8b19561152314744af1" Jun 03 15:52:11.047397 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.047383 2573 scope.go:117] "RemoveContainer" containerID="29dc8164fe12a121ea7270e64506492d23b4cfe2c42e86afa0cbfecd6e3d8dbd" Jun 03 15:52:11.047633 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:52:11.047611 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29dc8164fe12a121ea7270e64506492d23b4cfe2c42e86afa0cbfecd6e3d8dbd\": container with ID starting with 29dc8164fe12a121ea7270e64506492d23b4cfe2c42e86afa0cbfecd6e3d8dbd not found: ID does not exist" containerID="29dc8164fe12a121ea7270e64506492d23b4cfe2c42e86afa0cbfecd6e3d8dbd" Jun 03 15:52:11.047694 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.047639 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29dc8164fe12a121ea7270e64506492d23b4cfe2c42e86afa0cbfecd6e3d8dbd"} err="failed to get container status \"29dc8164fe12a121ea7270e64506492d23b4cfe2c42e86afa0cbfecd6e3d8dbd\": rpc error: code = NotFound desc = could not find container \"29dc8164fe12a121ea7270e64506492d23b4cfe2c42e86afa0cbfecd6e3d8dbd\": container with ID starting with 29dc8164fe12a121ea7270e64506492d23b4cfe2c42e86afa0cbfecd6e3d8dbd not found: ID does not exist" Jun 03 15:52:11.047694 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.047668 2573 scope.go:117] "RemoveContainer" containerID="8d87c9adb821586af3e12f73603d01bf1f6fbf397d0558a68af58614aad3007c" Jun 03 15:52:11.047884 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:52:11.047865 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d87c9adb821586af3e12f73603d01bf1f6fbf397d0558a68af58614aad3007c\": container with ID starting with 8d87c9adb821586af3e12f73603d01bf1f6fbf397d0558a68af58614aad3007c not found: ID does not exist" containerID="8d87c9adb821586af3e12f73603d01bf1f6fbf397d0558a68af58614aad3007c" Jun 03 15:52:11.047927 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.047889 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d87c9adb821586af3e12f73603d01bf1f6fbf397d0558a68af58614aad3007c"} err="failed to get container status \"8d87c9adb821586af3e12f73603d01bf1f6fbf397d0558a68af58614aad3007c\": rpc error: code = NotFound desc = could not find container \"8d87c9adb821586af3e12f73603d01bf1f6fbf397d0558a68af58614aad3007c\": container with ID starting with 8d87c9adb821586af3e12f73603d01bf1f6fbf397d0558a68af58614aad3007c not found: ID does not exist" Jun 03 15:52:11.047927 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.047901 2573 scope.go:117] "RemoveContainer" containerID="7853df1b72abbce4dd8e4ad89788f997bd7ae994f61c60c88551fcf83bbfaee2" Jun 03 15:52:11.048100 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:52:11.048086 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7853df1b72abbce4dd8e4ad89788f997bd7ae994f61c60c88551fcf83bbfaee2\": container with ID starting with 7853df1b72abbce4dd8e4ad89788f997bd7ae994f61c60c88551fcf83bbfaee2 not found: ID does not exist" containerID="7853df1b72abbce4dd8e4ad89788f997bd7ae994f61c60c88551fcf83bbfaee2" Jun 03 15:52:11.048143 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.048103 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7853df1b72abbce4dd8e4ad89788f997bd7ae994f61c60c88551fcf83bbfaee2"} err="failed to get container status \"7853df1b72abbce4dd8e4ad89788f997bd7ae994f61c60c88551fcf83bbfaee2\": rpc error: code = NotFound desc = could not find container \"7853df1b72abbce4dd8e4ad89788f997bd7ae994f61c60c88551fcf83bbfaee2\": container with ID starting with 7853df1b72abbce4dd8e4ad89788f997bd7ae994f61c60c88551fcf83bbfaee2 not found: ID does not exist" Jun 03 15:52:11.048143 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.048115 2573 scope.go:117] "RemoveContainer" containerID="ddd1c71773aab377c44786063b4dac92e0e5411108e2cf26e2f2c6af52b03a84" Jun 03 15:52:11.048294 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:52:11.048279 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddd1c71773aab377c44786063b4dac92e0e5411108e2cf26e2f2c6af52b03a84\": container with ID starting with ddd1c71773aab377c44786063b4dac92e0e5411108e2cf26e2f2c6af52b03a84 not found: ID does not exist" containerID="ddd1c71773aab377c44786063b4dac92e0e5411108e2cf26e2f2c6af52b03a84" Jun 03 15:52:11.048330 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.048295 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddd1c71773aab377c44786063b4dac92e0e5411108e2cf26e2f2c6af52b03a84"} err="failed to get container status \"ddd1c71773aab377c44786063b4dac92e0e5411108e2cf26e2f2c6af52b03a84\": rpc error: code = NotFound desc = could not find container \"ddd1c71773aab377c44786063b4dac92e0e5411108e2cf26e2f2c6af52b03a84\": container with ID starting with ddd1c71773aab377c44786063b4dac92e0e5411108e2cf26e2f2c6af52b03a84 not found: ID does not exist" Jun 03 15:52:11.048330 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.048307 2573 scope.go:117] "RemoveContainer" containerID="93fef6e271c0ea791f4502ac35128495cca5762d8930a0b7e9d490000d0ac781" Jun 03 15:52:11.048500 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:52:11.048464 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93fef6e271c0ea791f4502ac35128495cca5762d8930a0b7e9d490000d0ac781\": container with ID starting with 93fef6e271c0ea791f4502ac35128495cca5762d8930a0b7e9d490000d0ac781 not found: ID does not exist" containerID="93fef6e271c0ea791f4502ac35128495cca5762d8930a0b7e9d490000d0ac781" Jun 03 15:52:11.048544 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.048503 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93fef6e271c0ea791f4502ac35128495cca5762d8930a0b7e9d490000d0ac781"} err="failed to get container status \"93fef6e271c0ea791f4502ac35128495cca5762d8930a0b7e9d490000d0ac781\": rpc error: code = NotFound desc = could not find container \"93fef6e271c0ea791f4502ac35128495cca5762d8930a0b7e9d490000d0ac781\": container with ID starting with 93fef6e271c0ea791f4502ac35128495cca5762d8930a0b7e9d490000d0ac781 not found: ID does not exist" Jun 03 15:52:11.048544 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.048515 2573 scope.go:117] "RemoveContainer" containerID="19b69ab18eeb9426558ee2d315f44180550f71c10961be9afb4434677b232f3b" Jun 03 15:52:11.048750 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:52:11.048733 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19b69ab18eeb9426558ee2d315f44180550f71c10961be9afb4434677b232f3b\": container with ID starting with 19b69ab18eeb9426558ee2d315f44180550f71c10961be9afb4434677b232f3b not found: ID does not exist" containerID="19b69ab18eeb9426558ee2d315f44180550f71c10961be9afb4434677b232f3b" Jun 03 15:52:11.048791 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.048759 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19b69ab18eeb9426558ee2d315f44180550f71c10961be9afb4434677b232f3b"} err="failed to get container status \"19b69ab18eeb9426558ee2d315f44180550f71c10961be9afb4434677b232f3b\": rpc error: code = NotFound desc = could not find container \"19b69ab18eeb9426558ee2d315f44180550f71c10961be9afb4434677b232f3b\": container with ID starting with 19b69ab18eeb9426558ee2d315f44180550f71c10961be9afb4434677b232f3b not found: ID does not exist" Jun 03 15:52:11.048791 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.048782 2573 scope.go:117] "RemoveContainer" containerID="646e6c6befdf3d37cdb737bb3d8089af2dfad3eba69cc8b19561152314744af1" Jun 03 15:52:11.048987 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:52:11.048967 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"646e6c6befdf3d37cdb737bb3d8089af2dfad3eba69cc8b19561152314744af1\": container with ID starting with 646e6c6befdf3d37cdb737bb3d8089af2dfad3eba69cc8b19561152314744af1 not found: ID does not exist" containerID="646e6c6befdf3d37cdb737bb3d8089af2dfad3eba69cc8b19561152314744af1" Jun 03 15:52:11.049069 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.048990 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"646e6c6befdf3d37cdb737bb3d8089af2dfad3eba69cc8b19561152314744af1"} err="failed to get container status \"646e6c6befdf3d37cdb737bb3d8089af2dfad3eba69cc8b19561152314744af1\": rpc error: code = NotFound desc = could not find container \"646e6c6befdf3d37cdb737bb3d8089af2dfad3eba69cc8b19561152314744af1\": container with ID starting with 646e6c6befdf3d37cdb737bb3d8089af2dfad3eba69cc8b19561152314744af1 not found: ID does not exist" Jun 03 15:52:11.049069 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.049010 2573 scope.go:117] "RemoveContainer" containerID="29dc8164fe12a121ea7270e64506492d23b4cfe2c42e86afa0cbfecd6e3d8dbd" Jun 03 15:52:11.049239 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.049221 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29dc8164fe12a121ea7270e64506492d23b4cfe2c42e86afa0cbfecd6e3d8dbd"} err="failed to get container status \"29dc8164fe12a121ea7270e64506492d23b4cfe2c42e86afa0cbfecd6e3d8dbd\": rpc error: code = NotFound desc = could not find container \"29dc8164fe12a121ea7270e64506492d23b4cfe2c42e86afa0cbfecd6e3d8dbd\": container with ID starting with 29dc8164fe12a121ea7270e64506492d23b4cfe2c42e86afa0cbfecd6e3d8dbd not found: ID does not exist" Jun 03 15:52:11.049284 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.049240 2573 scope.go:117] "RemoveContainer" containerID="8d87c9adb821586af3e12f73603d01bf1f6fbf397d0558a68af58614aad3007c" Jun 03 15:52:11.049445 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.049429 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d87c9adb821586af3e12f73603d01bf1f6fbf397d0558a68af58614aad3007c"} err="failed to get container status \"8d87c9adb821586af3e12f73603d01bf1f6fbf397d0558a68af58614aad3007c\": rpc error: code = NotFound desc = could not find container \"8d87c9adb821586af3e12f73603d01bf1f6fbf397d0558a68af58614aad3007c\": container with ID starting with 8d87c9adb821586af3e12f73603d01bf1f6fbf397d0558a68af58614aad3007c not found: ID does not exist" Jun 03 15:52:11.049508 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.049446 2573 scope.go:117] "RemoveContainer" containerID="7853df1b72abbce4dd8e4ad89788f997bd7ae994f61c60c88551fcf83bbfaee2" Jun 03 15:52:11.049658 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.049642 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7853df1b72abbce4dd8e4ad89788f997bd7ae994f61c60c88551fcf83bbfaee2"} err="failed to get container status \"7853df1b72abbce4dd8e4ad89788f997bd7ae994f61c60c88551fcf83bbfaee2\": rpc error: code = NotFound desc = could not find container \"7853df1b72abbce4dd8e4ad89788f997bd7ae994f61c60c88551fcf83bbfaee2\": container with ID starting with 7853df1b72abbce4dd8e4ad89788f997bd7ae994f61c60c88551fcf83bbfaee2 not found: ID does not exist" Jun 03 15:52:11.049706 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.049659 2573 scope.go:117] "RemoveContainer" containerID="ddd1c71773aab377c44786063b4dac92e0e5411108e2cf26e2f2c6af52b03a84" Jun 03 15:52:11.049838 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.049822 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddd1c71773aab377c44786063b4dac92e0e5411108e2cf26e2f2c6af52b03a84"} err="failed to get container status \"ddd1c71773aab377c44786063b4dac92e0e5411108e2cf26e2f2c6af52b03a84\": rpc error: code = NotFound desc = could not find container \"ddd1c71773aab377c44786063b4dac92e0e5411108e2cf26e2f2c6af52b03a84\": container with ID starting with ddd1c71773aab377c44786063b4dac92e0e5411108e2cf26e2f2c6af52b03a84 not found: ID does not exist" Jun 03 15:52:11.049884 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.049839 2573 scope.go:117] "RemoveContainer" containerID="93fef6e271c0ea791f4502ac35128495cca5762d8930a0b7e9d490000d0ac781" Jun 03 15:52:11.050076 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.050055 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93fef6e271c0ea791f4502ac35128495cca5762d8930a0b7e9d490000d0ac781"} err="failed to get container status \"93fef6e271c0ea791f4502ac35128495cca5762d8930a0b7e9d490000d0ac781\": rpc error: code = NotFound desc = could not find container \"93fef6e271c0ea791f4502ac35128495cca5762d8930a0b7e9d490000d0ac781\": container with ID starting with 93fef6e271c0ea791f4502ac35128495cca5762d8930a0b7e9d490000d0ac781 not found: ID does not exist" Jun 03 15:52:11.050076 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.050075 2573 scope.go:117] "RemoveContainer" containerID="19b69ab18eeb9426558ee2d315f44180550f71c10961be9afb4434677b232f3b" Jun 03 15:52:11.050279 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.050262 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19b69ab18eeb9426558ee2d315f44180550f71c10961be9afb4434677b232f3b"} err="failed to get container status \"19b69ab18eeb9426558ee2d315f44180550f71c10961be9afb4434677b232f3b\": rpc error: code = NotFound desc = could not find container \"19b69ab18eeb9426558ee2d315f44180550f71c10961be9afb4434677b232f3b\": container with ID starting with 19b69ab18eeb9426558ee2d315f44180550f71c10961be9afb4434677b232f3b not found: ID does not exist" Jun 03 15:52:11.050325 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.050279 2573 scope.go:117] "RemoveContainer" containerID="646e6c6befdf3d37cdb737bb3d8089af2dfad3eba69cc8b19561152314744af1" Jun 03 15:52:11.050498 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.050465 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"646e6c6befdf3d37cdb737bb3d8089af2dfad3eba69cc8b19561152314744af1"} err="failed to get container status \"646e6c6befdf3d37cdb737bb3d8089af2dfad3eba69cc8b19561152314744af1\": rpc error: code = NotFound desc = could not find container \"646e6c6befdf3d37cdb737bb3d8089af2dfad3eba69cc8b19561152314744af1\": container with ID starting with 646e6c6befdf3d37cdb737bb3d8089af2dfad3eba69cc8b19561152314744af1 not found: ID does not exist" Jun 03 15:52:11.062227 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.062200 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 15:52:11.062540 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.062524 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96076b50-057c-4d09-9222-ef4a6cf473ef" containerName="config-reloader" Jun 03 15:52:11.062608 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.062542 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="96076b50-057c-4d09-9222-ef4a6cf473ef" containerName="config-reloader" Jun 03 15:52:11.062608 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.062558 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96076b50-057c-4d09-9222-ef4a6cf473ef" containerName="alertmanager" Jun 03 15:52:11.062608 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.062566 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="96076b50-057c-4d09-9222-ef4a6cf473ef" containerName="alertmanager" Jun 03 15:52:11.062608 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.062585 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96076b50-057c-4d09-9222-ef4a6cf473ef" containerName="prom-label-proxy" Jun 03 15:52:11.062608 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.062593 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="96076b50-057c-4d09-9222-ef4a6cf473ef" containerName="prom-label-proxy" Jun 03 15:52:11.062608 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.062603 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96076b50-057c-4d09-9222-ef4a6cf473ef" containerName="kube-rbac-proxy" Jun 03 15:52:11.062608 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.062609 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="96076b50-057c-4d09-9222-ef4a6cf473ef" containerName="kube-rbac-proxy" Jun 03 15:52:11.062823 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.062642 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96076b50-057c-4d09-9222-ef4a6cf473ef" containerName="init-config-reloader" Jun 03 15:52:11.062823 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.062648 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="96076b50-057c-4d09-9222-ef4a6cf473ef" containerName="init-config-reloader" Jun 03 15:52:11.062823 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.062654 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96076b50-057c-4d09-9222-ef4a6cf473ef" containerName="kube-rbac-proxy-metric" Jun 03 15:52:11.062823 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.062659 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="96076b50-057c-4d09-9222-ef4a6cf473ef" containerName="kube-rbac-proxy-metric" Jun 03 15:52:11.062823 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.062667 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96076b50-057c-4d09-9222-ef4a6cf473ef" containerName="kube-rbac-proxy-web" Jun 03 15:52:11.062823 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.062672 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="96076b50-057c-4d09-9222-ef4a6cf473ef" containerName="kube-rbac-proxy-web" Jun 03 15:52:11.062823 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.062735 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="96076b50-057c-4d09-9222-ef4a6cf473ef" containerName="kube-rbac-proxy" Jun 03 15:52:11.062823 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.062742 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="96076b50-057c-4d09-9222-ef4a6cf473ef" containerName="kube-rbac-proxy-metric" Jun 03 15:52:11.062823 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.062748 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="96076b50-057c-4d09-9222-ef4a6cf473ef" containerName="prom-label-proxy" Jun 03 15:52:11.062823 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.062755 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="96076b50-057c-4d09-9222-ef4a6cf473ef" containerName="kube-rbac-proxy-web" Jun 03 15:52:11.062823 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.062762 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="96076b50-057c-4d09-9222-ef4a6cf473ef" containerName="alertmanager" Jun 03 15:52:11.062823 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.062768 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="96076b50-057c-4d09-9222-ef4a6cf473ef" containerName="config-reloader" Jun 03 15:52:11.065450 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.065435 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:52:11.068380 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.068360 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 03 15:52:11.068380 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.068374 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 03 15:52:11.068904 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.068889 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 03 15:52:11.069330 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.069315 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 03 15:52:11.069380 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.069352 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 03 15:52:11.069946 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.069930 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 03 15:52:11.070030 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.069954 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 03 15:52:11.070232 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.070205 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 03 15:52:11.070330 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.070246 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vtvt5\"" Jun 03 15:52:11.075133 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.075115 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 03 15:52:11.083135 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.083110 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 15:52:11.158102 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.158076 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/04d18240-307e-4152-adb5-31a90e3d95b0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"04d18240-307e-4152-adb5-31a90e3d95b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:52:11.158226 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.158112 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/04d18240-307e-4152-adb5-31a90e3d95b0-config-out\") pod \"alertmanager-main-0\" (UID: \"04d18240-307e-4152-adb5-31a90e3d95b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:52:11.158226 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.158133 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/04d18240-307e-4152-adb5-31a90e3d95b0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"04d18240-307e-4152-adb5-31a90e3d95b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:52:11.158226 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.158148 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/04d18240-307e-4152-adb5-31a90e3d95b0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"04d18240-307e-4152-adb5-31a90e3d95b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:52:11.158226 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.158198 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/04d18240-307e-4152-adb5-31a90e3d95b0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"04d18240-307e-4152-adb5-31a90e3d95b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:52:11.158361 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.158237 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hczbx\" (UniqueName: \"kubernetes.io/projected/04d18240-307e-4152-adb5-31a90e3d95b0-kube-api-access-hczbx\") pod \"alertmanager-main-0\" (UID: \"04d18240-307e-4152-adb5-31a90e3d95b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:52:11.158361 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.158258 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04d18240-307e-4152-adb5-31a90e3d95b0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"04d18240-307e-4152-adb5-31a90e3d95b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:52:11.158361 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.158275 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/04d18240-307e-4152-adb5-31a90e3d95b0-config-volume\") pod \"alertmanager-main-0\" (UID: \"04d18240-307e-4152-adb5-31a90e3d95b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:52:11.158361 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.158304 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/04d18240-307e-4152-adb5-31a90e3d95b0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"04d18240-307e-4152-adb5-31a90e3d95b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:52:11.158361 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.158345 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/04d18240-307e-4152-adb5-31a90e3d95b0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"04d18240-307e-4152-adb5-31a90e3d95b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:52:11.158546 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.158374 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/04d18240-307e-4152-adb5-31a90e3d95b0-web-config\") pod \"alertmanager-main-0\" (UID: \"04d18240-307e-4152-adb5-31a90e3d95b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:52:11.158546 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.158420 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/04d18240-307e-4152-adb5-31a90e3d95b0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"04d18240-307e-4152-adb5-31a90e3d95b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:52:11.158546 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.158444 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/04d18240-307e-4152-adb5-31a90e3d95b0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"04d18240-307e-4152-adb5-31a90e3d95b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:52:11.259223 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.259173 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/04d18240-307e-4152-adb5-31a90e3d95b0-config-out\") pod \"alertmanager-main-0\" (UID: \"04d18240-307e-4152-adb5-31a90e3d95b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:52:11.259223 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.259222 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/04d18240-307e-4152-adb5-31a90e3d95b0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"04d18240-307e-4152-adb5-31a90e3d95b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:52:11.259223 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.259241 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/04d18240-307e-4152-adb5-31a90e3d95b0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"04d18240-307e-4152-adb5-31a90e3d95b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:52:11.259552 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.259261 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/04d18240-307e-4152-adb5-31a90e3d95b0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"04d18240-307e-4152-adb5-31a90e3d95b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:52:11.259552 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.259288 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hczbx\" (UniqueName: \"kubernetes.io/projected/04d18240-307e-4152-adb5-31a90e3d95b0-kube-api-access-hczbx\") pod \"alertmanager-main-0\" (UID: \"04d18240-307e-4152-adb5-31a90e3d95b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:52:11.259552 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.259424 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04d18240-307e-4152-adb5-31a90e3d95b0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"04d18240-307e-4152-adb5-31a90e3d95b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:52:11.259552 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.259448 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/04d18240-307e-4152-adb5-31a90e3d95b0-config-volume\") pod \"alertmanager-main-0\" (UID: \"04d18240-307e-4152-adb5-31a90e3d95b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:52:11.259552 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.259496 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/04d18240-307e-4152-adb5-31a90e3d95b0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"04d18240-307e-4152-adb5-31a90e3d95b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:52:11.259914 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.259577 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/04d18240-307e-4152-adb5-31a90e3d95b0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"04d18240-307e-4152-adb5-31a90e3d95b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:52:11.259914 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.259625 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/04d18240-307e-4152-adb5-31a90e3d95b0-web-config\") pod \"alertmanager-main-0\" (UID: \"04d18240-307e-4152-adb5-31a90e3d95b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:52:11.259914 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.259664 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/04d18240-307e-4152-adb5-31a90e3d95b0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"04d18240-307e-4152-adb5-31a90e3d95b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:52:11.259914 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.259693 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/04d18240-307e-4152-adb5-31a90e3d95b0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"04d18240-307e-4152-adb5-31a90e3d95b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:52:11.259914 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.259727 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/04d18240-307e-4152-adb5-31a90e3d95b0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"04d18240-307e-4152-adb5-31a90e3d95b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:52:11.260149 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.259982 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/04d18240-307e-4152-adb5-31a90e3d95b0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"04d18240-307e-4152-adb5-31a90e3d95b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:52:11.260149 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.260089 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/04d18240-307e-4152-adb5-31a90e3d95b0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"04d18240-307e-4152-adb5-31a90e3d95b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:52:11.260301 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.260245 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04d18240-307e-4152-adb5-31a90e3d95b0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"04d18240-307e-4152-adb5-31a90e3d95b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:52:11.262209 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.262183 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/04d18240-307e-4152-adb5-31a90e3d95b0-config-out\") pod \"alertmanager-main-0\" (UID: \"04d18240-307e-4152-adb5-31a90e3d95b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:52:11.262346 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.262321 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/04d18240-307e-4152-adb5-31a90e3d95b0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"04d18240-307e-4152-adb5-31a90e3d95b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:52:11.262503 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.262460 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/04d18240-307e-4152-adb5-31a90e3d95b0-config-volume\") pod \"alertmanager-main-0\" (UID: \"04d18240-307e-4152-adb5-31a90e3d95b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:52:11.262607 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.262530 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/04d18240-307e-4152-adb5-31a90e3d95b0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"04d18240-307e-4152-adb5-31a90e3d95b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:52:11.262741 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.262721 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/04d18240-307e-4152-adb5-31a90e3d95b0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"04d18240-307e-4152-adb5-31a90e3d95b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:52:11.262859 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.262845 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/04d18240-307e-4152-adb5-31a90e3d95b0-web-config\") pod \"alertmanager-main-0\" (UID: \"04d18240-307e-4152-adb5-31a90e3d95b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:52:11.262891 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.262855 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/04d18240-307e-4152-adb5-31a90e3d95b0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"04d18240-307e-4152-adb5-31a90e3d95b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:52:11.263126 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.263113 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/04d18240-307e-4152-adb5-31a90e3d95b0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"04d18240-307e-4152-adb5-31a90e3d95b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:52:11.264095 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.264071 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/04d18240-307e-4152-adb5-31a90e3d95b0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"04d18240-307e-4152-adb5-31a90e3d95b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:52:11.268803 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.268787 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hczbx\" (UniqueName: \"kubernetes.io/projected/04d18240-307e-4152-adb5-31a90e3d95b0-kube-api-access-hczbx\") pod \"alertmanager-main-0\" (UID: \"04d18240-307e-4152-adb5-31a90e3d95b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:52:11.376155 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.376109 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:52:11.514295 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.514269 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 15:52:11.515889 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:52:11.515852 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04d18240_307e_4152_adb5_31a90e3d95b0.slice/crio-b8028b325514c46e58ec3177e1f0a482fa3eef194664fd9dbb1167df5705539c WatchSource:0}: Error finding container b8028b325514c46e58ec3177e1f0a482fa3eef194664fd9dbb1167df5705539c: Status 404 returned error can't find the container with id b8028b325514c46e58ec3177e1f0a482fa3eef194664fd9dbb1167df5705539c Jun 03 15:52:11.999366 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.999327 2573 generic.go:358] "Generic (PLEG): container finished" podID="04d18240-307e-4152-adb5-31a90e3d95b0" containerID="101db261a74ae0506519ce57eafeff9df4da33428233b9eded1d38a406d1e183" exitCode=0 Jun 03 15:52:11.999747 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.999412 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"04d18240-307e-4152-adb5-31a90e3d95b0","Type":"ContainerDied","Data":"101db261a74ae0506519ce57eafeff9df4da33428233b9eded1d38a406d1e183"} Jun 03 15:52:11.999747 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:11.999449 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"04d18240-307e-4152-adb5-31a90e3d95b0","Type":"ContainerStarted","Data":"b8028b325514c46e58ec3177e1f0a482fa3eef194664fd9dbb1167df5705539c"} Jun 03 15:52:12.233808 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:12.233776 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96076b50-057c-4d09-9222-ef4a6cf473ef" path="/var/lib/kubelet/pods/96076b50-057c-4d09-9222-ef4a6cf473ef/volumes" Jun 03 15:52:13.009864 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:13.009825 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"04d18240-307e-4152-adb5-31a90e3d95b0","Type":"ContainerStarted","Data":"83c61b7fc0400181fb527f8305fdceb9feeed187edfa9d51d8f5b2d3df24a365"} Jun 03 15:52:13.009864 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:13.009863 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"04d18240-307e-4152-adb5-31a90e3d95b0","Type":"ContainerStarted","Data":"4ca018c6d9d54a3b41e46c649d51e206ee254aeee150c85008a6051802926a6b"} Jun 03 15:52:13.010321 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:13.009877 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"04d18240-307e-4152-adb5-31a90e3d95b0","Type":"ContainerStarted","Data":"f62eff65340b8bb54570d5c1d2ad8327848bcc527935be3d10530507e7acd591"} Jun 03 15:52:13.010321 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:13.009889 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"04d18240-307e-4152-adb5-31a90e3d95b0","Type":"ContainerStarted","Data":"5ed9cd50d711093e4bc42110e555608f34c1163361665a28d829327cac46195b"} Jun 03 15:52:13.010321 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:13.009899 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"04d18240-307e-4152-adb5-31a90e3d95b0","Type":"ContainerStarted","Data":"497ba7714668d2b99467aafe1fe36da54812617731bdcd24b1befb5717e4f8a5"} Jun 03 15:52:13.010321 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:13.009910 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"04d18240-307e-4152-adb5-31a90e3d95b0","Type":"ContainerStarted","Data":"93073cb1ae78eea2f26dd072e84e6c8cfc260dda9f74c2ccd5fa6ee861b22463"} Jun 03 15:52:13.042530 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:13.042455 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.042437802 podStartE2EDuration="2.042437802s" podCreationTimestamp="2026-06-03 15:52:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:52:13.041079074 +0000 UTC m=+193.398074230" watchObservedRunningTime="2026-06-03 15:52:13.042437802 +0000 UTC m=+193.399432935" Jun 03 15:52:13.694946 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:13.694912 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 15:52:13.695360 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:13.695327 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dd451b12-b8ac-4c93-9872-c99bfca851c4" containerName="prometheus" containerID="cri-o://6d80401c9e7e508023fe4754b121e132f390dcb631bfb2ebbc98284f46845ca8" gracePeriod=600 Jun 03 15:52:13.695535 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:13.695343 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dd451b12-b8ac-4c93-9872-c99bfca851c4" containerName="kube-rbac-proxy" containerID="cri-o://c631d3a8fb534bd0dc24cad4f5a917363ec04bb3063837ea4f2d3be0caf6eee3" gracePeriod=600 Jun 03 15:52:13.695535 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:13.695376 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dd451b12-b8ac-4c93-9872-c99bfca851c4" containerName="thanos-sidecar" containerID="cri-o://1e0aa63e5db6a95a18c3edcdbf811810a1b61141749fe5e08885469ca840278d" gracePeriod=600 Jun 03 15:52:13.695535 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:13.695376 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dd451b12-b8ac-4c93-9872-c99bfca851c4" containerName="kube-rbac-proxy-web" containerID="cri-o://2bb18fcc794ba4649e60b53c488dafd181aa0e6a48e3f136a63884f01f4c3d9f" gracePeriod=600 Jun 03 15:52:13.695535 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:13.695427 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dd451b12-b8ac-4c93-9872-c99bfca851c4" containerName="config-reloader" containerID="cri-o://61a21d8054068b925577cf3b2049980ff26683483521f3f327659a9e3fef0d52" gracePeriod=600 Jun 03 15:52:13.695535 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:13.695376 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dd451b12-b8ac-4c93-9872-c99bfca851c4" containerName="kube-rbac-proxy-thanos" containerID="cri-o://eb94dab44037e0321eeba1566feb0c80c6853a114bb422ac50474d16324ab8f7" gracePeriod=600 Jun 03 15:52:13.927223 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:13.927201 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.015820 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.015733 2573 generic.go:358] "Generic (PLEG): container finished" podID="dd451b12-b8ac-4c93-9872-c99bfca851c4" containerID="eb94dab44037e0321eeba1566feb0c80c6853a114bb422ac50474d16324ab8f7" exitCode=0 Jun 03 15:52:14.015820 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.015760 2573 generic.go:358] "Generic (PLEG): container finished" podID="dd451b12-b8ac-4c93-9872-c99bfca851c4" containerID="c631d3a8fb534bd0dc24cad4f5a917363ec04bb3063837ea4f2d3be0caf6eee3" exitCode=0 Jun 03 15:52:14.015820 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.015766 2573 generic.go:358] "Generic (PLEG): container finished" podID="dd451b12-b8ac-4c93-9872-c99bfca851c4" containerID="2bb18fcc794ba4649e60b53c488dafd181aa0e6a48e3f136a63884f01f4c3d9f" exitCode=0 Jun 03 15:52:14.015820 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.015772 2573 generic.go:358] "Generic (PLEG): container finished" podID="dd451b12-b8ac-4c93-9872-c99bfca851c4" containerID="1e0aa63e5db6a95a18c3edcdbf811810a1b61141749fe5e08885469ca840278d" exitCode=0 Jun 03 15:52:14.015820 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.015777 2573 generic.go:358] "Generic (PLEG): container finished" podID="dd451b12-b8ac-4c93-9872-c99bfca851c4" containerID="61a21d8054068b925577cf3b2049980ff26683483521f3f327659a9e3fef0d52" exitCode=0 Jun 03 15:52:14.015820 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.015782 2573 generic.go:358] "Generic (PLEG): container finished" podID="dd451b12-b8ac-4c93-9872-c99bfca851c4" containerID="6d80401c9e7e508023fe4754b121e132f390dcb631bfb2ebbc98284f46845ca8" exitCode=0 Jun 03 15:52:14.016465 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.015819 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd451b12-b8ac-4c93-9872-c99bfca851c4","Type":"ContainerDied","Data":"eb94dab44037e0321eeba1566feb0c80c6853a114bb422ac50474d16324ab8f7"} Jun 03 15:52:14.016465 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.015856 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd451b12-b8ac-4c93-9872-c99bfca851c4","Type":"ContainerDied","Data":"c631d3a8fb534bd0dc24cad4f5a917363ec04bb3063837ea4f2d3be0caf6eee3"} Jun 03 15:52:14.016465 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.015871 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd451b12-b8ac-4c93-9872-c99bfca851c4","Type":"ContainerDied","Data":"2bb18fcc794ba4649e60b53c488dafd181aa0e6a48e3f136a63884f01f4c3d9f"} Jun 03 15:52:14.016465 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.015871 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.016465 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.015886 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd451b12-b8ac-4c93-9872-c99bfca851c4","Type":"ContainerDied","Data":"1e0aa63e5db6a95a18c3edcdbf811810a1b61141749fe5e08885469ca840278d"} Jun 03 15:52:14.016465 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.015901 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd451b12-b8ac-4c93-9872-c99bfca851c4","Type":"ContainerDied","Data":"61a21d8054068b925577cf3b2049980ff26683483521f3f327659a9e3fef0d52"} Jun 03 15:52:14.016465 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.015914 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd451b12-b8ac-4c93-9872-c99bfca851c4","Type":"ContainerDied","Data":"6d80401c9e7e508023fe4754b121e132f390dcb631bfb2ebbc98284f46845ca8"} Jun 03 15:52:14.016465 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.015926 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd451b12-b8ac-4c93-9872-c99bfca851c4","Type":"ContainerDied","Data":"42efa0dee1ed79f4ea1238c7a461d93da304f1e388a479cde6e0a61f2b912e2e"} Jun 03 15:52:14.016465 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.015923 2573 scope.go:117] "RemoveContainer" containerID="eb94dab44037e0321eeba1566feb0c80c6853a114bb422ac50474d16324ab8f7" Jun 03 15:52:14.022995 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.022975 2573 scope.go:117] "RemoveContainer" containerID="c631d3a8fb534bd0dc24cad4f5a917363ec04bb3063837ea4f2d3be0caf6eee3" Jun 03 15:52:14.029394 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.029378 2573 scope.go:117] "RemoveContainer" containerID="2bb18fcc794ba4649e60b53c488dafd181aa0e6a48e3f136a63884f01f4c3d9f" Jun 03 15:52:14.035679 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.035661 2573 scope.go:117] "RemoveContainer" containerID="1e0aa63e5db6a95a18c3edcdbf811810a1b61141749fe5e08885469ca840278d" Jun 03 15:52:14.041918 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.041901 2573 scope.go:117] "RemoveContainer" containerID="61a21d8054068b925577cf3b2049980ff26683483521f3f327659a9e3fef0d52" Jun 03 15:52:14.048056 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.048038 2573 scope.go:117] "RemoveContainer" containerID="6d80401c9e7e508023fe4754b121e132f390dcb631bfb2ebbc98284f46845ca8" Jun 03 15:52:14.056204 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.056185 2573 scope.go:117] "RemoveContainer" containerID="d4b15466672b1cd62b3b0b5fa3d3efe6d298b3c5dab42b7df9f5cecf401fc71f" Jun 03 15:52:14.062637 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.062622 2573 scope.go:117] "RemoveContainer" containerID="eb94dab44037e0321eeba1566feb0c80c6853a114bb422ac50474d16324ab8f7" Jun 03 15:52:14.062866 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:52:14.062850 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb94dab44037e0321eeba1566feb0c80c6853a114bb422ac50474d16324ab8f7\": container with ID starting with eb94dab44037e0321eeba1566feb0c80c6853a114bb422ac50474d16324ab8f7 not found: ID does not exist" containerID="eb94dab44037e0321eeba1566feb0c80c6853a114bb422ac50474d16324ab8f7" Jun 03 15:52:14.062956 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.062877 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb94dab44037e0321eeba1566feb0c80c6853a114bb422ac50474d16324ab8f7"} err="failed to get container status \"eb94dab44037e0321eeba1566feb0c80c6853a114bb422ac50474d16324ab8f7\": rpc error: code = NotFound desc = could not find container \"eb94dab44037e0321eeba1566feb0c80c6853a114bb422ac50474d16324ab8f7\": container with ID starting with eb94dab44037e0321eeba1566feb0c80c6853a114bb422ac50474d16324ab8f7 not found: ID does not exist" Jun 03 15:52:14.062956 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.062895 2573 scope.go:117] "RemoveContainer" containerID="c631d3a8fb534bd0dc24cad4f5a917363ec04bb3063837ea4f2d3be0caf6eee3" Jun 03 15:52:14.063106 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:52:14.063088 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c631d3a8fb534bd0dc24cad4f5a917363ec04bb3063837ea4f2d3be0caf6eee3\": container with ID starting with c631d3a8fb534bd0dc24cad4f5a917363ec04bb3063837ea4f2d3be0caf6eee3 not found: ID does not exist" containerID="c631d3a8fb534bd0dc24cad4f5a917363ec04bb3063837ea4f2d3be0caf6eee3" Jun 03 15:52:14.063143 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.063113 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c631d3a8fb534bd0dc24cad4f5a917363ec04bb3063837ea4f2d3be0caf6eee3"} err="failed to get container status \"c631d3a8fb534bd0dc24cad4f5a917363ec04bb3063837ea4f2d3be0caf6eee3\": rpc error: code = NotFound desc = could not find container \"c631d3a8fb534bd0dc24cad4f5a917363ec04bb3063837ea4f2d3be0caf6eee3\": container with ID starting with c631d3a8fb534bd0dc24cad4f5a917363ec04bb3063837ea4f2d3be0caf6eee3 not found: ID does not exist" Jun 03 15:52:14.063143 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.063136 2573 scope.go:117] "RemoveContainer" containerID="2bb18fcc794ba4649e60b53c488dafd181aa0e6a48e3f136a63884f01f4c3d9f" Jun 03 15:52:14.063378 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:52:14.063359 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2bb18fcc794ba4649e60b53c488dafd181aa0e6a48e3f136a63884f01f4c3d9f\": container with ID starting with 2bb18fcc794ba4649e60b53c488dafd181aa0e6a48e3f136a63884f01f4c3d9f not found: ID does not exist" containerID="2bb18fcc794ba4649e60b53c488dafd181aa0e6a48e3f136a63884f01f4c3d9f" Jun 03 15:52:14.063435 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.063383 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bb18fcc794ba4649e60b53c488dafd181aa0e6a48e3f136a63884f01f4c3d9f"} err="failed to get container status \"2bb18fcc794ba4649e60b53c488dafd181aa0e6a48e3f136a63884f01f4c3d9f\": rpc error: code = NotFound desc = could not find container \"2bb18fcc794ba4649e60b53c488dafd181aa0e6a48e3f136a63884f01f4c3d9f\": container with ID starting with 2bb18fcc794ba4649e60b53c488dafd181aa0e6a48e3f136a63884f01f4c3d9f not found: ID does not exist" Jun 03 15:52:14.063435 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.063398 2573 scope.go:117] "RemoveContainer" containerID="1e0aa63e5db6a95a18c3edcdbf811810a1b61141749fe5e08885469ca840278d" Jun 03 15:52:14.063642 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:52:14.063628 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e0aa63e5db6a95a18c3edcdbf811810a1b61141749fe5e08885469ca840278d\": container with ID starting with 1e0aa63e5db6a95a18c3edcdbf811810a1b61141749fe5e08885469ca840278d not found: ID does not exist" containerID="1e0aa63e5db6a95a18c3edcdbf811810a1b61141749fe5e08885469ca840278d" Jun 03 15:52:14.063681 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.063644 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e0aa63e5db6a95a18c3edcdbf811810a1b61141749fe5e08885469ca840278d"} err="failed to get container status \"1e0aa63e5db6a95a18c3edcdbf811810a1b61141749fe5e08885469ca840278d\": rpc error: code = NotFound desc = could not find container \"1e0aa63e5db6a95a18c3edcdbf811810a1b61141749fe5e08885469ca840278d\": container with ID starting with 1e0aa63e5db6a95a18c3edcdbf811810a1b61141749fe5e08885469ca840278d not found: ID does not exist" Jun 03 15:52:14.063681 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.063656 2573 scope.go:117] "RemoveContainer" containerID="61a21d8054068b925577cf3b2049980ff26683483521f3f327659a9e3fef0d52" Jun 03 15:52:14.063863 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:52:14.063844 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61a21d8054068b925577cf3b2049980ff26683483521f3f327659a9e3fef0d52\": container with ID starting with 61a21d8054068b925577cf3b2049980ff26683483521f3f327659a9e3fef0d52 not found: ID does not exist" containerID="61a21d8054068b925577cf3b2049980ff26683483521f3f327659a9e3fef0d52" Jun 03 15:52:14.063901 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.063866 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61a21d8054068b925577cf3b2049980ff26683483521f3f327659a9e3fef0d52"} err="failed to get container status \"61a21d8054068b925577cf3b2049980ff26683483521f3f327659a9e3fef0d52\": rpc error: code = NotFound desc = could not find container \"61a21d8054068b925577cf3b2049980ff26683483521f3f327659a9e3fef0d52\": container with ID starting with 61a21d8054068b925577cf3b2049980ff26683483521f3f327659a9e3fef0d52 not found: ID does not exist" Jun 03 15:52:14.063901 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.063891 2573 scope.go:117] "RemoveContainer" containerID="6d80401c9e7e508023fe4754b121e132f390dcb631bfb2ebbc98284f46845ca8" Jun 03 15:52:14.064080 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:52:14.064061 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d80401c9e7e508023fe4754b121e132f390dcb631bfb2ebbc98284f46845ca8\": container with ID starting with 6d80401c9e7e508023fe4754b121e132f390dcb631bfb2ebbc98284f46845ca8 not found: ID does not exist" containerID="6d80401c9e7e508023fe4754b121e132f390dcb631bfb2ebbc98284f46845ca8" Jun 03 15:52:14.064114 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.064085 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d80401c9e7e508023fe4754b121e132f390dcb631bfb2ebbc98284f46845ca8"} err="failed to get container status \"6d80401c9e7e508023fe4754b121e132f390dcb631bfb2ebbc98284f46845ca8\": rpc error: code = NotFound desc = could not find container \"6d80401c9e7e508023fe4754b121e132f390dcb631bfb2ebbc98284f46845ca8\": container with ID starting with 6d80401c9e7e508023fe4754b121e132f390dcb631bfb2ebbc98284f46845ca8 not found: ID does not exist" Jun 03 15:52:14.064114 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.064099 2573 scope.go:117] "RemoveContainer" containerID="d4b15466672b1cd62b3b0b5fa3d3efe6d298b3c5dab42b7df9f5cecf401fc71f" Jun 03 15:52:14.064286 ip-10-0-141-30 kubenswrapper[2573]: E0603 15:52:14.064272 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4b15466672b1cd62b3b0b5fa3d3efe6d298b3c5dab42b7df9f5cecf401fc71f\": container with ID starting with d4b15466672b1cd62b3b0b5fa3d3efe6d298b3c5dab42b7df9f5cecf401fc71f not found: ID does not exist" containerID="d4b15466672b1cd62b3b0b5fa3d3efe6d298b3c5dab42b7df9f5cecf401fc71f" Jun 03 15:52:14.064321 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.064290 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4b15466672b1cd62b3b0b5fa3d3efe6d298b3c5dab42b7df9f5cecf401fc71f"} err="failed to get container status \"d4b15466672b1cd62b3b0b5fa3d3efe6d298b3c5dab42b7df9f5cecf401fc71f\": rpc error: code = NotFound desc = could not find container \"d4b15466672b1cd62b3b0b5fa3d3efe6d298b3c5dab42b7df9f5cecf401fc71f\": container with ID starting with d4b15466672b1cd62b3b0b5fa3d3efe6d298b3c5dab42b7df9f5cecf401fc71f not found: ID does not exist" Jun 03 15:52:14.064321 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.064304 2573 scope.go:117] "RemoveContainer" containerID="eb94dab44037e0321eeba1566feb0c80c6853a114bb422ac50474d16324ab8f7" Jun 03 15:52:14.064568 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.064537 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb94dab44037e0321eeba1566feb0c80c6853a114bb422ac50474d16324ab8f7"} err="failed to get container status \"eb94dab44037e0321eeba1566feb0c80c6853a114bb422ac50474d16324ab8f7\": rpc error: code = NotFound desc = could not find container \"eb94dab44037e0321eeba1566feb0c80c6853a114bb422ac50474d16324ab8f7\": container with ID starting with eb94dab44037e0321eeba1566feb0c80c6853a114bb422ac50474d16324ab8f7 not found: ID does not exist" Jun 03 15:52:14.064619 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.064574 2573 scope.go:117] "RemoveContainer" containerID="c631d3a8fb534bd0dc24cad4f5a917363ec04bb3063837ea4f2d3be0caf6eee3" Jun 03 15:52:14.064794 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.064778 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c631d3a8fb534bd0dc24cad4f5a917363ec04bb3063837ea4f2d3be0caf6eee3"} err="failed to get container status \"c631d3a8fb534bd0dc24cad4f5a917363ec04bb3063837ea4f2d3be0caf6eee3\": rpc error: code = NotFound desc = could not find container \"c631d3a8fb534bd0dc24cad4f5a917363ec04bb3063837ea4f2d3be0caf6eee3\": container with ID starting with c631d3a8fb534bd0dc24cad4f5a917363ec04bb3063837ea4f2d3be0caf6eee3 not found: ID does not exist" Jun 03 15:52:14.064831 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.064796 2573 scope.go:117] "RemoveContainer" containerID="2bb18fcc794ba4649e60b53c488dafd181aa0e6a48e3f136a63884f01f4c3d9f" Jun 03 15:52:14.064974 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.064950 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bb18fcc794ba4649e60b53c488dafd181aa0e6a48e3f136a63884f01f4c3d9f"} err="failed to get container status \"2bb18fcc794ba4649e60b53c488dafd181aa0e6a48e3f136a63884f01f4c3d9f\": rpc error: code = NotFound desc = could not find container \"2bb18fcc794ba4649e60b53c488dafd181aa0e6a48e3f136a63884f01f4c3d9f\": container with ID starting with 2bb18fcc794ba4649e60b53c488dafd181aa0e6a48e3f136a63884f01f4c3d9f not found: ID does not exist" Jun 03 15:52:14.064974 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.064969 2573 scope.go:117] "RemoveContainer" containerID="1e0aa63e5db6a95a18c3edcdbf811810a1b61141749fe5e08885469ca840278d" Jun 03 15:52:14.065184 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.065165 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e0aa63e5db6a95a18c3edcdbf811810a1b61141749fe5e08885469ca840278d"} err="failed to get container status \"1e0aa63e5db6a95a18c3edcdbf811810a1b61141749fe5e08885469ca840278d\": rpc error: code = NotFound desc = could not find container \"1e0aa63e5db6a95a18c3edcdbf811810a1b61141749fe5e08885469ca840278d\": container with ID starting with 1e0aa63e5db6a95a18c3edcdbf811810a1b61141749fe5e08885469ca840278d not found: ID does not exist" Jun 03 15:52:14.065233 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.065184 2573 scope.go:117] "RemoveContainer" containerID="61a21d8054068b925577cf3b2049980ff26683483521f3f327659a9e3fef0d52" Jun 03 15:52:14.065408 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.065389 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61a21d8054068b925577cf3b2049980ff26683483521f3f327659a9e3fef0d52"} err="failed to get container status \"61a21d8054068b925577cf3b2049980ff26683483521f3f327659a9e3fef0d52\": rpc error: code = NotFound desc = could not find container \"61a21d8054068b925577cf3b2049980ff26683483521f3f327659a9e3fef0d52\": container with ID starting with 61a21d8054068b925577cf3b2049980ff26683483521f3f327659a9e3fef0d52 not found: ID does not exist" Jun 03 15:52:14.065489 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.065410 2573 scope.go:117] "RemoveContainer" containerID="6d80401c9e7e508023fe4754b121e132f390dcb631bfb2ebbc98284f46845ca8" Jun 03 15:52:14.065653 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.065638 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d80401c9e7e508023fe4754b121e132f390dcb631bfb2ebbc98284f46845ca8"} err="failed to get container status \"6d80401c9e7e508023fe4754b121e132f390dcb631bfb2ebbc98284f46845ca8\": rpc error: code = NotFound desc = could not find container \"6d80401c9e7e508023fe4754b121e132f390dcb631bfb2ebbc98284f46845ca8\": container with ID starting with 6d80401c9e7e508023fe4754b121e132f390dcb631bfb2ebbc98284f46845ca8 not found: ID does not exist" Jun 03 15:52:14.065693 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.065655 2573 scope.go:117] "RemoveContainer" containerID="d4b15466672b1cd62b3b0b5fa3d3efe6d298b3c5dab42b7df9f5cecf401fc71f" Jun 03 15:52:14.065833 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.065814 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4b15466672b1cd62b3b0b5fa3d3efe6d298b3c5dab42b7df9f5cecf401fc71f"} err="failed to get container status \"d4b15466672b1cd62b3b0b5fa3d3efe6d298b3c5dab42b7df9f5cecf401fc71f\": rpc error: code = NotFound desc = could not find container \"d4b15466672b1cd62b3b0b5fa3d3efe6d298b3c5dab42b7df9f5cecf401fc71f\": container with ID starting with d4b15466672b1cd62b3b0b5fa3d3efe6d298b3c5dab42b7df9f5cecf401fc71f not found: ID does not exist" Jun 03 15:52:14.065912 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.065834 2573 scope.go:117] "RemoveContainer" containerID="eb94dab44037e0321eeba1566feb0c80c6853a114bb422ac50474d16324ab8f7" Jun 03 15:52:14.066066 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.066051 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb94dab44037e0321eeba1566feb0c80c6853a114bb422ac50474d16324ab8f7"} err="failed to get container status \"eb94dab44037e0321eeba1566feb0c80c6853a114bb422ac50474d16324ab8f7\": rpc error: code = NotFound desc = could not find container \"eb94dab44037e0321eeba1566feb0c80c6853a114bb422ac50474d16324ab8f7\": container with ID starting with eb94dab44037e0321eeba1566feb0c80c6853a114bb422ac50474d16324ab8f7 not found: ID does not exist" Jun 03 15:52:14.066112 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.066067 2573 scope.go:117] "RemoveContainer" containerID="c631d3a8fb534bd0dc24cad4f5a917363ec04bb3063837ea4f2d3be0caf6eee3" Jun 03 15:52:14.066255 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.066236 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c631d3a8fb534bd0dc24cad4f5a917363ec04bb3063837ea4f2d3be0caf6eee3"} err="failed to get container status \"c631d3a8fb534bd0dc24cad4f5a917363ec04bb3063837ea4f2d3be0caf6eee3\": rpc error: code = NotFound desc = could not find container \"c631d3a8fb534bd0dc24cad4f5a917363ec04bb3063837ea4f2d3be0caf6eee3\": container with ID starting with c631d3a8fb534bd0dc24cad4f5a917363ec04bb3063837ea4f2d3be0caf6eee3 not found: ID does not exist" Jun 03 15:52:14.066321 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.066256 2573 scope.go:117] "RemoveContainer" containerID="2bb18fcc794ba4649e60b53c488dafd181aa0e6a48e3f136a63884f01f4c3d9f" Jun 03 15:52:14.066489 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.066451 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bb18fcc794ba4649e60b53c488dafd181aa0e6a48e3f136a63884f01f4c3d9f"} err="failed to get container status \"2bb18fcc794ba4649e60b53c488dafd181aa0e6a48e3f136a63884f01f4c3d9f\": rpc error: code = NotFound desc = could not find container \"2bb18fcc794ba4649e60b53c488dafd181aa0e6a48e3f136a63884f01f4c3d9f\": container with ID starting with 2bb18fcc794ba4649e60b53c488dafd181aa0e6a48e3f136a63884f01f4c3d9f not found: ID does not exist" Jun 03 15:52:14.066489 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.066483 2573 scope.go:117] "RemoveContainer" containerID="1e0aa63e5db6a95a18c3edcdbf811810a1b61141749fe5e08885469ca840278d" Jun 03 15:52:14.066700 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.066684 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e0aa63e5db6a95a18c3edcdbf811810a1b61141749fe5e08885469ca840278d"} err="failed to get container status \"1e0aa63e5db6a95a18c3edcdbf811810a1b61141749fe5e08885469ca840278d\": rpc error: code = NotFound desc = could not find container \"1e0aa63e5db6a95a18c3edcdbf811810a1b61141749fe5e08885469ca840278d\": container with ID starting with 1e0aa63e5db6a95a18c3edcdbf811810a1b61141749fe5e08885469ca840278d not found: ID does not exist" Jun 03 15:52:14.066760 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.066701 2573 scope.go:117] "RemoveContainer" containerID="61a21d8054068b925577cf3b2049980ff26683483521f3f327659a9e3fef0d52" Jun 03 15:52:14.066889 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.066873 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61a21d8054068b925577cf3b2049980ff26683483521f3f327659a9e3fef0d52"} err="failed to get container status \"61a21d8054068b925577cf3b2049980ff26683483521f3f327659a9e3fef0d52\": rpc error: code = NotFound desc = could not find container \"61a21d8054068b925577cf3b2049980ff26683483521f3f327659a9e3fef0d52\": container with ID starting with 61a21d8054068b925577cf3b2049980ff26683483521f3f327659a9e3fef0d52 not found: ID does not exist" Jun 03 15:52:14.066954 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.066890 2573 scope.go:117] "RemoveContainer" containerID="6d80401c9e7e508023fe4754b121e132f390dcb631bfb2ebbc98284f46845ca8" Jun 03 15:52:14.067081 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.067065 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d80401c9e7e508023fe4754b121e132f390dcb631bfb2ebbc98284f46845ca8"} err="failed to get container status \"6d80401c9e7e508023fe4754b121e132f390dcb631bfb2ebbc98284f46845ca8\": rpc error: code = NotFound desc = could not find container \"6d80401c9e7e508023fe4754b121e132f390dcb631bfb2ebbc98284f46845ca8\": container with ID starting with 6d80401c9e7e508023fe4754b121e132f390dcb631bfb2ebbc98284f46845ca8 not found: ID does not exist" Jun 03 15:52:14.067139 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.067081 2573 scope.go:117] "RemoveContainer" containerID="d4b15466672b1cd62b3b0b5fa3d3efe6d298b3c5dab42b7df9f5cecf401fc71f" Jun 03 15:52:14.067256 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.067240 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4b15466672b1cd62b3b0b5fa3d3efe6d298b3c5dab42b7df9f5cecf401fc71f"} err="failed to get container status \"d4b15466672b1cd62b3b0b5fa3d3efe6d298b3c5dab42b7df9f5cecf401fc71f\": rpc error: code = NotFound desc = could not find container \"d4b15466672b1cd62b3b0b5fa3d3efe6d298b3c5dab42b7df9f5cecf401fc71f\": container with ID starting with d4b15466672b1cd62b3b0b5fa3d3efe6d298b3c5dab42b7df9f5cecf401fc71f not found: ID does not exist" Jun 03 15:52:14.067313 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.067256 2573 scope.go:117] "RemoveContainer" containerID="eb94dab44037e0321eeba1566feb0c80c6853a114bb422ac50474d16324ab8f7" Jun 03 15:52:14.067446 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.067430 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb94dab44037e0321eeba1566feb0c80c6853a114bb422ac50474d16324ab8f7"} err="failed to get container status \"eb94dab44037e0321eeba1566feb0c80c6853a114bb422ac50474d16324ab8f7\": rpc error: code = NotFound desc = could not find container \"eb94dab44037e0321eeba1566feb0c80c6853a114bb422ac50474d16324ab8f7\": container with ID starting with eb94dab44037e0321eeba1566feb0c80c6853a114bb422ac50474d16324ab8f7 not found: ID does not exist" Jun 03 15:52:14.067535 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.067447 2573 scope.go:117] "RemoveContainer" containerID="c631d3a8fb534bd0dc24cad4f5a917363ec04bb3063837ea4f2d3be0caf6eee3" Jun 03 15:52:14.067666 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.067650 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c631d3a8fb534bd0dc24cad4f5a917363ec04bb3063837ea4f2d3be0caf6eee3"} err="failed to get container status \"c631d3a8fb534bd0dc24cad4f5a917363ec04bb3063837ea4f2d3be0caf6eee3\": rpc error: code = NotFound desc = could not find container \"c631d3a8fb534bd0dc24cad4f5a917363ec04bb3063837ea4f2d3be0caf6eee3\": container with ID starting with c631d3a8fb534bd0dc24cad4f5a917363ec04bb3063837ea4f2d3be0caf6eee3 not found: ID does not exist" Jun 03 15:52:14.067724 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.067668 2573 scope.go:117] "RemoveContainer" containerID="2bb18fcc794ba4649e60b53c488dafd181aa0e6a48e3f136a63884f01f4c3d9f" Jun 03 15:52:14.067857 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.067841 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bb18fcc794ba4649e60b53c488dafd181aa0e6a48e3f136a63884f01f4c3d9f"} err="failed to get container status \"2bb18fcc794ba4649e60b53c488dafd181aa0e6a48e3f136a63884f01f4c3d9f\": rpc error: code = NotFound desc = could not find container \"2bb18fcc794ba4649e60b53c488dafd181aa0e6a48e3f136a63884f01f4c3d9f\": container with ID starting with 2bb18fcc794ba4649e60b53c488dafd181aa0e6a48e3f136a63884f01f4c3d9f not found: ID does not exist" Jun 03 15:52:14.067919 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.067858 2573 scope.go:117] "RemoveContainer" containerID="1e0aa63e5db6a95a18c3edcdbf811810a1b61141749fe5e08885469ca840278d" Jun 03 15:52:14.068060 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.068040 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e0aa63e5db6a95a18c3edcdbf811810a1b61141749fe5e08885469ca840278d"} err="failed to get container status \"1e0aa63e5db6a95a18c3edcdbf811810a1b61141749fe5e08885469ca840278d\": rpc error: code = NotFound desc = could not find container \"1e0aa63e5db6a95a18c3edcdbf811810a1b61141749fe5e08885469ca840278d\": container with ID starting with 1e0aa63e5db6a95a18c3edcdbf811810a1b61141749fe5e08885469ca840278d not found: ID does not exist" Jun 03 15:52:14.068104 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.068070 2573 scope.go:117] "RemoveContainer" containerID="61a21d8054068b925577cf3b2049980ff26683483521f3f327659a9e3fef0d52" Jun 03 15:52:14.068258 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.068243 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61a21d8054068b925577cf3b2049980ff26683483521f3f327659a9e3fef0d52"} err="failed to get container status \"61a21d8054068b925577cf3b2049980ff26683483521f3f327659a9e3fef0d52\": rpc error: code = NotFound desc = could not find container \"61a21d8054068b925577cf3b2049980ff26683483521f3f327659a9e3fef0d52\": container with ID starting with 61a21d8054068b925577cf3b2049980ff26683483521f3f327659a9e3fef0d52 not found: ID does not exist" Jun 03 15:52:14.068296 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.068258 2573 scope.go:117] "RemoveContainer" containerID="6d80401c9e7e508023fe4754b121e132f390dcb631bfb2ebbc98284f46845ca8" Jun 03 15:52:14.068421 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.068404 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d80401c9e7e508023fe4754b121e132f390dcb631bfb2ebbc98284f46845ca8"} err="failed to get container status \"6d80401c9e7e508023fe4754b121e132f390dcb631bfb2ebbc98284f46845ca8\": rpc error: code = NotFound desc = could not find container \"6d80401c9e7e508023fe4754b121e132f390dcb631bfb2ebbc98284f46845ca8\": container with ID starting with 6d80401c9e7e508023fe4754b121e132f390dcb631bfb2ebbc98284f46845ca8 not found: ID does not exist" Jun 03 15:52:14.068515 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.068423 2573 scope.go:117] "RemoveContainer" containerID="d4b15466672b1cd62b3b0b5fa3d3efe6d298b3c5dab42b7df9f5cecf401fc71f" Jun 03 15:52:14.068705 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.068685 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4b15466672b1cd62b3b0b5fa3d3efe6d298b3c5dab42b7df9f5cecf401fc71f"} err="failed to get container status \"d4b15466672b1cd62b3b0b5fa3d3efe6d298b3c5dab42b7df9f5cecf401fc71f\": rpc error: code = NotFound desc = could not find container \"d4b15466672b1cd62b3b0b5fa3d3efe6d298b3c5dab42b7df9f5cecf401fc71f\": container with ID starting with d4b15466672b1cd62b3b0b5fa3d3efe6d298b3c5dab42b7df9f5cecf401fc71f not found: ID does not exist" Jun 03 15:52:14.068761 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.068706 2573 scope.go:117] "RemoveContainer" containerID="eb94dab44037e0321eeba1566feb0c80c6853a114bb422ac50474d16324ab8f7" Jun 03 15:52:14.068943 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.068921 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb94dab44037e0321eeba1566feb0c80c6853a114bb422ac50474d16324ab8f7"} err="failed to get container status \"eb94dab44037e0321eeba1566feb0c80c6853a114bb422ac50474d16324ab8f7\": rpc error: code = NotFound desc = could not find container \"eb94dab44037e0321eeba1566feb0c80c6853a114bb422ac50474d16324ab8f7\": container with ID starting with eb94dab44037e0321eeba1566feb0c80c6853a114bb422ac50474d16324ab8f7 not found: ID does not exist" Jun 03 15:52:14.068999 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.068944 2573 scope.go:117] "RemoveContainer" containerID="c631d3a8fb534bd0dc24cad4f5a917363ec04bb3063837ea4f2d3be0caf6eee3" Jun 03 15:52:14.069165 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.069138 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c631d3a8fb534bd0dc24cad4f5a917363ec04bb3063837ea4f2d3be0caf6eee3"} err="failed to get container status \"c631d3a8fb534bd0dc24cad4f5a917363ec04bb3063837ea4f2d3be0caf6eee3\": rpc error: code = NotFound desc = could not find container \"c631d3a8fb534bd0dc24cad4f5a917363ec04bb3063837ea4f2d3be0caf6eee3\": container with ID starting with c631d3a8fb534bd0dc24cad4f5a917363ec04bb3063837ea4f2d3be0caf6eee3 not found: ID does not exist" Jun 03 15:52:14.069165 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.069156 2573 scope.go:117] "RemoveContainer" containerID="2bb18fcc794ba4649e60b53c488dafd181aa0e6a48e3f136a63884f01f4c3d9f" Jun 03 15:52:14.069390 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.069373 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bb18fcc794ba4649e60b53c488dafd181aa0e6a48e3f136a63884f01f4c3d9f"} err="failed to get container status \"2bb18fcc794ba4649e60b53c488dafd181aa0e6a48e3f136a63884f01f4c3d9f\": rpc error: code = NotFound desc = could not find container \"2bb18fcc794ba4649e60b53c488dafd181aa0e6a48e3f136a63884f01f4c3d9f\": container with ID starting with 2bb18fcc794ba4649e60b53c488dafd181aa0e6a48e3f136a63884f01f4c3d9f not found: ID does not exist" Jun 03 15:52:14.069439 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.069390 2573 scope.go:117] "RemoveContainer" containerID="1e0aa63e5db6a95a18c3edcdbf811810a1b61141749fe5e08885469ca840278d" Jun 03 15:52:14.069618 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.069599 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e0aa63e5db6a95a18c3edcdbf811810a1b61141749fe5e08885469ca840278d"} err="failed to get container status \"1e0aa63e5db6a95a18c3edcdbf811810a1b61141749fe5e08885469ca840278d\": rpc error: code = NotFound desc = could not find container \"1e0aa63e5db6a95a18c3edcdbf811810a1b61141749fe5e08885469ca840278d\": container with ID starting with 1e0aa63e5db6a95a18c3edcdbf811810a1b61141749fe5e08885469ca840278d not found: ID does not exist" Jun 03 15:52:14.069660 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.069618 2573 scope.go:117] "RemoveContainer" containerID="61a21d8054068b925577cf3b2049980ff26683483521f3f327659a9e3fef0d52" Jun 03 15:52:14.069813 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.069795 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61a21d8054068b925577cf3b2049980ff26683483521f3f327659a9e3fef0d52"} err="failed to get container status \"61a21d8054068b925577cf3b2049980ff26683483521f3f327659a9e3fef0d52\": rpc error: code = NotFound desc = could not find container \"61a21d8054068b925577cf3b2049980ff26683483521f3f327659a9e3fef0d52\": container with ID starting with 61a21d8054068b925577cf3b2049980ff26683483521f3f327659a9e3fef0d52 not found: ID does not exist" Jun 03 15:52:14.069886 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.069815 2573 scope.go:117] "RemoveContainer" containerID="6d80401c9e7e508023fe4754b121e132f390dcb631bfb2ebbc98284f46845ca8" Jun 03 15:52:14.070020 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.070004 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d80401c9e7e508023fe4754b121e132f390dcb631bfb2ebbc98284f46845ca8"} err="failed to get container status \"6d80401c9e7e508023fe4754b121e132f390dcb631bfb2ebbc98284f46845ca8\": rpc error: code = NotFound desc = could not find container \"6d80401c9e7e508023fe4754b121e132f390dcb631bfb2ebbc98284f46845ca8\": container with ID starting with 6d80401c9e7e508023fe4754b121e132f390dcb631bfb2ebbc98284f46845ca8 not found: ID does not exist" Jun 03 15:52:14.070069 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.070020 2573 scope.go:117] "RemoveContainer" containerID="d4b15466672b1cd62b3b0b5fa3d3efe6d298b3c5dab42b7df9f5cecf401fc71f" Jun 03 15:52:14.070221 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.070202 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4b15466672b1cd62b3b0b5fa3d3efe6d298b3c5dab42b7df9f5cecf401fc71f"} err="failed to get container status \"d4b15466672b1cd62b3b0b5fa3d3efe6d298b3c5dab42b7df9f5cecf401fc71f\": rpc error: code = NotFound desc = could not find container \"d4b15466672b1cd62b3b0b5fa3d3efe6d298b3c5dab42b7df9f5cecf401fc71f\": container with ID starting with d4b15466672b1cd62b3b0b5fa3d3efe6d298b3c5dab42b7df9f5cecf401fc71f not found: ID does not exist" Jun 03 15:52:14.070263 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.070222 2573 scope.go:117] "RemoveContainer" containerID="eb94dab44037e0321eeba1566feb0c80c6853a114bb422ac50474d16324ab8f7" Jun 03 15:52:14.070416 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.070399 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb94dab44037e0321eeba1566feb0c80c6853a114bb422ac50474d16324ab8f7"} err="failed to get container status \"eb94dab44037e0321eeba1566feb0c80c6853a114bb422ac50474d16324ab8f7\": rpc error: code = NotFound desc = could not find container \"eb94dab44037e0321eeba1566feb0c80c6853a114bb422ac50474d16324ab8f7\": container with ID starting with eb94dab44037e0321eeba1566feb0c80c6853a114bb422ac50474d16324ab8f7 not found: ID does not exist" Jun 03 15:52:14.070503 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.070418 2573 scope.go:117] "RemoveContainer" containerID="c631d3a8fb534bd0dc24cad4f5a917363ec04bb3063837ea4f2d3be0caf6eee3" Jun 03 15:52:14.070642 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.070625 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c631d3a8fb534bd0dc24cad4f5a917363ec04bb3063837ea4f2d3be0caf6eee3"} err="failed to get container status \"c631d3a8fb534bd0dc24cad4f5a917363ec04bb3063837ea4f2d3be0caf6eee3\": rpc error: code = NotFound desc = could not find container \"c631d3a8fb534bd0dc24cad4f5a917363ec04bb3063837ea4f2d3be0caf6eee3\": container with ID starting with c631d3a8fb534bd0dc24cad4f5a917363ec04bb3063837ea4f2d3be0caf6eee3 not found: ID does not exist" Jun 03 15:52:14.070711 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.070643 2573 scope.go:117] "RemoveContainer" containerID="2bb18fcc794ba4649e60b53c488dafd181aa0e6a48e3f136a63884f01f4c3d9f" Jun 03 15:52:14.070867 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.070852 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bb18fcc794ba4649e60b53c488dafd181aa0e6a48e3f136a63884f01f4c3d9f"} err="failed to get container status \"2bb18fcc794ba4649e60b53c488dafd181aa0e6a48e3f136a63884f01f4c3d9f\": rpc error: code = NotFound desc = could not find container \"2bb18fcc794ba4649e60b53c488dafd181aa0e6a48e3f136a63884f01f4c3d9f\": container with ID starting with 2bb18fcc794ba4649e60b53c488dafd181aa0e6a48e3f136a63884f01f4c3d9f not found: ID does not exist" Jun 03 15:52:14.070924 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.070869 2573 scope.go:117] "RemoveContainer" containerID="1e0aa63e5db6a95a18c3edcdbf811810a1b61141749fe5e08885469ca840278d" Jun 03 15:52:14.071041 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.071021 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e0aa63e5db6a95a18c3edcdbf811810a1b61141749fe5e08885469ca840278d"} err="failed to get container status \"1e0aa63e5db6a95a18c3edcdbf811810a1b61141749fe5e08885469ca840278d\": rpc error: code = NotFound desc = could not find container \"1e0aa63e5db6a95a18c3edcdbf811810a1b61141749fe5e08885469ca840278d\": container with ID starting with 1e0aa63e5db6a95a18c3edcdbf811810a1b61141749fe5e08885469ca840278d not found: ID does not exist" Jun 03 15:52:14.071041 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.071039 2573 scope.go:117] "RemoveContainer" containerID="61a21d8054068b925577cf3b2049980ff26683483521f3f327659a9e3fef0d52" Jun 03 15:52:14.071243 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.071229 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61a21d8054068b925577cf3b2049980ff26683483521f3f327659a9e3fef0d52"} err="failed to get container status \"61a21d8054068b925577cf3b2049980ff26683483521f3f327659a9e3fef0d52\": rpc error: code = NotFound desc = could not find container \"61a21d8054068b925577cf3b2049980ff26683483521f3f327659a9e3fef0d52\": container with ID starting with 61a21d8054068b925577cf3b2049980ff26683483521f3f327659a9e3fef0d52 not found: ID does not exist" Jun 03 15:52:14.071243 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.071242 2573 scope.go:117] "RemoveContainer" containerID="6d80401c9e7e508023fe4754b121e132f390dcb631bfb2ebbc98284f46845ca8" Jun 03 15:52:14.071425 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.071406 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d80401c9e7e508023fe4754b121e132f390dcb631bfb2ebbc98284f46845ca8"} err="failed to get container status \"6d80401c9e7e508023fe4754b121e132f390dcb631bfb2ebbc98284f46845ca8\": rpc error: code = NotFound desc = could not find container \"6d80401c9e7e508023fe4754b121e132f390dcb631bfb2ebbc98284f46845ca8\": container with ID starting with 6d80401c9e7e508023fe4754b121e132f390dcb631bfb2ebbc98284f46845ca8 not found: ID does not exist" Jun 03 15:52:14.071464 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.071425 2573 scope.go:117] "RemoveContainer" containerID="d4b15466672b1cd62b3b0b5fa3d3efe6d298b3c5dab42b7df9f5cecf401fc71f" Jun 03 15:52:14.071614 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.071598 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4b15466672b1cd62b3b0b5fa3d3efe6d298b3c5dab42b7df9f5cecf401fc71f"} err="failed to get container status \"d4b15466672b1cd62b3b0b5fa3d3efe6d298b3c5dab42b7df9f5cecf401fc71f\": rpc error: code = NotFound desc = could not find container \"d4b15466672b1cd62b3b0b5fa3d3efe6d298b3c5dab42b7df9f5cecf401fc71f\": container with ID starting with d4b15466672b1cd62b3b0b5fa3d3efe6d298b3c5dab42b7df9f5cecf401fc71f not found: ID does not exist" Jun 03 15:52:14.083997 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.083975 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dd451b12-b8ac-4c93-9872-c99bfca851c4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"dd451b12-b8ac-4c93-9872-c99bfca851c4\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " Jun 03 15:52:14.084042 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.084006 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dd451b12-b8ac-4c93-9872-c99bfca851c4-tls-assets\") pod \"dd451b12-b8ac-4c93-9872-c99bfca851c4\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " Jun 03 15:52:14.084042 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.084024 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/dd451b12-b8ac-4c93-9872-c99bfca851c4-config\") pod \"dd451b12-b8ac-4c93-9872-c99bfca851c4\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " Jun 03 15:52:14.084103 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.084042 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dd451b12-b8ac-4c93-9872-c99bfca851c4-thanos-prometheus-http-client-file\") pod \"dd451b12-b8ac-4c93-9872-c99bfca851c4\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " Jun 03 15:52:14.084194 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.084175 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dd451b12-b8ac-4c93-9872-c99bfca851c4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"dd451b12-b8ac-4c93-9872-c99bfca851c4\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " Jun 03 15:52:14.084250 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.084231 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g75m7\" (UniqueName: \"kubernetes.io/projected/dd451b12-b8ac-4c93-9872-c99bfca851c4-kube-api-access-g75m7\") pod \"dd451b12-b8ac-4c93-9872-c99bfca851c4\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " Jun 03 15:52:14.084303 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.084262 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dd451b12-b8ac-4c93-9872-c99bfca851c4-secret-prometheus-k8s-tls\") pod \"dd451b12-b8ac-4c93-9872-c99bfca851c4\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " Jun 03 15:52:14.084303 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.084291 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd451b12-b8ac-4c93-9872-c99bfca851c4-configmap-kubelet-serving-ca-bundle\") pod \"dd451b12-b8ac-4c93-9872-c99bfca851c4\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " Jun 03 15:52:14.084391 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.084349 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dd451b12-b8ac-4c93-9872-c99bfca851c4-secret-kube-rbac-proxy\") pod \"dd451b12-b8ac-4c93-9872-c99bfca851c4\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " Jun 03 15:52:14.084391 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.084381 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd451b12-b8ac-4c93-9872-c99bfca851c4-configmap-serving-certs-ca-bundle\") pod \"dd451b12-b8ac-4c93-9872-c99bfca851c4\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " Jun 03 15:52:14.084505 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.084410 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dd451b12-b8ac-4c93-9872-c99bfca851c4-prometheus-k8s-db\") pod \"dd451b12-b8ac-4c93-9872-c99bfca851c4\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " Jun 03 15:52:14.084505 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.084440 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dd451b12-b8ac-4c93-9872-c99bfca851c4-prometheus-k8s-rulefiles-0\") pod \"dd451b12-b8ac-4c93-9872-c99bfca851c4\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " Jun 03 15:52:14.084505 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.084464 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dd451b12-b8ac-4c93-9872-c99bfca851c4-config-out\") pod \"dd451b12-b8ac-4c93-9872-c99bfca851c4\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " Jun 03 15:52:14.084659 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.084526 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd451b12-b8ac-4c93-9872-c99bfca851c4-configmap-metrics-client-ca\") pod \"dd451b12-b8ac-4c93-9872-c99bfca851c4\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " Jun 03 15:52:14.084659 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.084567 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd451b12-b8ac-4c93-9872-c99bfca851c4-prometheus-trusted-ca-bundle\") pod \"dd451b12-b8ac-4c93-9872-c99bfca851c4\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " Jun 03 15:52:14.084659 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.084604 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dd451b12-b8ac-4c93-9872-c99bfca851c4-secret-metrics-client-certs\") pod \"dd451b12-b8ac-4c93-9872-c99bfca851c4\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " Jun 03 15:52:14.084659 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.084632 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dd451b12-b8ac-4c93-9872-c99bfca851c4-secret-grpc-tls\") pod \"dd451b12-b8ac-4c93-9872-c99bfca851c4\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " Jun 03 15:52:14.084829 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.084663 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dd451b12-b8ac-4c93-9872-c99bfca851c4-web-config\") pod \"dd451b12-b8ac-4c93-9872-c99bfca851c4\" (UID: \"dd451b12-b8ac-4c93-9872-c99bfca851c4\") " Jun 03 15:52:14.086487 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.084947 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd451b12-b8ac-4c93-9872-c99bfca851c4-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "dd451b12-b8ac-4c93-9872-c99bfca851c4" (UID: "dd451b12-b8ac-4c93-9872-c99bfca851c4"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:52:14.086487 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.085159 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd451b12-b8ac-4c93-9872-c99bfca851c4-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "dd451b12-b8ac-4c93-9872-c99bfca851c4" (UID: "dd451b12-b8ac-4c93-9872-c99bfca851c4"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:52:14.086487 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.085236 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd451b12-b8ac-4c93-9872-c99bfca851c4-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "dd451b12-b8ac-4c93-9872-c99bfca851c4" (UID: "dd451b12-b8ac-4c93-9872-c99bfca851c4"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:52:14.086487 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.085544 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd451b12-b8ac-4c93-9872-c99bfca851c4-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "dd451b12-b8ac-4c93-9872-c99bfca851c4" (UID: "dd451b12-b8ac-4c93-9872-c99bfca851c4"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:52:14.086487 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.086424 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd451b12-b8ac-4c93-9872-c99bfca851c4-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "dd451b12-b8ac-4c93-9872-c99bfca851c4" (UID: "dd451b12-b8ac-4c93-9872-c99bfca851c4"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:52:14.086890 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.086864 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd451b12-b8ac-4c93-9872-c99bfca851c4-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "dd451b12-b8ac-4c93-9872-c99bfca851c4" (UID: "dd451b12-b8ac-4c93-9872-c99bfca851c4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:52:14.086973 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.086953 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd451b12-b8ac-4c93-9872-c99bfca851c4-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "dd451b12-b8ac-4c93-9872-c99bfca851c4" (UID: "dd451b12-b8ac-4c93-9872-c99bfca851c4"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:52:14.087033 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.087001 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd451b12-b8ac-4c93-9872-c99bfca851c4-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "dd451b12-b8ac-4c93-9872-c99bfca851c4" (UID: "dd451b12-b8ac-4c93-9872-c99bfca851c4"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:52:14.087665 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.087625 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd451b12-b8ac-4c93-9872-c99bfca851c4-kube-api-access-g75m7" (OuterVolumeSpecName: "kube-api-access-g75m7") pod "dd451b12-b8ac-4c93-9872-c99bfca851c4" (UID: "dd451b12-b8ac-4c93-9872-c99bfca851c4"). InnerVolumeSpecName "kube-api-access-g75m7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:52:14.087665 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.087646 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd451b12-b8ac-4c93-9872-c99bfca851c4-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "dd451b12-b8ac-4c93-9872-c99bfca851c4" (UID: "dd451b12-b8ac-4c93-9872-c99bfca851c4"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:52:14.087810 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.087666 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd451b12-b8ac-4c93-9872-c99bfca851c4-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "dd451b12-b8ac-4c93-9872-c99bfca851c4" (UID: "dd451b12-b8ac-4c93-9872-c99bfca851c4"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:52:14.088713 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.088687 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd451b12-b8ac-4c93-9872-c99bfca851c4-config" (OuterVolumeSpecName: "config") pod "dd451b12-b8ac-4c93-9872-c99bfca851c4" (UID: "dd451b12-b8ac-4c93-9872-c99bfca851c4"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:52:14.088811 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.088771 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd451b12-b8ac-4c93-9872-c99bfca851c4-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "dd451b12-b8ac-4c93-9872-c99bfca851c4" (UID: "dd451b12-b8ac-4c93-9872-c99bfca851c4"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:52:14.088868 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.088825 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd451b12-b8ac-4c93-9872-c99bfca851c4-config-out" (OuterVolumeSpecName: "config-out") pod "dd451b12-b8ac-4c93-9872-c99bfca851c4" (UID: "dd451b12-b8ac-4c93-9872-c99bfca851c4"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:52:14.089018 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.088993 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd451b12-b8ac-4c93-9872-c99bfca851c4-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "dd451b12-b8ac-4c93-9872-c99bfca851c4" (UID: "dd451b12-b8ac-4c93-9872-c99bfca851c4"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:52:14.089118 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.089099 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd451b12-b8ac-4c93-9872-c99bfca851c4-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "dd451b12-b8ac-4c93-9872-c99bfca851c4" (UID: "dd451b12-b8ac-4c93-9872-c99bfca851c4"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:52:14.089118 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.089110 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd451b12-b8ac-4c93-9872-c99bfca851c4-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "dd451b12-b8ac-4c93-9872-c99bfca851c4" (UID: "dd451b12-b8ac-4c93-9872-c99bfca851c4"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:52:14.097758 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.097734 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd451b12-b8ac-4c93-9872-c99bfca851c4-web-config" (OuterVolumeSpecName: "web-config") pod "dd451b12-b8ac-4c93-9872-c99bfca851c4" (UID: "dd451b12-b8ac-4c93-9872-c99bfca851c4"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:52:14.186396 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.186366 2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd451b12-b8ac-4c93-9872-c99bfca851c4-prometheus-trusted-ca-bundle\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Jun 03 15:52:14.186396 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.186401 2573 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dd451b12-b8ac-4c93-9872-c99bfca851c4-secret-metrics-client-certs\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Jun 03 15:52:14.186594 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.186418 2573 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dd451b12-b8ac-4c93-9872-c99bfca851c4-secret-grpc-tls\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Jun 03 15:52:14.186594 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.186432 2573 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dd451b12-b8ac-4c93-9872-c99bfca851c4-web-config\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Jun 03 15:52:14.186594 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.186443 2573 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dd451b12-b8ac-4c93-9872-c99bfca851c4-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Jun 03 15:52:14.186594 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.186454 2573 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dd451b12-b8ac-4c93-9872-c99bfca851c4-tls-assets\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Jun 03 15:52:14.186594 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.186463 2573 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/dd451b12-b8ac-4c93-9872-c99bfca851c4-config\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Jun 03 15:52:14.186594 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.186498 2573 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dd451b12-b8ac-4c93-9872-c99bfca851c4-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Jun 03 15:52:14.186594 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.186509 2573 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dd451b12-b8ac-4c93-9872-c99bfca851c4-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Jun 03 15:52:14.186594 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.186519 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g75m7\" (UniqueName: \"kubernetes.io/projected/dd451b12-b8ac-4c93-9872-c99bfca851c4-kube-api-access-g75m7\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Jun 03 15:52:14.186594 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.186530 2573 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dd451b12-b8ac-4c93-9872-c99bfca851c4-secret-prometheus-k8s-tls\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Jun 03 15:52:14.186594 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.186538 2573 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd451b12-b8ac-4c93-9872-c99bfca851c4-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Jun 03 15:52:14.186594 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.186547 2573 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dd451b12-b8ac-4c93-9872-c99bfca851c4-secret-kube-rbac-proxy\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Jun 03 15:52:14.186594 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.186556 2573 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd451b12-b8ac-4c93-9872-c99bfca851c4-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Jun 03 15:52:14.186594 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.186565 2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dd451b12-b8ac-4c93-9872-c99bfca851c4-prometheus-k8s-db\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Jun 03 15:52:14.186594 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.186575 2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dd451b12-b8ac-4c93-9872-c99bfca851c4-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Jun 03 15:52:14.186594 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.186595 2573 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dd451b12-b8ac-4c93-9872-c99bfca851c4-config-out\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Jun 03 15:52:14.187007 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.186604 2573 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd451b12-b8ac-4c93-9872-c99bfca851c4-configmap-metrics-client-ca\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Jun 03 15:52:14.339274 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.339242 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 15:52:14.347148 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.347116 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 15:52:14.377429 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.377402 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 15:52:14.377669 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.377656 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd451b12-b8ac-4c93-9872-c99bfca851c4" containerName="prometheus" Jun 03 15:52:14.377718 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.377670 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd451b12-b8ac-4c93-9872-c99bfca851c4" containerName="prometheus" Jun 03 15:52:14.377718 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.377682 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd451b12-b8ac-4c93-9872-c99bfca851c4" containerName="thanos-sidecar" Jun 03 15:52:14.377718 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.377687 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd451b12-b8ac-4c93-9872-c99bfca851c4" containerName="thanos-sidecar" Jun 03 15:52:14.377718 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.377696 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd451b12-b8ac-4c93-9872-c99bfca851c4" containerName="kube-rbac-proxy-thanos" Jun 03 15:52:14.377718 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.377701 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd451b12-b8ac-4c93-9872-c99bfca851c4" containerName="kube-rbac-proxy-thanos" Jun 03 15:52:14.377718 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.377709 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd451b12-b8ac-4c93-9872-c99bfca851c4" containerName="init-config-reloader" Jun 03 15:52:14.377718 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.377714 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd451b12-b8ac-4c93-9872-c99bfca851c4" containerName="init-config-reloader" Jun 03 15:52:14.377718 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.377720 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd451b12-b8ac-4c93-9872-c99bfca851c4" containerName="config-reloader" Jun 03 15:52:14.377929 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.377725 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd451b12-b8ac-4c93-9872-c99bfca851c4" containerName="config-reloader" Jun 03 15:52:14.377929 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.377732 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd451b12-b8ac-4c93-9872-c99bfca851c4" containerName="kube-rbac-proxy" Jun 03 15:52:14.377929 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.377737 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd451b12-b8ac-4c93-9872-c99bfca851c4" containerName="kube-rbac-proxy" Jun 03 15:52:14.377929 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.377744 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd451b12-b8ac-4c93-9872-c99bfca851c4" containerName="kube-rbac-proxy-web" Jun 03 15:52:14.377929 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.377749 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd451b12-b8ac-4c93-9872-c99bfca851c4" containerName="kube-rbac-proxy-web" Jun 03 15:52:14.377929 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.377791 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="dd451b12-b8ac-4c93-9872-c99bfca851c4" containerName="thanos-sidecar" Jun 03 15:52:14.377929 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.377799 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="dd451b12-b8ac-4c93-9872-c99bfca851c4" containerName="config-reloader" Jun 03 15:52:14.377929 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.377806 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="dd451b12-b8ac-4c93-9872-c99bfca851c4" containerName="kube-rbac-proxy-web" Jun 03 15:52:14.377929 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.377812 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="dd451b12-b8ac-4c93-9872-c99bfca851c4" containerName="kube-rbac-proxy" Jun 03 15:52:14.377929 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.377817 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="dd451b12-b8ac-4c93-9872-c99bfca851c4" containerName="kube-rbac-proxy-thanos" Jun 03 15:52:14.377929 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.377824 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="dd451b12-b8ac-4c93-9872-c99bfca851c4" containerName="prometheus" Jun 03 15:52:14.382324 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.382308 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.385153 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.385134 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 03 15:52:14.385232 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.385143 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-4vw59\"" Jun 03 15:52:14.385232 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.385197 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 03 15:52:14.385526 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.385507 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 03 15:52:14.385747 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.385733 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6fb9peue5hu97\"" Jun 03 15:52:14.385830 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.385782 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 03 15:52:14.385963 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.385945 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 03 15:52:14.386033 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.385990 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 03 15:52:14.386217 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.386199 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 03 15:52:14.386294 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.386202 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 03 15:52:14.386686 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.386671 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 03 15:52:14.386769 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.386728 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 03 15:52:14.387838 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.387822 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 03 15:52:14.392994 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.392974 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 03 15:52:14.401098 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.401075 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 15:52:14.489052 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.489018 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/43fbc77c-cbc0-4caf-9094-7842b6279b43-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"43fbc77c-cbc0-4caf-9094-7842b6279b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.489052 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.489053 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/43fbc77c-cbc0-4caf-9094-7842b6279b43-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"43fbc77c-cbc0-4caf-9094-7842b6279b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.489256 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.489081 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43fbc77c-cbc0-4caf-9094-7842b6279b43-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"43fbc77c-cbc0-4caf-9094-7842b6279b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.489256 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.489170 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/43fbc77c-cbc0-4caf-9094-7842b6279b43-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"43fbc77c-cbc0-4caf-9094-7842b6279b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.489256 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.489204 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/43fbc77c-cbc0-4caf-9094-7842b6279b43-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"43fbc77c-cbc0-4caf-9094-7842b6279b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.489256 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.489224 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/43fbc77c-cbc0-4caf-9094-7842b6279b43-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"43fbc77c-cbc0-4caf-9094-7842b6279b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.489374 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.489258 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/43fbc77c-cbc0-4caf-9094-7842b6279b43-config-out\") pod \"prometheus-k8s-0\" (UID: \"43fbc77c-cbc0-4caf-9094-7842b6279b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.489374 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.489274 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43fbc77c-cbc0-4caf-9094-7842b6279b43-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"43fbc77c-cbc0-4caf-9094-7842b6279b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.489374 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.489293 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/43fbc77c-cbc0-4caf-9094-7842b6279b43-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"43fbc77c-cbc0-4caf-9094-7842b6279b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.489374 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.489313 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/43fbc77c-cbc0-4caf-9094-7842b6279b43-web-config\") pod \"prometheus-k8s-0\" (UID: \"43fbc77c-cbc0-4caf-9094-7842b6279b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.489374 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.489351 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/43fbc77c-cbc0-4caf-9094-7842b6279b43-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"43fbc77c-cbc0-4caf-9094-7842b6279b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.489374 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.489367 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/43fbc77c-cbc0-4caf-9094-7842b6279b43-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"43fbc77c-cbc0-4caf-9094-7842b6279b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.489568 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.489405 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43fbc77c-cbc0-4caf-9094-7842b6279b43-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"43fbc77c-cbc0-4caf-9094-7842b6279b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.489568 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.489435 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/43fbc77c-cbc0-4caf-9094-7842b6279b43-config\") pod \"prometheus-k8s-0\" (UID: \"43fbc77c-cbc0-4caf-9094-7842b6279b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.489568 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.489498 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/43fbc77c-cbc0-4caf-9094-7842b6279b43-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"43fbc77c-cbc0-4caf-9094-7842b6279b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.489568 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.489535 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/43fbc77c-cbc0-4caf-9094-7842b6279b43-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"43fbc77c-cbc0-4caf-9094-7842b6279b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.489568 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.489558 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9c2n\" (UniqueName: \"kubernetes.io/projected/43fbc77c-cbc0-4caf-9094-7842b6279b43-kube-api-access-v9c2n\") pod \"prometheus-k8s-0\" (UID: \"43fbc77c-cbc0-4caf-9094-7842b6279b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.489710 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.489604 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43fbc77c-cbc0-4caf-9094-7842b6279b43-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"43fbc77c-cbc0-4caf-9094-7842b6279b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.590128 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.590031 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/43fbc77c-cbc0-4caf-9094-7842b6279b43-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"43fbc77c-cbc0-4caf-9094-7842b6279b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.590128 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.590064 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/43fbc77c-cbc0-4caf-9094-7842b6279b43-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"43fbc77c-cbc0-4caf-9094-7842b6279b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.590128 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.590082 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/43fbc77c-cbc0-4caf-9094-7842b6279b43-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"43fbc77c-cbc0-4caf-9094-7842b6279b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.590128 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.590103 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/43fbc77c-cbc0-4caf-9094-7842b6279b43-config-out\") pod \"prometheus-k8s-0\" (UID: \"43fbc77c-cbc0-4caf-9094-7842b6279b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.590416 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.590221 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43fbc77c-cbc0-4caf-9094-7842b6279b43-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"43fbc77c-cbc0-4caf-9094-7842b6279b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.590416 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.590264 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/43fbc77c-cbc0-4caf-9094-7842b6279b43-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"43fbc77c-cbc0-4caf-9094-7842b6279b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.590416 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.590287 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/43fbc77c-cbc0-4caf-9094-7842b6279b43-web-config\") pod \"prometheus-k8s-0\" (UID: \"43fbc77c-cbc0-4caf-9094-7842b6279b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.590416 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.590323 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/43fbc77c-cbc0-4caf-9094-7842b6279b43-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"43fbc77c-cbc0-4caf-9094-7842b6279b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.590416 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.590352 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/43fbc77c-cbc0-4caf-9094-7842b6279b43-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"43fbc77c-cbc0-4caf-9094-7842b6279b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.590416 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.590381 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43fbc77c-cbc0-4caf-9094-7842b6279b43-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"43fbc77c-cbc0-4caf-9094-7842b6279b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.590416 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.590408 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/43fbc77c-cbc0-4caf-9094-7842b6279b43-config\") pod \"prometheus-k8s-0\" (UID: \"43fbc77c-cbc0-4caf-9094-7842b6279b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.590865 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.590503 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/43fbc77c-cbc0-4caf-9094-7842b6279b43-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"43fbc77c-cbc0-4caf-9094-7842b6279b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.590865 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.590545 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/43fbc77c-cbc0-4caf-9094-7842b6279b43-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"43fbc77c-cbc0-4caf-9094-7842b6279b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.590865 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.590584 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v9c2n\" (UniqueName: \"kubernetes.io/projected/43fbc77c-cbc0-4caf-9094-7842b6279b43-kube-api-access-v9c2n\") pod \"prometheus-k8s-0\" (UID: \"43fbc77c-cbc0-4caf-9094-7842b6279b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.590865 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.590633 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43fbc77c-cbc0-4caf-9094-7842b6279b43-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"43fbc77c-cbc0-4caf-9094-7842b6279b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.591234 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.591186 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/43fbc77c-cbc0-4caf-9094-7842b6279b43-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"43fbc77c-cbc0-4caf-9094-7842b6279b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.591311 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.591277 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/43fbc77c-cbc0-4caf-9094-7842b6279b43-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"43fbc77c-cbc0-4caf-9094-7842b6279b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.591371 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.591322 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43fbc77c-cbc0-4caf-9094-7842b6279b43-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"43fbc77c-cbc0-4caf-9094-7842b6279b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.592079 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.591851 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43fbc77c-cbc0-4caf-9094-7842b6279b43-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"43fbc77c-cbc0-4caf-9094-7842b6279b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.592286 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.592260 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43fbc77c-cbc0-4caf-9094-7842b6279b43-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"43fbc77c-cbc0-4caf-9094-7842b6279b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.593491 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.593309 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/43fbc77c-cbc0-4caf-9094-7842b6279b43-config-out\") pod \"prometheus-k8s-0\" (UID: \"43fbc77c-cbc0-4caf-9094-7842b6279b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.593750 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.593661 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/43fbc77c-cbc0-4caf-9094-7842b6279b43-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"43fbc77c-cbc0-4caf-9094-7842b6279b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.594160 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.594138 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/43fbc77c-cbc0-4caf-9094-7842b6279b43-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"43fbc77c-cbc0-4caf-9094-7842b6279b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.594271 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.594230 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/43fbc77c-cbc0-4caf-9094-7842b6279b43-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"43fbc77c-cbc0-4caf-9094-7842b6279b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.594689 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.594666 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/43fbc77c-cbc0-4caf-9094-7842b6279b43-web-config\") pod \"prometheus-k8s-0\" (UID: \"43fbc77c-cbc0-4caf-9094-7842b6279b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.596025 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.595046 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/43fbc77c-cbc0-4caf-9094-7842b6279b43-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"43fbc77c-cbc0-4caf-9094-7842b6279b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.596025 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.595450 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/43fbc77c-cbc0-4caf-9094-7842b6279b43-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"43fbc77c-cbc0-4caf-9094-7842b6279b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.596190 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.596164 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43fbc77c-cbc0-4caf-9094-7842b6279b43-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"43fbc77c-cbc0-4caf-9094-7842b6279b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.597082 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.597055 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/43fbc77c-cbc0-4caf-9094-7842b6279b43-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"43fbc77c-cbc0-4caf-9094-7842b6279b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.597171 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.597118 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43fbc77c-cbc0-4caf-9094-7842b6279b43-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"43fbc77c-cbc0-4caf-9094-7842b6279b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.599070 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.598381 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/43fbc77c-cbc0-4caf-9094-7842b6279b43-config\") pod \"prometheus-k8s-0\" (UID: \"43fbc77c-cbc0-4caf-9094-7842b6279b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.599070 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.598431 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/43fbc77c-cbc0-4caf-9094-7842b6279b43-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"43fbc77c-cbc0-4caf-9094-7842b6279b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.599070 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.598598 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/43fbc77c-cbc0-4caf-9094-7842b6279b43-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"43fbc77c-cbc0-4caf-9094-7842b6279b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.599874 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.599846 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/43fbc77c-cbc0-4caf-9094-7842b6279b43-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"43fbc77c-cbc0-4caf-9094-7842b6279b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.600050 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.600035 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/43fbc77c-cbc0-4caf-9094-7842b6279b43-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"43fbc77c-cbc0-4caf-9094-7842b6279b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.605102 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.605085 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9c2n\" (UniqueName: \"kubernetes.io/projected/43fbc77c-cbc0-4caf-9094-7842b6279b43-kube-api-access-v9c2n\") pod \"prometheus-k8s-0\" (UID: \"43fbc77c-cbc0-4caf-9094-7842b6279b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.692529 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.692493 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:52:14.839604 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:14.839408 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 15:52:14.842667 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:52:14.842601 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43fbc77c_cbc0_4caf_9094_7842b6279b43.slice/crio-029db092bdc8b3506afa6cd0690279488237da755ac218ac0bbb7d12794965e9 WatchSource:0}: Error finding container 029db092bdc8b3506afa6cd0690279488237da755ac218ac0bbb7d12794965e9: Status 404 returned error can't find the container with id 029db092bdc8b3506afa6cd0690279488237da755ac218ac0bbb7d12794965e9 Jun 03 15:52:15.020925 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:15.020895 2573 generic.go:358] "Generic (PLEG): container finished" podID="43fbc77c-cbc0-4caf-9094-7842b6279b43" containerID="714563096f0603bdc1fd9bdcc8fd36e918a793b827014ae92f4ff2f94d380453" exitCode=0 Jun 03 15:52:15.021305 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:15.020965 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43fbc77c-cbc0-4caf-9094-7842b6279b43","Type":"ContainerDied","Data":"714563096f0603bdc1fd9bdcc8fd36e918a793b827014ae92f4ff2f94d380453"} Jun 03 15:52:15.021305 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:15.020985 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43fbc77c-cbc0-4caf-9094-7842b6279b43","Type":"ContainerStarted","Data":"029db092bdc8b3506afa6cd0690279488237da755ac218ac0bbb7d12794965e9"} Jun 03 15:52:16.026376 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:16.026279 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43fbc77c-cbc0-4caf-9094-7842b6279b43","Type":"ContainerStarted","Data":"5b5f14e54143ed77f589d44a1eb175a3fe59bf38b860692f7f3fa6fa5de67828"} Jun 03 15:52:16.026376 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:16.026319 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43fbc77c-cbc0-4caf-9094-7842b6279b43","Type":"ContainerStarted","Data":"abe83b57b789f876b11edb1fe7d8cd400db9cdddc0c058dc239b7ee6d47b767a"} Jun 03 15:52:16.026376 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:16.026334 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43fbc77c-cbc0-4caf-9094-7842b6279b43","Type":"ContainerStarted","Data":"a6b34dacb877a4136d6450f7272c103b11d2537e5da9c869b72622bbf419353b"} Jun 03 15:52:16.026376 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:16.026348 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43fbc77c-cbc0-4caf-9094-7842b6279b43","Type":"ContainerStarted","Data":"47866eb0fbbea480189c990b8e41d0aad163b6511ce2889910dbcac7f3e9062f"} Jun 03 15:52:16.026376 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:16.026360 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43fbc77c-cbc0-4caf-9094-7842b6279b43","Type":"ContainerStarted","Data":"ccb27b686ea35ac9c1bb29af8c954a304ce8f4968b5ef241da939071f7bfa849"} Jun 03 15:52:16.026376 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:16.026374 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43fbc77c-cbc0-4caf-9094-7842b6279b43","Type":"ContainerStarted","Data":"cca667c91f5e27bcbf42c9029d5cfc768b496b543122c27198fa262cd40904b8"} Jun 03 15:52:16.057755 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:16.057705 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.057688033 podStartE2EDuration="2.057688033s" podCreationTimestamp="2026-06-03 15:52:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:52:16.056403913 +0000 UTC m=+196.413399045" watchObservedRunningTime="2026-06-03 15:52:16.057688033 +0000 UTC m=+196.414683178" Jun 03 15:52:16.234197 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:16.234161 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd451b12-b8ac-4c93-9872-c99bfca851c4" path="/var/lib/kubelet/pods/dd451b12-b8ac-4c93-9872-c99bfca851c4/volumes" Jun 03 15:52:19.692984 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:52:19.692941 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:53:14.693167 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:53:14.693113 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:53:14.708753 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:53:14.708728 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:53:15.207309 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:53:15.207285 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:54:00.115128 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:54:00.115100 2573 kubelet.go:1628] "Image garbage collection succeeded" Jun 03 15:55:58.123772 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:55:58.123738 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-kkwwb"] Jun 03 15:55:58.126985 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:55:58.126962 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-kkwwb" Jun 03 15:55:58.129347 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:55:58.129328 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 03 15:55:58.129500 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:55:58.129451 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 03 15:55:58.129592 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:55:58.129577 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-p8kc4\"" Jun 03 15:55:58.133897 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:55:58.133878 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-kkwwb"] Jun 03 15:55:58.143215 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:55:58.143196 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/09fc44cf-aa62-4ba2-85ef-ca7a09c3fe0f-bound-sa-token\") pod \"cert-manager-79c8d999ff-kkwwb\" (UID: \"09fc44cf-aa62-4ba2-85ef-ca7a09c3fe0f\") " pod="cert-manager/cert-manager-79c8d999ff-kkwwb" Jun 03 15:55:58.143298 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:55:58.143254 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2p28\" (UniqueName: \"kubernetes.io/projected/09fc44cf-aa62-4ba2-85ef-ca7a09c3fe0f-kube-api-access-p2p28\") pod \"cert-manager-79c8d999ff-kkwwb\" (UID: \"09fc44cf-aa62-4ba2-85ef-ca7a09c3fe0f\") " pod="cert-manager/cert-manager-79c8d999ff-kkwwb" Jun 03 15:55:58.244095 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:55:58.244061 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p2p28\" (UniqueName: \"kubernetes.io/projected/09fc44cf-aa62-4ba2-85ef-ca7a09c3fe0f-kube-api-access-p2p28\") pod \"cert-manager-79c8d999ff-kkwwb\" (UID: \"09fc44cf-aa62-4ba2-85ef-ca7a09c3fe0f\") " pod="cert-manager/cert-manager-79c8d999ff-kkwwb" Jun 03 15:55:58.244256 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:55:58.244109 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/09fc44cf-aa62-4ba2-85ef-ca7a09c3fe0f-bound-sa-token\") pod \"cert-manager-79c8d999ff-kkwwb\" (UID: \"09fc44cf-aa62-4ba2-85ef-ca7a09c3fe0f\") " pod="cert-manager/cert-manager-79c8d999ff-kkwwb" Jun 03 15:55:58.253164 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:55:58.253133 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2p28\" (UniqueName: \"kubernetes.io/projected/09fc44cf-aa62-4ba2-85ef-ca7a09c3fe0f-kube-api-access-p2p28\") pod \"cert-manager-79c8d999ff-kkwwb\" (UID: \"09fc44cf-aa62-4ba2-85ef-ca7a09c3fe0f\") " pod="cert-manager/cert-manager-79c8d999ff-kkwwb" Jun 03 15:55:58.253340 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:55:58.253321 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/09fc44cf-aa62-4ba2-85ef-ca7a09c3fe0f-bound-sa-token\") pod \"cert-manager-79c8d999ff-kkwwb\" (UID: \"09fc44cf-aa62-4ba2-85ef-ca7a09c3fe0f\") " pod="cert-manager/cert-manager-79c8d999ff-kkwwb" Jun 03 15:55:58.444828 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:55:58.444748 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-kkwwb" Jun 03 15:55:58.596968 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:55:58.596937 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-kkwwb"] Jun 03 15:55:58.604894 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:55:58.604863 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod09fc44cf_aa62_4ba2_85ef_ca7a09c3fe0f.slice/crio-ca51168e3799ad1be5313582920ecce38b4f7ea4405c34278dafca7277c060ad WatchSource:0}: Error finding container ca51168e3799ad1be5313582920ecce38b4f7ea4405c34278dafca7277c060ad: Status 404 returned error can't find the container with id ca51168e3799ad1be5313582920ecce38b4f7ea4405c34278dafca7277c060ad Jun 03 15:55:58.606756 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:55:58.606727 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 15:55:58.630170 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:55:58.630135 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-kkwwb" event={"ID":"09fc44cf-aa62-4ba2-85ef-ca7a09c3fe0f","Type":"ContainerStarted","Data":"ca51168e3799ad1be5313582920ecce38b4f7ea4405c34278dafca7277c060ad"} Jun 03 15:56:01.640215 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:01.640174 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-kkwwb" event={"ID":"09fc44cf-aa62-4ba2-85ef-ca7a09c3fe0f","Type":"ContainerStarted","Data":"e93920286784a2104f590b7aa3c5c757714ed3e741d135829ac79791e6c3ed3c"} Jun 03 15:56:01.658081 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:01.658032 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-kkwwb" podStartSLOduration=0.727716628 podStartE2EDuration="3.658018957s" podCreationTimestamp="2026-06-03 15:55:58 +0000 UTC" firstStartedPulling="2026-06-03 15:55:58.606869194 +0000 UTC m=+418.963864303" lastFinishedPulling="2026-06-03 15:56:01.537171523 +0000 UTC m=+421.894166632" observedRunningTime="2026-06-03 15:56:01.656678266 +0000 UTC m=+422.013673398" watchObservedRunningTime="2026-06-03 15:56:01.658018957 +0000 UTC m=+422.015014089" Jun 03 15:56:18.234751 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:18.234674 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58656688f4-lcvth"] Jun 03 15:56:18.237770 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:18.237754 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-lcvth" Jun 03 15:56:18.243163 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:18.243141 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gqrbj\"" Jun 03 15:56:18.243465 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:18.243446 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 03 15:56:18.246786 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:18.246765 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 03 15:56:18.247680 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:18.247666 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 03 15:56:18.265572 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:18.265530 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58656688f4-lcvth"] Jun 03 15:56:18.270325 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:18.270302 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 03 15:56:18.313227 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:18.313189 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58a670e0-5401-479d-99f5-5e55a8f4f280-tmp\") pod \"opendatahub-operator-controller-manager-58656688f4-lcvth\" (UID: \"58a670e0-5401-479d-99f5-5e55a8f4f280\") " pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-lcvth" Jun 03 15:56:18.313379 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:18.313312 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/58a670e0-5401-479d-99f5-5e55a8f4f280-manifests\") pod \"opendatahub-operator-controller-manager-58656688f4-lcvth\" (UID: \"58a670e0-5401-479d-99f5-5e55a8f4f280\") " pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-lcvth" Jun 03 15:56:18.313379 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:18.313347 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8skx7\" (UniqueName: \"kubernetes.io/projected/58a670e0-5401-479d-99f5-5e55a8f4f280-kube-api-access-8skx7\") pod \"opendatahub-operator-controller-manager-58656688f4-lcvth\" (UID: \"58a670e0-5401-479d-99f5-5e55a8f4f280\") " pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-lcvth" Jun 03 15:56:18.313379 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:18.313371 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/58a670e0-5401-479d-99f5-5e55a8f4f280-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58656688f4-lcvth\" (UID: \"58a670e0-5401-479d-99f5-5e55a8f4f280\") " pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-lcvth" Jun 03 15:56:18.313509 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:18.313390 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/58a670e0-5401-479d-99f5-5e55a8f4f280-webhook-cert\") pod \"opendatahub-operator-controller-manager-58656688f4-lcvth\" (UID: \"58a670e0-5401-479d-99f5-5e55a8f4f280\") " pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-lcvth" Jun 03 15:56:18.414465 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:18.414415 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/58a670e0-5401-479d-99f5-5e55a8f4f280-manifests\") pod \"opendatahub-operator-controller-manager-58656688f4-lcvth\" (UID: \"58a670e0-5401-479d-99f5-5e55a8f4f280\") " pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-lcvth" Jun 03 15:56:18.414465 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:18.414458 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8skx7\" (UniqueName: \"kubernetes.io/projected/58a670e0-5401-479d-99f5-5e55a8f4f280-kube-api-access-8skx7\") pod \"opendatahub-operator-controller-manager-58656688f4-lcvth\" (UID: \"58a670e0-5401-479d-99f5-5e55a8f4f280\") " pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-lcvth" Jun 03 15:56:18.414741 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:18.414549 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/58a670e0-5401-479d-99f5-5e55a8f4f280-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58656688f4-lcvth\" (UID: \"58a670e0-5401-479d-99f5-5e55a8f4f280\") " pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-lcvth" Jun 03 15:56:18.414741 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:18.414566 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/58a670e0-5401-479d-99f5-5e55a8f4f280-webhook-cert\") pod \"opendatahub-operator-controller-manager-58656688f4-lcvth\" (UID: \"58a670e0-5401-479d-99f5-5e55a8f4f280\") " pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-lcvth" Jun 03 15:56:18.414741 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:18.414613 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58a670e0-5401-479d-99f5-5e55a8f4f280-tmp\") pod \"opendatahub-operator-controller-manager-58656688f4-lcvth\" (UID: \"58a670e0-5401-479d-99f5-5e55a8f4f280\") " pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-lcvth" Jun 03 15:56:18.414950 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:18.414927 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/58a670e0-5401-479d-99f5-5e55a8f4f280-manifests\") pod \"opendatahub-operator-controller-manager-58656688f4-lcvth\" (UID: \"58a670e0-5401-479d-99f5-5e55a8f4f280\") " pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-lcvth" Jun 03 15:56:18.416854 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:18.416830 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58a670e0-5401-479d-99f5-5e55a8f4f280-tmp\") pod \"opendatahub-operator-controller-manager-58656688f4-lcvth\" (UID: \"58a670e0-5401-479d-99f5-5e55a8f4f280\") " pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-lcvth" Jun 03 15:56:18.417023 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:18.417004 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/58a670e0-5401-479d-99f5-5e55a8f4f280-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58656688f4-lcvth\" (UID: \"58a670e0-5401-479d-99f5-5e55a8f4f280\") " pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-lcvth" Jun 03 15:56:18.417078 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:18.417061 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/58a670e0-5401-479d-99f5-5e55a8f4f280-webhook-cert\") pod \"opendatahub-operator-controller-manager-58656688f4-lcvth\" (UID: \"58a670e0-5401-479d-99f5-5e55a8f4f280\") " pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-lcvth" Jun 03 15:56:18.429170 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:18.429139 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8skx7\" (UniqueName: \"kubernetes.io/projected/58a670e0-5401-479d-99f5-5e55a8f4f280-kube-api-access-8skx7\") pod \"opendatahub-operator-controller-manager-58656688f4-lcvth\" (UID: \"58a670e0-5401-479d-99f5-5e55a8f4f280\") " pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-lcvth" Jun 03 15:56:18.547895 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:18.547805 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-lcvth" Jun 03 15:56:18.702909 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:18.702881 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58656688f4-lcvth"] Jun 03 15:56:18.705446 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:56:18.705421 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58a670e0_5401_479d_99f5_5e55a8f4f280.slice/crio-deac107abb0ae504171e2c9d5744cb8bd9595dd50657faeeff0e09696a372147 WatchSource:0}: Error finding container deac107abb0ae504171e2c9d5744cb8bd9595dd50657faeeff0e09696a372147: Status 404 returned error can't find the container with id deac107abb0ae504171e2c9d5744cb8bd9595dd50657faeeff0e09696a372147 Jun 03 15:56:19.693344 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:19.693308 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-lcvth" event={"ID":"58a670e0-5401-479d-99f5-5e55a8f4f280","Type":"ContainerStarted","Data":"deac107abb0ae504171e2c9d5744cb8bd9595dd50657faeeff0e09696a372147"} Jun 03 15:56:21.699520 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:21.699488 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-lcvth" event={"ID":"58a670e0-5401-479d-99f5-5e55a8f4f280","Type":"ContainerStarted","Data":"319da67839f0d5f72a3fb6b54e4995eab093596abed6efdfe49c33a094cfbd3e"} Jun 03 15:56:22.703514 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:22.703455 2573 generic.go:358] "Generic (PLEG): container finished" podID="58a670e0-5401-479d-99f5-5e55a8f4f280" containerID="319da67839f0d5f72a3fb6b54e4995eab093596abed6efdfe49c33a094cfbd3e" exitCode=0 Jun 03 15:56:22.703876 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:22.703536 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-lcvth" event={"ID":"58a670e0-5401-479d-99f5-5e55a8f4f280","Type":"ContainerDied","Data":"319da67839f0d5f72a3fb6b54e4995eab093596abed6efdfe49c33a094cfbd3e"} Jun 03 15:56:23.708147 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:23.708103 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-lcvth" event={"ID":"58a670e0-5401-479d-99f5-5e55a8f4f280","Type":"ContainerStarted","Data":"28800fa64e0c2bf49db03f5a8d4af1a30dcadd646fc3a41a66b989941d195c75"} Jun 03 15:56:23.708665 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:23.708239 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-lcvth" Jun 03 15:56:23.750172 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:23.750118 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-lcvth" podStartSLOduration=1.359933686 podStartE2EDuration="5.750094527s" podCreationTimestamp="2026-06-03 15:56:18 +0000 UTC" firstStartedPulling="2026-06-03 15:56:18.707048164 +0000 UTC m=+439.064043273" lastFinishedPulling="2026-06-03 15:56:23.097208992 +0000 UTC m=+443.454204114" observedRunningTime="2026-06-03 15:56:23.748801692 +0000 UTC m=+444.105796824" watchObservedRunningTime="2026-06-03 15:56:23.750094527 +0000 UTC m=+444.107089658" Jun 03 15:56:34.713870 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:34.713841 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-lcvth" Jun 03 15:56:36.775407 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:36.775371 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-98789b7d5-s47jb"] Jun 03 15:56:36.783370 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:36.783349 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-98789b7d5-s47jb" Jun 03 15:56:36.790448 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:36.790402 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 03 15:56:36.790448 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:36.790425 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 03 15:56:36.790663 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:36.790533 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 03 15:56:36.790663 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:36.790562 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 03 15:56:36.790663 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:36.790600 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 03 15:56:36.790810 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:36.790792 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-9g8cm\"" Jun 03 15:56:36.795975 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:36.795952 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-98789b7d5-s47jb"] Jun 03 15:56:36.870411 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:36.870374 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbvjl\" (UniqueName: \"kubernetes.io/projected/5339402c-6750-470c-b1c3-f2c49e7fb95b-kube-api-access-kbvjl\") pod \"lws-controller-manager-98789b7d5-s47jb\" (UID: \"5339402c-6750-470c-b1c3-f2c49e7fb95b\") " pod="openshift-lws-operator/lws-controller-manager-98789b7d5-s47jb" Jun 03 15:56:36.870411 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:36.870413 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5339402c-6750-470c-b1c3-f2c49e7fb95b-cert\") pod \"lws-controller-manager-98789b7d5-s47jb\" (UID: \"5339402c-6750-470c-b1c3-f2c49e7fb95b\") " pod="openshift-lws-operator/lws-controller-manager-98789b7d5-s47jb" Jun 03 15:56:36.870655 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:36.870439 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5339402c-6750-470c-b1c3-f2c49e7fb95b-metrics-cert\") pod \"lws-controller-manager-98789b7d5-s47jb\" (UID: \"5339402c-6750-470c-b1c3-f2c49e7fb95b\") " pod="openshift-lws-operator/lws-controller-manager-98789b7d5-s47jb" Jun 03 15:56:36.870655 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:36.870576 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5339402c-6750-470c-b1c3-f2c49e7fb95b-manager-config\") pod \"lws-controller-manager-98789b7d5-s47jb\" (UID: \"5339402c-6750-470c-b1c3-f2c49e7fb95b\") " pod="openshift-lws-operator/lws-controller-manager-98789b7d5-s47jb" Jun 03 15:56:36.971414 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:36.971371 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5339402c-6750-470c-b1c3-f2c49e7fb95b-manager-config\") pod \"lws-controller-manager-98789b7d5-s47jb\" (UID: \"5339402c-6750-470c-b1c3-f2c49e7fb95b\") " pod="openshift-lws-operator/lws-controller-manager-98789b7d5-s47jb" Jun 03 15:56:36.971629 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:36.971445 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kbvjl\" (UniqueName: \"kubernetes.io/projected/5339402c-6750-470c-b1c3-f2c49e7fb95b-kube-api-access-kbvjl\") pod \"lws-controller-manager-98789b7d5-s47jb\" (UID: \"5339402c-6750-470c-b1c3-f2c49e7fb95b\") " pod="openshift-lws-operator/lws-controller-manager-98789b7d5-s47jb" Jun 03 15:56:36.971629 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:36.971500 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5339402c-6750-470c-b1c3-f2c49e7fb95b-cert\") pod \"lws-controller-manager-98789b7d5-s47jb\" (UID: \"5339402c-6750-470c-b1c3-f2c49e7fb95b\") " pod="openshift-lws-operator/lws-controller-manager-98789b7d5-s47jb" Jun 03 15:56:36.971629 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:36.971541 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5339402c-6750-470c-b1c3-f2c49e7fb95b-metrics-cert\") pod \"lws-controller-manager-98789b7d5-s47jb\" (UID: \"5339402c-6750-470c-b1c3-f2c49e7fb95b\") " pod="openshift-lws-operator/lws-controller-manager-98789b7d5-s47jb" Jun 03 15:56:36.972093 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:36.972068 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5339402c-6750-470c-b1c3-f2c49e7fb95b-manager-config\") pod \"lws-controller-manager-98789b7d5-s47jb\" (UID: \"5339402c-6750-470c-b1c3-f2c49e7fb95b\") " pod="openshift-lws-operator/lws-controller-manager-98789b7d5-s47jb" Jun 03 15:56:36.973957 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:36.973938 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5339402c-6750-470c-b1c3-f2c49e7fb95b-metrics-cert\") pod \"lws-controller-manager-98789b7d5-s47jb\" (UID: \"5339402c-6750-470c-b1c3-f2c49e7fb95b\") " pod="openshift-lws-operator/lws-controller-manager-98789b7d5-s47jb" Jun 03 15:56:36.974065 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:36.974047 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5339402c-6750-470c-b1c3-f2c49e7fb95b-cert\") pod \"lws-controller-manager-98789b7d5-s47jb\" (UID: \"5339402c-6750-470c-b1c3-f2c49e7fb95b\") " pod="openshift-lws-operator/lws-controller-manager-98789b7d5-s47jb" Jun 03 15:56:36.986442 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:36.986411 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbvjl\" (UniqueName: \"kubernetes.io/projected/5339402c-6750-470c-b1c3-f2c49e7fb95b-kube-api-access-kbvjl\") pod \"lws-controller-manager-98789b7d5-s47jb\" (UID: \"5339402c-6750-470c-b1c3-f2c49e7fb95b\") " pod="openshift-lws-operator/lws-controller-manager-98789b7d5-s47jb" Jun 03 15:56:37.092438 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:37.092390 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-98789b7d5-s47jb" Jun 03 15:56:37.228828 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:37.228795 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-98789b7d5-s47jb"] Jun 03 15:56:37.231762 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:56:37.231735 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5339402c_6750_470c_b1c3_f2c49e7fb95b.slice/crio-2f9e0b47ec0853a4577f5bb2e203364fd6ed6f236f45926b480fb639443c9046 WatchSource:0}: Error finding container 2f9e0b47ec0853a4577f5bb2e203364fd6ed6f236f45926b480fb639443c9046: Status 404 returned error can't find the container with id 2f9e0b47ec0853a4577f5bb2e203364fd6ed6f236f45926b480fb639443c9046 Jun 03 15:56:37.748571 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:37.748527 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-98789b7d5-s47jb" event={"ID":"5339402c-6750-470c-b1c3-f2c49e7fb95b","Type":"ContainerStarted","Data":"2f9e0b47ec0853a4577f5bb2e203364fd6ed6f236f45926b480fb639443c9046"} Jun 03 15:56:40.760483 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:40.760425 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-98789b7d5-s47jb" event={"ID":"5339402c-6750-470c-b1c3-f2c49e7fb95b","Type":"ContainerStarted","Data":"d693b5b1501d9fc3837de90c712e8546ea794d6dbba96c4665f166788228331e"} Jun 03 15:56:40.760884 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:40.760573 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-98789b7d5-s47jb" Jun 03 15:56:40.788172 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:40.788114 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-98789b7d5-s47jb" podStartSLOduration=2.079577078 podStartE2EDuration="4.788099293s" podCreationTimestamp="2026-06-03 15:56:36 +0000 UTC" firstStartedPulling="2026-06-03 15:56:37.233423166 +0000 UTC m=+457.590418276" lastFinishedPulling="2026-06-03 15:56:39.941945378 +0000 UTC m=+460.298940491" observedRunningTime="2026-06-03 15:56:40.785883751 +0000 UTC m=+461.142878877" watchObservedRunningTime="2026-06-03 15:56:40.788099293 +0000 UTC m=+461.145094426" Jun 03 15:56:51.766420 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:51.766388 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-98789b7d5-s47jb" Jun 03 15:56:56.062489 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:56.062447 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-zjksz"] Jun 03 15:56:56.149412 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:56.149384 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-zjksz" Jun 03 15:56:56.173054 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:56.173025 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-zjksz"] Jun 03 15:56:56.177378 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:56.177353 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 03 15:56:56.178099 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:56.178080 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 03 15:56:56.178183 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:56.178127 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-xwr6b\"" Jun 03 15:56:56.239225 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:56.239192 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbgnd\" (UniqueName: \"kubernetes.io/projected/bc2bd837-b2e0-481c-a19b-db56cabeef92-kube-api-access-dbgnd\") pod \"servicemesh-operator3-55f49c5f94-zjksz\" (UID: \"bc2bd837-b2e0-481c-a19b-db56cabeef92\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-zjksz" Jun 03 15:56:56.239402 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:56.239261 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/bc2bd837-b2e0-481c-a19b-db56cabeef92-operator-config\") pod \"servicemesh-operator3-55f49c5f94-zjksz\" (UID: \"bc2bd837-b2e0-481c-a19b-db56cabeef92\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-zjksz" Jun 03 15:56:56.339990 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:56.339953 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/bc2bd837-b2e0-481c-a19b-db56cabeef92-operator-config\") pod \"servicemesh-operator3-55f49c5f94-zjksz\" (UID: \"bc2bd837-b2e0-481c-a19b-db56cabeef92\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-zjksz" Jun 03 15:56:56.340145 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:56.340030 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dbgnd\" (UniqueName: \"kubernetes.io/projected/bc2bd837-b2e0-481c-a19b-db56cabeef92-kube-api-access-dbgnd\") pod \"servicemesh-operator3-55f49c5f94-zjksz\" (UID: \"bc2bd837-b2e0-481c-a19b-db56cabeef92\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-zjksz" Jun 03 15:56:56.342555 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:56.342528 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/bc2bd837-b2e0-481c-a19b-db56cabeef92-operator-config\") pod \"servicemesh-operator3-55f49c5f94-zjksz\" (UID: \"bc2bd837-b2e0-481c-a19b-db56cabeef92\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-zjksz" Jun 03 15:56:56.357716 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:56.357686 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbgnd\" (UniqueName: \"kubernetes.io/projected/bc2bd837-b2e0-481c-a19b-db56cabeef92-kube-api-access-dbgnd\") pod \"servicemesh-operator3-55f49c5f94-zjksz\" (UID: \"bc2bd837-b2e0-481c-a19b-db56cabeef92\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-zjksz" Jun 03 15:56:56.459130 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:56.459098 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-zjksz" Jun 03 15:56:56.661622 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:56.661528 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-zjksz"] Jun 03 15:56:56.665698 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:56:56.665670 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc2bd837_b2e0_481c_a19b_db56cabeef92.slice/crio-ef5c5aebe2f5bbda93da12bd8bee719b24a8eed8a3738d2a59c31492f163cb89 WatchSource:0}: Error finding container ef5c5aebe2f5bbda93da12bd8bee719b24a8eed8a3738d2a59c31492f163cb89: Status 404 returned error can't find the container with id ef5c5aebe2f5bbda93da12bd8bee719b24a8eed8a3738d2a59c31492f163cb89 Jun 03 15:56:56.814224 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:56.814187 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-zjksz" event={"ID":"bc2bd837-b2e0-481c-a19b-db56cabeef92","Type":"ContainerStarted","Data":"ef5c5aebe2f5bbda93da12bd8bee719b24a8eed8a3738d2a59c31492f163cb89"} Jun 03 15:56:59.838181 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:59.838135 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-zjksz" event={"ID":"bc2bd837-b2e0-481c-a19b-db56cabeef92","Type":"ContainerStarted","Data":"af2ff6e0e2f8f26975bcddb634c2a5720292ef13d46ad5c02a3e7a060a51430f"} Jun 03 15:56:59.838570 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:59.838263 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-zjksz" Jun 03 15:56:59.877272 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:56:59.877209 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-zjksz" podStartSLOduration=1.202281518 podStartE2EDuration="3.877192412s" podCreationTimestamp="2026-06-03 15:56:56 +0000 UTC" firstStartedPulling="2026-06-03 15:56:56.668209961 +0000 UTC m=+477.025205074" lastFinishedPulling="2026-06-03 15:56:59.343120853 +0000 UTC m=+479.700115968" observedRunningTime="2026-06-03 15:56:59.875360097 +0000 UTC m=+480.232355229" watchObservedRunningTime="2026-06-03 15:56:59.877192412 +0000 UTC m=+480.234187547" Jun 03 15:57:03.859513 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:03.859481 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-84m6g"] Jun 03 15:57:03.864099 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:03.864076 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-84m6g" Jun 03 15:57:03.866426 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:03.866396 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 03 15:57:03.866615 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:03.866595 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-88vqd\"" Jun 03 15:57:03.866698 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:03.866677 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 03 15:57:03.866877 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:03.866856 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 15:57:03.866877 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:03.866872 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 03 15:57:03.867166 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:03.867148 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 03 15:57:03.867258 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:03.867167 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 15:57:03.876392 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:03.876366 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-84m6g"] Jun 03 15:57:03.911060 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:03.911033 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1ad392d6-377c-4540-8019-57340e89db1d-cacerts\") pod \"istiod-openshift-gateway-798958bb55-84m6g\" (UID: \"1ad392d6-377c-4540-8019-57340e89db1d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-84m6g" Jun 03 15:57:03.911228 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:03.911076 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwlqh\" (UniqueName: \"kubernetes.io/projected/1ad392d6-377c-4540-8019-57340e89db1d-kube-api-access-zwlqh\") pod \"istiod-openshift-gateway-798958bb55-84m6g\" (UID: \"1ad392d6-377c-4540-8019-57340e89db1d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-84m6g" Jun 03 15:57:03.911228 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:03.911096 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ad392d6-377c-4540-8019-57340e89db1d-istio-token\") pod \"istiod-openshift-gateway-798958bb55-84m6g\" (UID: \"1ad392d6-377c-4540-8019-57340e89db1d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-84m6g" Jun 03 15:57:03.911228 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:03.911113 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1ad392d6-377c-4540-8019-57340e89db1d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-84m6g\" (UID: \"1ad392d6-377c-4540-8019-57340e89db1d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-84m6g" Jun 03 15:57:03.911228 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:03.911200 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1ad392d6-377c-4540-8019-57340e89db1d-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-84m6g\" (UID: \"1ad392d6-377c-4540-8019-57340e89db1d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-84m6g" Jun 03 15:57:03.911402 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:03.911241 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ad392d6-377c-4540-8019-57340e89db1d-local-certs\") pod \"istiod-openshift-gateway-798958bb55-84m6g\" (UID: \"1ad392d6-377c-4540-8019-57340e89db1d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-84m6g" Jun 03 15:57:03.911402 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:03.911268 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1ad392d6-377c-4540-8019-57340e89db1d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-84m6g\" (UID: \"1ad392d6-377c-4540-8019-57340e89db1d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-84m6g" Jun 03 15:57:04.012613 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:04.012572 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1ad392d6-377c-4540-8019-57340e89db1d-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-84m6g\" (UID: \"1ad392d6-377c-4540-8019-57340e89db1d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-84m6g" Jun 03 15:57:04.012780 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:04.012624 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ad392d6-377c-4540-8019-57340e89db1d-local-certs\") pod \"istiod-openshift-gateway-798958bb55-84m6g\" (UID: \"1ad392d6-377c-4540-8019-57340e89db1d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-84m6g" Jun 03 15:57:04.012780 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:04.012745 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1ad392d6-377c-4540-8019-57340e89db1d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-84m6g\" (UID: \"1ad392d6-377c-4540-8019-57340e89db1d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-84m6g" Jun 03 15:57:04.012857 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:04.012835 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1ad392d6-377c-4540-8019-57340e89db1d-cacerts\") pod \"istiod-openshift-gateway-798958bb55-84m6g\" (UID: \"1ad392d6-377c-4540-8019-57340e89db1d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-84m6g" Jun 03 15:57:04.012904 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:04.012888 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zwlqh\" (UniqueName: \"kubernetes.io/projected/1ad392d6-377c-4540-8019-57340e89db1d-kube-api-access-zwlqh\") pod \"istiod-openshift-gateway-798958bb55-84m6g\" (UID: \"1ad392d6-377c-4540-8019-57340e89db1d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-84m6g" Jun 03 15:57:04.012955 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:04.012920 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ad392d6-377c-4540-8019-57340e89db1d-istio-token\") pod \"istiod-openshift-gateway-798958bb55-84m6g\" (UID: \"1ad392d6-377c-4540-8019-57340e89db1d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-84m6g" Jun 03 15:57:04.012955 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:04.012947 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1ad392d6-377c-4540-8019-57340e89db1d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-84m6g\" (UID: \"1ad392d6-377c-4540-8019-57340e89db1d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-84m6g" Jun 03 15:57:04.013589 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:04.013561 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1ad392d6-377c-4540-8019-57340e89db1d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-84m6g\" (UID: \"1ad392d6-377c-4540-8019-57340e89db1d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-84m6g" Jun 03 15:57:04.015576 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:04.015556 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ad392d6-377c-4540-8019-57340e89db1d-local-certs\") pod \"istiod-openshift-gateway-798958bb55-84m6g\" (UID: \"1ad392d6-377c-4540-8019-57340e89db1d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-84m6g" Jun 03 15:57:04.015673 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:04.015619 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1ad392d6-377c-4540-8019-57340e89db1d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-84m6g\" (UID: \"1ad392d6-377c-4540-8019-57340e89db1d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-84m6g" Jun 03 15:57:04.015960 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:04.015940 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1ad392d6-377c-4540-8019-57340e89db1d-cacerts\") pod \"istiod-openshift-gateway-798958bb55-84m6g\" (UID: \"1ad392d6-377c-4540-8019-57340e89db1d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-84m6g" Jun 03 15:57:04.016263 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:04.016243 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1ad392d6-377c-4540-8019-57340e89db1d-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-84m6g\" (UID: \"1ad392d6-377c-4540-8019-57340e89db1d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-84m6g" Jun 03 15:57:04.022109 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:04.022087 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ad392d6-377c-4540-8019-57340e89db1d-istio-token\") pod \"istiod-openshift-gateway-798958bb55-84m6g\" (UID: \"1ad392d6-377c-4540-8019-57340e89db1d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-84m6g" Jun 03 15:57:04.022193 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:04.022165 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwlqh\" (UniqueName: \"kubernetes.io/projected/1ad392d6-377c-4540-8019-57340e89db1d-kube-api-access-zwlqh\") pod \"istiod-openshift-gateway-798958bb55-84m6g\" (UID: \"1ad392d6-377c-4540-8019-57340e89db1d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-84m6g" Jun 03 15:57:04.174094 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:04.174002 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-84m6g" Jun 03 15:57:04.313746 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:04.313711 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-84m6g"] Jun 03 15:57:04.316913 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:57:04.316868 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ad392d6_377c_4540_8019_57340e89db1d.slice/crio-9503d411b5e7b12733e914b28bac7e20e77a2444f0b7ffbfc73525a2eda561f8 WatchSource:0}: Error finding container 9503d411b5e7b12733e914b28bac7e20e77a2444f0b7ffbfc73525a2eda561f8: Status 404 returned error can't find the container with id 9503d411b5e7b12733e914b28bac7e20e77a2444f0b7ffbfc73525a2eda561f8 Jun 03 15:57:04.859819 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:04.859777 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-84m6g" event={"ID":"1ad392d6-377c-4540-8019-57340e89db1d","Type":"ContainerStarted","Data":"9503d411b5e7b12733e914b28bac7e20e77a2444f0b7ffbfc73525a2eda561f8"} Jun 03 15:57:06.836493 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:06.836431 2573 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 03 15:57:06.836758 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:06.836538 2573 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 03 15:57:07.876273 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:07.876237 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-84m6g" event={"ID":"1ad392d6-377c-4540-8019-57340e89db1d","Type":"ContainerStarted","Data":"b4f264850f521911d166e82c8b5f1a5a15206d34c6805ba66ae3dc550e5f95f9"} Jun 03 15:57:07.876682 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:07.876402 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-84m6g" Jun 03 15:57:07.878249 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:07.878224 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-84m6g" Jun 03 15:57:07.956602 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:07.956542 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-84m6g" podStartSLOduration=2.439185438 podStartE2EDuration="4.956526282s" podCreationTimestamp="2026-06-03 15:57:03 +0000 UTC" firstStartedPulling="2026-06-03 15:57:04.318854876 +0000 UTC m=+484.675849986" lastFinishedPulling="2026-06-03 15:57:06.836195716 +0000 UTC m=+487.193190830" observedRunningTime="2026-06-03 15:57:07.955207984 +0000 UTC m=+488.312203156" watchObservedRunningTime="2026-06-03 15:57:07.956526282 +0000 UTC m=+488.313521417" Jun 03 15:57:08.428327 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:08.428294 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-78c4457769-qtpvq"] Jun 03 15:57:08.432560 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:08.432537 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-78c4457769-qtpvq" Jun 03 15:57:08.434981 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:08.434949 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 03 15:57:08.435145 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:08.435124 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-t6cr4\"" Jun 03 15:57:08.440373 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:08.440349 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-78c4457769-qtpvq"] Jun 03 15:57:08.555829 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:08.555789 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/469da770-1965-41c6-9a14-babdff64b540-redirect-config\") pod \"dashboard-redirect-78c4457769-qtpvq\" (UID: \"469da770-1965-41c6-9a14-babdff64b540\") " pod="opendatahub/dashboard-redirect-78c4457769-qtpvq" Jun 03 15:57:08.556012 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:08.555842 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcxwq\" (UniqueName: \"kubernetes.io/projected/469da770-1965-41c6-9a14-babdff64b540-kube-api-access-fcxwq\") pod \"dashboard-redirect-78c4457769-qtpvq\" (UID: \"469da770-1965-41c6-9a14-babdff64b540\") " pod="opendatahub/dashboard-redirect-78c4457769-qtpvq" Jun 03 15:57:08.656907 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:08.656864 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fcxwq\" (UniqueName: \"kubernetes.io/projected/469da770-1965-41c6-9a14-babdff64b540-kube-api-access-fcxwq\") pod \"dashboard-redirect-78c4457769-qtpvq\" (UID: \"469da770-1965-41c6-9a14-babdff64b540\") " pod="opendatahub/dashboard-redirect-78c4457769-qtpvq" Jun 03 15:57:08.657079 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:08.656985 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/469da770-1965-41c6-9a14-babdff64b540-redirect-config\") pod \"dashboard-redirect-78c4457769-qtpvq\" (UID: \"469da770-1965-41c6-9a14-babdff64b540\") " pod="opendatahub/dashboard-redirect-78c4457769-qtpvq" Jun 03 15:57:08.657721 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:08.657700 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/469da770-1965-41c6-9a14-babdff64b540-redirect-config\") pod \"dashboard-redirect-78c4457769-qtpvq\" (UID: \"469da770-1965-41c6-9a14-babdff64b540\") " pod="opendatahub/dashboard-redirect-78c4457769-qtpvq" Jun 03 15:57:08.666767 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:08.666733 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcxwq\" (UniqueName: \"kubernetes.io/projected/469da770-1965-41c6-9a14-babdff64b540-kube-api-access-fcxwq\") pod \"dashboard-redirect-78c4457769-qtpvq\" (UID: \"469da770-1965-41c6-9a14-babdff64b540\") " pod="opendatahub/dashboard-redirect-78c4457769-qtpvq" Jun 03 15:57:08.745249 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:08.745145 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-78c4457769-qtpvq" Jun 03 15:57:08.918751 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:08.918705 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-78c4457769-qtpvq"] Jun 03 15:57:08.919148 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:57:08.918937 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod469da770_1965_41c6_9a14_babdff64b540.slice/crio-a24c25f1441e89f5f237860e4f06ff457abb97f535bc9a98beff2252eac779e0 WatchSource:0}: Error finding container a24c25f1441e89f5f237860e4f06ff457abb97f535bc9a98beff2252eac779e0: Status 404 returned error can't find the container with id a24c25f1441e89f5f237860e4f06ff457abb97f535bc9a98beff2252eac779e0 Jun 03 15:57:09.888014 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:09.887838 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-78c4457769-qtpvq" event={"ID":"469da770-1965-41c6-9a14-babdff64b540","Type":"ContainerStarted","Data":"a24c25f1441e89f5f237860e4f06ff457abb97f535bc9a98beff2252eac779e0"} Jun 03 15:57:10.849651 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:10.849614 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-zjksz" Jun 03 15:57:13.902954 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:13.902855 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-78c4457769-qtpvq" event={"ID":"469da770-1965-41c6-9a14-babdff64b540","Type":"ContainerStarted","Data":"03bf02446d4b219ade5e37c3050b57d291d6645847c1cd2b1804cc028d54bb35"} Jun 03 15:57:13.924321 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:57:13.924265 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-78c4457769-qtpvq" podStartSLOduration=1.25497557 podStartE2EDuration="5.924251418s" podCreationTimestamp="2026-06-03 15:57:08 +0000 UTC" firstStartedPulling="2026-06-03 15:57:08.920521397 +0000 UTC m=+489.277516512" lastFinishedPulling="2026-06-03 15:57:13.589797243 +0000 UTC m=+493.946792360" observedRunningTime="2026-06-03 15:57:13.923071631 +0000 UTC m=+494.280066765" watchObservedRunningTime="2026-06-03 15:57:13.924251418 +0000 UTC m=+494.281246547" Jun 03 15:58:36.721843 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:58:36.721792 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b9mv9"] Jun 03 15:58:36.724962 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:58:36.724942 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b9mv9" Jun 03 15:58:36.728169 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:58:36.728137 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 15:58:36.728362 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:58:36.728341 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-cf8ch\"" Jun 03 15:58:36.728450 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:58:36.728379 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 15:58:36.738306 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:58:36.738280 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b9mv9"] Jun 03 15:58:36.811440 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:58:36.811402 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8jkz\" (UniqueName: \"kubernetes.io/projected/e99c5a8f-06de-416d-8f7f-533f5686a0b1-kube-api-access-t8jkz\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-b9mv9\" (UID: \"e99c5a8f-06de-416d-8f7f-533f5686a0b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b9mv9" Jun 03 15:58:36.811440 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:58:36.811443 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e99c5a8f-06de-416d-8f7f-533f5686a0b1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-b9mv9\" (UID: \"e99c5a8f-06de-416d-8f7f-533f5686a0b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b9mv9" Jun 03 15:58:36.912806 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:58:36.912764 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t8jkz\" (UniqueName: \"kubernetes.io/projected/e99c5a8f-06de-416d-8f7f-533f5686a0b1-kube-api-access-t8jkz\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-b9mv9\" (UID: \"e99c5a8f-06de-416d-8f7f-533f5686a0b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b9mv9" Jun 03 15:58:36.912977 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:58:36.912813 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e99c5a8f-06de-416d-8f7f-533f5686a0b1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-b9mv9\" (UID: \"e99c5a8f-06de-416d-8f7f-533f5686a0b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b9mv9" Jun 03 15:58:36.913216 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:58:36.913197 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e99c5a8f-06de-416d-8f7f-533f5686a0b1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-b9mv9\" (UID: \"e99c5a8f-06de-416d-8f7f-533f5686a0b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b9mv9" Jun 03 15:58:36.922974 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:58:36.922944 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8jkz\" (UniqueName: \"kubernetes.io/projected/e99c5a8f-06de-416d-8f7f-533f5686a0b1-kube-api-access-t8jkz\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-b9mv9\" (UID: \"e99c5a8f-06de-416d-8f7f-533f5686a0b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b9mv9" Jun 03 15:58:37.037904 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:58:37.037819 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b9mv9" Jun 03 15:58:37.178810 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:58:37.178413 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b9mv9"] Jun 03 15:58:37.183546 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:58:37.183514 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode99c5a8f_06de_416d_8f7f_533f5686a0b1.slice/crio-829ee56cab08e62e1223ebf8cc5dce9e237ad949223a7cfa0d346ff6deec0bb5 WatchSource:0}: Error finding container 829ee56cab08e62e1223ebf8cc5dce9e237ad949223a7cfa0d346ff6deec0bb5: Status 404 returned error can't find the container with id 829ee56cab08e62e1223ebf8cc5dce9e237ad949223a7cfa0d346ff6deec0bb5 Jun 03 15:58:38.174229 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:58:38.174191 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b9mv9" event={"ID":"e99c5a8f-06de-416d-8f7f-533f5686a0b1","Type":"ContainerStarted","Data":"829ee56cab08e62e1223ebf8cc5dce9e237ad949223a7cfa0d346ff6deec0bb5"} Jun 03 15:58:41.186888 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:58:41.186848 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b9mv9" event={"ID":"e99c5a8f-06de-416d-8f7f-533f5686a0b1","Type":"ContainerStarted","Data":"4553fc534f6da15ed496d2fbb1ea742a74d8532a2a85e5f5c0acbbfaeb4ef605"} Jun 03 15:58:41.187345 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:58:41.186964 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b9mv9" Jun 03 15:58:41.210321 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:58:41.210271 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b9mv9" podStartSLOduration=1.648789253 podStartE2EDuration="5.210257517s" podCreationTimestamp="2026-06-03 15:58:36 +0000 UTC" firstStartedPulling="2026-06-03 15:58:37.186029734 +0000 UTC m=+577.543024844" lastFinishedPulling="2026-06-03 15:58:40.747497989 +0000 UTC m=+581.104493108" observedRunningTime="2026-06-03 15:58:41.207462318 +0000 UTC m=+581.564457450" watchObservedRunningTime="2026-06-03 15:58:41.210257517 +0000 UTC m=+581.567252649" Jun 03 15:58:52.109298 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:58:52.109246 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b9mv9"] Jun 03 15:58:52.109829 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:58:52.109582 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b9mv9" podUID="e99c5a8f-06de-416d-8f7f-533f5686a0b1" containerName="manager" containerID="cri-o://4553fc534f6da15ed496d2fbb1ea742a74d8532a2a85e5f5c0acbbfaeb4ef605" gracePeriod=10 Jun 03 15:58:52.111302 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:58:52.111276 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b9mv9" Jun 03 15:58:52.223568 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:58:52.223539 2573 generic.go:358] "Generic (PLEG): container finished" podID="e99c5a8f-06de-416d-8f7f-533f5686a0b1" containerID="4553fc534f6da15ed496d2fbb1ea742a74d8532a2a85e5f5c0acbbfaeb4ef605" exitCode=0 Jun 03 15:58:52.223666 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:58:52.223620 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b9mv9" event={"ID":"e99c5a8f-06de-416d-8f7f-533f5686a0b1","Type":"ContainerDied","Data":"4553fc534f6da15ed496d2fbb1ea742a74d8532a2a85e5f5c0acbbfaeb4ef605"} Jun 03 15:58:52.352121 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:58:52.352099 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b9mv9" Jun 03 15:58:52.453108 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:58:52.453018 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t8jkz\" (UniqueName: \"kubernetes.io/projected/e99c5a8f-06de-416d-8f7f-533f5686a0b1-kube-api-access-t8jkz\") pod \"e99c5a8f-06de-416d-8f7f-533f5686a0b1\" (UID: \"e99c5a8f-06de-416d-8f7f-533f5686a0b1\") " Jun 03 15:58:52.453271 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:58:52.453178 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e99c5a8f-06de-416d-8f7f-533f5686a0b1-extensions-socket-volume\") pod \"e99c5a8f-06de-416d-8f7f-533f5686a0b1\" (UID: \"e99c5a8f-06de-416d-8f7f-533f5686a0b1\") " Jun 03 15:58:52.453747 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:58:52.453715 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e99c5a8f-06de-416d-8f7f-533f5686a0b1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e99c5a8f-06de-416d-8f7f-533f5686a0b1" (UID: "e99c5a8f-06de-416d-8f7f-533f5686a0b1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:58:52.455235 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:58:52.455211 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e99c5a8f-06de-416d-8f7f-533f5686a0b1-kube-api-access-t8jkz" (OuterVolumeSpecName: "kube-api-access-t8jkz") pod "e99c5a8f-06de-416d-8f7f-533f5686a0b1" (UID: "e99c5a8f-06de-416d-8f7f-533f5686a0b1"). InnerVolumeSpecName "kube-api-access-t8jkz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:58:52.554801 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:58:52.554764 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e99c5a8f-06de-416d-8f7f-533f5686a0b1-extensions-socket-volume\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Jun 03 15:58:52.554801 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:58:52.554797 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t8jkz\" (UniqueName: \"kubernetes.io/projected/e99c5a8f-06de-416d-8f7f-533f5686a0b1-kube-api-access-t8jkz\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Jun 03 15:58:53.228066 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:58:53.228039 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b9mv9" Jun 03 15:58:53.228488 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:58:53.228034 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b9mv9" event={"ID":"e99c5a8f-06de-416d-8f7f-533f5686a0b1","Type":"ContainerDied","Data":"829ee56cab08e62e1223ebf8cc5dce9e237ad949223a7cfa0d346ff6deec0bb5"} Jun 03 15:58:53.228488 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:58:53.228160 2573 scope.go:117] "RemoveContainer" containerID="4553fc534f6da15ed496d2fbb1ea742a74d8532a2a85e5f5c0acbbfaeb4ef605" Jun 03 15:58:53.253032 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:58:53.253002 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b9mv9"] Jun 03 15:58:53.258982 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:58:53.258960 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b9mv9"] Jun 03 15:58:54.234865 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:58:54.234818 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e99c5a8f-06de-416d-8f7f-533f5686a0b1" path="/var/lib/kubelet/pods/e99c5a8f-06de-416d-8f7f-533f5686a0b1/volumes" Jun 03 15:59:20.656594 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:59:20.656497 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-f9255"] Jun 03 15:59:20.656993 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:59:20.656834 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e99c5a8f-06de-416d-8f7f-533f5686a0b1" containerName="manager" Jun 03 15:59:20.656993 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:59:20.656845 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e99c5a8f-06de-416d-8f7f-533f5686a0b1" containerName="manager" Jun 03 15:59:20.656993 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:59:20.656904 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="e99c5a8f-06de-416d-8f7f-533f5686a0b1" containerName="manager" Jun 03 15:59:20.658922 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:59:20.658900 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-f9255" Jun 03 15:59:20.661336 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:59:20.661311 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 03 15:59:20.661443 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:59:20.661357 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 15:59:20.662112 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:59:20.662094 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jhv64\"" Jun 03 15:59:20.662215 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:59:20.662098 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 15:59:20.670207 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:59:20.670186 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-f9255"] Jun 03 15:59:20.700670 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:59:20.700622 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nx5p\" (UniqueName: \"kubernetes.io/projected/a7d599fc-d0cf-4d2d-ad57-fab7d832f39d-kube-api-access-6nx5p\") pod \"limitador-limitador-78c99df468-f9255\" (UID: \"a7d599fc-d0cf-4d2d-ad57-fab7d832f39d\") " pod="kuadrant-system/limitador-limitador-78c99df468-f9255" Jun 03 15:59:20.701042 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:59:20.700721 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a7d599fc-d0cf-4d2d-ad57-fab7d832f39d-config-file\") pod \"limitador-limitador-78c99df468-f9255\" (UID: \"a7d599fc-d0cf-4d2d-ad57-fab7d832f39d\") " pod="kuadrant-system/limitador-limitador-78c99df468-f9255" Jun 03 15:59:20.702683 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:59:20.702657 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-f9255"] Jun 03 15:59:20.802030 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:59:20.801988 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6nx5p\" (UniqueName: \"kubernetes.io/projected/a7d599fc-d0cf-4d2d-ad57-fab7d832f39d-kube-api-access-6nx5p\") pod \"limitador-limitador-78c99df468-f9255\" (UID: \"a7d599fc-d0cf-4d2d-ad57-fab7d832f39d\") " pod="kuadrant-system/limitador-limitador-78c99df468-f9255" Jun 03 15:59:20.802219 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:59:20.802077 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a7d599fc-d0cf-4d2d-ad57-fab7d832f39d-config-file\") pod \"limitador-limitador-78c99df468-f9255\" (UID: \"a7d599fc-d0cf-4d2d-ad57-fab7d832f39d\") " pod="kuadrant-system/limitador-limitador-78c99df468-f9255" Jun 03 15:59:20.802764 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:59:20.802737 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a7d599fc-d0cf-4d2d-ad57-fab7d832f39d-config-file\") pod \"limitador-limitador-78c99df468-f9255\" (UID: \"a7d599fc-d0cf-4d2d-ad57-fab7d832f39d\") " pod="kuadrant-system/limitador-limitador-78c99df468-f9255" Jun 03 15:59:20.811520 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:59:20.811496 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nx5p\" (UniqueName: \"kubernetes.io/projected/a7d599fc-d0cf-4d2d-ad57-fab7d832f39d-kube-api-access-6nx5p\") pod \"limitador-limitador-78c99df468-f9255\" (UID: \"a7d599fc-d0cf-4d2d-ad57-fab7d832f39d\") " pod="kuadrant-system/limitador-limitador-78c99df468-f9255" Jun 03 15:59:20.969404 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:59:20.969313 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-f9255" Jun 03 15:59:21.122956 ip-10-0-141-30 kubenswrapper[2573]: W0603 15:59:21.122917 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7d599fc_d0cf_4d2d_ad57_fab7d832f39d.slice/crio-e0a23457f21356f13f3e3e733f25a0ab94ea7bc7fe7045ee9295ec5b2be03106 WatchSource:0}: Error finding container e0a23457f21356f13f3e3e733f25a0ab94ea7bc7fe7045ee9295ec5b2be03106: Status 404 returned error can't find the container with id e0a23457f21356f13f3e3e733f25a0ab94ea7bc7fe7045ee9295ec5b2be03106 Jun 03 15:59:21.123133 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:59:21.123112 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-f9255"] Jun 03 15:59:21.320245 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:59:21.320207 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-f9255" event={"ID":"a7d599fc-d0cf-4d2d-ad57-fab7d832f39d","Type":"ContainerStarted","Data":"e0a23457f21356f13f3e3e733f25a0ab94ea7bc7fe7045ee9295ec5b2be03106"} Jun 03 15:59:24.332340 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:59:24.332308 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-f9255" event={"ID":"a7d599fc-d0cf-4d2d-ad57-fab7d832f39d","Type":"ContainerStarted","Data":"14e7602faeaf470790bf5f71d9a6a7a47e1cf212b41270829087a0b6a6ca9e4f"} Jun 03 15:59:24.332734 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:59:24.332456 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-f9255" Jun 03 15:59:24.358493 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:59:24.358420 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-f9255" podStartSLOduration=1.940348764 podStartE2EDuration="4.358407056s" podCreationTimestamp="2026-06-03 15:59:20 +0000 UTC" firstStartedPulling="2026-06-03 15:59:21.125128954 +0000 UTC m=+621.482124064" lastFinishedPulling="2026-06-03 15:59:23.543187243 +0000 UTC m=+623.900182356" observedRunningTime="2026-06-03 15:59:24.356976128 +0000 UTC m=+624.713971260" watchObservedRunningTime="2026-06-03 15:59:24.358407056 +0000 UTC m=+624.715402212" Jun 03 15:59:35.336958 ip-10-0-141-30 kubenswrapper[2573]: I0603 15:59:35.336923 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-f9255" Jun 03 16:00:16.494595 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:00:16.494563 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 16:00:16.496699 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:00:16.496681 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 16:00:16.499402 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:00:16.499378 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-tcpkf\"" Jun 03 16:00:16.499402 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:00:16.499397 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 03 16:00:16.499617 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:00:16.499423 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 03 16:00:16.499931 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:00:16.499916 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 03 16:00:16.507443 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:00:16.507421 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 16:00:16.574264 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:00:16.574229 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jn88l\" (UniqueName: \"kubernetes.io/projected/b149aba9-9990-4850-bec9-9de90d7d4bf6-kube-api-access-jn88l\") pod \"maas-keycloak-0\" (UID: \"b149aba9-9990-4850-bec9-9de90d7d4bf6\") " pod="keycloak-system/maas-keycloak-0" Jun 03 16:00:16.675181 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:00:16.675145 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jn88l\" (UniqueName: \"kubernetes.io/projected/b149aba9-9990-4850-bec9-9de90d7d4bf6-kube-api-access-jn88l\") pod \"maas-keycloak-0\" (UID: \"b149aba9-9990-4850-bec9-9de90d7d4bf6\") " pod="keycloak-system/maas-keycloak-0" Jun 03 16:00:16.686746 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:00:16.686709 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jn88l\" (UniqueName: \"kubernetes.io/projected/b149aba9-9990-4850-bec9-9de90d7d4bf6-kube-api-access-jn88l\") pod \"maas-keycloak-0\" (UID: \"b149aba9-9990-4850-bec9-9de90d7d4bf6\") " pod="keycloak-system/maas-keycloak-0" Jun 03 16:00:16.806884 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:00:16.806795 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 16:00:16.941406 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:00:16.941374 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 16:00:16.944707 ip-10-0-141-30 kubenswrapper[2573]: W0603 16:00:16.944676 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb149aba9_9990_4850_bec9_9de90d7d4bf6.slice/crio-9e8fdc6e819098a1b54b566a74ce3cac2957e46eaae3e62f7310e612bf4ffcf6 WatchSource:0}: Error finding container 9e8fdc6e819098a1b54b566a74ce3cac2957e46eaae3e62f7310e612bf4ffcf6: Status 404 returned error can't find the container with id 9e8fdc6e819098a1b54b566a74ce3cac2957e46eaae3e62f7310e612bf4ffcf6 Jun 03 16:00:17.509229 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:00:17.509185 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"b149aba9-9990-4850-bec9-9de90d7d4bf6","Type":"ContainerStarted","Data":"9e8fdc6e819098a1b54b566a74ce3cac2957e46eaae3e62f7310e612bf4ffcf6"} Jun 03 16:00:22.528871 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:00:22.528829 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"b149aba9-9990-4850-bec9-9de90d7d4bf6","Type":"ContainerStarted","Data":"380a56dfe3fa99f214e23aadd9b1b116b40a8b58031c7dd85dc30608583248f9"} Jun 03 16:00:22.807860 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:00:22.807750 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 03 16:00:22.809918 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:00:22.809875 2573 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b149aba9-9990-4850-bec9-9de90d7d4bf6" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.27:9000/health/started\": dial tcp 10.133.0.27:9000: connect: connection refused" Jun 03 16:00:23.807909 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:00:23.807854 2573 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b149aba9-9990-4850-bec9-9de90d7d4bf6" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.27:9000/health/started\": dial tcp 10.133.0.27:9000: connect: connection refused" Jun 03 16:00:24.807745 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:00:24.807701 2573 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b149aba9-9990-4850-bec9-9de90d7d4bf6" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.27:9000/health/started\": dial tcp 10.133.0.27:9000: connect: connection refused" Jun 03 16:00:25.807906 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:00:25.807852 2573 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b149aba9-9990-4850-bec9-9de90d7d4bf6" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.27:9000/health/started\": dial tcp 10.133.0.27:9000: connect: connection refused" Jun 03 16:00:26.807579 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:00:26.807537 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 03 16:00:26.807996 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:00:26.807956 2573 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b149aba9-9990-4850-bec9-9de90d7d4bf6" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.27:9000/health/started\": dial tcp 10.133.0.27:9000: connect: connection refused" Jun 03 16:00:27.808184 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:00:27.808130 2573 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b149aba9-9990-4850-bec9-9de90d7d4bf6" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.27:9000/health/started\": dial tcp 10.133.0.27:9000: connect: connection refused" Jun 03 16:00:28.808186 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:00:28.808127 2573 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b149aba9-9990-4850-bec9-9de90d7d4bf6" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.27:9000/health/started\": dial tcp 10.133.0.27:9000: connect: connection refused" Jun 03 16:00:29.807648 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:00:29.807592 2573 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b149aba9-9990-4850-bec9-9de90d7d4bf6" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.27:9000/health/started\": dial tcp 10.133.0.27:9000: connect: connection refused" Jun 03 16:00:30.808028 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:00:30.807980 2573 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b149aba9-9990-4850-bec9-9de90d7d4bf6" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.27:9000/health/started\": dial tcp 10.133.0.27:9000: connect: connection refused" Jun 03 16:00:31.807406 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:00:31.807359 2573 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b149aba9-9990-4850-bec9-9de90d7d4bf6" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.27:9000/health/started\": dial tcp 10.133.0.27:9000: connect: connection refused" Jun 03 16:00:32.807795 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:00:32.807738 2573 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b149aba9-9990-4850-bec9-9de90d7d4bf6" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.27:9000/health/started\": dial tcp 10.133.0.27:9000: connect: connection refused" Jun 03 16:00:33.807350 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:00:33.807308 2573 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b149aba9-9990-4850-bec9-9de90d7d4bf6" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.27:9000/health/started\": dial tcp 10.133.0.27:9000: connect: connection refused" Jun 03 16:00:34.895304 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:00:34.895248 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 03 16:00:34.909677 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:00:34.909634 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="b149aba9-9990-4850-bec9-9de90d7d4bf6" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 16:00:34.917727 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:00:34.917667 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=14.06838149 podStartE2EDuration="18.917649273s" podCreationTimestamp="2026-06-03 16:00:16 +0000 UTC" firstStartedPulling="2026-06-03 16:00:16.94601176 +0000 UTC m=+677.303006870" lastFinishedPulling="2026-06-03 16:00:21.795279543 +0000 UTC m=+682.152274653" observedRunningTime="2026-06-03 16:00:22.553101197 +0000 UTC m=+682.910096331" watchObservedRunningTime="2026-06-03 16:00:34.917649273 +0000 UTC m=+695.274644406" Jun 03 16:00:44.901424 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:00:44.901392 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 03 16:01:28.043548 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:28.043513 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-f9255"] Jun 03 16:01:38.643021 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:38.642979 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 16:01:38.643999 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:38.643943 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="b149aba9-9990-4850-bec9-9de90d7d4bf6" containerName="keycloak" containerID="cri-o://380a56dfe3fa99f214e23aadd9b1b116b40a8b58031c7dd85dc30608583248f9" gracePeriod=30 Jun 03 16:01:40.689574 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:40.689546 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 16:01:40.812099 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:40.812012 2573 generic.go:358] "Generic (PLEG): container finished" podID="b149aba9-9990-4850-bec9-9de90d7d4bf6" containerID="380a56dfe3fa99f214e23aadd9b1b116b40a8b58031c7dd85dc30608583248f9" exitCode=143 Jun 03 16:01:40.812099 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:40.812080 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 16:01:40.812281 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:40.812099 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"b149aba9-9990-4850-bec9-9de90d7d4bf6","Type":"ContainerDied","Data":"380a56dfe3fa99f214e23aadd9b1b116b40a8b58031c7dd85dc30608583248f9"} Jun 03 16:01:40.812281 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:40.812139 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"b149aba9-9990-4850-bec9-9de90d7d4bf6","Type":"ContainerDied","Data":"9e8fdc6e819098a1b54b566a74ce3cac2957e46eaae3e62f7310e612bf4ffcf6"} Jun 03 16:01:40.812281 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:40.812162 2573 scope.go:117] "RemoveContainer" containerID="380a56dfe3fa99f214e23aadd9b1b116b40a8b58031c7dd85dc30608583248f9" Jun 03 16:01:40.821057 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:40.821035 2573 scope.go:117] "RemoveContainer" containerID="380a56dfe3fa99f214e23aadd9b1b116b40a8b58031c7dd85dc30608583248f9" Jun 03 16:01:40.821380 ip-10-0-141-30 kubenswrapper[2573]: E0603 16:01:40.821358 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"380a56dfe3fa99f214e23aadd9b1b116b40a8b58031c7dd85dc30608583248f9\": container with ID starting with 380a56dfe3fa99f214e23aadd9b1b116b40a8b58031c7dd85dc30608583248f9 not found: ID does not exist" containerID="380a56dfe3fa99f214e23aadd9b1b116b40a8b58031c7dd85dc30608583248f9" Jun 03 16:01:40.821515 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:40.821389 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"380a56dfe3fa99f214e23aadd9b1b116b40a8b58031c7dd85dc30608583248f9"} err="failed to get container status \"380a56dfe3fa99f214e23aadd9b1b116b40a8b58031c7dd85dc30608583248f9\": rpc error: code = NotFound desc = could not find container \"380a56dfe3fa99f214e23aadd9b1b116b40a8b58031c7dd85dc30608583248f9\": container with ID starting with 380a56dfe3fa99f214e23aadd9b1b116b40a8b58031c7dd85dc30608583248f9 not found: ID does not exist" Jun 03 16:01:40.834293 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:40.834273 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jn88l\" (UniqueName: \"kubernetes.io/projected/b149aba9-9990-4850-bec9-9de90d7d4bf6-kube-api-access-jn88l\") pod \"b149aba9-9990-4850-bec9-9de90d7d4bf6\" (UID: \"b149aba9-9990-4850-bec9-9de90d7d4bf6\") " Jun 03 16:01:40.836418 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:40.836397 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b149aba9-9990-4850-bec9-9de90d7d4bf6-kube-api-access-jn88l" (OuterVolumeSpecName: "kube-api-access-jn88l") pod "b149aba9-9990-4850-bec9-9de90d7d4bf6" (UID: "b149aba9-9990-4850-bec9-9de90d7d4bf6"). InnerVolumeSpecName "kube-api-access-jn88l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:01:40.935570 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:40.935533 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jn88l\" (UniqueName: \"kubernetes.io/projected/b149aba9-9990-4850-bec9-9de90d7d4bf6-kube-api-access-jn88l\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Jun 03 16:01:41.136241 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:41.136207 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 16:01:41.141396 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:41.141366 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 16:01:41.170410 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:41.170377 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 16:01:41.170793 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:41.170774 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b149aba9-9990-4850-bec9-9de90d7d4bf6" containerName="keycloak" Jun 03 16:01:41.170870 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:41.170794 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b149aba9-9990-4850-bec9-9de90d7d4bf6" containerName="keycloak" Jun 03 16:01:41.171011 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:41.170980 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="b149aba9-9990-4850-bec9-9de90d7d4bf6" containerName="keycloak" Jun 03 16:01:41.175601 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:41.175585 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 16:01:41.177950 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:41.177930 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 03 16:01:41.178053 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:41.177981 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 03 16:01:41.178053 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:41.177932 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 03 16:01:41.178156 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:41.178124 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 03 16:01:41.178212 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:41.178199 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-tcpkf\"" Jun 03 16:01:41.186331 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:41.186308 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 16:01:41.339307 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:41.339273 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghzkk\" (UniqueName: \"kubernetes.io/projected/083a0846-0ec2-464c-9394-0eb5b2e913af-kube-api-access-ghzkk\") pod \"maas-keycloak-0\" (UID: \"083a0846-0ec2-464c-9394-0eb5b2e913af\") " pod="keycloak-system/maas-keycloak-0" Jun 03 16:01:41.339515 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:41.339395 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/083a0846-0ec2-464c-9394-0eb5b2e913af-test-realms\") pod \"maas-keycloak-0\" (UID: \"083a0846-0ec2-464c-9394-0eb5b2e913af\") " pod="keycloak-system/maas-keycloak-0" Jun 03 16:01:41.440611 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:41.440513 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/083a0846-0ec2-464c-9394-0eb5b2e913af-test-realms\") pod \"maas-keycloak-0\" (UID: \"083a0846-0ec2-464c-9394-0eb5b2e913af\") " pod="keycloak-system/maas-keycloak-0" Jun 03 16:01:41.440611 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:41.440580 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ghzkk\" (UniqueName: \"kubernetes.io/projected/083a0846-0ec2-464c-9394-0eb5b2e913af-kube-api-access-ghzkk\") pod \"maas-keycloak-0\" (UID: \"083a0846-0ec2-464c-9394-0eb5b2e913af\") " pod="keycloak-system/maas-keycloak-0" Jun 03 16:01:41.441206 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:41.441184 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/083a0846-0ec2-464c-9394-0eb5b2e913af-test-realms\") pod \"maas-keycloak-0\" (UID: \"083a0846-0ec2-464c-9394-0eb5b2e913af\") " pod="keycloak-system/maas-keycloak-0" Jun 03 16:01:41.451238 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:41.451218 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghzkk\" (UniqueName: \"kubernetes.io/projected/083a0846-0ec2-464c-9394-0eb5b2e913af-kube-api-access-ghzkk\") pod \"maas-keycloak-0\" (UID: \"083a0846-0ec2-464c-9394-0eb5b2e913af\") " pod="keycloak-system/maas-keycloak-0" Jun 03 16:01:41.485886 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:41.485855 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 16:01:41.616339 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:41.616306 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 16:01:41.621178 ip-10-0-141-30 kubenswrapper[2573]: W0603 16:01:41.621143 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod083a0846_0ec2_464c_9394_0eb5b2e913af.slice/crio-ef6355df80fdbf89a2a9e02ab82b3136a179366d238e16b42098f714ae9125ad WatchSource:0}: Error finding container ef6355df80fdbf89a2a9e02ab82b3136a179366d238e16b42098f714ae9125ad: Status 404 returned error can't find the container with id ef6355df80fdbf89a2a9e02ab82b3136a179366d238e16b42098f714ae9125ad Jun 03 16:01:41.622836 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:41.622818 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 16:01:41.816386 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:41.816302 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"083a0846-0ec2-464c-9394-0eb5b2e913af","Type":"ContainerStarted","Data":"ef6355df80fdbf89a2a9e02ab82b3136a179366d238e16b42098f714ae9125ad"} Jun 03 16:01:42.234667 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:42.234636 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b149aba9-9990-4850-bec9-9de90d7d4bf6" path="/var/lib/kubelet/pods/b149aba9-9990-4850-bec9-9de90d7d4bf6/volumes" Jun 03 16:01:42.826173 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:42.826132 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"083a0846-0ec2-464c-9394-0eb5b2e913af","Type":"ContainerStarted","Data":"c91c334ba0a542fbe5f224a0c4a75f5321c86d1367f4ec8a8fff4395a3c5fab1"} Jun 03 16:01:42.848032 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:42.847957 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.393770903 podStartE2EDuration="1.847930687s" podCreationTimestamp="2026-06-03 16:01:41 +0000 UTC" firstStartedPulling="2026-06-03 16:01:41.622937676 +0000 UTC m=+761.979932786" lastFinishedPulling="2026-06-03 16:01:42.077097459 +0000 UTC m=+762.434092570" observedRunningTime="2026-06-03 16:01:42.846259203 +0000 UTC m=+763.203254335" watchObservedRunningTime="2026-06-03 16:01:42.847930687 +0000 UTC m=+763.204925820" Jun 03 16:01:43.486313 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:43.486254 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 03 16:01:43.487843 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:43.487798 2573 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="083a0846-0ec2-464c-9394-0eb5b2e913af" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Jun 03 16:01:44.486568 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:44.486453 2573 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="083a0846-0ec2-464c-9394-0eb5b2e913af" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Jun 03 16:01:45.487139 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:45.487078 2573 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="083a0846-0ec2-464c-9394-0eb5b2e913af" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Jun 03 16:01:46.486702 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:46.486266 2573 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="083a0846-0ec2-464c-9394-0eb5b2e913af" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Jun 03 16:01:47.486397 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:47.486343 2573 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="083a0846-0ec2-464c-9394-0eb5b2e913af" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Jun 03 16:01:48.487018 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:48.486949 2573 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="083a0846-0ec2-464c-9394-0eb5b2e913af" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Jun 03 16:01:49.486829 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:49.486771 2573 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="083a0846-0ec2-464c-9394-0eb5b2e913af" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Jun 03 16:01:50.486298 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:50.486255 2573 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="083a0846-0ec2-464c-9394-0eb5b2e913af" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Jun 03 16:01:51.486546 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:51.486506 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 03 16:01:51.486925 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:51.486802 2573 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="083a0846-0ec2-464c-9394-0eb5b2e913af" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Jun 03 16:01:52.486815 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:52.486760 2573 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="083a0846-0ec2-464c-9394-0eb5b2e913af" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Jun 03 16:01:53.486325 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:53.486266 2573 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="083a0846-0ec2-464c-9394-0eb5b2e913af" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Jun 03 16:01:54.487012 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:54.486961 2573 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="083a0846-0ec2-464c-9394-0eb5b2e913af" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Jun 03 16:01:55.596437 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:55.596386 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 03 16:01:55.612556 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:01:55.612501 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="083a0846-0ec2-464c-9394-0eb5b2e913af" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 16:02:05.603294 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:05.603260 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 03 16:02:33.151296 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:33.151209 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-87dzj"] Jun 03 16:02:33.155209 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:33.155186 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-87dzj" Jun 03 16:02:33.158536 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:33.158514 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 03 16:02:33.159445 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:33.159419 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 03 16:02:33.159601 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:33.159430 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-z6r2v\"" Jun 03 16:02:33.159601 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:33.159443 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 03 16:02:33.169878 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:33.169850 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-87dzj"] Jun 03 16:02:33.221089 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:33.221056 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f064de42-a6d6-45d7-9b84-f5221e1a03dd-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-87dzj\" (UID: \"f064de42-a6d6-45d7-9b84-f5221e1a03dd\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-87dzj" Jun 03 16:02:33.221248 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:33.221131 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86p4n\" (UniqueName: \"kubernetes.io/projected/f064de42-a6d6-45d7-9b84-f5221e1a03dd-kube-api-access-86p4n\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-87dzj\" (UID: \"f064de42-a6d6-45d7-9b84-f5221e1a03dd\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-87dzj" Jun 03 16:02:33.221248 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:33.221156 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f064de42-a6d6-45d7-9b84-f5221e1a03dd-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-87dzj\" (UID: \"f064de42-a6d6-45d7-9b84-f5221e1a03dd\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-87dzj" Jun 03 16:02:33.221248 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:33.221175 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f064de42-a6d6-45d7-9b84-f5221e1a03dd-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-87dzj\" (UID: \"f064de42-a6d6-45d7-9b84-f5221e1a03dd\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-87dzj" Jun 03 16:02:33.221402 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:33.221284 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f064de42-a6d6-45d7-9b84-f5221e1a03dd-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-87dzj\" (UID: \"f064de42-a6d6-45d7-9b84-f5221e1a03dd\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-87dzj" Jun 03 16:02:33.221402 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:33.221334 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f064de42-a6d6-45d7-9b84-f5221e1a03dd-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-87dzj\" (UID: \"f064de42-a6d6-45d7-9b84-f5221e1a03dd\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-87dzj" Jun 03 16:02:33.322248 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:33.322217 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f064de42-a6d6-45d7-9b84-f5221e1a03dd-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-87dzj\" (UID: \"f064de42-a6d6-45d7-9b84-f5221e1a03dd\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-87dzj" Jun 03 16:02:33.322427 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:33.322300 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f064de42-a6d6-45d7-9b84-f5221e1a03dd-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-87dzj\" (UID: \"f064de42-a6d6-45d7-9b84-f5221e1a03dd\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-87dzj" Jun 03 16:02:33.322427 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:33.322376 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-86p4n\" (UniqueName: \"kubernetes.io/projected/f064de42-a6d6-45d7-9b84-f5221e1a03dd-kube-api-access-86p4n\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-87dzj\" (UID: \"f064de42-a6d6-45d7-9b84-f5221e1a03dd\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-87dzj" Jun 03 16:02:33.322585 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:33.322433 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f064de42-a6d6-45d7-9b84-f5221e1a03dd-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-87dzj\" (UID: \"f064de42-a6d6-45d7-9b84-f5221e1a03dd\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-87dzj" Jun 03 16:02:33.322585 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:33.322458 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f064de42-a6d6-45d7-9b84-f5221e1a03dd-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-87dzj\" (UID: \"f064de42-a6d6-45d7-9b84-f5221e1a03dd\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-87dzj" Jun 03 16:02:33.322585 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:33.322528 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f064de42-a6d6-45d7-9b84-f5221e1a03dd-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-87dzj\" (UID: \"f064de42-a6d6-45d7-9b84-f5221e1a03dd\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-87dzj" Jun 03 16:02:33.322806 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:33.322782 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f064de42-a6d6-45d7-9b84-f5221e1a03dd-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-87dzj\" (UID: \"f064de42-a6d6-45d7-9b84-f5221e1a03dd\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-87dzj" Jun 03 16:02:33.323074 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:33.323049 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f064de42-a6d6-45d7-9b84-f5221e1a03dd-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-87dzj\" (UID: \"f064de42-a6d6-45d7-9b84-f5221e1a03dd\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-87dzj" Jun 03 16:02:33.323462 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:33.323437 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f064de42-a6d6-45d7-9b84-f5221e1a03dd-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-87dzj\" (UID: \"f064de42-a6d6-45d7-9b84-f5221e1a03dd\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-87dzj" Jun 03 16:02:33.325202 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:33.325180 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f064de42-a6d6-45d7-9b84-f5221e1a03dd-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-87dzj\" (UID: \"f064de42-a6d6-45d7-9b84-f5221e1a03dd\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-87dzj" Jun 03 16:02:33.325435 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:33.325418 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f064de42-a6d6-45d7-9b84-f5221e1a03dd-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-87dzj\" (UID: \"f064de42-a6d6-45d7-9b84-f5221e1a03dd\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-87dzj" Jun 03 16:02:33.333539 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:33.333518 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86p4n\" (UniqueName: \"kubernetes.io/projected/f064de42-a6d6-45d7-9b84-f5221e1a03dd-kube-api-access-86p4n\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-87dzj\" (UID: \"f064de42-a6d6-45d7-9b84-f5221e1a03dd\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-87dzj" Jun 03 16:02:33.467632 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:33.467542 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-87dzj" Jun 03 16:02:33.599840 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:33.599800 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-87dzj"] Jun 03 16:02:33.602445 ip-10-0-141-30 kubenswrapper[2573]: W0603 16:02:33.602417 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf064de42_a6d6_45d7_9b84_f5221e1a03dd.slice/crio-8f73bb2ab53e49233719822e5b4bec5110da4d4d992b807396615cb22510bdac WatchSource:0}: Error finding container 8f73bb2ab53e49233719822e5b4bec5110da4d4d992b807396615cb22510bdac: Status 404 returned error can't find the container with id 8f73bb2ab53e49233719822e5b4bec5110da4d4d992b807396615cb22510bdac Jun 03 16:02:33.712043 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:33.712007 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-f9255"] Jun 03 16:02:34.035419 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:34.035383 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-87dzj" event={"ID":"f064de42-a6d6-45d7-9b84-f5221e1a03dd","Type":"ContainerStarted","Data":"8f73bb2ab53e49233719822e5b4bec5110da4d4d992b807396615cb22510bdac"} Jun 03 16:02:38.049853 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:38.049759 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-87dzj" event={"ID":"f064de42-a6d6-45d7-9b84-f5221e1a03dd","Type":"ContainerStarted","Data":"6509d1f2bcfe1841dbce25f14b7b306f926da9e00dc0f56ef16de555d7f4327e"} Jun 03 16:02:44.781494 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:44.781438 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-xj9b9"] Jun 03 16:02:44.786439 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:44.786417 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xj9b9" Jun 03 16:02:44.789023 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:44.789004 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 03 16:02:44.797211 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:44.797188 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-xj9b9"] Jun 03 16:02:44.834531 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:44.834500 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ef75f996-01d8-46a7-b754-47a9ccfefcab-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-xj9b9\" (UID: \"ef75f996-01d8-46a7-b754-47a9ccfefcab\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xj9b9" Jun 03 16:02:44.834693 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:44.834551 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef75f996-01d8-46a7-b754-47a9ccfefcab-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-xj9b9\" (UID: \"ef75f996-01d8-46a7-b754-47a9ccfefcab\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xj9b9" Jun 03 16:02:44.834693 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:44.834575 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrvh5\" (UniqueName: \"kubernetes.io/projected/ef75f996-01d8-46a7-b754-47a9ccfefcab-kube-api-access-hrvh5\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-xj9b9\" (UID: \"ef75f996-01d8-46a7-b754-47a9ccfefcab\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xj9b9" Jun 03 16:02:44.834693 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:44.834666 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef75f996-01d8-46a7-b754-47a9ccfefcab-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-xj9b9\" (UID: \"ef75f996-01d8-46a7-b754-47a9ccfefcab\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xj9b9" Jun 03 16:02:44.834825 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:44.834771 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef75f996-01d8-46a7-b754-47a9ccfefcab-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-xj9b9\" (UID: \"ef75f996-01d8-46a7-b754-47a9ccfefcab\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xj9b9" Jun 03 16:02:44.834825 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:44.834811 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef75f996-01d8-46a7-b754-47a9ccfefcab-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-xj9b9\" (UID: \"ef75f996-01d8-46a7-b754-47a9ccfefcab\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xj9b9" Jun 03 16:02:44.935482 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:44.935431 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef75f996-01d8-46a7-b754-47a9ccfefcab-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-xj9b9\" (UID: \"ef75f996-01d8-46a7-b754-47a9ccfefcab\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xj9b9" Jun 03 16:02:44.935657 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:44.935526 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef75f996-01d8-46a7-b754-47a9ccfefcab-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-xj9b9\" (UID: \"ef75f996-01d8-46a7-b754-47a9ccfefcab\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xj9b9" Jun 03 16:02:44.935657 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:44.935559 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ef75f996-01d8-46a7-b754-47a9ccfefcab-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-xj9b9\" (UID: \"ef75f996-01d8-46a7-b754-47a9ccfefcab\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xj9b9" Jun 03 16:02:44.935657 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:44.935592 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef75f996-01d8-46a7-b754-47a9ccfefcab-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-xj9b9\" (UID: \"ef75f996-01d8-46a7-b754-47a9ccfefcab\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xj9b9" Jun 03 16:02:44.935657 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:44.935621 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hrvh5\" (UniqueName: \"kubernetes.io/projected/ef75f996-01d8-46a7-b754-47a9ccfefcab-kube-api-access-hrvh5\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-xj9b9\" (UID: \"ef75f996-01d8-46a7-b754-47a9ccfefcab\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xj9b9" Jun 03 16:02:44.935852 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:44.935687 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef75f996-01d8-46a7-b754-47a9ccfefcab-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-xj9b9\" (UID: \"ef75f996-01d8-46a7-b754-47a9ccfefcab\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xj9b9" Jun 03 16:02:44.935975 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:44.935955 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ef75f996-01d8-46a7-b754-47a9ccfefcab-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-xj9b9\" (UID: \"ef75f996-01d8-46a7-b754-47a9ccfefcab\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xj9b9" Jun 03 16:02:44.936050 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:44.936007 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef75f996-01d8-46a7-b754-47a9ccfefcab-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-xj9b9\" (UID: \"ef75f996-01d8-46a7-b754-47a9ccfefcab\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xj9b9" Jun 03 16:02:44.936050 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:44.936026 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef75f996-01d8-46a7-b754-47a9ccfefcab-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-xj9b9\" (UID: \"ef75f996-01d8-46a7-b754-47a9ccfefcab\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xj9b9" Jun 03 16:02:44.937720 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:44.937702 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef75f996-01d8-46a7-b754-47a9ccfefcab-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-xj9b9\" (UID: \"ef75f996-01d8-46a7-b754-47a9ccfefcab\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xj9b9" Jun 03 16:02:44.937985 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:44.937968 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef75f996-01d8-46a7-b754-47a9ccfefcab-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-xj9b9\" (UID: \"ef75f996-01d8-46a7-b754-47a9ccfefcab\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xj9b9" Jun 03 16:02:44.945574 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:44.945554 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrvh5\" (UniqueName: \"kubernetes.io/projected/ef75f996-01d8-46a7-b754-47a9ccfefcab-kube-api-access-hrvh5\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-xj9b9\" (UID: \"ef75f996-01d8-46a7-b754-47a9ccfefcab\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xj9b9" Jun 03 16:02:45.097924 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:45.097884 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xj9b9" Jun 03 16:02:45.230905 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:45.230880 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-xj9b9"] Jun 03 16:02:45.233340 ip-10-0-141-30 kubenswrapper[2573]: W0603 16:02:45.233313 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef75f996_01d8_46a7_b754_47a9ccfefcab.slice/crio-5ec4d2a495d0351b74c05130084a57e2cc0da558f0637a2da4e30185e2077494 WatchSource:0}: Error finding container 5ec4d2a495d0351b74c05130084a57e2cc0da558f0637a2da4e30185e2077494: Status 404 returned error can't find the container with id 5ec4d2a495d0351b74c05130084a57e2cc0da558f0637a2da4e30185e2077494 Jun 03 16:02:45.233976 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:45.233950 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-f9255"] Jun 03 16:02:46.078841 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:46.078799 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xj9b9" event={"ID":"ef75f996-01d8-46a7-b754-47a9ccfefcab","Type":"ContainerStarted","Data":"57c6cc84e5b2611402428632c9b6edbcfe84fb3b59209b07ad887206ce626cbb"} Jun 03 16:02:46.078841 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:46.078849 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xj9b9" event={"ID":"ef75f996-01d8-46a7-b754-47a9ccfefcab","Type":"ContainerStarted","Data":"5ec4d2a495d0351b74c05130084a57e2cc0da558f0637a2da4e30185e2077494"} Jun 03 16:02:47.083138 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:47.083100 2573 generic.go:358] "Generic (PLEG): container finished" podID="ef75f996-01d8-46a7-b754-47a9ccfefcab" containerID="57c6cc84e5b2611402428632c9b6edbcfe84fb3b59209b07ad887206ce626cbb" exitCode=0 Jun 03 16:02:47.083551 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:47.083152 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xj9b9" event={"ID":"ef75f996-01d8-46a7-b754-47a9ccfefcab","Type":"ContainerDied","Data":"57c6cc84e5b2611402428632c9b6edbcfe84fb3b59209b07ad887206ce626cbb"} Jun 03 16:02:49.091960 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:49.091918 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xj9b9" event={"ID":"ef75f996-01d8-46a7-b754-47a9ccfefcab","Type":"ContainerStarted","Data":"563cb6902f783180060004776ce6b27483b966b3e8029abe77f3b71aacc9800e"} Jun 03 16:02:49.116524 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:49.116463 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xj9b9" podStartSLOduration=3.26906556 podStartE2EDuration="5.116449966s" podCreationTimestamp="2026-06-03 16:02:44 +0000 UTC" firstStartedPulling="2026-06-03 16:02:47.083684162 +0000 UTC m=+827.440679271" lastFinishedPulling="2026-06-03 16:02:48.931068553 +0000 UTC m=+829.288063677" observedRunningTime="2026-06-03 16:02:49.115986495 +0000 UTC m=+829.472981629" watchObservedRunningTime="2026-06-03 16:02:49.116449966 +0000 UTC m=+829.473445098" Jun 03 16:02:52.918725 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:52.918680 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-f9255"] Jun 03 16:02:55.098695 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:55.098665 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xj9b9" Jun 03 16:02:55.099168 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:55.098815 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xj9b9" Jun 03 16:02:55.111236 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:55.111206 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xj9b9" Jun 03 16:02:55.125318 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:55.125291 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xj9b9" Jun 03 16:02:59.220689 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:02:59.220654 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-f9255"] Jun 03 16:03:03.721375 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:03:03.721336 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-f9255"] Jun 03 16:03:10.484607 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:03:10.484568 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-6tcwn"] Jun 03 16:03:10.498060 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:03:10.497903 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-6tcwn" Jun 03 16:03:10.500418 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:03:10.500392 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-6tcwn"] Jun 03 16:03:10.500915 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:03:10.500889 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 03 16:03:10.667588 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:03:10.667540 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/102101a2-0af9-4edf-bbda-1cd2364baf73-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-6tcwn\" (UID: \"102101a2-0af9-4edf-bbda-1cd2364baf73\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-6tcwn" Jun 03 16:03:10.667762 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:03:10.667598 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6d2k\" (UniqueName: \"kubernetes.io/projected/102101a2-0af9-4edf-bbda-1cd2364baf73-kube-api-access-q6d2k\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-6tcwn\" (UID: \"102101a2-0af9-4edf-bbda-1cd2364baf73\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-6tcwn" Jun 03 16:03:10.667762 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:03:10.667669 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/102101a2-0af9-4edf-bbda-1cd2364baf73-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-6tcwn\" (UID: \"102101a2-0af9-4edf-bbda-1cd2364baf73\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-6tcwn" Jun 03 16:03:10.667762 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:03:10.667694 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/102101a2-0af9-4edf-bbda-1cd2364baf73-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-6tcwn\" (UID: \"102101a2-0af9-4edf-bbda-1cd2364baf73\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-6tcwn" Jun 03 16:03:10.667762 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:03:10.667717 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/102101a2-0af9-4edf-bbda-1cd2364baf73-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-6tcwn\" (UID: \"102101a2-0af9-4edf-bbda-1cd2364baf73\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-6tcwn" Jun 03 16:03:10.667762 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:03:10.667734 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/102101a2-0af9-4edf-bbda-1cd2364baf73-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-6tcwn\" (UID: \"102101a2-0af9-4edf-bbda-1cd2364baf73\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-6tcwn" Jun 03 16:03:10.768215 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:03:10.768129 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/102101a2-0af9-4edf-bbda-1cd2364baf73-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-6tcwn\" (UID: \"102101a2-0af9-4edf-bbda-1cd2364baf73\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-6tcwn" Jun 03 16:03:10.768215 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:03:10.768168 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/102101a2-0af9-4edf-bbda-1cd2364baf73-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-6tcwn\" (UID: \"102101a2-0af9-4edf-bbda-1cd2364baf73\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-6tcwn" Jun 03 16:03:10.768215 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:03:10.768200 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/102101a2-0af9-4edf-bbda-1cd2364baf73-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-6tcwn\" (UID: \"102101a2-0af9-4edf-bbda-1cd2364baf73\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-6tcwn" Jun 03 16:03:10.768503 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:03:10.768228 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/102101a2-0af9-4edf-bbda-1cd2364baf73-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-6tcwn\" (UID: \"102101a2-0af9-4edf-bbda-1cd2364baf73\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-6tcwn" Jun 03 16:03:10.768503 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:03:10.768290 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/102101a2-0af9-4edf-bbda-1cd2364baf73-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-6tcwn\" (UID: \"102101a2-0af9-4edf-bbda-1cd2364baf73\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-6tcwn" Jun 03 16:03:10.768503 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:03:10.768327 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q6d2k\" (UniqueName: \"kubernetes.io/projected/102101a2-0af9-4edf-bbda-1cd2364baf73-kube-api-access-q6d2k\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-6tcwn\" (UID: \"102101a2-0af9-4edf-bbda-1cd2364baf73\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-6tcwn" Jun 03 16:03:10.768713 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:03:10.768689 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/102101a2-0af9-4edf-bbda-1cd2364baf73-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-6tcwn\" (UID: \"102101a2-0af9-4edf-bbda-1cd2364baf73\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-6tcwn" Jun 03 16:03:10.768782 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:03:10.768730 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/102101a2-0af9-4edf-bbda-1cd2364baf73-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-6tcwn\" (UID: \"102101a2-0af9-4edf-bbda-1cd2364baf73\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-6tcwn" Jun 03 16:03:10.768782 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:03:10.768744 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/102101a2-0af9-4edf-bbda-1cd2364baf73-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-6tcwn\" (UID: \"102101a2-0af9-4edf-bbda-1cd2364baf73\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-6tcwn" Jun 03 16:03:10.770484 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:03:10.770456 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/102101a2-0af9-4edf-bbda-1cd2364baf73-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-6tcwn\" (UID: \"102101a2-0af9-4edf-bbda-1cd2364baf73\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-6tcwn" Jun 03 16:03:10.770896 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:03:10.770876 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/102101a2-0af9-4edf-bbda-1cd2364baf73-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-6tcwn\" (UID: \"102101a2-0af9-4edf-bbda-1cd2364baf73\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-6tcwn" Jun 03 16:03:10.779368 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:03:10.779342 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6d2k\" (UniqueName: \"kubernetes.io/projected/102101a2-0af9-4edf-bbda-1cd2364baf73-kube-api-access-q6d2k\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-6tcwn\" (UID: \"102101a2-0af9-4edf-bbda-1cd2364baf73\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-6tcwn" Jun 03 16:03:10.810141 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:03:10.810112 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-6tcwn" Jun 03 16:03:10.944158 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:03:10.944124 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-6tcwn"] Jun 03 16:03:10.946917 ip-10-0-141-30 kubenswrapper[2573]: W0603 16:03:10.946887 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod102101a2_0af9_4edf_bbda_1cd2364baf73.slice/crio-e505b7de8d27a9b075147571511f9829e500252b05accdb7bffe3a9fae367488 WatchSource:0}: Error finding container e505b7de8d27a9b075147571511f9829e500252b05accdb7bffe3a9fae367488: Status 404 returned error can't find the container with id e505b7de8d27a9b075147571511f9829e500252b05accdb7bffe3a9fae367488 Jun 03 16:03:11.168591 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:03:11.168554 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-6tcwn" event={"ID":"102101a2-0af9-4edf-bbda-1cd2364baf73","Type":"ContainerStarted","Data":"039400cee37bd01d116ee677b0d5bbadc5614bd808976a798343bc6e4d7bc610"} Jun 03 16:03:11.168591 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:03:11.168592 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-6tcwn" event={"ID":"102101a2-0af9-4edf-bbda-1cd2364baf73","Type":"ContainerStarted","Data":"e505b7de8d27a9b075147571511f9829e500252b05accdb7bffe3a9fae367488"} Jun 03 16:03:12.628606 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:03:12.628571 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-f9255"] Jun 03 16:09:25.980199 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:25.980165 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-6tcwn_102101a2-0af9-4edf-bbda-1cd2364baf73/storage-initializer/0.log" Jun 03 16:09:31.847851 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:31.847817 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-78c4457769-qtpvq_469da770-1965-41c6-9a14-babdff64b540/nginx/0.log" Jun 03 16:09:32.847485 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:32.847454 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58656688f4-lcvth_58a670e0-5401-479d-99f5-5e55a8f4f280/copy-manifests/0.log" Jun 03 16:09:32.862754 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:32.862729 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58656688f4-lcvth_58a670e0-5401-479d-99f5-5e55a8f4f280/manager/0.log" Jun 03 16:09:35.322304 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:35.322276 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-f9255_a7d599fc-d0cf-4d2d-ad57-fab7d832f39d/limitador/0.log" Jun 03 16:09:35.955098 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:35.955064 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-84m6g_1ad392d6-377c-4540-8019-57340e89db1d/discovery/0.log" Jun 03 16:09:36.946250 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:36.946220 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-87dzj_f064de42-a6d6-45d7-9b84-f5221e1a03dd/storage-initializer/0.log" Jun 03 16:09:37.079087 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:37.079057 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-xj9b9_ef75f996-01d8-46a7-b754-47a9ccfefcab/storage-initializer/0.log" Jun 03 16:09:37.091764 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:37.091742 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-xj9b9_ef75f996-01d8-46a7-b754-47a9ccfefcab/main/0.log" Jun 03 16:09:37.619424 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:37.619395 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-6tcwn_102101a2-0af9-4edf-bbda-1cd2364baf73/storage-initializer/0.log" Jun 03 16:09:45.764119 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:45.764087 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-gnf9x_dd3517b6-8b26-4614-a559-162258f28dbf/global-pull-secret-syncer/0.log" Jun 03 16:09:46.153849 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:46.153821 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ntc9t_738f714c-1988-41e8-9eb6-8ee92d4f07d5/konnectivity-agent/0.log" Jun 03 16:09:46.344153 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:46.344119 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-30.ec2.internal_1ea1fc29e200e4220b7c6bf0d70a6719/haproxy/0.log" Jun 03 16:09:50.695603 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:50.695574 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-f9255_a7d599fc-d0cf-4d2d-ad57-fab7d832f39d/limitador/0.log" Jun 03 16:09:52.324631 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:52.324603 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_04d18240-307e-4152-adb5-31a90e3d95b0/alertmanager/0.log" Jun 03 16:09:52.407589 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:52.407564 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_04d18240-307e-4152-adb5-31a90e3d95b0/config-reloader/0.log" Jun 03 16:09:52.452121 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:52.452096 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_04d18240-307e-4152-adb5-31a90e3d95b0/kube-rbac-proxy-web/0.log" Jun 03 16:09:52.497181 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:52.497158 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_04d18240-307e-4152-adb5-31a90e3d95b0/kube-rbac-proxy/0.log" Jun 03 16:09:52.544157 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:52.544130 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_04d18240-307e-4152-adb5-31a90e3d95b0/kube-rbac-proxy-metric/0.log" Jun 03 16:09:52.598853 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:52.598791 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_04d18240-307e-4152-adb5-31a90e3d95b0/prom-label-proxy/0.log" Jun 03 16:09:52.644896 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:52.644875 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_04d18240-307e-4152-adb5-31a90e3d95b0/init-config-reloader/0.log" Jun 03 16:09:52.786732 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:52.786709 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-gfxp6_2a82cd14-8e94-458d-9e44-e5ca4f1743df/kube-state-metrics/0.log" Jun 03 16:09:52.851869 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:52.851813 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-gfxp6_2a82cd14-8e94-458d-9e44-e5ca4f1743df/kube-rbac-proxy-main/0.log" Jun 03 16:09:52.883380 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:52.883359 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-gfxp6_2a82cd14-8e94-458d-9e44-e5ca4f1743df/kube-rbac-proxy-self/0.log" Jun 03 16:09:52.924070 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:52.924051 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-667dcd4-rr79q_b299018e-c4d4-488b-b6e4-8475c1dfb24e/metrics-server/0.log" Jun 03 16:09:52.972515 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:52.972495 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5768fcc9dd-7qftz_72f174a8-f17c-4662-bb30-a7f38f5680f4/monitoring-plugin/0.log" Jun 03 16:09:53.049366 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:53.049347 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2zfg9_b55da440-3026-4e63-bde6-c9970eaf8f87/node-exporter/0.log" Jun 03 16:09:53.098358 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:53.098342 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2zfg9_b55da440-3026-4e63-bde6-c9970eaf8f87/kube-rbac-proxy/0.log" Jun 03 16:09:53.133392 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:53.133339 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2zfg9_b55da440-3026-4e63-bde6-c9970eaf8f87/init-textfile/0.log" Jun 03 16:09:53.656911 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:53.656870 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_43fbc77c-cbc0-4caf-9094-7842b6279b43/prometheus/0.log" Jun 03 16:09:53.714896 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:53.714862 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_43fbc77c-cbc0-4caf-9094-7842b6279b43/config-reloader/0.log" Jun 03 16:09:53.768487 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:53.768449 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_43fbc77c-cbc0-4caf-9094-7842b6279b43/thanos-sidecar/0.log" Jun 03 16:09:53.803389 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:53.803354 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_43fbc77c-cbc0-4caf-9094-7842b6279b43/kube-rbac-proxy-web/0.log" Jun 03 16:09:53.858284 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:53.858256 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_43fbc77c-cbc0-4caf-9094-7842b6279b43/kube-rbac-proxy/0.log" Jun 03 16:09:53.893077 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:53.893052 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_43fbc77c-cbc0-4caf-9094-7842b6279b43/kube-rbac-proxy-thanos/0.log" Jun 03 16:09:53.946200 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:53.946137 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_43fbc77c-cbc0-4caf-9094-7842b6279b43/init-config-reloader/0.log" Jun 03 16:09:54.576327 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:54.576294 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wpskt/perf-node-gather-daemonset-5lshz"] Jun 03 16:09:54.578689 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:54.578669 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-5lshz" Jun 03 16:09:54.580918 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:54.580900 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wpskt\"/\"kube-root-ca.crt\"" Jun 03 16:09:54.582678 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:54.582659 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wpskt\"/\"default-dockercfg-ff6qh\"" Jun 03 16:09:54.582783 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:54.582675 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wpskt\"/\"openshift-service-ca.crt\"" Jun 03 16:09:54.594226 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:54.594204 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wpskt/perf-node-gather-daemonset-5lshz"] Jun 03 16:09:54.678648 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:54.678615 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6815cf0b-66c3-4fc1-886e-7ca35a816ac3-podres\") pod \"perf-node-gather-daemonset-5lshz\" (UID: \"6815cf0b-66c3-4fc1-886e-7ca35a816ac3\") " pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-5lshz" Jun 03 16:09:54.679021 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:54.678675 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6815cf0b-66c3-4fc1-886e-7ca35a816ac3-sys\") pod \"perf-node-gather-daemonset-5lshz\" (UID: \"6815cf0b-66c3-4fc1-886e-7ca35a816ac3\") " pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-5lshz" Jun 03 16:09:54.679021 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:54.678733 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rm4vl\" (UniqueName: \"kubernetes.io/projected/6815cf0b-66c3-4fc1-886e-7ca35a816ac3-kube-api-access-rm4vl\") pod \"perf-node-gather-daemonset-5lshz\" (UID: \"6815cf0b-66c3-4fc1-886e-7ca35a816ac3\") " pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-5lshz" Jun 03 16:09:54.679021 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:54.678793 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6815cf0b-66c3-4fc1-886e-7ca35a816ac3-proc\") pod \"perf-node-gather-daemonset-5lshz\" (UID: \"6815cf0b-66c3-4fc1-886e-7ca35a816ac3\") " pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-5lshz" Jun 03 16:09:54.679021 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:54.678869 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6815cf0b-66c3-4fc1-886e-7ca35a816ac3-lib-modules\") pod \"perf-node-gather-daemonset-5lshz\" (UID: \"6815cf0b-66c3-4fc1-886e-7ca35a816ac3\") " pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-5lshz" Jun 03 16:09:54.779873 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:54.779842 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6815cf0b-66c3-4fc1-886e-7ca35a816ac3-podres\") pod \"perf-node-gather-daemonset-5lshz\" (UID: \"6815cf0b-66c3-4fc1-886e-7ca35a816ac3\") " pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-5lshz" Jun 03 16:09:54.780027 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:54.779895 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6815cf0b-66c3-4fc1-886e-7ca35a816ac3-sys\") pod \"perf-node-gather-daemonset-5lshz\" (UID: \"6815cf0b-66c3-4fc1-886e-7ca35a816ac3\") " pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-5lshz" Jun 03 16:09:54.780027 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:54.779950 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6815cf0b-66c3-4fc1-886e-7ca35a816ac3-sys\") pod \"perf-node-gather-daemonset-5lshz\" (UID: \"6815cf0b-66c3-4fc1-886e-7ca35a816ac3\") " pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-5lshz" Jun 03 16:09:54.780027 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:54.779975 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rm4vl\" (UniqueName: \"kubernetes.io/projected/6815cf0b-66c3-4fc1-886e-7ca35a816ac3-kube-api-access-rm4vl\") pod \"perf-node-gather-daemonset-5lshz\" (UID: \"6815cf0b-66c3-4fc1-886e-7ca35a816ac3\") " pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-5lshz" Jun 03 16:09:54.780027 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:54.780003 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6815cf0b-66c3-4fc1-886e-7ca35a816ac3-proc\") pod \"perf-node-gather-daemonset-5lshz\" (UID: \"6815cf0b-66c3-4fc1-886e-7ca35a816ac3\") " pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-5lshz" Jun 03 16:09:54.780027 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:54.780006 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6815cf0b-66c3-4fc1-886e-7ca35a816ac3-podres\") pod \"perf-node-gather-daemonset-5lshz\" (UID: \"6815cf0b-66c3-4fc1-886e-7ca35a816ac3\") " pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-5lshz" Jun 03 16:09:54.780250 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:54.780047 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6815cf0b-66c3-4fc1-886e-7ca35a816ac3-lib-modules\") pod \"perf-node-gather-daemonset-5lshz\" (UID: \"6815cf0b-66c3-4fc1-886e-7ca35a816ac3\") " pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-5lshz" Jun 03 16:09:54.780250 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:54.780096 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6815cf0b-66c3-4fc1-886e-7ca35a816ac3-proc\") pod \"perf-node-gather-daemonset-5lshz\" (UID: \"6815cf0b-66c3-4fc1-886e-7ca35a816ac3\") " pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-5lshz" Jun 03 16:09:54.780250 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:54.780154 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6815cf0b-66c3-4fc1-886e-7ca35a816ac3-lib-modules\") pod \"perf-node-gather-daemonset-5lshz\" (UID: \"6815cf0b-66c3-4fc1-886e-7ca35a816ac3\") " pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-5lshz" Jun 03 16:09:54.792086 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:54.792060 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rm4vl\" (UniqueName: \"kubernetes.io/projected/6815cf0b-66c3-4fc1-886e-7ca35a816ac3-kube-api-access-rm4vl\") pod \"perf-node-gather-daemonset-5lshz\" (UID: \"6815cf0b-66c3-4fc1-886e-7ca35a816ac3\") " pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-5lshz" Jun 03 16:09:54.889115 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:54.889027 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-5lshz" Jun 03 16:09:55.021963 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:55.021919 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wpskt/perf-node-gather-daemonset-5lshz"] Jun 03 16:09:55.027731 ip-10-0-141-30 kubenswrapper[2573]: W0603 16:09:55.027693 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6815cf0b_66c3_4fc1_886e_7ca35a816ac3.slice/crio-af8be5a70074c15daefc7d7f2e7a9e1dddd65423d858e6dfae43bb9e872ab7d8 WatchSource:0}: Error finding container af8be5a70074c15daefc7d7f2e7a9e1dddd65423d858e6dfae43bb9e872ab7d8: Status 404 returned error can't find the container with id af8be5a70074c15daefc7d7f2e7a9e1dddd65423d858e6dfae43bb9e872ab7d8 Jun 03 16:09:55.029586 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:55.029568 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 16:09:55.557547 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:55.557441 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-5lshz" event={"ID":"6815cf0b-66c3-4fc1-886e-7ca35a816ac3","Type":"ContainerStarted","Data":"6fc854fd9ac814c6cabc7d0c180e177a7b1d5d3689bfeca2ae1529519ec9de80"} Jun 03 16:09:55.557547 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:55.557503 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-5lshz" event={"ID":"6815cf0b-66c3-4fc1-886e-7ca35a816ac3","Type":"ContainerStarted","Data":"af8be5a70074c15daefc7d7f2e7a9e1dddd65423d858e6dfae43bb9e872ab7d8"} Jun 03 16:09:55.557745 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:55.557552 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-5lshz" Jun 03 16:09:55.584239 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:55.584147 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-5lshz" podStartSLOduration=1.58413053 podStartE2EDuration="1.58413053s" podCreationTimestamp="2026-06-03 16:09:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 16:09:55.583617339 +0000 UTC m=+1255.940612470" watchObservedRunningTime="2026-06-03 16:09:55.58413053 +0000 UTC m=+1255.941125662" Jun 03 16:09:57.047864 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:57.047830 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-c65b8dc4b-6hwfq_a2ed9416-2213-4243-97ae-995553f3e968/download-server/0.log" Jun 03 16:09:58.912485 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:58.912454 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tp8vd_2298cc45-cdd7-4fca-a51e-94a79e892855/dns/0.log" Jun 03 16:09:58.969734 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:58.969701 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tp8vd_2298cc45-cdd7-4fca-a51e-94a79e892855/kube-rbac-proxy/0.log" Jun 03 16:09:59.057703 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:59.057671 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nzf52_0bc1339f-a919-4ead-8f5f-272a36a862c2/dns-node-resolver/0.log" Jun 03 16:09:59.713642 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:59.713615 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5db8b96774-pqm6h_de836ecf-5281-488f-af12-1db87063ef15/registry/0.log" Jun 03 16:09:59.865890 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:09:59.865860 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zqg8b_af92e0dd-a3c0-4993-a37a-edd0d027a43f/node-ca/0.log" Jun 03 16:10:01.217243 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:10:01.217206 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-84m6g_1ad392d6-377c-4540-8019-57340e89db1d/discovery/0.log" Jun 03 16:10:01.571887 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:10:01.571860 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-5lshz" Jun 03 16:10:02.101197 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:10:02.101168 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8sgrl_ac827321-cac1-4344-a714-31cb7d92d0b1/serve-healthcheck-canary/0.log" Jun 03 16:10:02.793155 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:10:02.793126 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g4kt7_d302c9e0-652d-40e2-867d-932429dfc947/kube-rbac-proxy/0.log" Jun 03 16:10:02.827004 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:10:02.826974 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g4kt7_d302c9e0-652d-40e2-867d-932429dfc947/exporter/0.log" Jun 03 16:10:02.861823 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:10:02.861792 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g4kt7_d302c9e0-652d-40e2-867d-932429dfc947/extractor/0.log" Jun 03 16:10:05.652696 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:10:05.652671 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-78c4457769-qtpvq_469da770-1965-41c6-9a14-babdff64b540/nginx/0.log" Jun 03 16:10:06.068550 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:10:06.068523 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58656688f4-lcvth_58a670e0-5401-479d-99f5-5e55a8f4f280/manager/0.log" Jun 03 16:10:06.095645 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:10:06.095621 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58656688f4-lcvth_58a670e0-5401-479d-99f5-5e55a8f4f280/copy-manifests/0.log" Jun 03 16:10:07.692813 ip-10-0-141-30 kubenswrapper[2573]: I0603 16:10:07.692783 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-98789b7d5-s47jb_5339402c-6750-470c-b1c3-f2c49e7fb95b/manager/0.log"