Jun 03 00:16:45.813308 ip-10-0-130-219 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 03 00:16:45.813319 ip-10-0-130-219 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 03 00:16:45.813326 ip-10-0-130-219 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 03 00:16:45.813538 ip-10-0-130-219 systemd[1]: Failed to start Kubernetes Kubelet. Jun 03 00:16:57.085184 ip-10-0-130-219 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 03 00:16:57.085200 ip-10-0-130-219 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot d24ac87043ab47248cf200e34728c1f1 -- Jun 03 00:19:38.661018 ip-10-0-130-219 systemd[1]: Starting Kubernetes Kubelet... Jun 03 00:19:39.100432 ip-10-0-130-219 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 00:19:39.100432 ip-10-0-130-219 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 00:19:39.100432 ip-10-0-130-219 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 00:19:39.100432 ip-10-0-130-219 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 00:19:39.100432 ip-10-0-130-219 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 00:19:39.101261 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.101173 2559 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 00:19:39.105557 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105540 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 00:19:39.105557 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105556 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 00:19:39.105557 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105560 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 00:19:39.105753 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105565 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 00:19:39.105753 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105568 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 00:19:39.105753 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105571 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 00:19:39.105753 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105573 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 00:19:39.105753 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105576 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 00:19:39.105753 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105579 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 00:19:39.105753 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105582 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 00:19:39.105753 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105584 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 00:19:39.105753 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105587 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 00:19:39.105753 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105590 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 00:19:39.105753 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105592 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 03 00:19:39.105753 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105595 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 00:19:39.105753 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105598 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 00:19:39.105753 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105601 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 00:19:39.105753 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105603 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 00:19:39.105753 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105606 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 00:19:39.105753 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105609 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 00:19:39.105753 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105612 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 00:19:39.105753 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105615 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 00:19:39.106214 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105620 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 00:19:39.106214 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105624 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 00:19:39.106214 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105627 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 00:19:39.106214 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105630 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 00:19:39.106214 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105634 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 00:19:39.106214 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105638 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 00:19:39.106214 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105641 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 00:19:39.106214 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105644 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 00:19:39.106214 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105646 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 00:19:39.106214 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105649 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 00:19:39.106214 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105652 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 00:19:39.106214 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105655 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 00:19:39.106214 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105657 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 00:19:39.106214 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105660 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 00:19:39.106214 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105663 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 00:19:39.106214 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105667 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 00:19:39.106214 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105670 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 00:19:39.106214 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105673 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 00:19:39.106214 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105676 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 00:19:39.106730 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105679 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 00:19:39.106730 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105692 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 00:19:39.106730 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105695 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 00:19:39.106730 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105697 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 00:19:39.106730 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105700 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 00:19:39.106730 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105703 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 00:19:39.106730 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105706 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 00:19:39.106730 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105709 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 00:19:39.106730 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105712 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 00:19:39.106730 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105715 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 00:19:39.106730 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105718 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 00:19:39.106730 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105720 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 00:19:39.106730 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105723 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 00:19:39.106730 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105726 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 00:19:39.106730 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105729 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 00:19:39.106730 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105732 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 00:19:39.106730 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105734 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 00:19:39.106730 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105746 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 00:19:39.106730 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105749 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 00:19:39.107196 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105752 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 00:19:39.107196 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105754 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 00:19:39.107196 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105757 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 00:19:39.107196 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105760 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 00:19:39.107196 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105763 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 00:19:39.107196 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105765 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 00:19:39.107196 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105768 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 00:19:39.107196 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105772 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 00:19:39.107196 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105775 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 00:19:39.107196 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105778 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 00:19:39.107196 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105781 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 00:19:39.107196 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105783 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 00:19:39.107196 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105786 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 00:19:39.107196 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105789 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 00:19:39.107196 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105800 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 00:19:39.107196 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105802 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 00:19:39.107196 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105805 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 00:19:39.107196 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105808 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 00:19:39.107196 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105810 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 00:19:39.107196 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105813 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 00:19:39.107679 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105815 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 00:19:39.107679 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105818 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 00:19:39.107679 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105821 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 00:19:39.107679 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105824 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 00:19:39.107679 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105827 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 00:19:39.107679 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.105829 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 00:19:39.107679 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.106873 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 00:19:39.107679 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.106880 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 00:19:39.107679 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.106883 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 00:19:39.107679 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.106887 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 00:19:39.107679 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.106890 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 00:19:39.107679 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.106893 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 00:19:39.107679 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.106904 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 00:19:39.107679 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.106907 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 00:19:39.107679 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.106910 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 00:19:39.107679 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.106912 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 00:19:39.107679 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.106915 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 00:19:39.107679 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.106918 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 00:19:39.107679 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.106921 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 00:19:39.107679 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.106924 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 00:19:39.108181 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.106926 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 00:19:39.108181 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.106929 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 00:19:39.108181 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.106932 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 00:19:39.108181 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.106934 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 00:19:39.108181 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.106937 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 00:19:39.108181 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.106940 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 00:19:39.108181 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.106948 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 00:19:39.108181 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.106951 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 00:19:39.108181 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.106954 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 00:19:39.108181 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.106956 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 00:19:39.108181 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.106959 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 00:19:39.108181 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.106962 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 00:19:39.108181 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.106964 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 00:19:39.108181 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.106967 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 00:19:39.108181 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.106970 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 00:19:39.108181 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.106973 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 00:19:39.108181 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.106976 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 00:19:39.108181 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.106978 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 00:19:39.108181 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.106981 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 00:19:39.108181 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.106983 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 00:19:39.108679 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.106986 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 00:19:39.108679 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.106988 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 00:19:39.108679 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.106991 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 00:19:39.108679 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.106994 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 00:19:39.108679 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.106997 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 00:19:39.108679 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107000 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 00:19:39.108679 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107002 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 00:19:39.108679 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107005 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 00:19:39.108679 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107007 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 00:19:39.108679 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107010 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 00:19:39.108679 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107013 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 00:19:39.108679 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107016 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 00:19:39.108679 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107018 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 00:19:39.108679 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107022 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 00:19:39.108679 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107025 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 00:19:39.108679 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107027 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 00:19:39.108679 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107030 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 00:19:39.108679 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107032 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 00:19:39.108679 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107035 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 00:19:39.109159 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107043 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 00:19:39.109159 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107046 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 00:19:39.109159 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107048 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 00:19:39.109159 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107051 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 00:19:39.109159 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107054 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 00:19:39.109159 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107056 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 00:19:39.109159 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107059 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 00:19:39.109159 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107062 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 00:19:39.109159 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107064 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 00:19:39.109159 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107067 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 00:19:39.109159 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107069 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 00:19:39.109159 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107072 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 00:19:39.109159 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107075 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 00:19:39.109159 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107077 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 00:19:39.109159 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107080 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 00:19:39.109159 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107082 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 00:19:39.109159 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107085 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 03 00:19:39.109159 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107089 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 00:19:39.109159 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107092 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 00:19:39.109159 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107095 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 00:19:39.109648 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107097 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 00:19:39.109648 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107100 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 00:19:39.109648 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107103 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 00:19:39.109648 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107105 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 00:19:39.109648 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107107 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 00:19:39.109648 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107110 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 00:19:39.109648 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107112 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 00:19:39.109648 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107115 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 00:19:39.109648 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107119 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 00:19:39.109648 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107123 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 00:19:39.109648 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107127 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 00:19:39.109648 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107130 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 00:19:39.109648 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107133 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 00:19:39.109648 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107214 2559 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 00:19:39.109648 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107222 2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 00:19:39.109648 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107238 2559 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 00:19:39.109648 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107243 2559 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 00:19:39.109648 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107247 2559 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 00:19:39.109648 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107251 2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 00:19:39.109648 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107255 2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 00:19:39.110156 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107260 2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 00:19:39.110156 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107263 2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 00:19:39.110156 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107266 2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 00:19:39.110156 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107269 2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 00:19:39.110156 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107273 2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 00:19:39.110156 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107276 2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 00:19:39.110156 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107279 2559 flags.go:64] FLAG: --cgroup-root="" Jun 03 00:19:39.110156 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107282 2559 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 00:19:39.110156 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107285 2559 flags.go:64] FLAG: --client-ca-file="" Jun 03 00:19:39.110156 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107288 2559 flags.go:64] FLAG: --cloud-config="" Jun 03 00:19:39.110156 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107291 2559 flags.go:64] FLAG: --cloud-provider="external" Jun 03 00:19:39.110156 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107294 2559 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 00:19:39.110156 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107301 2559 flags.go:64] FLAG: --cluster-domain="" Jun 03 00:19:39.110156 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107304 2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 00:19:39.110156 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107307 2559 flags.go:64] FLAG: --config-dir="" Jun 03 00:19:39.110156 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107310 2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 00:19:39.110156 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107314 2559 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 00:19:39.110156 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107319 2559 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 00:19:39.110156 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107322 2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 00:19:39.110156 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107325 2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 00:19:39.110156 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107328 2559 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 00:19:39.110156 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107331 2559 flags.go:64] FLAG: --contention-profiling="false" Jun 03 00:19:39.110156 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107334 2559 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 00:19:39.110156 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107337 2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 00:19:39.110793 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107341 2559 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 00:19:39.110793 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107344 2559 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 00:19:39.110793 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107354 2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 00:19:39.110793 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107357 2559 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 00:19:39.110793 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107360 2559 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 00:19:39.110793 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107363 2559 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 00:19:39.110793 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107366 2559 flags.go:64] FLAG: --enable-server="true" Jun 03 00:19:39.110793 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107369 2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 00:19:39.110793 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107377 2559 flags.go:64] FLAG: --event-burst="100" Jun 03 00:19:39.110793 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107380 2559 flags.go:64] FLAG: --event-qps="50" Jun 03 00:19:39.110793 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107383 2559 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 00:19:39.110793 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107386 2559 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 00:19:39.110793 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107389 2559 flags.go:64] FLAG: --eviction-hard="" Jun 03 00:19:39.110793 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107393 2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 00:19:39.110793 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107396 2559 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 00:19:39.110793 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107399 2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 00:19:39.110793 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107402 2559 flags.go:64] FLAG: --eviction-soft="" Jun 03 00:19:39.110793 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107405 2559 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 00:19:39.110793 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107408 2559 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 00:19:39.110793 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107411 2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 00:19:39.110793 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107414 2559 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 00:19:39.110793 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107418 2559 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 00:19:39.110793 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107420 2559 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 00:19:39.110793 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107424 2559 flags.go:64] FLAG: --feature-gates="" Jun 03 00:19:39.110793 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107428 2559 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 00:19:39.111406 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107431 2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 00:19:39.111406 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107434 2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 00:19:39.111406 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107437 2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 00:19:39.111406 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107440 2559 flags.go:64] FLAG: --healthz-port="10248" Jun 03 00:19:39.111406 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107443 2559 flags.go:64] FLAG: --help="false" Jun 03 00:19:39.111406 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107446 2559 flags.go:64] FLAG: --hostname-override="ip-10-0-130-219.ec2.internal" Jun 03 00:19:39.111406 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107449 2559 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 00:19:39.111406 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107452 2559 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 00:19:39.111406 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107455 2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 00:19:39.111406 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107458 2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 00:19:39.111406 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107468 2559 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 00:19:39.111406 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107471 2559 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 00:19:39.111406 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107474 2559 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 00:19:39.111406 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107477 2559 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 00:19:39.111406 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107480 2559 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 00:19:39.111406 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107483 2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 00:19:39.111406 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107486 2559 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 00:19:39.111406 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107489 2559 flags.go:64] FLAG: --kube-reserved="" Jun 03 00:19:39.111406 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107492 2559 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 00:19:39.111406 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107495 2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 00:19:39.111406 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107498 2559 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 00:19:39.111406 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107500 2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 00:19:39.111406 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107503 2559 flags.go:64] FLAG: --lock-file="" Jun 03 00:19:39.111406 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107506 2559 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 00:19:39.111994 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107509 2559 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 00:19:39.111994 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107512 2559 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 00:19:39.111994 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107518 2559 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 00:19:39.111994 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107521 2559 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 00:19:39.111994 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107524 2559 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 00:19:39.111994 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107527 2559 flags.go:64] FLAG: --logging-format="text" Jun 03 00:19:39.111994 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107532 2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 00:19:39.111994 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107536 2559 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 00:19:39.111994 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107539 2559 flags.go:64] FLAG: --manifest-url="" Jun 03 00:19:39.111994 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107542 2559 flags.go:64] FLAG: --manifest-url-header="" Jun 03 00:19:39.111994 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107546 2559 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 00:19:39.111994 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107549 2559 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 00:19:39.111994 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107553 2559 flags.go:64] FLAG: --max-pods="110" Jun 03 00:19:39.111994 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107556 2559 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 00:19:39.111994 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107559 2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 00:19:39.111994 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107562 2559 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 00:19:39.111994 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107565 2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 00:19:39.111994 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107568 2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 00:19:39.111994 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107571 2559 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 00:19:39.111994 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107580 2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 00:19:39.111994 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107588 2559 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 00:19:39.111994 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107592 2559 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 00:19:39.111994 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107594 2559 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 00:19:39.111994 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107598 2559 flags.go:64] FLAG: --pod-cidr="" Jun 03 00:19:39.112613 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107601 2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 03 00:19:39.112613 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107607 2559 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 00:19:39.112613 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107610 2559 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 00:19:39.112613 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107613 2559 flags.go:64] FLAG: --pods-per-core="0" Jun 03 00:19:39.112613 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107616 2559 flags.go:64] FLAG: --port="10250" Jun 03 00:19:39.112613 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107619 2559 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 00:19:39.112613 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107622 2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f8b2a79834def7ce" Jun 03 00:19:39.112613 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107625 2559 flags.go:64] FLAG: --qos-reserved="" Jun 03 00:19:39.112613 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107628 2559 flags.go:64] FLAG: --read-only-port="10255" Jun 03 00:19:39.112613 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107635 2559 flags.go:64] FLAG: --register-node="true" Jun 03 00:19:39.112613 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107638 2559 flags.go:64] FLAG: --register-schedulable="true" Jun 03 00:19:39.112613 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107641 2559 flags.go:64] FLAG: --register-with-taints="" Jun 03 00:19:39.112613 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107644 2559 flags.go:64] FLAG: --registry-burst="10" Jun 03 00:19:39.112613 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107647 2559 flags.go:64] FLAG: --registry-qps="5" Jun 03 00:19:39.112613 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107651 2559 flags.go:64] FLAG: --reserved-cpus="" Jun 03 00:19:39.112613 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107654 2559 flags.go:64] FLAG: --reserved-memory="" Jun 03 00:19:39.112613 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107659 2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 00:19:39.112613 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107662 2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 00:19:39.112613 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107665 2559 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 00:19:39.112613 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107668 2559 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 00:19:39.112613 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107671 2559 flags.go:64] FLAG: --runonce="false" Jun 03 00:19:39.112613 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107673 2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 00:19:39.112613 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107677 2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 00:19:39.112613 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107680 2559 flags.go:64] FLAG: --seccomp-default="false" Jun 03 00:19:39.112613 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107695 2559 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 00:19:39.113239 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107698 2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 00:19:39.113239 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107702 2559 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 00:19:39.113239 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107705 2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 00:19:39.113239 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107714 2559 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 00:19:39.113239 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107718 2559 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 00:19:39.113239 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107720 2559 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 00:19:39.113239 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107724 2559 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 00:19:39.113239 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107727 2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 00:19:39.113239 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107730 2559 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 00:19:39.113239 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107732 2559 flags.go:64] FLAG: --system-cgroups="" Jun 03 00:19:39.113239 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107736 2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 00:19:39.113239 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107741 2559 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 00:19:39.113239 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107744 2559 flags.go:64] FLAG: --tls-cert-file="" Jun 03 00:19:39.113239 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107747 2559 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 00:19:39.113239 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107754 2559 flags.go:64] FLAG: --tls-min-version="" Jun 03 00:19:39.113239 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107757 2559 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 00:19:39.113239 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107762 2559 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 00:19:39.113239 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107765 2559 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 00:19:39.113239 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107768 2559 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 00:19:39.113239 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107771 2559 flags.go:64] FLAG: --v="2" Jun 03 00:19:39.113239 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107775 2559 flags.go:64] FLAG: --version="false" Jun 03 00:19:39.113239 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107783 2559 flags.go:64] FLAG: --vmodule="" Jun 03 00:19:39.113239 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107788 2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 00:19:39.113239 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.107791 2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 00:19:39.113239 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107897 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 00:19:39.113895 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107901 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 00:19:39.113895 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107905 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 00:19:39.113895 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107908 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 00:19:39.113895 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107911 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 00:19:39.113895 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107913 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 00:19:39.113895 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107916 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 00:19:39.113895 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107919 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 00:19:39.113895 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107921 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 00:19:39.113895 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107924 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 00:19:39.113895 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107927 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 00:19:39.113895 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107929 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 00:19:39.113895 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107933 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 00:19:39.113895 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107935 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 00:19:39.113895 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107938 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 00:19:39.113895 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107940 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 00:19:39.113895 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107943 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 00:19:39.113895 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107945 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 00:19:39.113895 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107948 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 00:19:39.113895 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107951 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 00:19:39.113895 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107953 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 00:19:39.114398 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107956 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 00:19:39.114398 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107959 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 00:19:39.114398 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107961 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 00:19:39.114398 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107965 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 00:19:39.114398 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107968 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 00:19:39.114398 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107971 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 00:19:39.114398 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107973 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 00:19:39.114398 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107976 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 00:19:39.114398 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107980 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 00:19:39.114398 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107983 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 00:19:39.114398 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107986 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 00:19:39.114398 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107989 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 00:19:39.114398 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107991 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 00:19:39.114398 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107994 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 00:19:39.114398 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107996 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 00:19:39.114398 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.107999 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 00:19:39.114398 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.108001 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 00:19:39.114398 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.108004 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 00:19:39.114398 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.108007 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 00:19:39.114398 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.108009 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 00:19:39.114935 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.108012 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 00:19:39.114935 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.108014 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 00:19:39.114935 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.108017 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 00:19:39.114935 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.108019 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 00:19:39.114935 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.108023 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 00:19:39.114935 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.108025 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 00:19:39.114935 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.108028 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 00:19:39.114935 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.108030 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 00:19:39.114935 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.108033 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 00:19:39.114935 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.108035 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 00:19:39.114935 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.108038 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 00:19:39.114935 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.108041 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 00:19:39.114935 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.108043 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 00:19:39.114935 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.108046 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 00:19:39.114935 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.108049 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 00:19:39.114935 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.108052 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 00:19:39.114935 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.108055 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 00:19:39.114935 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.108058 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 00:19:39.114935 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.108060 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 00:19:39.115421 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.108063 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 00:19:39.115421 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.108068 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 00:19:39.115421 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.108072 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 00:19:39.115421 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.108075 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 00:19:39.115421 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.108077 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 00:19:39.115421 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.108082 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 00:19:39.115421 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.108085 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 00:19:39.115421 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.108088 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 00:19:39.115421 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.108091 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 00:19:39.115421 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.108093 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 00:19:39.115421 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.108096 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 00:19:39.115421 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.108099 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 00:19:39.115421 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.108102 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 00:19:39.115421 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.108104 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 00:19:39.115421 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.108107 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 00:19:39.115421 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.108110 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 00:19:39.115421 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.108112 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 00:19:39.115421 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.108115 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 00:19:39.115421 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.108118 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 00:19:39.115908 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.108121 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 00:19:39.115908 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.108123 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 00:19:39.115908 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.108126 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 00:19:39.115908 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.108129 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 00:19:39.115908 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.108131 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 00:19:39.115908 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.108134 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 00:19:39.115908 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.108136 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 03 00:19:39.115908 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.110120 2559 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 00:19:39.116593 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.116475 2559 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 03 00:19:39.116623 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.116595 2559 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 00:19:39.116657 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116650 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 00:19:39.116657 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116656 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 00:19:39.116732 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116659 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 00:19:39.116732 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116663 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 00:19:39.116732 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116666 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 00:19:39.116732 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116669 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 00:19:39.116732 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116672 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 00:19:39.116732 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116675 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 00:19:39.116732 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116678 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 00:19:39.116732 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116696 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 00:19:39.116732 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116701 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 00:19:39.116732 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116706 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 00:19:39.116732 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116709 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 00:19:39.116732 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116711 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 00:19:39.116732 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116714 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 00:19:39.116732 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116717 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 00:19:39.116732 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116720 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 00:19:39.116732 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116723 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 00:19:39.116732 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116726 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 00:19:39.116732 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116729 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 00:19:39.116732 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116731 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 00:19:39.117210 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116739 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 00:19:39.117210 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116742 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 00:19:39.117210 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116745 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 00:19:39.117210 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116749 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 00:19:39.117210 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116753 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 00:19:39.117210 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116758 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 00:19:39.117210 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116761 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 00:19:39.117210 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116764 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 00:19:39.117210 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116767 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 03 00:19:39.117210 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116770 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 00:19:39.117210 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116773 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 00:19:39.117210 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116777 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 00:19:39.117210 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116779 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 00:19:39.117210 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116782 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 00:19:39.117210 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116785 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 00:19:39.117210 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116788 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 00:19:39.117210 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116791 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 00:19:39.117210 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116793 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 00:19:39.117210 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116796 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 00:19:39.117210 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116799 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 00:19:39.117711 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116801 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 00:19:39.117711 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116804 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 00:19:39.117711 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116806 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 00:19:39.117711 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116809 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 00:19:39.117711 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116811 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 00:19:39.117711 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116814 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 00:19:39.117711 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116817 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 00:19:39.117711 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116819 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 00:19:39.117711 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116822 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 00:19:39.117711 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116824 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 00:19:39.117711 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116827 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 00:19:39.117711 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116829 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 00:19:39.117711 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116832 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 00:19:39.117711 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116836 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 00:19:39.117711 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116839 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 00:19:39.117711 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116845 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 00:19:39.117711 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116848 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 00:19:39.117711 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116850 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 00:19:39.117711 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116853 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 00:19:39.117711 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116856 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 00:19:39.118225 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116858 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 00:19:39.118225 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116861 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 00:19:39.118225 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116864 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 00:19:39.118225 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116866 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 00:19:39.118225 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116869 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 00:19:39.118225 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116872 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 00:19:39.118225 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116875 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 00:19:39.118225 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116879 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 00:19:39.118225 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116882 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 00:19:39.118225 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116885 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 00:19:39.118225 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116887 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 00:19:39.118225 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116890 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 00:19:39.118225 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116893 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 00:19:39.118225 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116896 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 00:19:39.118225 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116898 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 00:19:39.118225 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116901 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 00:19:39.118225 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116904 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 00:19:39.118225 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116906 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 00:19:39.118225 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116909 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 00:19:39.118225 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116912 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 00:19:39.118738 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116914 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 00:19:39.118738 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116917 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 00:19:39.118738 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116920 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 00:19:39.118738 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116922 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 00:19:39.118738 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.116926 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 00:19:39.118738 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.116931 2559 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 00:19:39.118738 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117054 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 00:19:39.118738 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117060 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 00:19:39.118738 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117063 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 00:19:39.118738 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117066 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 00:19:39.118738 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117069 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 00:19:39.118738 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117071 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 00:19:39.118738 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117075 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 00:19:39.118738 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117080 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 00:19:39.118738 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117082 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 00:19:39.119121 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117085 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 00:19:39.119121 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117088 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 00:19:39.119121 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117092 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 00:19:39.119121 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117095 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 00:19:39.119121 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117098 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 00:19:39.119121 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117101 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 00:19:39.119121 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117103 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 00:19:39.119121 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117106 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 00:19:39.119121 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117109 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 00:19:39.119121 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117112 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 00:19:39.119121 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117114 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 00:19:39.119121 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117117 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 00:19:39.119121 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117119 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 00:19:39.119121 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117122 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 00:19:39.119121 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117124 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 00:19:39.119121 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117127 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 00:19:39.119121 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117129 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 00:19:39.119121 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117132 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 00:19:39.119121 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117134 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 00:19:39.119591 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117137 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 00:19:39.119591 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117140 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 00:19:39.119591 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117143 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 00:19:39.119591 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117146 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 00:19:39.119591 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117149 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 00:19:39.119591 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117155 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 00:19:39.119591 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117158 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 00:19:39.119591 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117161 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 00:19:39.119591 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117163 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 00:19:39.119591 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117166 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 00:19:39.119591 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117168 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 00:19:39.119591 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117171 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 00:19:39.119591 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117173 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 00:19:39.119591 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117176 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 00:19:39.119591 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117179 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 00:19:39.119591 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117181 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 00:19:39.119591 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117184 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 00:19:39.119591 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117187 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 00:19:39.119591 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117189 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 00:19:39.119591 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117192 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 00:19:39.120098 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117194 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 00:19:39.120098 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117197 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 00:19:39.120098 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117200 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 00:19:39.120098 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117203 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 00:19:39.120098 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117205 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 00:19:39.120098 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117208 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 00:19:39.120098 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117210 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 00:19:39.120098 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117213 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 00:19:39.120098 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117215 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 00:19:39.120098 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117218 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 00:19:39.120098 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117222 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 00:19:39.120098 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117224 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 00:19:39.120098 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117227 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 00:19:39.120098 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117229 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 00:19:39.120098 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117232 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 00:19:39.120098 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117235 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 00:19:39.120098 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117238 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 00:19:39.120098 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117240 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 03 00:19:39.120098 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117244 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 00:19:39.120098 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117246 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 00:19:39.120584 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117249 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 00:19:39.120584 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117251 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 00:19:39.120584 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117254 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 00:19:39.120584 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117256 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 00:19:39.120584 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117259 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 00:19:39.120584 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117261 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 00:19:39.120584 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117264 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 00:19:39.120584 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117267 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 00:19:39.120584 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117269 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 00:19:39.120584 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117272 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 00:19:39.120584 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117275 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 00:19:39.120584 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117277 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 00:19:39.120584 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117280 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 00:19:39.120584 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117282 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 00:19:39.120584 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117284 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 00:19:39.120584 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117287 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 00:19:39.120584 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117290 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 00:19:39.120584 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:39.117292 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 00:19:39.121083 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.117297 2559 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 00:19:39.121083 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.118013 2559 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 00:19:39.121083 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.120303 2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 00:19:39.121232 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.121220 2559 server.go:1019] "Starting client certificate rotation" Jun 03 00:19:39.121337 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.121320 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 00:19:39.121367 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.121353 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 00:19:39.148871 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.148848 2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 00:19:39.150998 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.150971 2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 00:19:39.168274 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.168246 2559 log.go:25] "Validated CRI v1 runtime API" Jun 03 00:19:39.174448 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.174428 2559 log.go:25] "Validated CRI v1 image API" Jun 03 00:19:39.175594 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.175578 2559 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 00:19:39.179835 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.179813 2559 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 00:19:39.180199 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.180166 2559 fs.go:135] Filesystem UUIDs: map[569cff3b-7ae2-4d2f-93a5-3c7b61b15771:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 f33036c4-1eb2-4ae2-8ec8-af2556fd643a:/dev/nvme0n1p4] Jun 03 00:19:39.180289 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.180195 2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 00:19:39.185275 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.185152 2559 manager.go:217] Machine: {Timestamp:2026-06-03 00:19:39.184633259 +0000 UTC m=+0.404555829 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3105058 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b73c1e0d877b3f9420e68c4eb9842 SystemUUID:ec2b73c1-e0d8-77b3-f942-0e68c4eb9842 BootID:d24ac870-43ab-4724-8cf2-00e34728c1f1 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:88:3d:47:08:0d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:88:3d:47:08:0d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e2:ad:e6:11:11:df Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 00:19:39.186133 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.186122 2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 00:19:39.186287 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.186272 2559 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 00:19:39.188352 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.188329 2559 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 00:19:39.188498 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.188354 2559 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-219.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 00:19:39.188547 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.188508 2559 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 00:19:39.188547 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.188517 2559 container_manager_linux.go:306] "Creating device plugin manager" Jun 03 00:19:39.188547 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.188525 2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 00:19:39.189430 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.189418 2559 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 00:19:39.190435 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.190425 2559 state_mem.go:36] "Initialized new in-memory state store" Jun 03 00:19:39.190557 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.190548 2559 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 03 00:19:39.193747 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.193735 2559 kubelet.go:491] "Attempting to sync node with API server" Jun 03 00:19:39.193801 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.193751 2559 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 00:19:39.193801 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.193764 2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 00:19:39.193801 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.193774 2559 kubelet.go:397] "Adding apiserver pod source" Jun 03 00:19:39.193801 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.193783 2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 00:19:39.194997 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.194984 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 00:19:39.195037 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.195004 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 00:19:39.197413 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.197393 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nvkxz" Jun 03 00:19:39.198139 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.198125 2559 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 03 00:19:39.202103 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.202071 2559 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 00:19:39.204600 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.204583 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 00:19:39.204663 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.204605 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 00:19:39.204663 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.204612 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 00:19:39.204663 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.204617 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 00:19:39.204663 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.204626 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 00:19:39.204663 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.204632 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 00:19:39.204663 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.204638 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 00:19:39.204663 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.204644 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 00:19:39.204663 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.204651 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 00:19:39.204663 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.204657 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 00:19:39.204663 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.204666 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 00:19:39.204985 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.204672 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 00:19:39.205994 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.205976 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nvkxz" Jun 03 00:19:39.206240 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:39.206220 2559 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 00:19:39.206290 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:39.206257 2559 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-219.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 00:19:39.206776 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.206765 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 00:19:39.206808 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.206778 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 00:19:39.209929 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.209914 2559 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 03 00:19:39.209979 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.209951 2559 server.go:1295] "Started kubelet" Jun 03 00:19:39.210044 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.210015 2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 00:19:39.210111 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.210041 2559 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 00:19:39.210157 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.210137 2559 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 03 00:19:39.210842 ip-10-0-130-219 systemd[1]: Started Kubernetes Kubelet. Jun 03 00:19:39.211676 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.211627 2559 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 00:19:39.212603 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.212587 2559 server.go:317] "Adding debug handlers to kubelet server" Jun 03 00:19:39.216889 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.216860 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 00:19:39.217353 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.217332 2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 00:19:39.217532 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.217518 2559 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 03 00:19:39.217698 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.217672 2559 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 03 00:19:39.217891 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.217879 2559 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 03 00:19:39.217981 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.217941 2559 reconstruct.go:97] "Volume reconstruction finished" Jun 03 00:19:39.217981 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.217983 2559 reconciler.go:26] "Reconciler: start to sync state" Jun 03 00:19:39.218631 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:39.218608 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-219.ec2.internal\" not found" Jun 03 00:19:39.218756 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.218740 2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 00:19:39.218816 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.218758 2559 factory.go:55] Registering systemd factory Jun 03 00:19:39.218816 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.218769 2559 factory.go:223] Registration of the systemd container factory successfully Jun 03 00:19:39.219020 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.219003 2559 factory.go:153] Registering CRI-O factory Jun 03 00:19:39.219020 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.219019 2559 factory.go:223] Registration of the crio container factory successfully Jun 03 00:19:39.219147 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.219036 2559 factory.go:103] Registering Raw factory Jun 03 00:19:39.219147 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.219055 2559 manager.go:1196] Started watching for new ooms in manager Jun 03 00:19:39.219436 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.219419 2559 manager.go:319] Starting recovery of all containers Jun 03 00:19:39.219520 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:39.219498 2559 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 00:19:39.220209 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.220191 2559 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 00:19:39.223154 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:39.223134 2559 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-130-219.ec2.internal\" not found" node="ip-10-0-130-219.ec2.internal" Jun 03 00:19:39.223747 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.223729 2559 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-130-219.ec2.internal" not found Jun 03 00:19:39.229991 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.229971 2559 manager.go:324] Recovery completed Jun 03 00:19:39.232173 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:39.232154 2559 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 03 00:19:39.235528 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.235514 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 00:19:39.237374 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.237356 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-219.ec2.internal" event="NodeHasSufficientMemory" Jun 03 00:19:39.237437 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.237387 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-219.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 00:19:39.237437 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.237397 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-219.ec2.internal" event="NodeHasSufficientPID" Jun 03 00:19:39.237966 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.237949 2559 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 00:19:39.237966 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.237962 2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 00:19:39.238066 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.237979 2559 state_mem.go:36] "Initialized new in-memory state store" Jun 03 00:19:39.240040 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.240021 2559 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-130-219.ec2.internal" not found Jun 03 00:19:39.240325 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.240314 2559 policy_none.go:49] "None policy: Start" Jun 03 00:19:39.240366 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.240331 2559 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 03 00:19:39.240366 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.240342 2559 state_mem.go:35] "Initializing new in-memory state store" Jun 03 00:19:39.287311 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.287292 2559 manager.go:341] "Starting Device Plugin manager" Jun 03 00:19:39.296264 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:39.287363 2559 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 00:19:39.296264 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.287373 2559 server.go:85] "Starting device plugin registration server" Jun 03 00:19:39.296264 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.287649 2559 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 00:19:39.296264 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.287671 2559 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 00:19:39.296264 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.287796 2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 00:19:39.296264 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.287892 2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 00:19:39.296264 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.287902 2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 00:19:39.296264 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:39.288654 2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 00:19:39.296264 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:39.288712 2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-219.ec2.internal\" not found" Jun 03 00:19:39.299696 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.299663 2559 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-130-219.ec2.internal" not found Jun 03 00:19:39.361259 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.361165 2559 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 03 00:19:39.362410 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.362397 2559 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 03 00:19:39.362519 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.362420 2559 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 03 00:19:39.362519 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.362441 2559 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 00:19:39.362519 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.362448 2559 kubelet.go:2451] "Starting kubelet main sync loop" Jun 03 00:19:39.362665 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:39.362532 2559 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 00:19:39.365183 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.365163 2559 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 00:19:39.388419 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.388395 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 00:19:39.389701 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.389671 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-219.ec2.internal" event="NodeHasSufficientMemory" Jun 03 00:19:39.389782 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.389715 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-219.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 00:19:39.389782 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.389728 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-219.ec2.internal" event="NodeHasSufficientPID" Jun 03 00:19:39.389782 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.389756 2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-219.ec2.internal" Jun 03 00:19:39.397667 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.397650 2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-219.ec2.internal" Jun 03 00:19:39.397721 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:39.397674 2559 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-219.ec2.internal\": node \"ip-10-0-130-219.ec2.internal\" not found" Jun 03 00:19:39.415005 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:39.414979 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-219.ec2.internal\" not found" Jun 03 00:19:39.462833 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.462775 2559 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-219.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-219.ec2.internal"] Jun 03 00:19:39.462987 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.462878 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 00:19:39.463943 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.463926 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-219.ec2.internal" event="NodeHasSufficientMemory" Jun 03 00:19:39.464038 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.463956 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-219.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 00:19:39.464038 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.463970 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-219.ec2.internal" event="NodeHasSufficientPID" Jun 03 00:19:39.465472 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.465460 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 00:19:39.465619 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.465604 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-219.ec2.internal" Jun 03 00:19:39.465715 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.465636 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 00:19:39.466256 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.466234 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-219.ec2.internal" event="NodeHasSufficientMemory" Jun 03 00:19:39.466351 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.466265 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-219.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 00:19:39.466351 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.466235 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-219.ec2.internal" event="NodeHasSufficientMemory" Jun 03 00:19:39.466351 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.466289 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-219.ec2.internal" event="NodeHasSufficientPID" Jun 03 00:19:39.466351 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.466302 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-219.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 00:19:39.466351 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.466323 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-219.ec2.internal" event="NodeHasSufficientPID" Jun 03 00:19:39.467529 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.467513 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-219.ec2.internal" Jun 03 00:19:39.467612 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.467545 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 00:19:39.468227 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.468209 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-219.ec2.internal" event="NodeHasSufficientMemory" Jun 03 00:19:39.468304 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.468243 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-219.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 00:19:39.468304 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.468259 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-219.ec2.internal" event="NodeHasSufficientPID" Jun 03 00:19:39.481285 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:39.481261 2559 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-219.ec2.internal\" not found" node="ip-10-0-130-219.ec2.internal" Jun 03 00:19:39.485681 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:39.485663 2559 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-219.ec2.internal\" not found" node="ip-10-0-130-219.ec2.internal" Jun 03 00:19:39.515164 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:39.515131 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-219.ec2.internal\" not found" Jun 03 00:19:39.519445 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.519425 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1be39df264fab6751b0b36bcc05d7d7f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-219.ec2.internal\" (UID: \"1be39df264fab6751b0b36bcc05d7d7f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-219.ec2.internal" Jun 03 00:19:39.519519 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.519454 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/19952b984930da1b15ba825fc7aad098-config\") pod \"kube-apiserver-proxy-ip-10-0-130-219.ec2.internal\" (UID: \"19952b984930da1b15ba825fc7aad098\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-219.ec2.internal" Jun 03 00:19:39.519519 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.519472 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1be39df264fab6751b0b36bcc05d7d7f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-219.ec2.internal\" (UID: \"1be39df264fab6751b0b36bcc05d7d7f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-219.ec2.internal" Jun 03 00:19:39.615544 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:39.615457 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-219.ec2.internal\" not found" Jun 03 00:19:39.619763 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.619748 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1be39df264fab6751b0b36bcc05d7d7f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-219.ec2.internal\" (UID: \"1be39df264fab6751b0b36bcc05d7d7f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-219.ec2.internal" Jun 03 00:19:39.619824 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.619775 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1be39df264fab6751b0b36bcc05d7d7f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-219.ec2.internal\" (UID: \"1be39df264fab6751b0b36bcc05d7d7f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-219.ec2.internal" Jun 03 00:19:39.619824 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.619799 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/19952b984930da1b15ba825fc7aad098-config\") pod \"kube-apiserver-proxy-ip-10-0-130-219.ec2.internal\" (UID: \"19952b984930da1b15ba825fc7aad098\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-219.ec2.internal" Jun 03 00:19:39.619920 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.619843 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1be39df264fab6751b0b36bcc05d7d7f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-219.ec2.internal\" (UID: \"1be39df264fab6751b0b36bcc05d7d7f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-219.ec2.internal" Jun 03 00:19:39.619920 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.619868 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1be39df264fab6751b0b36bcc05d7d7f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-219.ec2.internal\" (UID: \"1be39df264fab6751b0b36bcc05d7d7f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-219.ec2.internal" Jun 03 00:19:39.619920 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.619843 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/19952b984930da1b15ba825fc7aad098-config\") pod \"kube-apiserver-proxy-ip-10-0-130-219.ec2.internal\" (UID: \"19952b984930da1b15ba825fc7aad098\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-219.ec2.internal" Jun 03 00:19:39.716132 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:39.716085 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-219.ec2.internal\" not found" Jun 03 00:19:39.783519 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.783483 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-219.ec2.internal" Jun 03 00:19:39.790447 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:39.790429 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-219.ec2.internal" Jun 03 00:19:39.816933 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:39.816902 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-219.ec2.internal\" not found" Jun 03 00:19:39.917483 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:39.917397 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-219.ec2.internal\" not found" Jun 03 00:19:40.017881 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:40.017848 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-219.ec2.internal\" not found" Jun 03 00:19:40.118331 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:40.118283 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-219.ec2.internal\" not found" Jun 03 00:19:40.121477 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:40.121454 2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 00:19:40.121628 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:40.121612 2559 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 00:19:40.121669 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:40.121642 2559 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 00:19:40.208175 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:40.208101 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 00:14:39 +0000 UTC" deadline="2027-12-08 16:48:37.655659023 +0000 UTC" Jun 03 00:19:40.208175 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:40.208137 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13288h28m57.447525513s" Jun 03 00:19:40.217298 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:40.217271 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 00:19:40.219263 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:40.219245 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-219.ec2.internal\" not found" Jun 03 00:19:40.231464 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:40.231435 2559 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 00:19:40.250348 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:40.250321 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mgv77" Jun 03 00:19:40.256507 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:40.256488 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mgv77" Jun 03 00:19:40.320001 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:40.319967 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-219.ec2.internal\" not found" Jun 03 00:19:40.336213 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:40.336030 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19952b984930da1b15ba825fc7aad098.slice/crio-de7bb5893439b2b266d575d23985fe71fdf2e59692e767ec2e5f93956b2aeec2 WatchSource:0}: Error finding container de7bb5893439b2b266d575d23985fe71fdf2e59692e767ec2e5f93956b2aeec2: Status 404 returned error can't find the container with id de7bb5893439b2b266d575d23985fe71fdf2e59692e767ec2e5f93956b2aeec2 Jun 03 00:19:40.336456 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:40.336435 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1be39df264fab6751b0b36bcc05d7d7f.slice/crio-05fc215a41da8d43c888e6dc142d7e7c8e68f866f09b0a68bf7bfaced714c0ca WatchSource:0}: Error finding container 05fc215a41da8d43c888e6dc142d7e7c8e68f866f09b0a68bf7bfaced714c0ca: Status 404 returned error can't find the container with id 05fc215a41da8d43c888e6dc142d7e7c8e68f866f09b0a68bf7bfaced714c0ca Jun 03 00:19:40.340486 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:40.340470 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 00:19:40.365816 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:40.365766 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-219.ec2.internal" event={"ID":"1be39df264fab6751b0b36bcc05d7d7f","Type":"ContainerStarted","Data":"05fc215a41da8d43c888e6dc142d7e7c8e68f866f09b0a68bf7bfaced714c0ca"} Jun 03 00:19:40.366775 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:40.366751 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-219.ec2.internal" event={"ID":"19952b984930da1b15ba825fc7aad098","Type":"ContainerStarted","Data":"de7bb5893439b2b266d575d23985fe71fdf2e59692e767ec2e5f93956b2aeec2"} Jun 03 00:19:40.420147 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:40.420104 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-219.ec2.internal\" not found" Jun 03 00:19:40.481582 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:40.481514 2559 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 00:19:40.484503 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:40.484485 2559 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 00:19:40.518022 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:40.517997 2559 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-219.ec2.internal" Jun 03 00:19:40.527630 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:40.527604 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 00:19:40.528522 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:40.528510 2559 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-219.ec2.internal" Jun 03 00:19:40.535588 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:40.535573 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 00:19:40.938152 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:40.938124 2559 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 00:19:41.195316 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.195231 2559 apiserver.go:52] "Watching apiserver" Jun 03 00:19:41.202473 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.202439 2559 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 00:19:41.204403 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.204370 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-jwt8n","openshift-network-operator/iptables-alerter-jxzrc","kube-system/konnectivity-agent-xp7vr","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7hjt","openshift-cluster-node-tuning-operator/tuned-dl7hf","openshift-multus/multus-additional-cni-plugins-vns2z","openshift-ovn-kubernetes/ovnkube-node-t7gbw","kube-system/kube-apiserver-proxy-ip-10-0-130-219.ec2.internal","openshift-dns/node-resolver-cg2vj","openshift-image-registry/node-ca-p6rbs","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-219.ec2.internal","openshift-multus/multus-bpmj9","openshift-multus/network-metrics-daemon-h7qxw"] Jun 03 00:19:41.206244 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.206223 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.207425 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.207389 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jxzrc" Jun 03 00:19:41.208248 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.208227 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 00:19:41.208340 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.208282 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8bmbf\"" Jun 03 00:19:41.208402 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.208344 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 00:19:41.208457 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.208419 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 00:19:41.208714 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.208680 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xp7vr" Jun 03 00:19:41.209811 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.209140 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 00:19:41.209811 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.209290 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 00:19:41.209811 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.209312 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 00:19:41.209811 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.209340 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 00:19:41.209811 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.209532 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 00:19:41.209811 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.209550 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 00:19:41.209811 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.209596 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wtk9b\"" Jun 03 00:19:41.210180 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.210025 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7hjt" Jun 03 00:19:41.211065 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.210831 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 00:19:41.211065 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.210866 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fvfvl\"" Jun 03 00:19:41.211207 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.211096 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 00:19:41.212057 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.211887 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 00:19:41.212057 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.211940 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4hv6w\"" Jun 03 00:19:41.212057 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.211979 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 00:19:41.212256 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.212178 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 00:19:41.213027 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.213008 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dl7hf" Jun 03 00:19:41.214466 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.214426 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vns2z" Jun 03 00:19:41.214556 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.214519 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwt8n" Jun 03 00:19:41.214608 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:41.214584 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwt8n" podUID="0d640da7-6701-4c49-b1c4-efac1a49bea8" Jun 03 00:19:41.215083 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.215065 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 00:19:41.215172 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.215080 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-f5wsm\"" Jun 03 00:19:41.215172 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.215065 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 00:19:41.216200 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.216177 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 00:19:41.216352 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.216335 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 00:19:41.216471 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.216383 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2kcqs\"" Jun 03 00:19:41.216615 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.216598 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 00:19:41.216906 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.216884 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 00:19:41.216991 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.216923 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 00:19:41.217559 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.217532 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cg2vj" Jun 03 00:19:41.217646 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.217630 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-p6rbs" Jun 03 00:19:41.219026 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.219008 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 00:19:41.219965 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.219312 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bpmj9" Jun 03 00:19:41.219965 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.219328 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-c4gcp\"" Jun 03 00:19:41.219965 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.219449 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 00:19:41.219965 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.219537 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 00:19:41.219965 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.219602 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-cztjr\"" Jun 03 00:19:41.219965 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.219723 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 00:19:41.219965 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.219823 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 00:19:41.220889 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.220739 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h7qxw" Jun 03 00:19:41.220889 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.220753 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 00:19:41.220889 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:41.220805 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h7qxw" podUID="3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf" Jun 03 00:19:41.221156 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.221138 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-n27wc\"" Jun 03 00:19:41.227410 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.227390 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/83a1d409-7d22-41cf-9905-80f917032d5d-multus-conf-dir\") pod \"multus-bpmj9\" (UID: \"83a1d409-7d22-41cf-9905-80f917032d5d\") " pod="openshift-multus/multus-bpmj9" Jun 03 00:19:41.227494 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.227437 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkf77\" (UniqueName: \"kubernetes.io/projected/83a1d409-7d22-41cf-9905-80f917032d5d-kube-api-access-zkf77\") pod \"multus-bpmj9\" (UID: \"83a1d409-7d22-41cf-9905-80f917032d5d\") " pod="openshift-multus/multus-bpmj9" Jun 03 00:19:41.227494 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.227465 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/25936d51-9126-434b-be53-677c56a0a8f7-host-run-netns\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.227494 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.227481 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e7b6b59e-f07b-4199-ae0b-588e703fa51e-etc-tuned\") pod \"tuned-dl7hf\" (UID: \"e7b6b59e-f07b-4199-ae0b-588e703fa51e\") " pod="openshift-cluster-node-tuning-operator/tuned-dl7hf" Jun 03 00:19:41.227618 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.227504 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a8382002-46e9-42fa-b498-3d6de2fe6a85-serviceca\") pod \"node-ca-p6rbs\" (UID: \"a8382002-46e9-42fa-b498-3d6de2fe6a85\") " pod="openshift-image-registry/node-ca-p6rbs" Jun 03 00:19:41.227618 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.227528 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/83a1d409-7d22-41cf-9905-80f917032d5d-hostroot\") pod \"multus-bpmj9\" (UID: \"83a1d409-7d22-41cf-9905-80f917032d5d\") " pod="openshift-multus/multus-bpmj9" Jun 03 00:19:41.227618 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.227572 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/25936d51-9126-434b-be53-677c56a0a8f7-systemd-units\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.227618 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.227608 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/25936d51-9126-434b-be53-677c56a0a8f7-host-slash\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.227838 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.227634 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/25936d51-9126-434b-be53-677c56a0a8f7-etc-openvswitch\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.227838 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.227660 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25936d51-9126-434b-be53-677c56a0a8f7-host-run-ovn-kubernetes\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.227838 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.227703 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f05e258b-34c0-44b2-a462-e93d8c555d89-etc-selinux\") pod \"aws-ebs-csi-driver-node-j7hjt\" (UID: \"f05e258b-34c0-44b2-a462-e93d8c555d89\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7hjt" Jun 03 00:19:41.227838 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.227773 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e7b6b59e-f07b-4199-ae0b-588e703fa51e-run\") pod \"tuned-dl7hf\" (UID: \"e7b6b59e-f07b-4199-ae0b-588e703fa51e\") " pod="openshift-cluster-node-tuning-operator/tuned-dl7hf" Jun 03 00:19:41.227838 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.227797 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83a1d409-7d22-41cf-9905-80f917032d5d-etc-kubernetes\") pod \"multus-bpmj9\" (UID: \"83a1d409-7d22-41cf-9905-80f917032d5d\") " pod="openshift-multus/multus-bpmj9" Jun 03 00:19:41.228090 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.227843 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e7b6b59e-f07b-4199-ae0b-588e703fa51e-etc-sysctl-d\") pod \"tuned-dl7hf\" (UID: \"e7b6b59e-f07b-4199-ae0b-588e703fa51e\") " pod="openshift-cluster-node-tuning-operator/tuned-dl7hf" Jun 03 00:19:41.228090 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.227883 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7b6b59e-f07b-4199-ae0b-588e703fa51e-tmp\") pod \"tuned-dl7hf\" (UID: \"e7b6b59e-f07b-4199-ae0b-588e703fa51e\") " pod="openshift-cluster-node-tuning-operator/tuned-dl7hf" Jun 03 00:19:41.228090 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.227913 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wprmp\" (UniqueName: \"kubernetes.io/projected/fa442458-bc93-4944-a646-e510875818e8-kube-api-access-wprmp\") pod \"iptables-alerter-jxzrc\" (UID: \"fa442458-bc93-4944-a646-e510875818e8\") " pod="openshift-network-operator/iptables-alerter-jxzrc" Jun 03 00:19:41.228090 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.227941 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/83a1d409-7d22-41cf-9905-80f917032d5d-multus-socket-dir-parent\") pod \"multus-bpmj9\" (UID: \"83a1d409-7d22-41cf-9905-80f917032d5d\") " pod="openshift-multus/multus-bpmj9" Jun 03 00:19:41.228090 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.227965 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/83a1d409-7d22-41cf-9905-80f917032d5d-host-run-netns\") pod \"multus-bpmj9\" (UID: \"83a1d409-7d22-41cf-9905-80f917032d5d\") " pod="openshift-multus/multus-bpmj9" Jun 03 00:19:41.228090 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.227989 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/25936d51-9126-434b-be53-677c56a0a8f7-host-cni-bin\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.228090 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.228012 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e7b6b59e-f07b-4199-ae0b-588e703fa51e-lib-modules\") pod \"tuned-dl7hf\" (UID: \"e7b6b59e-f07b-4199-ae0b-588e703fa51e\") " pod="openshift-cluster-node-tuning-operator/tuned-dl7hf" Jun 03 00:19:41.228090 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.228034 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7b6b59e-f07b-4199-ae0b-588e703fa51e-var-lib-kubelet\") pod \"tuned-dl7hf\" (UID: \"e7b6b59e-f07b-4199-ae0b-588e703fa51e\") " pod="openshift-cluster-node-tuning-operator/tuned-dl7hf" Jun 03 00:19:41.228090 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.228068 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/418186d3-434f-4d2f-afbf-2ba437ececd4-system-cni-dir\") pod \"multus-additional-cni-plugins-vns2z\" (UID: \"418186d3-434f-4d2f-afbf-2ba437ececd4\") " pod="openshift-multus/multus-additional-cni-plugins-vns2z" Jun 03 00:19:41.228495 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.228098 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/418186d3-434f-4d2f-afbf-2ba437ececd4-os-release\") pod \"multus-additional-cni-plugins-vns2z\" (UID: \"418186d3-434f-4d2f-afbf-2ba437ececd4\") " pod="openshift-multus/multus-additional-cni-plugins-vns2z" Jun 03 00:19:41.228495 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.228135 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/418186d3-434f-4d2f-afbf-2ba437ececd4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vns2z\" (UID: \"418186d3-434f-4d2f-afbf-2ba437ececd4\") " pod="openshift-multus/multus-additional-cni-plugins-vns2z" Jun 03 00:19:41.228495 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.228177 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdm84\" (UniqueName: \"kubernetes.io/projected/fc278c33-3725-483e-971f-7465ef42f509-kube-api-access-sdm84\") pod \"node-resolver-cg2vj\" (UID: \"fc278c33-3725-483e-971f-7465ef42f509\") " pod="openshift-dns/node-resolver-cg2vj" Jun 03 00:19:41.228495 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.228211 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/83a1d409-7d22-41cf-9905-80f917032d5d-multus-cni-dir\") pod \"multus-bpmj9\" (UID: \"83a1d409-7d22-41cf-9905-80f917032d5d\") " pod="openshift-multus/multus-bpmj9" Jun 03 00:19:41.228495 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.228244 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a8382002-46e9-42fa-b498-3d6de2fe6a85-host\") pod \"node-ca-p6rbs\" (UID: \"a8382002-46e9-42fa-b498-3d6de2fe6a85\") " pod="openshift-image-registry/node-ca-p6rbs" Jun 03 00:19:41.228495 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.228278 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/418186d3-434f-4d2f-afbf-2ba437ececd4-cni-binary-copy\") pod \"multus-additional-cni-plugins-vns2z\" (UID: \"418186d3-434f-4d2f-afbf-2ba437ececd4\") " pod="openshift-multus/multus-additional-cni-plugins-vns2z" Jun 03 00:19:41.228495 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.228302 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/83a1d409-7d22-41cf-9905-80f917032d5d-cnibin\") pod \"multus-bpmj9\" (UID: \"83a1d409-7d22-41cf-9905-80f917032d5d\") " pod="openshift-multus/multus-bpmj9" Jun 03 00:19:41.228495 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.228325 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/83a1d409-7d22-41cf-9905-80f917032d5d-host-run-k8s-cni-cncf-io\") pod \"multus-bpmj9\" (UID: \"83a1d409-7d22-41cf-9905-80f917032d5d\") " pod="openshift-multus/multus-bpmj9" Jun 03 00:19:41.228495 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.228353 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/83a1d409-7d22-41cf-9905-80f917032d5d-host-var-lib-kubelet\") pod \"multus-bpmj9\" (UID: \"83a1d409-7d22-41cf-9905-80f917032d5d\") " pod="openshift-multus/multus-bpmj9" Jun 03 00:19:41.228495 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.228386 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls5nc\" (UniqueName: \"kubernetes.io/projected/a8382002-46e9-42fa-b498-3d6de2fe6a85-kube-api-access-ls5nc\") pod \"node-ca-p6rbs\" (UID: \"a8382002-46e9-42fa-b498-3d6de2fe6a85\") " pod="openshift-image-registry/node-ca-p6rbs" Jun 03 00:19:41.228495 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.228417 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/83a1d409-7d22-41cf-9905-80f917032d5d-cni-binary-copy\") pod \"multus-bpmj9\" (UID: \"83a1d409-7d22-41cf-9905-80f917032d5d\") " pod="openshift-multus/multus-bpmj9" Jun 03 00:19:41.228495 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.228443 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/25936d51-9126-434b-be53-677c56a0a8f7-node-log\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.228495 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.228465 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/25936d51-9126-434b-be53-677c56a0a8f7-env-overrides\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.228495 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.228489 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f05e258b-34c0-44b2-a462-e93d8c555d89-registration-dir\") pod \"aws-ebs-csi-driver-node-j7hjt\" (UID: \"f05e258b-34c0-44b2-a462-e93d8c555d89\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7hjt" Jun 03 00:19:41.229144 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.228511 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc278c33-3725-483e-971f-7465ef42f509-tmp-dir\") pod \"node-resolver-cg2vj\" (UID: \"fc278c33-3725-483e-971f-7465ef42f509\") " pod="openshift-dns/node-resolver-cg2vj" Jun 03 00:19:41.229144 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.228536 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/83a1d409-7d22-41cf-9905-80f917032d5d-host-var-lib-cni-multus\") pod \"multus-bpmj9\" (UID: \"83a1d409-7d22-41cf-9905-80f917032d5d\") " pod="openshift-multus/multus-bpmj9" Jun 03 00:19:41.229144 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.228567 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/25936d51-9126-434b-be53-677c56a0a8f7-host-cni-netd\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.229144 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.228590 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bb2zx\" (UniqueName: \"kubernetes.io/projected/25936d51-9126-434b-be53-677c56a0a8f7-kube-api-access-bb2zx\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.229144 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.228611 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f05e258b-34c0-44b2-a462-e93d8c555d89-device-dir\") pod \"aws-ebs-csi-driver-node-j7hjt\" (UID: \"f05e258b-34c0-44b2-a462-e93d8c555d89\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7hjt" Jun 03 00:19:41.229144 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.228633 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f05e258b-34c0-44b2-a462-e93d8c555d89-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j7hjt\" (UID: \"f05e258b-34c0-44b2-a462-e93d8c555d89\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7hjt" Jun 03 00:19:41.229144 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.228655 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e7b6b59e-f07b-4199-ae0b-588e703fa51e-etc-modprobe-d\") pod \"tuned-dl7hf\" (UID: \"e7b6b59e-f07b-4199-ae0b-588e703fa51e\") " pod="openshift-cluster-node-tuning-operator/tuned-dl7hf" Jun 03 00:19:41.229144 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.228679 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99qnm\" (UniqueName: \"kubernetes.io/projected/e7b6b59e-f07b-4199-ae0b-588e703fa51e-kube-api-access-99qnm\") pod \"tuned-dl7hf\" (UID: \"e7b6b59e-f07b-4199-ae0b-588e703fa51e\") " pod="openshift-cluster-node-tuning-operator/tuned-dl7hf" Jun 03 00:19:41.229144 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.228726 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/83a1d409-7d22-41cf-9905-80f917032d5d-multus-daemon-config\") pod \"multus-bpmj9\" (UID: \"83a1d409-7d22-41cf-9905-80f917032d5d\") " pod="openshift-multus/multus-bpmj9" Jun 03 00:19:41.229144 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.228765 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/25936d51-9126-434b-be53-677c56a0a8f7-run-ovn\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.229144 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.228788 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/25936d51-9126-434b-be53-677c56a0a8f7-log-socket\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.229668 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.229638 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/25936d51-9126-434b-be53-677c56a0a8f7-ovnkube-config\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.229743 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.229703 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/83a1d409-7d22-41cf-9905-80f917032d5d-os-release\") pod \"multus-bpmj9\" (UID: \"83a1d409-7d22-41cf-9905-80f917032d5d\") " pod="openshift-multus/multus-bpmj9" Jun 03 00:19:41.229743 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.229732 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f05e258b-34c0-44b2-a462-e93d8c555d89-socket-dir\") pod \"aws-ebs-csi-driver-node-j7hjt\" (UID: \"f05e258b-34c0-44b2-a462-e93d8c555d89\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7hjt" Jun 03 00:19:41.229839 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.229752 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/83a1d409-7d22-41cf-9905-80f917032d5d-system-cni-dir\") pod \"multus-bpmj9\" (UID: \"83a1d409-7d22-41cf-9905-80f917032d5d\") " pod="openshift-multus/multus-bpmj9" Jun 03 00:19:41.229839 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.229771 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/83a1d409-7d22-41cf-9905-80f917032d5d-host-var-lib-cni-bin\") pod \"multus-bpmj9\" (UID: \"83a1d409-7d22-41cf-9905-80f917032d5d\") " pod="openshift-multus/multus-bpmj9" Jun 03 00:19:41.229839 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.229798 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/25936d51-9126-434b-be53-677c56a0a8f7-run-systemd\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.229839 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.229823 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25936d51-9126-434b-be53-677c56a0a8f7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.229962 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.229856 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/25936d51-9126-434b-be53-677c56a0a8f7-ovnkube-script-lib\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.229962 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.229889 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n48tk\" (UniqueName: \"kubernetes.io/projected/f05e258b-34c0-44b2-a462-e93d8c555d89-kube-api-access-n48tk\") pod \"aws-ebs-csi-driver-node-j7hjt\" (UID: \"f05e258b-34c0-44b2-a462-e93d8c555d89\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7hjt" Jun 03 00:19:41.230095 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.230083 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e7b6b59e-f07b-4199-ae0b-588e703fa51e-host\") pod \"tuned-dl7hf\" (UID: \"e7b6b59e-f07b-4199-ae0b-588e703fa51e\") " pod="openshift-cluster-node-tuning-operator/tuned-dl7hf" Jun 03 00:19:41.230129 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.230108 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fa442458-bc93-4944-a646-e510875818e8-host-slash\") pod \"iptables-alerter-jxzrc\" (UID: \"fa442458-bc93-4944-a646-e510875818e8\") " pod="openshift-network-operator/iptables-alerter-jxzrc" Jun 03 00:19:41.230129 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.230124 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/83a1d409-7d22-41cf-9905-80f917032d5d-host-run-multus-certs\") pod \"multus-bpmj9\" (UID: \"83a1d409-7d22-41cf-9905-80f917032d5d\") " pod="openshift-multus/multus-bpmj9" Jun 03 00:19:41.230186 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.230142 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/25936d51-9126-434b-be53-677c56a0a8f7-run-openvswitch\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.230186 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.230161 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f05e258b-34c0-44b2-a462-e93d8c555d89-sys-fs\") pod \"aws-ebs-csi-driver-node-j7hjt\" (UID: \"f05e258b-34c0-44b2-a462-e93d8c555d89\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7hjt" Jun 03 00:19:41.230186 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.230178 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e7b6b59e-f07b-4199-ae0b-588e703fa51e-etc-sysconfig\") pod \"tuned-dl7hf\" (UID: \"e7b6b59e-f07b-4199-ae0b-588e703fa51e\") " pod="openshift-cluster-node-tuning-operator/tuned-dl7hf" Jun 03 00:19:41.230303 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.230204 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7b6b59e-f07b-4199-ae0b-588e703fa51e-etc-kubernetes\") pod \"tuned-dl7hf\" (UID: \"e7b6b59e-f07b-4199-ae0b-588e703fa51e\") " pod="openshift-cluster-node-tuning-operator/tuned-dl7hf" Jun 03 00:19:41.230303 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.230224 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f834652a-ce69-4c9d-ac77-548eeb90a911-konnectivity-ca\") pod \"konnectivity-agent-xp7vr\" (UID: \"f834652a-ce69-4c9d-ac77-548eeb90a911\") " pod="kube-system/konnectivity-agent-xp7vr" Jun 03 00:19:41.230303 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.230256 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/418186d3-434f-4d2f-afbf-2ba437ececd4-cnibin\") pod \"multus-additional-cni-plugins-vns2z\" (UID: \"418186d3-434f-4d2f-afbf-2ba437ececd4\") " pod="openshift-multus/multus-additional-cni-plugins-vns2z" Jun 03 00:19:41.230303 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.230298 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/418186d3-434f-4d2f-afbf-2ba437ececd4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vns2z\" (UID: \"418186d3-434f-4d2f-afbf-2ba437ececd4\") " pod="openshift-multus/multus-additional-cni-plugins-vns2z" Jun 03 00:19:41.230460 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.230332 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54n7j\" (UniqueName: \"kubernetes.io/projected/0d640da7-6701-4c49-b1c4-efac1a49bea8-kube-api-access-54n7j\") pod \"network-check-target-jwt8n\" (UID: \"0d640da7-6701-4c49-b1c4-efac1a49bea8\") " pod="openshift-network-diagnostics/network-check-target-jwt8n" Jun 03 00:19:41.230460 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.230363 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/25936d51-9126-434b-be53-677c56a0a8f7-var-lib-openvswitch\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.230460 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.230387 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/25936d51-9126-434b-be53-677c56a0a8f7-ovn-node-metrics-cert\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.230460 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.230418 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e7b6b59e-f07b-4199-ae0b-588e703fa51e-etc-sysctl-conf\") pod \"tuned-dl7hf\" (UID: \"e7b6b59e-f07b-4199-ae0b-588e703fa51e\") " pod="openshift-cluster-node-tuning-operator/tuned-dl7hf" Jun 03 00:19:41.230460 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.230435 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e7b6b59e-f07b-4199-ae0b-588e703fa51e-etc-systemd\") pod \"tuned-dl7hf\" (UID: \"e7b6b59e-f07b-4199-ae0b-588e703fa51e\") " pod="openshift-cluster-node-tuning-operator/tuned-dl7hf" Jun 03 00:19:41.230702 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.230483 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fc278c33-3725-483e-971f-7465ef42f509-hosts-file\") pod \"node-resolver-cg2vj\" (UID: \"fc278c33-3725-483e-971f-7465ef42f509\") " pod="openshift-dns/node-resolver-cg2vj" Jun 03 00:19:41.230702 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.230531 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/25936d51-9126-434b-be53-677c56a0a8f7-host-kubelet\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.230702 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.230567 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e7b6b59e-f07b-4199-ae0b-588e703fa51e-sys\") pod \"tuned-dl7hf\" (UID: \"e7b6b59e-f07b-4199-ae0b-588e703fa51e\") " pod="openshift-cluster-node-tuning-operator/tuned-dl7hf" Jun 03 00:19:41.230702 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.230601 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fa442458-bc93-4944-a646-e510875818e8-iptables-alerter-script\") pod \"iptables-alerter-jxzrc\" (UID: \"fa442458-bc93-4944-a646-e510875818e8\") " pod="openshift-network-operator/iptables-alerter-jxzrc" Jun 03 00:19:41.230702 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.230630 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f834652a-ce69-4c9d-ac77-548eeb90a911-agent-certs\") pod \"konnectivity-agent-xp7vr\" (UID: \"f834652a-ce69-4c9d-ac77-548eeb90a911\") " pod="kube-system/konnectivity-agent-xp7vr" Jun 03 00:19:41.230928 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.230697 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/418186d3-434f-4d2f-afbf-2ba437ececd4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vns2z\" (UID: \"418186d3-434f-4d2f-afbf-2ba437ececd4\") " pod="openshift-multus/multus-additional-cni-plugins-vns2z" Jun 03 00:19:41.231296 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.230747 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mndx\" (UniqueName: \"kubernetes.io/projected/418186d3-434f-4d2f-afbf-2ba437ececd4-kube-api-access-6mndx\") pod \"multus-additional-cni-plugins-vns2z\" (UID: \"418186d3-434f-4d2f-afbf-2ba437ececd4\") " pod="openshift-multus/multus-additional-cni-plugins-vns2z" Jun 03 00:19:41.257445 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.257412 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 00:14:40 +0000 UTC" deadline="2028-03-10 23:09:37.502946488 +0000 UTC" Jun 03 00:19:41.257445 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.257444 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15526h49m56.245505897s" Jun 03 00:19:41.319116 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.319080 2559 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 03 00:19:41.331694 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.331658 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/25936d51-9126-434b-be53-677c56a0a8f7-systemd-units\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.331891 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.331714 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/25936d51-9126-434b-be53-677c56a0a8f7-host-slash\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.331891 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.331742 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/25936d51-9126-434b-be53-677c56a0a8f7-etc-openvswitch\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.331891 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.331770 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25936d51-9126-434b-be53-677c56a0a8f7-host-run-ovn-kubernetes\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.331891 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.331783 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/25936d51-9126-434b-be53-677c56a0a8f7-systemd-units\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.331891 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.331795 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f05e258b-34c0-44b2-a462-e93d8c555d89-etc-selinux\") pod \"aws-ebs-csi-driver-node-j7hjt\" (UID: \"f05e258b-34c0-44b2-a462-e93d8c555d89\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7hjt" Jun 03 00:19:41.331891 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.331802 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/25936d51-9126-434b-be53-677c56a0a8f7-etc-openvswitch\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.331891 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.331819 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e7b6b59e-f07b-4199-ae0b-588e703fa51e-run\") pod \"tuned-dl7hf\" (UID: \"e7b6b59e-f07b-4199-ae0b-588e703fa51e\") " pod="openshift-cluster-node-tuning-operator/tuned-dl7hf" Jun 03 00:19:41.331891 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.331842 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25936d51-9126-434b-be53-677c56a0a8f7-host-run-ovn-kubernetes\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.331891 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.331845 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83a1d409-7d22-41cf-9905-80f917032d5d-etc-kubernetes\") pod \"multus-bpmj9\" (UID: \"83a1d409-7d22-41cf-9905-80f917032d5d\") " pod="openshift-multus/multus-bpmj9" Jun 03 00:19:41.331891 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.331882 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f05e258b-34c0-44b2-a462-e93d8c555d89-etc-selinux\") pod \"aws-ebs-csi-driver-node-j7hjt\" (UID: \"f05e258b-34c0-44b2-a462-e93d8c555d89\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7hjt" Jun 03 00:19:41.331891 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.331888 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83a1d409-7d22-41cf-9905-80f917032d5d-etc-kubernetes\") pod \"multus-bpmj9\" (UID: \"83a1d409-7d22-41cf-9905-80f917032d5d\") " pod="openshift-multus/multus-bpmj9" Jun 03 00:19:41.332426 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.331801 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/25936d51-9126-434b-be53-677c56a0a8f7-host-slash\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.332426 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.331898 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e7b6b59e-f07b-4199-ae0b-588e703fa51e-run\") pod \"tuned-dl7hf\" (UID: \"e7b6b59e-f07b-4199-ae0b-588e703fa51e\") " pod="openshift-cluster-node-tuning-operator/tuned-dl7hf" Jun 03 00:19:41.332426 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.331909 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e7b6b59e-f07b-4199-ae0b-588e703fa51e-etc-sysctl-d\") pod \"tuned-dl7hf\" (UID: \"e7b6b59e-f07b-4199-ae0b-588e703fa51e\") " pod="openshift-cluster-node-tuning-operator/tuned-dl7hf" Jun 03 00:19:41.332426 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.331954 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7b6b59e-f07b-4199-ae0b-588e703fa51e-tmp\") pod \"tuned-dl7hf\" (UID: \"e7b6b59e-f07b-4199-ae0b-588e703fa51e\") " pod="openshift-cluster-node-tuning-operator/tuned-dl7hf" Jun 03 00:19:41.332426 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.331980 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wprmp\" (UniqueName: \"kubernetes.io/projected/fa442458-bc93-4944-a646-e510875818e8-kube-api-access-wprmp\") pod \"iptables-alerter-jxzrc\" (UID: \"fa442458-bc93-4944-a646-e510875818e8\") " pod="openshift-network-operator/iptables-alerter-jxzrc" Jun 03 00:19:41.332426 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.332004 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/83a1d409-7d22-41cf-9905-80f917032d5d-multus-socket-dir-parent\") pod \"multus-bpmj9\" (UID: \"83a1d409-7d22-41cf-9905-80f917032d5d\") " pod="openshift-multus/multus-bpmj9" Jun 03 00:19:41.332426 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.332022 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/83a1d409-7d22-41cf-9905-80f917032d5d-host-run-netns\") pod \"multus-bpmj9\" (UID: \"83a1d409-7d22-41cf-9905-80f917032d5d\") " pod="openshift-multus/multus-bpmj9" Jun 03 00:19:41.332426 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.332030 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e7b6b59e-f07b-4199-ae0b-588e703fa51e-etc-sysctl-d\") pod \"tuned-dl7hf\" (UID: \"e7b6b59e-f07b-4199-ae0b-588e703fa51e\") " pod="openshift-cluster-node-tuning-operator/tuned-dl7hf" Jun 03 00:19:41.332426 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.332048 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/25936d51-9126-434b-be53-677c56a0a8f7-host-cni-bin\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.332426 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.332071 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e7b6b59e-f07b-4199-ae0b-588e703fa51e-lib-modules\") pod \"tuned-dl7hf\" (UID: \"e7b6b59e-f07b-4199-ae0b-588e703fa51e\") " pod="openshift-cluster-node-tuning-operator/tuned-dl7hf" Jun 03 00:19:41.332426 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.332071 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/83a1d409-7d22-41cf-9905-80f917032d5d-host-run-netns\") pod \"multus-bpmj9\" (UID: \"83a1d409-7d22-41cf-9905-80f917032d5d\") " pod="openshift-multus/multus-bpmj9" Jun 03 00:19:41.332426 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.332096 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/83a1d409-7d22-41cf-9905-80f917032d5d-multus-socket-dir-parent\") pod \"multus-bpmj9\" (UID: \"83a1d409-7d22-41cf-9905-80f917032d5d\") " pod="openshift-multus/multus-bpmj9" Jun 03 00:19:41.332426 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.332108 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7b6b59e-f07b-4199-ae0b-588e703fa51e-var-lib-kubelet\") pod \"tuned-dl7hf\" (UID: \"e7b6b59e-f07b-4199-ae0b-588e703fa51e\") " pod="openshift-cluster-node-tuning-operator/tuned-dl7hf" Jun 03 00:19:41.332426 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.332110 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/25936d51-9126-434b-be53-677c56a0a8f7-host-cni-bin\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.332426 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.332142 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/418186d3-434f-4d2f-afbf-2ba437ececd4-system-cni-dir\") pod \"multus-additional-cni-plugins-vns2z\" (UID: \"418186d3-434f-4d2f-afbf-2ba437ececd4\") " pod="openshift-multus/multus-additional-cni-plugins-vns2z" Jun 03 00:19:41.332426 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.332167 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e7b6b59e-f07b-4199-ae0b-588e703fa51e-lib-modules\") pod \"tuned-dl7hf\" (UID: \"e7b6b59e-f07b-4199-ae0b-588e703fa51e\") " pod="openshift-cluster-node-tuning-operator/tuned-dl7hf" Jun 03 00:19:41.332426 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.332170 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/418186d3-434f-4d2f-afbf-2ba437ececd4-os-release\") pod \"multus-additional-cni-plugins-vns2z\" (UID: \"418186d3-434f-4d2f-afbf-2ba437ececd4\") " pod="openshift-multus/multus-additional-cni-plugins-vns2z" Jun 03 00:19:41.332426 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.332191 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/418186d3-434f-4d2f-afbf-2ba437ececd4-system-cni-dir\") pod \"multus-additional-cni-plugins-vns2z\" (UID: \"418186d3-434f-4d2f-afbf-2ba437ececd4\") " pod="openshift-multus/multus-additional-cni-plugins-vns2z" Jun 03 00:19:41.333124 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.332230 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/418186d3-434f-4d2f-afbf-2ba437ececd4-os-release\") pod \"multus-additional-cni-plugins-vns2z\" (UID: \"418186d3-434f-4d2f-afbf-2ba437ececd4\") " pod="openshift-multus/multus-additional-cni-plugins-vns2z" Jun 03 00:19:41.333124 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.332234 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/418186d3-434f-4d2f-afbf-2ba437ececd4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vns2z\" (UID: \"418186d3-434f-4d2f-afbf-2ba437ececd4\") " pod="openshift-multus/multus-additional-cni-plugins-vns2z" Jun 03 00:19:41.333124 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.332261 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sdm84\" (UniqueName: \"kubernetes.io/projected/fc278c33-3725-483e-971f-7465ef42f509-kube-api-access-sdm84\") pod \"node-resolver-cg2vj\" (UID: \"fc278c33-3725-483e-971f-7465ef42f509\") " pod="openshift-dns/node-resolver-cg2vj" Jun 03 00:19:41.333124 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.332278 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/83a1d409-7d22-41cf-9905-80f917032d5d-multus-cni-dir\") pod \"multus-bpmj9\" (UID: \"83a1d409-7d22-41cf-9905-80f917032d5d\") " pod="openshift-multus/multus-bpmj9" Jun 03 00:19:41.333124 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.332301 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7b6b59e-f07b-4199-ae0b-588e703fa51e-var-lib-kubelet\") pod \"tuned-dl7hf\" (UID: \"e7b6b59e-f07b-4199-ae0b-588e703fa51e\") " pod="openshift-cluster-node-tuning-operator/tuned-dl7hf" Jun 03 00:19:41.333124 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.332339 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a8382002-46e9-42fa-b498-3d6de2fe6a85-host\") pod \"node-ca-p6rbs\" (UID: \"a8382002-46e9-42fa-b498-3d6de2fe6a85\") " pod="openshift-image-registry/node-ca-p6rbs" Jun 03 00:19:41.333124 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.332355 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/83a1d409-7d22-41cf-9905-80f917032d5d-multus-cni-dir\") pod \"multus-bpmj9\" (UID: \"83a1d409-7d22-41cf-9905-80f917032d5d\") " pod="openshift-multus/multus-bpmj9" Jun 03 00:19:41.333124 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.332367 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/418186d3-434f-4d2f-afbf-2ba437ececd4-cni-binary-copy\") pod \"multus-additional-cni-plugins-vns2z\" (UID: \"418186d3-434f-4d2f-afbf-2ba437ececd4\") " pod="openshift-multus/multus-additional-cni-plugins-vns2z" Jun 03 00:19:41.333124 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.332388 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/83a1d409-7d22-41cf-9905-80f917032d5d-cnibin\") pod \"multus-bpmj9\" (UID: \"83a1d409-7d22-41cf-9905-80f917032d5d\") " pod="openshift-multus/multus-bpmj9" Jun 03 00:19:41.333124 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.332395 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a8382002-46e9-42fa-b498-3d6de2fe6a85-host\") pod \"node-ca-p6rbs\" (UID: \"a8382002-46e9-42fa-b498-3d6de2fe6a85\") " pod="openshift-image-registry/node-ca-p6rbs" Jun 03 00:19:41.333124 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.332408 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/83a1d409-7d22-41cf-9905-80f917032d5d-host-run-k8s-cni-cncf-io\") pod \"multus-bpmj9\" (UID: \"83a1d409-7d22-41cf-9905-80f917032d5d\") " pod="openshift-multus/multus-bpmj9" Jun 03 00:19:41.333124 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.332430 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/83a1d409-7d22-41cf-9905-80f917032d5d-host-var-lib-kubelet\") pod \"multus-bpmj9\" (UID: \"83a1d409-7d22-41cf-9905-80f917032d5d\") " pod="openshift-multus/multus-bpmj9" Jun 03 00:19:41.333124 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.332442 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/418186d3-434f-4d2f-afbf-2ba437ececd4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vns2z\" (UID: \"418186d3-434f-4d2f-afbf-2ba437ececd4\") " pod="openshift-multus/multus-additional-cni-plugins-vns2z" Jun 03 00:19:41.333124 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.332444 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/83a1d409-7d22-41cf-9905-80f917032d5d-cnibin\") pod \"multus-bpmj9\" (UID: \"83a1d409-7d22-41cf-9905-80f917032d5d\") " pod="openshift-multus/multus-bpmj9" Jun 03 00:19:41.333124 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.332453 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ls5nc\" (UniqueName: \"kubernetes.io/projected/a8382002-46e9-42fa-b498-3d6de2fe6a85-kube-api-access-ls5nc\") pod \"node-ca-p6rbs\" (UID: \"a8382002-46e9-42fa-b498-3d6de2fe6a85\") " pod="openshift-image-registry/node-ca-p6rbs" Jun 03 00:19:41.333124 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.332475 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/83a1d409-7d22-41cf-9905-80f917032d5d-host-run-k8s-cni-cncf-io\") pod \"multus-bpmj9\" (UID: \"83a1d409-7d22-41cf-9905-80f917032d5d\") " pod="openshift-multus/multus-bpmj9" Jun 03 00:19:41.333124 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.332496 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/83a1d409-7d22-41cf-9905-80f917032d5d-host-var-lib-kubelet\") pod \"multus-bpmj9\" (UID: \"83a1d409-7d22-41cf-9905-80f917032d5d\") " pod="openshift-multus/multus-bpmj9" Jun 03 00:19:41.333124 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.332577 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/83a1d409-7d22-41cf-9905-80f917032d5d-cni-binary-copy\") pod \"multus-bpmj9\" (UID: \"83a1d409-7d22-41cf-9905-80f917032d5d\") " pod="openshift-multus/multus-bpmj9" Jun 03 00:19:41.333856 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.332605 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/25936d51-9126-434b-be53-677c56a0a8f7-node-log\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.333856 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.332628 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/25936d51-9126-434b-be53-677c56a0a8f7-env-overrides\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.333856 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.332653 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f05e258b-34c0-44b2-a462-e93d8c555d89-registration-dir\") pod \"aws-ebs-csi-driver-node-j7hjt\" (UID: \"f05e258b-34c0-44b2-a462-e93d8c555d89\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7hjt" Jun 03 00:19:41.333856 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.332671 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/25936d51-9126-434b-be53-677c56a0a8f7-node-log\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.333856 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.332680 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc278c33-3725-483e-971f-7465ef42f509-tmp-dir\") pod \"node-resolver-cg2vj\" (UID: \"fc278c33-3725-483e-971f-7465ef42f509\") " pod="openshift-dns/node-resolver-cg2vj" Jun 03 00:19:41.333856 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.332723 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/83a1d409-7d22-41cf-9905-80f917032d5d-host-var-lib-cni-multus\") pod \"multus-bpmj9\" (UID: \"83a1d409-7d22-41cf-9905-80f917032d5d\") " pod="openshift-multus/multus-bpmj9" Jun 03 00:19:41.333856 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.332742 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f05e258b-34c0-44b2-a462-e93d8c555d89-registration-dir\") pod \"aws-ebs-csi-driver-node-j7hjt\" (UID: \"f05e258b-34c0-44b2-a462-e93d8c555d89\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7hjt" Jun 03 00:19:41.333856 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.332748 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/25936d51-9126-434b-be53-677c56a0a8f7-host-cni-netd\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.333856 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.332746 2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 00:19:41.333856 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.332874 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/83a1d409-7d22-41cf-9905-80f917032d5d-host-var-lib-cni-multus\") pod \"multus-bpmj9\" (UID: \"83a1d409-7d22-41cf-9905-80f917032d5d\") " pod="openshift-multus/multus-bpmj9" Jun 03 00:19:41.333856 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.332918 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/25936d51-9126-434b-be53-677c56a0a8f7-host-cni-netd\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.333856 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.332962 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bb2zx\" (UniqueName: \"kubernetes.io/projected/25936d51-9126-434b-be53-677c56a0a8f7-kube-api-access-bb2zx\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.333856 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.333014 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f05e258b-34c0-44b2-a462-e93d8c555d89-device-dir\") pod \"aws-ebs-csi-driver-node-j7hjt\" (UID: \"f05e258b-34c0-44b2-a462-e93d8c555d89\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7hjt" Jun 03 00:19:41.333856 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.332993 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/418186d3-434f-4d2f-afbf-2ba437ececd4-cni-binary-copy\") pod \"multus-additional-cni-plugins-vns2z\" (UID: \"418186d3-434f-4d2f-afbf-2ba437ececd4\") " pod="openshift-multus/multus-additional-cni-plugins-vns2z" Jun 03 00:19:41.333856 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.333040 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f05e258b-34c0-44b2-a462-e93d8c555d89-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j7hjt\" (UID: \"f05e258b-34c0-44b2-a462-e93d8c555d89\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7hjt" Jun 03 00:19:41.333856 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.333060 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc278c33-3725-483e-971f-7465ef42f509-tmp-dir\") pod \"node-resolver-cg2vj\" (UID: \"fc278c33-3725-483e-971f-7465ef42f509\") " pod="openshift-dns/node-resolver-cg2vj" Jun 03 00:19:41.333856 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.333066 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e7b6b59e-f07b-4199-ae0b-588e703fa51e-etc-modprobe-d\") pod \"tuned-dl7hf\" (UID: \"e7b6b59e-f07b-4199-ae0b-588e703fa51e\") " pod="openshift-cluster-node-tuning-operator/tuned-dl7hf" Jun 03 00:19:41.333856 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.333090 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-99qnm\" (UniqueName: \"kubernetes.io/projected/e7b6b59e-f07b-4199-ae0b-588e703fa51e-kube-api-access-99qnm\") pod \"tuned-dl7hf\" (UID: \"e7b6b59e-f07b-4199-ae0b-588e703fa51e\") " pod="openshift-cluster-node-tuning-operator/tuned-dl7hf" Jun 03 00:19:41.334553 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.333126 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f05e258b-34c0-44b2-a462-e93d8c555d89-device-dir\") pod \"aws-ebs-csi-driver-node-j7hjt\" (UID: \"f05e258b-34c0-44b2-a462-e93d8c555d89\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7hjt" Jun 03 00:19:41.334553 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.333171 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f05e258b-34c0-44b2-a462-e93d8c555d89-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j7hjt\" (UID: \"f05e258b-34c0-44b2-a462-e93d8c555d89\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7hjt" Jun 03 00:19:41.334553 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.333197 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/25936d51-9126-434b-be53-677c56a0a8f7-env-overrides\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.334553 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.333231 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/83a1d409-7d22-41cf-9905-80f917032d5d-multus-daemon-config\") pod \"multus-bpmj9\" (UID: \"83a1d409-7d22-41cf-9905-80f917032d5d\") " pod="openshift-multus/multus-bpmj9" Jun 03 00:19:41.334553 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.333261 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/25936d51-9126-434b-be53-677c56a0a8f7-run-ovn\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.334553 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.333268 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e7b6b59e-f07b-4199-ae0b-588e703fa51e-etc-modprobe-d\") pod \"tuned-dl7hf\" (UID: \"e7b6b59e-f07b-4199-ae0b-588e703fa51e\") " pod="openshift-cluster-node-tuning-operator/tuned-dl7hf" Jun 03 00:19:41.334553 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.333286 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/25936d51-9126-434b-be53-677c56a0a8f7-log-socket\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.334553 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.333319 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/25936d51-9126-434b-be53-677c56a0a8f7-ovnkube-config\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.334553 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.333326 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/25936d51-9126-434b-be53-677c56a0a8f7-run-ovn\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.334553 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.333343 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/83a1d409-7d22-41cf-9905-80f917032d5d-os-release\") pod \"multus-bpmj9\" (UID: \"83a1d409-7d22-41cf-9905-80f917032d5d\") " pod="openshift-multus/multus-bpmj9" Jun 03 00:19:41.334553 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.333353 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/83a1d409-7d22-41cf-9905-80f917032d5d-cni-binary-copy\") pod \"multus-bpmj9\" (UID: \"83a1d409-7d22-41cf-9905-80f917032d5d\") " pod="openshift-multus/multus-bpmj9" Jun 03 00:19:41.334553 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.333392 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f05e258b-34c0-44b2-a462-e93d8c555d89-socket-dir\") pod \"aws-ebs-csi-driver-node-j7hjt\" (UID: \"f05e258b-34c0-44b2-a462-e93d8c555d89\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7hjt" Jun 03 00:19:41.334553 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.333425 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/83a1d409-7d22-41cf-9905-80f917032d5d-system-cni-dir\") pod \"multus-bpmj9\" (UID: \"83a1d409-7d22-41cf-9905-80f917032d5d\") " pod="openshift-multus/multus-bpmj9" Jun 03 00:19:41.334553 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.333449 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/83a1d409-7d22-41cf-9905-80f917032d5d-host-var-lib-cni-bin\") pod \"multus-bpmj9\" (UID: \"83a1d409-7d22-41cf-9905-80f917032d5d\") " pod="openshift-multus/multus-bpmj9" Jun 03 00:19:41.334553 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.333456 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/83a1d409-7d22-41cf-9905-80f917032d5d-os-release\") pod \"multus-bpmj9\" (UID: \"83a1d409-7d22-41cf-9905-80f917032d5d\") " pod="openshift-multus/multus-bpmj9" Jun 03 00:19:41.334553 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.333494 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/25936d51-9126-434b-be53-677c56a0a8f7-run-systemd\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.334553 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.333522 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25936d51-9126-434b-be53-677c56a0a8f7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.334553 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.333530 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/25936d51-9126-434b-be53-677c56a0a8f7-log-socket\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.335442 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.333549 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/25936d51-9126-434b-be53-677c56a0a8f7-ovnkube-script-lib\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.335442 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.333575 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n48tk\" (UniqueName: \"kubernetes.io/projected/f05e258b-34c0-44b2-a462-e93d8c555d89-kube-api-access-n48tk\") pod \"aws-ebs-csi-driver-node-j7hjt\" (UID: \"f05e258b-34c0-44b2-a462-e93d8c555d89\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7hjt" Jun 03 00:19:41.335442 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.333601 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e7b6b59e-f07b-4199-ae0b-588e703fa51e-host\") pod \"tuned-dl7hf\" (UID: \"e7b6b59e-f07b-4199-ae0b-588e703fa51e\") " pod="openshift-cluster-node-tuning-operator/tuned-dl7hf" Jun 03 00:19:41.335442 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.333604 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25936d51-9126-434b-be53-677c56a0a8f7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.335442 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.333639 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fa442458-bc93-4944-a646-e510875818e8-host-slash\") pod \"iptables-alerter-jxzrc\" (UID: \"fa442458-bc93-4944-a646-e510875818e8\") " pod="openshift-network-operator/iptables-alerter-jxzrc" Jun 03 00:19:41.335442 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.333670 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/83a1d409-7d22-41cf-9905-80f917032d5d-host-run-multus-certs\") pod \"multus-bpmj9\" (UID: \"83a1d409-7d22-41cf-9905-80f917032d5d\") " pod="openshift-multus/multus-bpmj9" Jun 03 00:19:41.335442 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.333705 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f05e258b-34c0-44b2-a462-e93d8c555d89-socket-dir\") pod \"aws-ebs-csi-driver-node-j7hjt\" (UID: \"f05e258b-34c0-44b2-a462-e93d8c555d89\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7hjt" Jun 03 00:19:41.335442 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.333717 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/25936d51-9126-434b-be53-677c56a0a8f7-run-openvswitch\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.335442 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.333743 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f05e258b-34c0-44b2-a462-e93d8c555d89-sys-fs\") pod \"aws-ebs-csi-driver-node-j7hjt\" (UID: \"f05e258b-34c0-44b2-a462-e93d8c555d89\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7hjt" Jun 03 00:19:41.335442 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.333765 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/83a1d409-7d22-41cf-9905-80f917032d5d-system-cni-dir\") pod \"multus-bpmj9\" (UID: \"83a1d409-7d22-41cf-9905-80f917032d5d\") " pod="openshift-multus/multus-bpmj9" Jun 03 00:19:41.335442 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.333768 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e7b6b59e-f07b-4199-ae0b-588e703fa51e-etc-sysconfig\") pod \"tuned-dl7hf\" (UID: \"e7b6b59e-f07b-4199-ae0b-588e703fa51e\") " pod="openshift-cluster-node-tuning-operator/tuned-dl7hf" Jun 03 00:19:41.335442 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.333771 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/83a1d409-7d22-41cf-9905-80f917032d5d-multus-daemon-config\") pod \"multus-bpmj9\" (UID: \"83a1d409-7d22-41cf-9905-80f917032d5d\") " pod="openshift-multus/multus-bpmj9" Jun 03 00:19:41.335442 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.333793 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7b6b59e-f07b-4199-ae0b-588e703fa51e-etc-kubernetes\") pod \"tuned-dl7hf\" (UID: \"e7b6b59e-f07b-4199-ae0b-588e703fa51e\") " pod="openshift-cluster-node-tuning-operator/tuned-dl7hf" Jun 03 00:19:41.335442 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.333818 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f834652a-ce69-4c9d-ac77-548eeb90a911-konnectivity-ca\") pod \"konnectivity-agent-xp7vr\" (UID: \"f834652a-ce69-4c9d-ac77-548eeb90a911\") " pod="kube-system/konnectivity-agent-xp7vr" Jun 03 00:19:41.335442 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.333827 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/83a1d409-7d22-41cf-9905-80f917032d5d-host-run-multus-certs\") pod \"multus-bpmj9\" (UID: \"83a1d409-7d22-41cf-9905-80f917032d5d\") " pod="openshift-multus/multus-bpmj9" Jun 03 00:19:41.335442 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.333843 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/418186d3-434f-4d2f-afbf-2ba437ececd4-cnibin\") pod \"multus-additional-cni-plugins-vns2z\" (UID: \"418186d3-434f-4d2f-afbf-2ba437ececd4\") " pod="openshift-multus/multus-additional-cni-plugins-vns2z" Jun 03 00:19:41.335442 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.333845 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/25936d51-9126-434b-be53-677c56a0a8f7-ovnkube-config\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.336174 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.333868 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/418186d3-434f-4d2f-afbf-2ba437ececd4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vns2z\" (UID: \"418186d3-434f-4d2f-afbf-2ba437ececd4\") " pod="openshift-multus/multus-additional-cni-plugins-vns2z" Jun 03 00:19:41.336174 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.333875 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/25936d51-9126-434b-be53-677c56a0a8f7-run-systemd\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.336174 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.333895 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-54n7j\" (UniqueName: \"kubernetes.io/projected/0d640da7-6701-4c49-b1c4-efac1a49bea8-kube-api-access-54n7j\") pod \"network-check-target-jwt8n\" (UID: \"0d640da7-6701-4c49-b1c4-efac1a49bea8\") " pod="openshift-network-diagnostics/network-check-target-jwt8n" Jun 03 00:19:41.336174 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.333919 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/25936d51-9126-434b-be53-677c56a0a8f7-var-lib-openvswitch\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.336174 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.333938 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e7b6b59e-f07b-4199-ae0b-588e703fa51e-host\") pod \"tuned-dl7hf\" (UID: \"e7b6b59e-f07b-4199-ae0b-588e703fa51e\") " pod="openshift-cluster-node-tuning-operator/tuned-dl7hf" Jun 03 00:19:41.336174 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.333945 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/25936d51-9126-434b-be53-677c56a0a8f7-ovn-node-metrics-cert\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.336174 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.333971 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e7b6b59e-f07b-4199-ae0b-588e703fa51e-etc-sysctl-conf\") pod \"tuned-dl7hf\" (UID: \"e7b6b59e-f07b-4199-ae0b-588e703fa51e\") " pod="openshift-cluster-node-tuning-operator/tuned-dl7hf" Jun 03 00:19:41.336174 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.333980 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fa442458-bc93-4944-a646-e510875818e8-host-slash\") pod \"iptables-alerter-jxzrc\" (UID: \"fa442458-bc93-4944-a646-e510875818e8\") " pod="openshift-network-operator/iptables-alerter-jxzrc" Jun 03 00:19:41.336174 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.333995 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e7b6b59e-f07b-4199-ae0b-588e703fa51e-etc-systemd\") pod \"tuned-dl7hf\" (UID: \"e7b6b59e-f07b-4199-ae0b-588e703fa51e\") " pod="openshift-cluster-node-tuning-operator/tuned-dl7hf" Jun 03 00:19:41.336174 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.334018 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fc278c33-3725-483e-971f-7465ef42f509-hosts-file\") pod \"node-resolver-cg2vj\" (UID: \"fc278c33-3725-483e-971f-7465ef42f509\") " pod="openshift-dns/node-resolver-cg2vj" Jun 03 00:19:41.336174 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.334050 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf-metrics-certs\") pod \"network-metrics-daemon-h7qxw\" (UID: \"3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf\") " pod="openshift-multus/network-metrics-daemon-h7qxw" Jun 03 00:19:41.336174 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.334075 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/25936d51-9126-434b-be53-677c56a0a8f7-host-kubelet\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.336174 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.334101 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e7b6b59e-f07b-4199-ae0b-588e703fa51e-sys\") pod \"tuned-dl7hf\" (UID: \"e7b6b59e-f07b-4199-ae0b-588e703fa51e\") " pod="openshift-cluster-node-tuning-operator/tuned-dl7hf" Jun 03 00:19:41.336174 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.334114 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/25936d51-9126-434b-be53-677c56a0a8f7-ovnkube-script-lib\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.336174 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.334125 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fa442458-bc93-4944-a646-e510875818e8-iptables-alerter-script\") pod \"iptables-alerter-jxzrc\" (UID: \"fa442458-bc93-4944-a646-e510875818e8\") " pod="openshift-network-operator/iptables-alerter-jxzrc" Jun 03 00:19:41.336174 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.334153 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f834652a-ce69-4c9d-ac77-548eeb90a911-agent-certs\") pod \"konnectivity-agent-xp7vr\" (UID: \"f834652a-ce69-4c9d-ac77-548eeb90a911\") " pod="kube-system/konnectivity-agent-xp7vr" Jun 03 00:19:41.336174 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.334165 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/25936d51-9126-434b-be53-677c56a0a8f7-run-openvswitch\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.336931 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.334173 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f05e258b-34c0-44b2-a462-e93d8c555d89-sys-fs\") pod \"aws-ebs-csi-driver-node-j7hjt\" (UID: \"f05e258b-34c0-44b2-a462-e93d8c555d89\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7hjt" Jun 03 00:19:41.336931 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.334180 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/418186d3-434f-4d2f-afbf-2ba437ececd4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vns2z\" (UID: \"418186d3-434f-4d2f-afbf-2ba437ececd4\") " pod="openshift-multus/multus-additional-cni-plugins-vns2z" Jun 03 00:19:41.336931 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.334206 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/418186d3-434f-4d2f-afbf-2ba437ececd4-cnibin\") pod \"multus-additional-cni-plugins-vns2z\" (UID: \"418186d3-434f-4d2f-afbf-2ba437ececd4\") " pod="openshift-multus/multus-additional-cni-plugins-vns2z" Jun 03 00:19:41.336931 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.334228 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fc278c33-3725-483e-971f-7465ef42f509-hosts-file\") pod \"node-resolver-cg2vj\" (UID: \"fc278c33-3725-483e-971f-7465ef42f509\") " pod="openshift-dns/node-resolver-cg2vj" Jun 03 00:19:41.336931 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.334274 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/83a1d409-7d22-41cf-9905-80f917032d5d-host-var-lib-cni-bin\") pod \"multus-bpmj9\" (UID: \"83a1d409-7d22-41cf-9905-80f917032d5d\") " pod="openshift-multus/multus-bpmj9" Jun 03 00:19:41.336931 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.334273 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6mndx\" (UniqueName: \"kubernetes.io/projected/418186d3-434f-4d2f-afbf-2ba437ececd4-kube-api-access-6mndx\") pod \"multus-additional-cni-plugins-vns2z\" (UID: \"418186d3-434f-4d2f-afbf-2ba437ececd4\") " pod="openshift-multus/multus-additional-cni-plugins-vns2z" Jun 03 00:19:41.336931 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.334344 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e7b6b59e-f07b-4199-ae0b-588e703fa51e-etc-sysconfig\") pod \"tuned-dl7hf\" (UID: \"e7b6b59e-f07b-4199-ae0b-588e703fa51e\") " pod="openshift-cluster-node-tuning-operator/tuned-dl7hf" Jun 03 00:19:41.336931 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.334368 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e7b6b59e-f07b-4199-ae0b-588e703fa51e-etc-systemd\") pod \"tuned-dl7hf\" (UID: \"e7b6b59e-f07b-4199-ae0b-588e703fa51e\") " pod="openshift-cluster-node-tuning-operator/tuned-dl7hf" Jun 03 00:19:41.336931 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.334373 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/25936d51-9126-434b-be53-677c56a0a8f7-var-lib-openvswitch\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.336931 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.334404 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7b6b59e-f07b-4199-ae0b-588e703fa51e-etc-kubernetes\") pod \"tuned-dl7hf\" (UID: \"e7b6b59e-f07b-4199-ae0b-588e703fa51e\") " pod="openshift-cluster-node-tuning-operator/tuned-dl7hf" Jun 03 00:19:41.336931 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.335004 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/83a1d409-7d22-41cf-9905-80f917032d5d-multus-conf-dir\") pod \"multus-bpmj9\" (UID: \"83a1d409-7d22-41cf-9905-80f917032d5d\") " pod="openshift-multus/multus-bpmj9" Jun 03 00:19:41.336931 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.334492 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/25936d51-9126-434b-be53-677c56a0a8f7-host-kubelet\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.336931 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.334504 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e7b6b59e-f07b-4199-ae0b-588e703fa51e-etc-sysctl-conf\") pod \"tuned-dl7hf\" (UID: \"e7b6b59e-f07b-4199-ae0b-588e703fa51e\") " pod="openshift-cluster-node-tuning-operator/tuned-dl7hf" Jun 03 00:19:41.336931 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.334529 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e7b6b59e-f07b-4199-ae0b-588e703fa51e-sys\") pod \"tuned-dl7hf\" (UID: \"e7b6b59e-f07b-4199-ae0b-588e703fa51e\") " pod="openshift-cluster-node-tuning-operator/tuned-dl7hf" Jun 03 00:19:41.336931 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.334937 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/418186d3-434f-4d2f-afbf-2ba437ececd4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vns2z\" (UID: \"418186d3-434f-4d2f-afbf-2ba437ececd4\") " pod="openshift-multus/multus-additional-cni-plugins-vns2z" Jun 03 00:19:41.336931 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.334944 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/418186d3-434f-4d2f-afbf-2ba437ececd4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vns2z\" (UID: \"418186d3-434f-4d2f-afbf-2ba437ececd4\") " pod="openshift-multus/multus-additional-cni-plugins-vns2z" Jun 03 00:19:41.336931 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.335048 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zkf77\" (UniqueName: \"kubernetes.io/projected/83a1d409-7d22-41cf-9905-80f917032d5d-kube-api-access-zkf77\") pod \"multus-bpmj9\" (UID: \"83a1d409-7d22-41cf-9905-80f917032d5d\") " pod="openshift-multus/multus-bpmj9" Jun 03 00:19:41.337764 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.334460 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f834652a-ce69-4c9d-ac77-548eeb90a911-konnectivity-ca\") pod \"konnectivity-agent-xp7vr\" (UID: \"f834652a-ce69-4c9d-ac77-548eeb90a911\") " pod="kube-system/konnectivity-agent-xp7vr" Jun 03 00:19:41.337764 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.334989 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fa442458-bc93-4944-a646-e510875818e8-iptables-alerter-script\") pod \"iptables-alerter-jxzrc\" (UID: \"fa442458-bc93-4944-a646-e510875818e8\") " pod="openshift-network-operator/iptables-alerter-jxzrc" Jun 03 00:19:41.337764 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.335053 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/83a1d409-7d22-41cf-9905-80f917032d5d-multus-conf-dir\") pod \"multus-bpmj9\" (UID: \"83a1d409-7d22-41cf-9905-80f917032d5d\") " pod="openshift-multus/multus-bpmj9" Jun 03 00:19:41.337764 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.335108 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/25936d51-9126-434b-be53-677c56a0a8f7-host-run-netns\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.337764 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.335143 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e7b6b59e-f07b-4199-ae0b-588e703fa51e-etc-tuned\") pod \"tuned-dl7hf\" (UID: \"e7b6b59e-f07b-4199-ae0b-588e703fa51e\") " pod="openshift-cluster-node-tuning-operator/tuned-dl7hf" Jun 03 00:19:41.337764 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.335169 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/25936d51-9126-434b-be53-677c56a0a8f7-host-run-netns\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.337764 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.335207 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a8382002-46e9-42fa-b498-3d6de2fe6a85-serviceca\") pod \"node-ca-p6rbs\" (UID: \"a8382002-46e9-42fa-b498-3d6de2fe6a85\") " pod="openshift-image-registry/node-ca-p6rbs" Jun 03 00:19:41.337764 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.335273 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/83a1d409-7d22-41cf-9905-80f917032d5d-hostroot\") pod \"multus-bpmj9\" (UID: \"83a1d409-7d22-41cf-9905-80f917032d5d\") " pod="openshift-multus/multus-bpmj9" Jun 03 00:19:41.337764 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.335327 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9wdq\" (UniqueName: \"kubernetes.io/projected/3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf-kube-api-access-q9wdq\") pod \"network-metrics-daemon-h7qxw\" (UID: \"3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf\") " pod="openshift-multus/network-metrics-daemon-h7qxw" Jun 03 00:19:41.337764 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.335353 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/83a1d409-7d22-41cf-9905-80f917032d5d-hostroot\") pod \"multus-bpmj9\" (UID: \"83a1d409-7d22-41cf-9905-80f917032d5d\") " pod="openshift-multus/multus-bpmj9" Jun 03 00:19:41.337764 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.335614 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a8382002-46e9-42fa-b498-3d6de2fe6a85-serviceca\") pod \"node-ca-p6rbs\" (UID: \"a8382002-46e9-42fa-b498-3d6de2fe6a85\") " pod="openshift-image-registry/node-ca-p6rbs" Jun 03 00:19:41.337764 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.337275 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/25936d51-9126-434b-be53-677c56a0a8f7-ovn-node-metrics-cert\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.337764 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.337338 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e7b6b59e-f07b-4199-ae0b-588e703fa51e-etc-tuned\") pod \"tuned-dl7hf\" (UID: \"e7b6b59e-f07b-4199-ae0b-588e703fa51e\") " pod="openshift-cluster-node-tuning-operator/tuned-dl7hf" Jun 03 00:19:41.338483 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.338304 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f834652a-ce69-4c9d-ac77-548eeb90a911-agent-certs\") pod \"konnectivity-agent-xp7vr\" (UID: \"f834652a-ce69-4c9d-ac77-548eeb90a911\") " pod="kube-system/konnectivity-agent-xp7vr" Jun 03 00:19:41.342177 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:41.342153 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 00:19:41.342177 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:41.342180 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 00:19:41.342370 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:41.342200 2559 projected.go:194] Error preparing data for projected volume kube-api-access-54n7j for pod openshift-network-diagnostics/network-check-target-jwt8n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:19:41.342370 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:41.342297 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d640da7-6701-4c49-b1c4-efac1a49bea8-kube-api-access-54n7j podName:0d640da7-6701-4c49-b1c4-efac1a49bea8 nodeName:}" failed. No retries permitted until 2026-06-03 00:19:41.842242107 +0000 UTC m=+3.062164677 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-54n7j" (UniqueName: "kubernetes.io/projected/0d640da7-6701-4c49-b1c4-efac1a49bea8-kube-api-access-54n7j") pod "network-check-target-jwt8n" (UID: "0d640da7-6701-4c49-b1c4-efac1a49bea8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:19:41.343646 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.343577 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls5nc\" (UniqueName: \"kubernetes.io/projected/a8382002-46e9-42fa-b498-3d6de2fe6a85-kube-api-access-ls5nc\") pod \"node-ca-p6rbs\" (UID: \"a8382002-46e9-42fa-b498-3d6de2fe6a85\") " pod="openshift-image-registry/node-ca-p6rbs" Jun 03 00:19:41.344479 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.344456 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdm84\" (UniqueName: \"kubernetes.io/projected/fc278c33-3725-483e-971f-7465ef42f509-kube-api-access-sdm84\") pod \"node-resolver-cg2vj\" (UID: \"fc278c33-3725-483e-971f-7465ef42f509\") " pod="openshift-dns/node-resolver-cg2vj" Jun 03 00:19:41.344912 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.344873 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bb2zx\" (UniqueName: \"kubernetes.io/projected/25936d51-9126-434b-be53-677c56a0a8f7-kube-api-access-bb2zx\") pod \"ovnkube-node-t7gbw\" (UID: \"25936d51-9126-434b-be53-677c56a0a8f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.345206 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.345181 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkf77\" (UniqueName: \"kubernetes.io/projected/83a1d409-7d22-41cf-9905-80f917032d5d-kube-api-access-zkf77\") pod \"multus-bpmj9\" (UID: \"83a1d409-7d22-41cf-9905-80f917032d5d\") " pod="openshift-multus/multus-bpmj9" Jun 03 00:19:41.345294 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.345186 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wprmp\" (UniqueName: \"kubernetes.io/projected/fa442458-bc93-4944-a646-e510875818e8-kube-api-access-wprmp\") pod \"iptables-alerter-jxzrc\" (UID: \"fa442458-bc93-4944-a646-e510875818e8\") " pod="openshift-network-operator/iptables-alerter-jxzrc" Jun 03 00:19:41.346433 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.346403 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n48tk\" (UniqueName: \"kubernetes.io/projected/f05e258b-34c0-44b2-a462-e93d8c555d89-kube-api-access-n48tk\") pod \"aws-ebs-csi-driver-node-j7hjt\" (UID: \"f05e258b-34c0-44b2-a462-e93d8c555d89\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7hjt" Jun 03 00:19:41.346530 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.346482 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99qnm\" (UniqueName: \"kubernetes.io/projected/e7b6b59e-f07b-4199-ae0b-588e703fa51e-kube-api-access-99qnm\") pod \"tuned-dl7hf\" (UID: \"e7b6b59e-f07b-4199-ae0b-588e703fa51e\") " pod="openshift-cluster-node-tuning-operator/tuned-dl7hf" Jun 03 00:19:41.347784 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.347660 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mndx\" (UniqueName: \"kubernetes.io/projected/418186d3-434f-4d2f-afbf-2ba437ececd4-kube-api-access-6mndx\") pod \"multus-additional-cni-plugins-vns2z\" (UID: \"418186d3-434f-4d2f-afbf-2ba437ececd4\") " pod="openshift-multus/multus-additional-cni-plugins-vns2z" Jun 03 00:19:41.349773 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.349752 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7b6b59e-f07b-4199-ae0b-588e703fa51e-tmp\") pod \"tuned-dl7hf\" (UID: \"e7b6b59e-f07b-4199-ae0b-588e703fa51e\") " pod="openshift-cluster-node-tuning-operator/tuned-dl7hf" Jun 03 00:19:41.436324 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.436295 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf-metrics-certs\") pod \"network-metrics-daemon-h7qxw\" (UID: \"3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf\") " pod="openshift-multus/network-metrics-daemon-h7qxw" Jun 03 00:19:41.436483 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.436407 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q9wdq\" (UniqueName: \"kubernetes.io/projected/3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf-kube-api-access-q9wdq\") pod \"network-metrics-daemon-h7qxw\" (UID: \"3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf\") " pod="openshift-multus/network-metrics-daemon-h7qxw" Jun 03 00:19:41.436483 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:41.436425 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:19:41.436566 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:41.436521 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf-metrics-certs podName:3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf nodeName:}" failed. No retries permitted until 2026-06-03 00:19:41.936497364 +0000 UTC m=+3.156419940 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf-metrics-certs") pod "network-metrics-daemon-h7qxw" (UID: "3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:19:41.451277 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.451185 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9wdq\" (UniqueName: \"kubernetes.io/projected/3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf-kube-api-access-q9wdq\") pod \"network-metrics-daemon-h7qxw\" (UID: \"3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf\") " pod="openshift-multus/network-metrics-daemon-h7qxw" Jun 03 00:19:41.527416 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.527366 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:19:41.539341 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.539315 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jxzrc" Jun 03 00:19:41.547028 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.547002 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xp7vr" Jun 03 00:19:41.554734 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.554708 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7hjt" Jun 03 00:19:41.561456 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.561424 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dl7hf" Jun 03 00:19:41.569187 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.569158 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vns2z" Jun 03 00:19:41.576939 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.576914 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cg2vj" Jun 03 00:19:41.584494 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.584468 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-p6rbs" Jun 03 00:19:41.591206 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.591185 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bpmj9" Jun 03 00:19:41.613744 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.613701 2559 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 00:19:41.920181 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:41.920147 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf05e258b_34c0_44b2_a462_e93d8c555d89.slice/crio-01ae6296e45f0d09d6b98c78cb065af7721fb3c2cb21b8a27303b7ccd1d9a351 WatchSource:0}: Error finding container 01ae6296e45f0d09d6b98c78cb065af7721fb3c2cb21b8a27303b7ccd1d9a351: Status 404 returned error can't find the container with id 01ae6296e45f0d09d6b98c78cb065af7721fb3c2cb21b8a27303b7ccd1d9a351 Jun 03 00:19:41.921117 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:41.921002 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf834652a_ce69_4c9d_ac77_548eeb90a911.slice/crio-7a68e05a970a033d6655508063d9ab880c366f9a91d85dbe4ac4bc36a10cc96b WatchSource:0}: Error finding container 7a68e05a970a033d6655508063d9ab880c366f9a91d85dbe4ac4bc36a10cc96b: Status 404 returned error can't find the container with id 7a68e05a970a033d6655508063d9ab880c366f9a91d85dbe4ac4bc36a10cc96b Jun 03 00:19:41.922040 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:41.921876 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25936d51_9126_434b_be53_677c56a0a8f7.slice/crio-d4caf6094c0b2f9114fddf794c2c42dd87b321a647c75ceb6c47250aa7c5d823 WatchSource:0}: Error finding container d4caf6094c0b2f9114fddf794c2c42dd87b321a647c75ceb6c47250aa7c5d823: Status 404 returned error can't find the container with id d4caf6094c0b2f9114fddf794c2c42dd87b321a647c75ceb6c47250aa7c5d823 Jun 03 00:19:41.924565 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:41.924536 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83a1d409_7d22_41cf_9905_80f917032d5d.slice/crio-951481f4bc71a70d8d6ad6f7c3cb99e350634ecb176819cb84b683774e4b283b WatchSource:0}: Error finding container 951481f4bc71a70d8d6ad6f7c3cb99e350634ecb176819cb84b683774e4b283b: Status 404 returned error can't find the container with id 951481f4bc71a70d8d6ad6f7c3cb99e350634ecb176819cb84b683774e4b283b Jun 03 00:19:41.925386 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:41.925359 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa442458_bc93_4944_a646_e510875818e8.slice/crio-9bc5448f1b2343084cfd422172204c8284f5f47276633aeef13695874b25979b WatchSource:0}: Error finding container 9bc5448f1b2343084cfd422172204c8284f5f47276633aeef13695874b25979b: Status 404 returned error can't find the container with id 9bc5448f1b2343084cfd422172204c8284f5f47276633aeef13695874b25979b Jun 03 00:19:41.927258 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:41.927210 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc278c33_3725_483e_971f_7465ef42f509.slice/crio-eebf53a3f2605333724a98401122acf57b2ce224db2f6c7f6079100375bd0607 WatchSource:0}: Error finding container eebf53a3f2605333724a98401122acf57b2ce224db2f6c7f6079100375bd0607: Status 404 returned error can't find the container with id eebf53a3f2605333724a98401122acf57b2ce224db2f6c7f6079100375bd0607 Jun 03 00:19:41.927572 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:41.927550 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7b6b59e_f07b_4199_ae0b_588e703fa51e.slice/crio-9c4e13b8cc79ec78af3ef77903b76219a3e75d0505566eb91081a6a115764e4c WatchSource:0}: Error finding container 9c4e13b8cc79ec78af3ef77903b76219a3e75d0505566eb91081a6a115764e4c: Status 404 returned error can't find the container with id 9c4e13b8cc79ec78af3ef77903b76219a3e75d0505566eb91081a6a115764e4c Jun 03 00:19:41.929250 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:41.929221 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod418186d3_434f_4d2f_afbf_2ba437ececd4.slice/crio-f040e1cbc889da103cc33450fd5b543a6cd6343160600fa3fa142439b50525c6 WatchSource:0}: Error finding container f040e1cbc889da103cc33450fd5b543a6cd6343160600fa3fa142439b50525c6: Status 404 returned error can't find the container with id f040e1cbc889da103cc33450fd5b543a6cd6343160600fa3fa142439b50525c6 Jun 03 00:19:41.932660 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:19:41.932637 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8382002_46e9_42fa_b498_3d6de2fe6a85.slice/crio-defb7316961cc56e6d775dce6645a115ad311021ca2740e91583a0faf3073389 WatchSource:0}: Error finding container defb7316961cc56e6d775dce6645a115ad311021ca2740e91583a0faf3073389: Status 404 returned error can't find the container with id defb7316961cc56e6d775dce6645a115ad311021ca2740e91583a0faf3073389 Jun 03 00:19:41.939784 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.939761 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-54n7j\" (UniqueName: \"kubernetes.io/projected/0d640da7-6701-4c49-b1c4-efac1a49bea8-kube-api-access-54n7j\") pod \"network-check-target-jwt8n\" (UID: \"0d640da7-6701-4c49-b1c4-efac1a49bea8\") " pod="openshift-network-diagnostics/network-check-target-jwt8n" Jun 03 00:19:41.939880 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:41.939802 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf-metrics-certs\") pod \"network-metrics-daemon-h7qxw\" (UID: \"3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf\") " pod="openshift-multus/network-metrics-daemon-h7qxw" Jun 03 00:19:41.939940 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:41.939912 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 00:19:41.939940 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:41.939924 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:19:41.940034 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:41.939977 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf-metrics-certs podName:3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf nodeName:}" failed. No retries permitted until 2026-06-03 00:19:42.939957674 +0000 UTC m=+4.159880243 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf-metrics-certs") pod "network-metrics-daemon-h7qxw" (UID: "3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:19:41.940034 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:41.939928 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 00:19:41.940034 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:41.940002 2559 projected.go:194] Error preparing data for projected volume kube-api-access-54n7j for pod openshift-network-diagnostics/network-check-target-jwt8n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:19:41.940142 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:41.940044 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d640da7-6701-4c49-b1c4-efac1a49bea8-kube-api-access-54n7j podName:0d640da7-6701-4c49-b1c4-efac1a49bea8 nodeName:}" failed. No retries permitted until 2026-06-03 00:19:42.940032544 +0000 UTC m=+4.159955112 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-54n7j" (UniqueName: "kubernetes.io/projected/0d640da7-6701-4c49-b1c4-efac1a49bea8-kube-api-access-54n7j") pod "network-check-target-jwt8n" (UID: "0d640da7-6701-4c49-b1c4-efac1a49bea8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:19:42.258072 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:42.258032 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 00:14:40 +0000 UTC" deadline="2028-02-02 14:21:10.448823625 +0000 UTC" Jun 03 00:19:42.258072 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:42.258068 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14630h1m28.190759494s" Jun 03 00:19:42.376750 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:42.376525 2559 generic.go:358] "Generic (PLEG): container finished" podID="1be39df264fab6751b0b36bcc05d7d7f" containerID="7f5581c1ec0cab7406d9a9055e5da39c353d7b67b4b98194644e3c52efcf4d9d" exitCode=0 Jun 03 00:19:42.376750 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:42.376615 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-219.ec2.internal" event={"ID":"1be39df264fab6751b0b36bcc05d7d7f","Type":"ContainerDied","Data":"7f5581c1ec0cab7406d9a9055e5da39c353d7b67b4b98194644e3c52efcf4d9d"} Jun 03 00:19:42.384263 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:42.383757 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-219.ec2.internal" event={"ID":"19952b984930da1b15ba825fc7aad098","Type":"ContainerStarted","Data":"5c06ffa002d76220cb79602ec67c213aabeaf7a61111b13c2c69891b9a504223"} Jun 03 00:19:42.385945 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:42.385918 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-p6rbs" event={"ID":"a8382002-46e9-42fa-b498-3d6de2fe6a85","Type":"ContainerStarted","Data":"defb7316961cc56e6d775dce6645a115ad311021ca2740e91583a0faf3073389"} Jun 03 00:19:42.391962 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:42.391928 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vns2z" event={"ID":"418186d3-434f-4d2f-afbf-2ba437ececd4","Type":"ContainerStarted","Data":"f040e1cbc889da103cc33450fd5b543a6cd6343160600fa3fa142439b50525c6"} Jun 03 00:19:42.398395 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:42.398363 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cg2vj" event={"ID":"fc278c33-3725-483e-971f-7465ef42f509","Type":"ContainerStarted","Data":"eebf53a3f2605333724a98401122acf57b2ce224db2f6c7f6079100375bd0607"} Jun 03 00:19:42.400389 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:42.400338 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bpmj9" event={"ID":"83a1d409-7d22-41cf-9905-80f917032d5d","Type":"ContainerStarted","Data":"951481f4bc71a70d8d6ad6f7c3cb99e350634ecb176819cb84b683774e4b283b"} Jun 03 00:19:42.416007 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:42.415923 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" event={"ID":"25936d51-9126-434b-be53-677c56a0a8f7","Type":"ContainerStarted","Data":"d4caf6094c0b2f9114fddf794c2c42dd87b321a647c75ceb6c47250aa7c5d823"} Jun 03 00:19:42.420106 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:42.420071 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7hjt" event={"ID":"f05e258b-34c0-44b2-a462-e93d8c555d89","Type":"ContainerStarted","Data":"01ae6296e45f0d09d6b98c78cb065af7721fb3c2cb21b8a27303b7ccd1d9a351"} Jun 03 00:19:42.425963 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:42.422994 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dl7hf" event={"ID":"e7b6b59e-f07b-4199-ae0b-588e703fa51e","Type":"ContainerStarted","Data":"9c4e13b8cc79ec78af3ef77903b76219a3e75d0505566eb91081a6a115764e4c"} Jun 03 00:19:42.435526 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:42.435457 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jxzrc" event={"ID":"fa442458-bc93-4944-a646-e510875818e8","Type":"ContainerStarted","Data":"9bc5448f1b2343084cfd422172204c8284f5f47276633aeef13695874b25979b"} Jun 03 00:19:42.442150 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:42.442111 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xp7vr" event={"ID":"f834652a-ce69-4c9d-ac77-548eeb90a911","Type":"ContainerStarted","Data":"7a68e05a970a033d6655508063d9ab880c366f9a91d85dbe4ac4bc36a10cc96b"} Jun 03 00:19:42.948462 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:42.948371 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-54n7j\" (UniqueName: \"kubernetes.io/projected/0d640da7-6701-4c49-b1c4-efac1a49bea8-kube-api-access-54n7j\") pod \"network-check-target-jwt8n\" (UID: \"0d640da7-6701-4c49-b1c4-efac1a49bea8\") " pod="openshift-network-diagnostics/network-check-target-jwt8n" Jun 03 00:19:42.948462 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:42.948431 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf-metrics-certs\") pod \"network-metrics-daemon-h7qxw\" (UID: \"3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf\") " pod="openshift-multus/network-metrics-daemon-h7qxw" Jun 03 00:19:42.948677 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:42.948662 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:19:42.948768 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:42.948701 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 00:19:42.948768 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:42.948727 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 00:19:42.948768 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:42.948744 2559 projected.go:194] Error preparing data for projected volume kube-api-access-54n7j for pod openshift-network-diagnostics/network-check-target-jwt8n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:19:42.948918 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:42.948798 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf-metrics-certs podName:3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf nodeName:}" failed. No retries permitted until 2026-06-03 00:19:44.948775077 +0000 UTC m=+6.168697635 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf-metrics-certs") pod "network-metrics-daemon-h7qxw" (UID: "3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:19:42.948918 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:42.948819 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d640da7-6701-4c49-b1c4-efac1a49bea8-kube-api-access-54n7j podName:0d640da7-6701-4c49-b1c4-efac1a49bea8 nodeName:}" failed. No retries permitted until 2026-06-03 00:19:44.948809822 +0000 UTC m=+6.168732381 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-54n7j" (UniqueName: "kubernetes.io/projected/0d640da7-6701-4c49-b1c4-efac1a49bea8-kube-api-access-54n7j") pod "network-check-target-jwt8n" (UID: "0d640da7-6701-4c49-b1c4-efac1a49bea8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:19:43.363923 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:43.363839 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwt8n" Jun 03 00:19:43.364369 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:43.363972 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwt8n" podUID="0d640da7-6701-4c49-b1c4-efac1a49bea8" Jun 03 00:19:43.364436 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:43.364424 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h7qxw" Jun 03 00:19:43.364553 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:43.364528 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h7qxw" podUID="3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf" Jun 03 00:19:43.457394 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:43.457313 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-219.ec2.internal" event={"ID":"1be39df264fab6751b0b36bcc05d7d7f","Type":"ContainerStarted","Data":"a03840c1ba7b2dbf1b5044bc39e4bb6b6a56cfc6f466226577ae04a1dcbd8b57"} Jun 03 00:19:43.470640 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:43.470225 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-219.ec2.internal" podStartSLOduration=3.470204521 podStartE2EDuration="3.470204521s" podCreationTimestamp="2026-06-03 00:19:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 00:19:42.404007764 +0000 UTC m=+3.623930339" watchObservedRunningTime="2026-06-03 00:19:43.470204521 +0000 UTC m=+4.690127096" Jun 03 00:19:43.470640 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:43.470422 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-219.ec2.internal" podStartSLOduration=3.470413765 podStartE2EDuration="3.470413765s" podCreationTimestamp="2026-06-03 00:19:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 00:19:43.469350289 +0000 UTC m=+4.689272865" watchObservedRunningTime="2026-06-03 00:19:43.470413765 +0000 UTC m=+4.690336340" Jun 03 00:19:44.965612 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:44.965575 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf-metrics-certs\") pod \"network-metrics-daemon-h7qxw\" (UID: \"3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf\") " pod="openshift-multus/network-metrics-daemon-h7qxw" Jun 03 00:19:44.966086 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:44.965660 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-54n7j\" (UniqueName: \"kubernetes.io/projected/0d640da7-6701-4c49-b1c4-efac1a49bea8-kube-api-access-54n7j\") pod \"network-check-target-jwt8n\" (UID: \"0d640da7-6701-4c49-b1c4-efac1a49bea8\") " pod="openshift-network-diagnostics/network-check-target-jwt8n" Jun 03 00:19:44.966086 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:44.965794 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 00:19:44.966086 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:44.965812 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 00:19:44.966086 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:44.965826 2559 projected.go:194] Error preparing data for projected volume kube-api-access-54n7j for pod openshift-network-diagnostics/network-check-target-jwt8n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:19:44.966086 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:44.965873 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d640da7-6701-4c49-b1c4-efac1a49bea8-kube-api-access-54n7j podName:0d640da7-6701-4c49-b1c4-efac1a49bea8 nodeName:}" failed. No retries permitted until 2026-06-03 00:19:48.965860217 +0000 UTC m=+10.185782769 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-54n7j" (UniqueName: "kubernetes.io/projected/0d640da7-6701-4c49-b1c4-efac1a49bea8-kube-api-access-54n7j") pod "network-check-target-jwt8n" (UID: "0d640da7-6701-4c49-b1c4-efac1a49bea8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:19:44.966310 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:44.966289 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:19:44.966365 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:44.966343 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf-metrics-certs podName:3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf nodeName:}" failed. No retries permitted until 2026-06-03 00:19:48.966327067 +0000 UTC m=+10.186249645 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf-metrics-certs") pod "network-metrics-daemon-h7qxw" (UID: "3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:19:45.363765 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:45.363112 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h7qxw" Jun 03 00:19:45.363765 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:45.363260 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h7qxw" podUID="3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf" Jun 03 00:19:45.363765 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:45.363729 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwt8n" Jun 03 00:19:45.364031 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:45.363842 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwt8n" podUID="0d640da7-6701-4c49-b1c4-efac1a49bea8" Jun 03 00:19:47.363472 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:47.363430 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwt8n" Jun 03 00:19:47.363959 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:47.363574 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwt8n" podUID="0d640da7-6701-4c49-b1c4-efac1a49bea8" Jun 03 00:19:47.363959 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:47.363697 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h7qxw" Jun 03 00:19:47.363959 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:47.363857 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h7qxw" podUID="3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf" Jun 03 00:19:49.000199 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:49.000156 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-54n7j\" (UniqueName: \"kubernetes.io/projected/0d640da7-6701-4c49-b1c4-efac1a49bea8-kube-api-access-54n7j\") pod \"network-check-target-jwt8n\" (UID: \"0d640da7-6701-4c49-b1c4-efac1a49bea8\") " pod="openshift-network-diagnostics/network-check-target-jwt8n" Jun 03 00:19:49.000751 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:49.000216 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf-metrics-certs\") pod \"network-metrics-daemon-h7qxw\" (UID: \"3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf\") " pod="openshift-multus/network-metrics-daemon-h7qxw" Jun 03 00:19:49.000751 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:49.000341 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:19:49.000751 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:49.000404 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf-metrics-certs podName:3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf nodeName:}" failed. No retries permitted until 2026-06-03 00:19:57.000384104 +0000 UTC m=+18.220306704 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf-metrics-certs") pod "network-metrics-daemon-h7qxw" (UID: "3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:19:49.000751 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:49.000501 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 00:19:49.000751 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:49.000514 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 00:19:49.000751 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:49.000526 2559 projected.go:194] Error preparing data for projected volume kube-api-access-54n7j for pod openshift-network-diagnostics/network-check-target-jwt8n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:19:49.000751 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:49.000562 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d640da7-6701-4c49-b1c4-efac1a49bea8-kube-api-access-54n7j podName:0d640da7-6701-4c49-b1c4-efac1a49bea8 nodeName:}" failed. No retries permitted until 2026-06-03 00:19:57.00055021 +0000 UTC m=+18.220472800 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-54n7j" (UniqueName: "kubernetes.io/projected/0d640da7-6701-4c49-b1c4-efac1a49bea8-kube-api-access-54n7j") pod "network-check-target-jwt8n" (UID: "0d640da7-6701-4c49-b1c4-efac1a49bea8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:19:49.364614 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:49.363997 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h7qxw" Jun 03 00:19:49.364614 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:49.364126 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h7qxw" podUID="3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf" Jun 03 00:19:49.364614 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:49.364437 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwt8n" Jun 03 00:19:49.364614 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:49.364524 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwt8n" podUID="0d640da7-6701-4c49-b1c4-efac1a49bea8" Jun 03 00:19:51.363481 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:51.363444 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwt8n" Jun 03 00:19:51.363481 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:51.363477 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h7qxw" Jun 03 00:19:51.363946 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:51.363570 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwt8n" podUID="0d640da7-6701-4c49-b1c4-efac1a49bea8" Jun 03 00:19:51.363946 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:51.363711 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h7qxw" podUID="3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf" Jun 03 00:19:53.363720 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:53.363662 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwt8n" Jun 03 00:19:53.364138 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:53.363663 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h7qxw" Jun 03 00:19:53.364138 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:53.363812 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwt8n" podUID="0d640da7-6701-4c49-b1c4-efac1a49bea8" Jun 03 00:19:53.364138 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:53.363891 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h7qxw" podUID="3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf" Jun 03 00:19:55.362981 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:55.362941 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwt8n" Jun 03 00:19:55.363513 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:55.362941 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h7qxw" Jun 03 00:19:55.363513 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:55.363073 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwt8n" podUID="0d640da7-6701-4c49-b1c4-efac1a49bea8" Jun 03 00:19:55.363513 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:55.363158 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h7qxw" podUID="3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf" Jun 03 00:19:57.054473 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:57.054425 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf-metrics-certs\") pod \"network-metrics-daemon-h7qxw\" (UID: \"3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf\") " pod="openshift-multus/network-metrics-daemon-h7qxw" Jun 03 00:19:57.054979 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:57.054513 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-54n7j\" (UniqueName: \"kubernetes.io/projected/0d640da7-6701-4c49-b1c4-efac1a49bea8-kube-api-access-54n7j\") pod \"network-check-target-jwt8n\" (UID: \"0d640da7-6701-4c49-b1c4-efac1a49bea8\") " pod="openshift-network-diagnostics/network-check-target-jwt8n" Jun 03 00:19:57.054979 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:57.054588 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:19:57.054979 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:57.054634 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 00:19:57.054979 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:57.054651 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 00:19:57.054979 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:57.054657 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf-metrics-certs podName:3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf nodeName:}" failed. No retries permitted until 2026-06-03 00:20:13.05463625 +0000 UTC m=+34.274558803 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf-metrics-certs") pod "network-metrics-daemon-h7qxw" (UID: "3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:19:57.054979 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:57.054664 2559 projected.go:194] Error preparing data for projected volume kube-api-access-54n7j for pod openshift-network-diagnostics/network-check-target-jwt8n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:19:57.054979 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:57.054731 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d640da7-6701-4c49-b1c4-efac1a49bea8-kube-api-access-54n7j podName:0d640da7-6701-4c49-b1c4-efac1a49bea8 nodeName:}" failed. No retries permitted until 2026-06-03 00:20:13.054716326 +0000 UTC m=+34.274638879 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-54n7j" (UniqueName: "kubernetes.io/projected/0d640da7-6701-4c49-b1c4-efac1a49bea8-kube-api-access-54n7j") pod "network-check-target-jwt8n" (UID: "0d640da7-6701-4c49-b1c4-efac1a49bea8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:19:57.363740 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:57.363635 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwt8n" Jun 03 00:19:57.363740 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:57.363669 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h7qxw" Jun 03 00:19:57.363944 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:57.363773 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwt8n" podUID="0d640da7-6701-4c49-b1c4-efac1a49bea8" Jun 03 00:19:57.363944 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:57.363900 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h7qxw" podUID="3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf" Jun 03 00:19:59.363907 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:59.363872 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h7qxw" Jun 03 00:19:59.364301 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:59.364001 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h7qxw" podUID="3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf" Jun 03 00:19:59.364301 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:19:59.364044 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwt8n" Jun 03 00:19:59.364301 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:19:59.364109 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwt8n" podUID="0d640da7-6701-4c49-b1c4-efac1a49bea8" Jun 03 00:20:00.495352 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:00.495089 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xp7vr" event={"ID":"f834652a-ce69-4c9d-ac77-548eeb90a911","Type":"ContainerStarted","Data":"1ea53a0e910b3803ff08f63e79a49eacce0a48cf4654e52258f239d1a4d2527e"} Jun 03 00:20:00.496856 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:00.496491 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-p6rbs" event={"ID":"a8382002-46e9-42fa-b498-3d6de2fe6a85","Type":"ContainerStarted","Data":"3fa9ced8abffb848bf851ffa40f12571ec46d8c54f4aad1481ada807f8a4a1d2"} Jun 03 00:20:00.498358 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:00.498337 2559 generic.go:358] "Generic (PLEG): container finished" podID="418186d3-434f-4d2f-afbf-2ba437ececd4" containerID="ac281f183d787b5f6bb5d191d4a0c894a220a89c4a15d513004da102b99c690e" exitCode=0 Jun 03 00:20:00.498454 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:00.498407 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vns2z" event={"ID":"418186d3-434f-4d2f-afbf-2ba437ececd4","Type":"ContainerDied","Data":"ac281f183d787b5f6bb5d191d4a0c894a220a89c4a15d513004da102b99c690e"} Jun 03 00:20:00.499600 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:00.499578 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cg2vj" event={"ID":"fc278c33-3725-483e-971f-7465ef42f509","Type":"ContainerStarted","Data":"b4d194fc5b3299dac615f083718d11f8f43118d98bc793b078d013dec033897d"} Jun 03 00:20:00.501167 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:00.501143 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bpmj9" event={"ID":"83a1d409-7d22-41cf-9905-80f917032d5d","Type":"ContainerStarted","Data":"a33f72be061998ed438dc8c2cedeadc4c5a1c660586d1d92c5b761549b9fe988"} Jun 03 00:20:00.503779 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:00.503761 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7gbw_25936d51-9126-434b-be53-677c56a0a8f7/ovn-acl-logging/0.log" Jun 03 00:20:00.504079 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:00.504061 2559 generic.go:358] "Generic (PLEG): container finished" podID="25936d51-9126-434b-be53-677c56a0a8f7" containerID="bed64fa631968843c9f238f23eae4f9d0b8d69020e21b903e960320125b6a249" exitCode=1 Jun 03 00:20:00.504152 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:00.504105 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" event={"ID":"25936d51-9126-434b-be53-677c56a0a8f7","Type":"ContainerStarted","Data":"1b61f9189f7eb1ab295d1afbcdecb1dab59c6e5711444985940a17ac02f2bf01"} Jun 03 00:20:00.504152 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:00.504131 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" event={"ID":"25936d51-9126-434b-be53-677c56a0a8f7","Type":"ContainerStarted","Data":"ac4d62cb000f3e75525ce0fdabec4eb4010b53331d9ab9fc4665f1dbc838cf59"} Jun 03 00:20:00.504152 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:00.504145 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" event={"ID":"25936d51-9126-434b-be53-677c56a0a8f7","Type":"ContainerDied","Data":"bed64fa631968843c9f238f23eae4f9d0b8d69020e21b903e960320125b6a249"} Jun 03 00:20:00.504322 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:00.504159 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" event={"ID":"25936d51-9126-434b-be53-677c56a0a8f7","Type":"ContainerStarted","Data":"9b6ba150efca1f6de62e0fb3d80d3c0359917e638654cae1492f1752561cb699"} Jun 03 00:20:00.506346 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:00.506323 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7hjt" event={"ID":"f05e258b-34c0-44b2-a462-e93d8c555d89","Type":"ContainerStarted","Data":"899d41cec7319e99d9f04596afca44834bf6aa41ad2fbac66e2edb16f2003ee3"} Jun 03 00:20:00.507637 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:00.507613 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dl7hf" event={"ID":"e7b6b59e-f07b-4199-ae0b-588e703fa51e","Type":"ContainerStarted","Data":"69974ffc0bacbbb0a2193a549d553162050fdaefde4c1cf40a2b4dcbf66cad93"} Jun 03 00:20:00.510946 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:00.508592 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xp7vr" podStartSLOduration=3.947965983 podStartE2EDuration="21.508576171s" podCreationTimestamp="2026-06-03 00:19:39 +0000 UTC" firstStartedPulling="2026-06-03 00:19:41.923674527 +0000 UTC m=+3.143597088" lastFinishedPulling="2026-06-03 00:19:59.484284709 +0000 UTC m=+20.704207276" observedRunningTime="2026-06-03 00:20:00.508302021 +0000 UTC m=+21.728224596" watchObservedRunningTime="2026-06-03 00:20:00.508576171 +0000 UTC m=+21.728498748" Jun 03 00:20:00.520887 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:00.520841 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-cg2vj" podStartSLOduration=3.965550382 podStartE2EDuration="21.520826532s" podCreationTimestamp="2026-06-03 00:19:39 +0000 UTC" firstStartedPulling="2026-06-03 00:19:41.928966732 +0000 UTC m=+3.148889301" lastFinishedPulling="2026-06-03 00:19:59.484242884 +0000 UTC m=+20.704165451" observedRunningTime="2026-06-03 00:20:00.520749464 +0000 UTC m=+21.740672039" watchObservedRunningTime="2026-06-03 00:20:00.520826532 +0000 UTC m=+21.740749104" Jun 03 00:20:00.533479 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:00.533398 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-p6rbs" podStartSLOduration=3.984241744 podStartE2EDuration="21.53338494s" podCreationTimestamp="2026-06-03 00:19:39 +0000 UTC" firstStartedPulling="2026-06-03 00:19:41.935098561 +0000 UTC m=+3.155021122" lastFinishedPulling="2026-06-03 00:19:59.484241766 +0000 UTC m=+20.704164318" observedRunningTime="2026-06-03 00:20:00.533321596 +0000 UTC m=+21.753244172" watchObservedRunningTime="2026-06-03 00:20:00.53338494 +0000 UTC m=+21.753307518" Jun 03 00:20:00.548820 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:00.548779 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dl7hf" podStartSLOduration=3.694293839 podStartE2EDuration="21.548765397s" podCreationTimestamp="2026-06-03 00:19:39 +0000 UTC" firstStartedPulling="2026-06-03 00:19:41.930052738 +0000 UTC m=+3.149975293" lastFinishedPulling="2026-06-03 00:19:59.784524295 +0000 UTC m=+21.004446851" observedRunningTime="2026-06-03 00:20:00.548053644 +0000 UTC m=+21.767976220" watchObservedRunningTime="2026-06-03 00:20:00.548765397 +0000 UTC m=+21.768687976" Jun 03 00:20:00.587393 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:00.587339 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-bpmj9" podStartSLOduration=3.690158822 podStartE2EDuration="21.587320067s" podCreationTimestamp="2026-06-03 00:19:39 +0000 UTC" firstStartedPulling="2026-06-03 00:19:41.926378098 +0000 UTC m=+3.146300655" lastFinishedPulling="2026-06-03 00:19:59.823539342 +0000 UTC m=+21.043461900" observedRunningTime="2026-06-03 00:20:00.587252771 +0000 UTC m=+21.807175345" watchObservedRunningTime="2026-06-03 00:20:00.587320067 +0000 UTC m=+21.807242647" Jun 03 00:20:01.226310 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:01.226131 2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 00:20:01.303724 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:01.303571 2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T00:20:01.226301981Z","UUID":"966b0650-fa26-4c68-aa91-1e811e02cb9f","Handler":null,"Name":"","Endpoint":""} Jun 03 00:20:01.315490 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:01.315461 2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 00:20:01.315490 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:01.315491 2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 00:20:01.363122 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:01.363031 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h7qxw" Jun 03 00:20:01.363122 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:01.363068 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwt8n" Jun 03 00:20:01.363322 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:20:01.363150 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h7qxw" podUID="3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf" Jun 03 00:20:01.363322 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:20:01.363274 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwt8n" podUID="0d640da7-6701-4c49-b1c4-efac1a49bea8" Jun 03 00:20:01.511974 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:01.511949 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7gbw_25936d51-9126-434b-be53-677c56a0a8f7/ovn-acl-logging/0.log" Jun 03 00:20:01.512356 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:01.512298 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" event={"ID":"25936d51-9126-434b-be53-677c56a0a8f7","Type":"ContainerStarted","Data":"41877e0037c41fe82bdb0b87632acfa53bbd6e316889649493d5ee5933930b2e"} Jun 03 00:20:01.512356 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:01.512336 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" event={"ID":"25936d51-9126-434b-be53-677c56a0a8f7","Type":"ContainerStarted","Data":"cb345af7cb5d83ede7f55368afda2550e7d13ddbc1426f7e76b97b32eee205d1"} Jun 03 00:20:01.513727 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:01.513705 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7hjt" event={"ID":"f05e258b-34c0-44b2-a462-e93d8c555d89","Type":"ContainerStarted","Data":"5c6771039a5fe63821d0fa7d7148db6cd8d74a8043cb1d76b136fa62b06234f0"} Jun 03 00:20:01.517791 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:01.517758 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jxzrc" event={"ID":"fa442458-bc93-4944-a646-e510875818e8","Type":"ContainerStarted","Data":"5f69266f635b36546f2cb86801352089fb8bb7bab300410c0725a4b0c50b7c0e"} Jun 03 00:20:01.530407 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:01.530357 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jxzrc" podStartSLOduration=4.67288675 podStartE2EDuration="22.530344593s" podCreationTimestamp="2026-06-03 00:19:39 +0000 UTC" firstStartedPulling="2026-06-03 00:19:41.927143867 +0000 UTC m=+3.147066435" lastFinishedPulling="2026-06-03 00:19:59.784601725 +0000 UTC m=+21.004524278" observedRunningTime="2026-06-03 00:20:01.530248539 +0000 UTC m=+22.750171113" watchObservedRunningTime="2026-06-03 00:20:01.530344593 +0000 UTC m=+22.750267167" Jun 03 00:20:02.521987 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:02.521902 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7hjt" event={"ID":"f05e258b-34c0-44b2-a462-e93d8c555d89","Type":"ContainerStarted","Data":"c8aadae1dc7259d8f10a79056a18011450782409c399bcfa84e415c4024a4092"} Jun 03 00:20:03.365814 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:03.365783 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwt8n" Jun 03 00:20:03.365996 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:03.365783 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h7qxw" Jun 03 00:20:03.365996 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:20:03.365891 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwt8n" podUID="0d640da7-6701-4c49-b1c4-efac1a49bea8" Jun 03 00:20:03.365996 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:20:03.365954 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h7qxw" podUID="3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf" Jun 03 00:20:03.526292 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:03.526264 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7gbw_25936d51-9126-434b-be53-677c56a0a8f7/ovn-acl-logging/0.log" Jun 03 00:20:03.527121 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:03.527091 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" event={"ID":"25936d51-9126-434b-be53-677c56a0a8f7","Type":"ContainerStarted","Data":"b23619e11802d51d73f327812735f7f941a78264fd2a752a90980184521732d3"} Jun 03 00:20:03.641291 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:03.641205 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xp7vr" Jun 03 00:20:03.642039 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:03.642019 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xp7vr" Jun 03 00:20:03.654317 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:03.654273 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7hjt" podStartSLOduration=4.319082463 podStartE2EDuration="24.65425846s" podCreationTimestamp="2026-06-03 00:19:39 +0000 UTC" firstStartedPulling="2026-06-03 00:19:41.921561283 +0000 UTC m=+3.141483851" lastFinishedPulling="2026-06-03 00:20:02.256737281 +0000 UTC m=+23.476659848" observedRunningTime="2026-06-03 00:20:02.536636803 +0000 UTC m=+23.756559377" watchObservedRunningTime="2026-06-03 00:20:03.65425846 +0000 UTC m=+24.874181046" Jun 03 00:20:04.530031 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:04.529773 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xp7vr" Jun 03 00:20:04.530649 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:04.530424 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xp7vr" Jun 03 00:20:05.363543 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:05.363508 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h7qxw" Jun 03 00:20:05.363782 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:05.363509 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwt8n" Jun 03 00:20:05.363782 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:20:05.363646 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h7qxw" podUID="3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf" Jun 03 00:20:05.363782 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:20:05.363732 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwt8n" podUID="0d640da7-6701-4c49-b1c4-efac1a49bea8" Jun 03 00:20:05.533827 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:05.533801 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7gbw_25936d51-9126-434b-be53-677c56a0a8f7/ovn-acl-logging/0.log" Jun 03 00:20:05.534197 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:05.534146 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" event={"ID":"25936d51-9126-434b-be53-677c56a0a8f7","Type":"ContainerStarted","Data":"1451115109fbd1c80bb48b908f653f0f841d615adf5db047cab9cbbdd1702125"} Jun 03 00:20:05.534495 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:05.534465 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:20:05.534629 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:05.534502 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:20:05.534629 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:05.534516 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:20:05.534629 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:05.534596 2559 scope.go:117] "RemoveContainer" containerID="bed64fa631968843c9f238f23eae4f9d0b8d69020e21b903e960320125b6a249" Jun 03 00:20:05.551947 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:05.551924 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:20:05.552513 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:05.552498 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:20:06.540496 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:06.540233 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7gbw_25936d51-9126-434b-be53-677c56a0a8f7/ovn-acl-logging/0.log" Jun 03 00:20:06.543559 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:06.543518 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" event={"ID":"25936d51-9126-434b-be53-677c56a0a8f7","Type":"ContainerStarted","Data":"b121b19b987285bf675676ec731b9c1a35a49c4acce7a0aea3a65660d5666245"} Jun 03 00:20:06.568762 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:06.568711 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" podStartSLOduration=9.634466977 podStartE2EDuration="27.568674027s" podCreationTimestamp="2026-06-03 00:19:39 +0000 UTC" firstStartedPulling="2026-06-03 00:19:41.924144345 +0000 UTC m=+3.144066901" lastFinishedPulling="2026-06-03 00:19:59.858351393 +0000 UTC m=+21.078273951" observedRunningTime="2026-06-03 00:20:06.567503488 +0000 UTC m=+27.787426063" watchObservedRunningTime="2026-06-03 00:20:06.568674027 +0000 UTC m=+27.788596601" Jun 03 00:20:06.863883 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:06.863819 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-h7qxw"] Jun 03 00:20:06.864080 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:06.864003 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h7qxw" Jun 03 00:20:06.864172 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:20:06.864147 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h7qxw" podUID="3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf" Jun 03 00:20:06.864601 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:06.864559 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jwt8n"] Jun 03 00:20:06.864754 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:06.864661 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwt8n" Jun 03 00:20:06.864834 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:20:06.864780 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwt8n" podUID="0d640da7-6701-4c49-b1c4-efac1a49bea8" Jun 03 00:20:08.363700 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:08.363496 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h7qxw" Jun 03 00:20:08.364111 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:08.363496 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwt8n" Jun 03 00:20:08.364111 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:20:08.363821 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h7qxw" podUID="3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf" Jun 03 00:20:08.364111 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:20:08.363856 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwt8n" podUID="0d640da7-6701-4c49-b1c4-efac1a49bea8" Jun 03 00:20:09.366001 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:09.365973 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h7qxw" Jun 03 00:20:09.366433 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:20:09.366105 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h7qxw" podUID="3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf" Jun 03 00:20:10.363266 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:10.363230 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwt8n" Jun 03 00:20:10.363445 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:20:10.363344 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwt8n" podUID="0d640da7-6701-4c49-b1c4-efac1a49bea8" Jun 03 00:20:10.554020 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:10.553986 2559 generic.go:358] "Generic (PLEG): container finished" podID="418186d3-434f-4d2f-afbf-2ba437ececd4" containerID="f622591fa3f2975fc707d0206bc4042d874bf297f5e7348e612e65f2f9b82bde" exitCode=0 Jun 03 00:20:10.554592 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:10.554046 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vns2z" event={"ID":"418186d3-434f-4d2f-afbf-2ba437ececd4","Type":"ContainerDied","Data":"f622591fa3f2975fc707d0206bc4042d874bf297f5e7348e612e65f2f9b82bde"} Jun 03 00:20:11.362932 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:11.362900 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h7qxw" Jun 03 00:20:11.363102 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:20:11.363009 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h7qxw" podUID="3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf" Jun 03 00:20:12.363330 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:12.363289 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwt8n" Jun 03 00:20:12.363830 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:20:12.363397 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwt8n" podUID="0d640da7-6701-4c49-b1c4-efac1a49bea8" Jun 03 00:20:12.559173 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:12.559138 2559 generic.go:358] "Generic (PLEG): container finished" podID="418186d3-434f-4d2f-afbf-2ba437ececd4" containerID="f337c3498f3a1e542d5507458e97b47dffb54e14cb3ae88b0e2fd4f938c21783" exitCode=0 Jun 03 00:20:12.559333 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:12.559188 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vns2z" event={"ID":"418186d3-434f-4d2f-afbf-2ba437ececd4","Type":"ContainerDied","Data":"f337c3498f3a1e542d5507458e97b47dffb54e14cb3ae88b0e2fd4f938c21783"} Jun 03 00:20:13.068488 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:13.068447 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-54n7j\" (UniqueName: \"kubernetes.io/projected/0d640da7-6701-4c49-b1c4-efac1a49bea8-kube-api-access-54n7j\") pod \"network-check-target-jwt8n\" (UID: \"0d640da7-6701-4c49-b1c4-efac1a49bea8\") " pod="openshift-network-diagnostics/network-check-target-jwt8n" Jun 03 00:20:13.068488 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:13.068494 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf-metrics-certs\") pod \"network-metrics-daemon-h7qxw\" (UID: \"3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf\") " pod="openshift-multus/network-metrics-daemon-h7qxw" Jun 03 00:20:13.068830 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:20:13.068605 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 00:20:13.068830 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:20:13.068617 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:20:13.068830 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:20:13.068625 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 00:20:13.068830 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:20:13.068635 2559 projected.go:194] Error preparing data for projected volume kube-api-access-54n7j for pod openshift-network-diagnostics/network-check-target-jwt8n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:20:13.068830 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:20:13.068705 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf-metrics-certs podName:3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf nodeName:}" failed. No retries permitted until 2026-06-03 00:20:45.068668481 +0000 UTC m=+66.288591034 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf-metrics-certs") pod "network-metrics-daemon-h7qxw" (UID: "3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:20:13.068830 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:20:13.068726 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d640da7-6701-4c49-b1c4-efac1a49bea8-kube-api-access-54n7j podName:0d640da7-6701-4c49-b1c4-efac1a49bea8 nodeName:}" failed. No retries permitted until 2026-06-03 00:20:45.068716474 +0000 UTC m=+66.288639027 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-54n7j" (UniqueName: "kubernetes.io/projected/0d640da7-6701-4c49-b1c4-efac1a49bea8-kube-api-access-54n7j") pod "network-check-target-jwt8n" (UID: "0d640da7-6701-4c49-b1c4-efac1a49bea8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:20:13.363178 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:13.363090 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h7qxw" Jun 03 00:20:13.363342 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:20:13.363223 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h7qxw" podUID="3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf" Jun 03 00:20:13.655701 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:13.655654 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-219.ec2.internal" event="NodeReady" Jun 03 00:20:13.656179 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:13.655829 2559 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 03 00:20:13.698410 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:13.698368 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-w2z46"] Jun 03 00:20:13.733246 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:13.733223 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lr49h"] Jun 03 00:20:13.733415 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:13.733394 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w2z46" Jun 03 00:20:13.735612 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:13.735593 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 00:20:13.735754 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:13.735655 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 00:20:13.735754 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:13.735661 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5c68x\"" Jun 03 00:20:13.755445 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:13.755412 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-w2z46"] Jun 03 00:20:13.755445 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:13.755446 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lr49h" Jun 03 00:20:13.755639 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:13.755449 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lr49h"] Jun 03 00:20:13.757292 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:13.757276 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 00:20:13.757452 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:13.757438 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 00:20:13.757500 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:13.757471 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8cxnz\"" Jun 03 00:20:13.757540 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:13.757528 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 00:20:13.872892 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:13.872848 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65351302-04fd-49bb-b5dc-836203281ad2-metrics-tls\") pod \"dns-default-w2z46\" (UID: \"65351302-04fd-49bb-b5dc-836203281ad2\") " pod="openshift-dns/dns-default-w2z46" Jun 03 00:20:13.873048 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:13.872951 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65351302-04fd-49bb-b5dc-836203281ad2-tmp-dir\") pod \"dns-default-w2z46\" (UID: \"65351302-04fd-49bb-b5dc-836203281ad2\") " pod="openshift-dns/dns-default-w2z46" Jun 03 00:20:13.873048 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:13.873009 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb4k6\" (UniqueName: \"kubernetes.io/projected/65351302-04fd-49bb-b5dc-836203281ad2-kube-api-access-wb4k6\") pod \"dns-default-w2z46\" (UID: \"65351302-04fd-49bb-b5dc-836203281ad2\") " pod="openshift-dns/dns-default-w2z46" Jun 03 00:20:13.873048 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:13.873026 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7ed00dab-a3f9-41cf-8bfc-80db5e4ea202-cert\") pod \"ingress-canary-lr49h\" (UID: \"7ed00dab-a3f9-41cf-8bfc-80db5e4ea202\") " pod="openshift-ingress-canary/ingress-canary-lr49h" Jun 03 00:20:13.873161 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:13.873061 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/65351302-04fd-49bb-b5dc-836203281ad2-config-volume\") pod \"dns-default-w2z46\" (UID: \"65351302-04fd-49bb-b5dc-836203281ad2\") " pod="openshift-dns/dns-default-w2z46" Jun 03 00:20:13.873161 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:13.873079 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bgsv\" (UniqueName: \"kubernetes.io/projected/7ed00dab-a3f9-41cf-8bfc-80db5e4ea202-kube-api-access-6bgsv\") pod \"ingress-canary-lr49h\" (UID: \"7ed00dab-a3f9-41cf-8bfc-80db5e4ea202\") " pod="openshift-ingress-canary/ingress-canary-lr49h" Jun 03 00:20:13.974207 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:13.974115 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/65351302-04fd-49bb-b5dc-836203281ad2-config-volume\") pod \"dns-default-w2z46\" (UID: \"65351302-04fd-49bb-b5dc-836203281ad2\") " pod="openshift-dns/dns-default-w2z46" Jun 03 00:20:13.974207 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:13.974165 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6bgsv\" (UniqueName: \"kubernetes.io/projected/7ed00dab-a3f9-41cf-8bfc-80db5e4ea202-kube-api-access-6bgsv\") pod \"ingress-canary-lr49h\" (UID: \"7ed00dab-a3f9-41cf-8bfc-80db5e4ea202\") " pod="openshift-ingress-canary/ingress-canary-lr49h" Jun 03 00:20:13.974416 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:13.974257 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65351302-04fd-49bb-b5dc-836203281ad2-metrics-tls\") pod \"dns-default-w2z46\" (UID: \"65351302-04fd-49bb-b5dc-836203281ad2\") " pod="openshift-dns/dns-default-w2z46" Jun 03 00:20:13.974416 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:13.974302 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65351302-04fd-49bb-b5dc-836203281ad2-tmp-dir\") pod \"dns-default-w2z46\" (UID: \"65351302-04fd-49bb-b5dc-836203281ad2\") " pod="openshift-dns/dns-default-w2z46" Jun 03 00:20:13.974416 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:13.974335 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wb4k6\" (UniqueName: \"kubernetes.io/projected/65351302-04fd-49bb-b5dc-836203281ad2-kube-api-access-wb4k6\") pod \"dns-default-w2z46\" (UID: \"65351302-04fd-49bb-b5dc-836203281ad2\") " pod="openshift-dns/dns-default-w2z46" Jun 03 00:20:13.974416 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:13.974350 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7ed00dab-a3f9-41cf-8bfc-80db5e4ea202-cert\") pod \"ingress-canary-lr49h\" (UID: \"7ed00dab-a3f9-41cf-8bfc-80db5e4ea202\") " pod="openshift-ingress-canary/ingress-canary-lr49h" Jun 03 00:20:13.974607 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:20:13.974423 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 00:20:13.974607 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:20:13.974450 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 00:20:13.974607 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:20:13.974502 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65351302-04fd-49bb-b5dc-836203281ad2-metrics-tls podName:65351302-04fd-49bb-b5dc-836203281ad2 nodeName:}" failed. No retries permitted until 2026-06-03 00:20:14.474480914 +0000 UTC m=+35.694403486 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65351302-04fd-49bb-b5dc-836203281ad2-metrics-tls") pod "dns-default-w2z46" (UID: "65351302-04fd-49bb-b5dc-836203281ad2") : secret "dns-default-metrics-tls" not found Jun 03 00:20:13.974607 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:20:13.974522 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ed00dab-a3f9-41cf-8bfc-80db5e4ea202-cert podName:7ed00dab-a3f9-41cf-8bfc-80db5e4ea202 nodeName:}" failed. No retries permitted until 2026-06-03 00:20:14.474512783 +0000 UTC m=+35.694435337 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7ed00dab-a3f9-41cf-8bfc-80db5e4ea202-cert") pod "ingress-canary-lr49h" (UID: "7ed00dab-a3f9-41cf-8bfc-80db5e4ea202") : secret "canary-serving-cert" not found Jun 03 00:20:13.974848 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:13.974610 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65351302-04fd-49bb-b5dc-836203281ad2-tmp-dir\") pod \"dns-default-w2z46\" (UID: \"65351302-04fd-49bb-b5dc-836203281ad2\") " pod="openshift-dns/dns-default-w2z46" Jun 03 00:20:13.974848 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:13.974797 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/65351302-04fd-49bb-b5dc-836203281ad2-config-volume\") pod \"dns-default-w2z46\" (UID: \"65351302-04fd-49bb-b5dc-836203281ad2\") " pod="openshift-dns/dns-default-w2z46" Jun 03 00:20:13.983916 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:13.983892 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb4k6\" (UniqueName: \"kubernetes.io/projected/65351302-04fd-49bb-b5dc-836203281ad2-kube-api-access-wb4k6\") pod \"dns-default-w2z46\" (UID: \"65351302-04fd-49bb-b5dc-836203281ad2\") " pod="openshift-dns/dns-default-w2z46" Jun 03 00:20:13.984032 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:13.983961 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bgsv\" (UniqueName: \"kubernetes.io/projected/7ed00dab-a3f9-41cf-8bfc-80db5e4ea202-kube-api-access-6bgsv\") pod \"ingress-canary-lr49h\" (UID: \"7ed00dab-a3f9-41cf-8bfc-80db5e4ea202\") " pod="openshift-ingress-canary/ingress-canary-lr49h" Jun 03 00:20:14.363209 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:14.363174 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwt8n" Jun 03 00:20:14.365353 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:14.365332 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 00:20:14.365475 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:14.365356 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nw924\"" Jun 03 00:20:14.365475 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:14.365364 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 00:20:14.476961 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:14.476926 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65351302-04fd-49bb-b5dc-836203281ad2-metrics-tls\") pod \"dns-default-w2z46\" (UID: \"65351302-04fd-49bb-b5dc-836203281ad2\") " pod="openshift-dns/dns-default-w2z46" Jun 03 00:20:14.477128 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:14.477005 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7ed00dab-a3f9-41cf-8bfc-80db5e4ea202-cert\") pod \"ingress-canary-lr49h\" (UID: \"7ed00dab-a3f9-41cf-8bfc-80db5e4ea202\") " pod="openshift-ingress-canary/ingress-canary-lr49h" Jun 03 00:20:14.477128 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:20:14.477080 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 00:20:14.477128 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:20:14.477090 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 00:20:14.477223 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:20:14.477141 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ed00dab-a3f9-41cf-8bfc-80db5e4ea202-cert podName:7ed00dab-a3f9-41cf-8bfc-80db5e4ea202 nodeName:}" failed. No retries permitted until 2026-06-03 00:20:15.477128563 +0000 UTC m=+36.697051116 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7ed00dab-a3f9-41cf-8bfc-80db5e4ea202-cert") pod "ingress-canary-lr49h" (UID: "7ed00dab-a3f9-41cf-8bfc-80db5e4ea202") : secret "canary-serving-cert" not found Jun 03 00:20:14.477223 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:20:14.477155 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65351302-04fd-49bb-b5dc-836203281ad2-metrics-tls podName:65351302-04fd-49bb-b5dc-836203281ad2 nodeName:}" failed. No retries permitted until 2026-06-03 00:20:15.477149721 +0000 UTC m=+36.697072274 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65351302-04fd-49bb-b5dc-836203281ad2-metrics-tls") pod "dns-default-w2z46" (UID: "65351302-04fd-49bb-b5dc-836203281ad2") : secret "dns-default-metrics-tls" not found Jun 03 00:20:14.564448 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:14.564406 2559 generic.go:358] "Generic (PLEG): container finished" podID="418186d3-434f-4d2f-afbf-2ba437ececd4" containerID="94f26da30802feb1c1e59ad39003fb0adfa9349b70554db9be007512811f9a16" exitCode=0 Jun 03 00:20:14.564601 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:14.564483 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vns2z" event={"ID":"418186d3-434f-4d2f-afbf-2ba437ececd4","Type":"ContainerDied","Data":"94f26da30802feb1c1e59ad39003fb0adfa9349b70554db9be007512811f9a16"} Jun 03 00:20:15.363047 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:15.363012 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h7qxw" Jun 03 00:20:15.365278 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:15.365253 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 00:20:15.365432 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:15.365254 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-88bpn\"" Jun 03 00:20:15.483154 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:15.483107 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7ed00dab-a3f9-41cf-8bfc-80db5e4ea202-cert\") pod \"ingress-canary-lr49h\" (UID: \"7ed00dab-a3f9-41cf-8bfc-80db5e4ea202\") " pod="openshift-ingress-canary/ingress-canary-lr49h" Jun 03 00:20:15.483154 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:15.483163 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65351302-04fd-49bb-b5dc-836203281ad2-metrics-tls\") pod \"dns-default-w2z46\" (UID: \"65351302-04fd-49bb-b5dc-836203281ad2\") " pod="openshift-dns/dns-default-w2z46" Jun 03 00:20:15.483396 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:20:15.483275 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 00:20:15.483396 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:20:15.483296 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 00:20:15.483396 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:20:15.483359 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ed00dab-a3f9-41cf-8bfc-80db5e4ea202-cert podName:7ed00dab-a3f9-41cf-8bfc-80db5e4ea202 nodeName:}" failed. No retries permitted until 2026-06-03 00:20:17.483337903 +0000 UTC m=+38.703260465 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7ed00dab-a3f9-41cf-8bfc-80db5e4ea202-cert") pod "ingress-canary-lr49h" (UID: "7ed00dab-a3f9-41cf-8bfc-80db5e4ea202") : secret "canary-serving-cert" not found Jun 03 00:20:15.483396 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:20:15.483379 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65351302-04fd-49bb-b5dc-836203281ad2-metrics-tls podName:65351302-04fd-49bb-b5dc-836203281ad2 nodeName:}" failed. No retries permitted until 2026-06-03 00:20:17.483369304 +0000 UTC m=+38.703291885 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65351302-04fd-49bb-b5dc-836203281ad2-metrics-tls") pod "dns-default-w2z46" (UID: "65351302-04fd-49bb-b5dc-836203281ad2") : secret "dns-default-metrics-tls" not found Jun 03 00:20:17.499375 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:17.499149 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65351302-04fd-49bb-b5dc-836203281ad2-metrics-tls\") pod \"dns-default-w2z46\" (UID: \"65351302-04fd-49bb-b5dc-836203281ad2\") " pod="openshift-dns/dns-default-w2z46" Jun 03 00:20:17.499823 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:17.499432 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7ed00dab-a3f9-41cf-8bfc-80db5e4ea202-cert\") pod \"ingress-canary-lr49h\" (UID: \"7ed00dab-a3f9-41cf-8bfc-80db5e4ea202\") " pod="openshift-ingress-canary/ingress-canary-lr49h" Jun 03 00:20:17.499823 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:20:17.499303 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 00:20:17.499823 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:20:17.499525 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65351302-04fd-49bb-b5dc-836203281ad2-metrics-tls podName:65351302-04fd-49bb-b5dc-836203281ad2 nodeName:}" failed. No retries permitted until 2026-06-03 00:20:21.499502 +0000 UTC m=+42.719424571 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65351302-04fd-49bb-b5dc-836203281ad2-metrics-tls") pod "dns-default-w2z46" (UID: "65351302-04fd-49bb-b5dc-836203281ad2") : secret "dns-default-metrics-tls" not found Jun 03 00:20:17.499823 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:20:17.499536 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 00:20:17.499823 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:20:17.499586 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ed00dab-a3f9-41cf-8bfc-80db5e4ea202-cert podName:7ed00dab-a3f9-41cf-8bfc-80db5e4ea202 nodeName:}" failed. No retries permitted until 2026-06-03 00:20:21.499570289 +0000 UTC m=+42.719492847 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7ed00dab-a3f9-41cf-8bfc-80db5e4ea202-cert") pod "ingress-canary-lr49h" (UID: "7ed00dab-a3f9-41cf-8bfc-80db5e4ea202") : secret "canary-serving-cert" not found Jun 03 00:20:20.577866 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:20.577831 2559 generic.go:358] "Generic (PLEG): container finished" podID="418186d3-434f-4d2f-afbf-2ba437ececd4" containerID="bf834b696dbe0942fcb180dac73b1435c07c1a444a482da46985fd8a6fc9a397" exitCode=0 Jun 03 00:20:20.578234 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:20.577898 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vns2z" event={"ID":"418186d3-434f-4d2f-afbf-2ba437ececd4","Type":"ContainerDied","Data":"bf834b696dbe0942fcb180dac73b1435c07c1a444a482da46985fd8a6fc9a397"} Jun 03 00:20:21.531675 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:21.531615 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7ed00dab-a3f9-41cf-8bfc-80db5e4ea202-cert\") pod \"ingress-canary-lr49h\" (UID: \"7ed00dab-a3f9-41cf-8bfc-80db5e4ea202\") " pod="openshift-ingress-canary/ingress-canary-lr49h" Jun 03 00:20:21.531886 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:21.531708 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65351302-04fd-49bb-b5dc-836203281ad2-metrics-tls\") pod \"dns-default-w2z46\" (UID: \"65351302-04fd-49bb-b5dc-836203281ad2\") " pod="openshift-dns/dns-default-w2z46" Jun 03 00:20:21.531886 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:20:21.531806 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 00:20:21.531886 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:20:21.531867 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65351302-04fd-49bb-b5dc-836203281ad2-metrics-tls podName:65351302-04fd-49bb-b5dc-836203281ad2 nodeName:}" failed. No retries permitted until 2026-06-03 00:20:29.531849081 +0000 UTC m=+50.751771634 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65351302-04fd-49bb-b5dc-836203281ad2-metrics-tls") pod "dns-default-w2z46" (UID: "65351302-04fd-49bb-b5dc-836203281ad2") : secret "dns-default-metrics-tls" not found Jun 03 00:20:21.531995 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:20:21.531806 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 00:20:21.531995 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:20:21.531925 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ed00dab-a3f9-41cf-8bfc-80db5e4ea202-cert podName:7ed00dab-a3f9-41cf-8bfc-80db5e4ea202 nodeName:}" failed. No retries permitted until 2026-06-03 00:20:29.531913243 +0000 UTC m=+50.751835810 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7ed00dab-a3f9-41cf-8bfc-80db5e4ea202-cert") pod "ingress-canary-lr49h" (UID: "7ed00dab-a3f9-41cf-8bfc-80db5e4ea202") : secret "canary-serving-cert" not found Jun 03 00:20:21.581650 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:21.581620 2559 generic.go:358] "Generic (PLEG): container finished" podID="418186d3-434f-4d2f-afbf-2ba437ececd4" containerID="ca65f8aa5dc310a1abbbdb55e95cf3f52d973e44da70c11ba2c6bb671b776e4d" exitCode=0 Jun 03 00:20:21.582093 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:21.581702 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vns2z" event={"ID":"418186d3-434f-4d2f-afbf-2ba437ececd4","Type":"ContainerDied","Data":"ca65f8aa5dc310a1abbbdb55e95cf3f52d973e44da70c11ba2c6bb671b776e4d"} Jun 03 00:20:22.586702 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:22.586655 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vns2z" event={"ID":"418186d3-434f-4d2f-afbf-2ba437ececd4","Type":"ContainerStarted","Data":"8b167a76179d5e44c55afa116fc366cd355bb8d7a79632624217ba3dc28abd95"} Jun 03 00:20:22.608753 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:22.608703 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vns2z" podStartSLOduration=5.441586904 podStartE2EDuration="43.608668734s" podCreationTimestamp="2026-06-03 00:19:39 +0000 UTC" firstStartedPulling="2026-06-03 00:19:41.933641836 +0000 UTC m=+3.153564389" lastFinishedPulling="2026-06-03 00:20:20.100723653 +0000 UTC m=+41.320646219" observedRunningTime="2026-06-03 00:20:22.607704977 +0000 UTC m=+43.827627549" watchObservedRunningTime="2026-06-03 00:20:22.608668734 +0000 UTC m=+43.828591335" Jun 03 00:20:29.589771 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:29.589730 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7ed00dab-a3f9-41cf-8bfc-80db5e4ea202-cert\") pod \"ingress-canary-lr49h\" (UID: \"7ed00dab-a3f9-41cf-8bfc-80db5e4ea202\") " pod="openshift-ingress-canary/ingress-canary-lr49h" Jun 03 00:20:29.590371 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:29.589783 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65351302-04fd-49bb-b5dc-836203281ad2-metrics-tls\") pod \"dns-default-w2z46\" (UID: \"65351302-04fd-49bb-b5dc-836203281ad2\") " pod="openshift-dns/dns-default-w2z46" Jun 03 00:20:29.590371 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:20:29.589942 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 00:20:29.590371 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:20:29.589956 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 00:20:29.590371 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:20:29.590043 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65351302-04fd-49bb-b5dc-836203281ad2-metrics-tls podName:65351302-04fd-49bb-b5dc-836203281ad2 nodeName:}" failed. No retries permitted until 2026-06-03 00:20:45.590029593 +0000 UTC m=+66.809952146 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65351302-04fd-49bb-b5dc-836203281ad2-metrics-tls") pod "dns-default-w2z46" (UID: "65351302-04fd-49bb-b5dc-836203281ad2") : secret "dns-default-metrics-tls" not found Jun 03 00:20:29.590371 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:20:29.590056 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ed00dab-a3f9-41cf-8bfc-80db5e4ea202-cert podName:7ed00dab-a3f9-41cf-8bfc-80db5e4ea202 nodeName:}" failed. No retries permitted until 2026-06-03 00:20:45.590050241 +0000 UTC m=+66.809972794 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7ed00dab-a3f9-41cf-8bfc-80db5e4ea202-cert") pod "ingress-canary-lr49h" (UID: "7ed00dab-a3f9-41cf-8bfc-80db5e4ea202") : secret "canary-serving-cert" not found Jun 03 00:20:37.556940 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:37.556916 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t7gbw" Jun 03 00:20:40.390478 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:40.390441 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-788bf58df5-qqf6x"] Jun 03 00:20:40.394651 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:40.394627 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-rslkg"] Jun 03 00:20:40.394783 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:40.394716 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-qqf6x" Jun 03 00:20:40.396568 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:40.396547 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 03 00:20:40.396718 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:40.396703 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-rslkg" Jun 03 00:20:40.396789 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:40.396743 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 03 00:20:40.396903 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:40.396880 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 00:20:40.397130 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:40.397095 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 00:20:40.397330 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:40.397315 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-fks84\"" Jun 03 00:20:40.398605 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:40.398586 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-fcgnd\"" Jun 03 00:20:40.398908 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:40.398890 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 03 00:20:40.399072 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:40.398985 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 03 00:20:40.402441 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:40.402417 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-rslkg"] Jun 03 00:20:40.402849 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:40.402828 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-qqf6x"] Jun 03 00:20:40.403960 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:40.403941 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 03 00:20:40.562040 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:40.561994 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d8857f61-7b88-44cd-a25d-ce64ef219677-snapshots\") pod \"insights-operator-788bf58df5-qqf6x\" (UID: \"d8857f61-7b88-44cd-a25d-ce64ef219677\") " pod="openshift-insights/insights-operator-788bf58df5-qqf6x" Jun 03 00:20:40.562221 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:40.562055 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6w5hw\" (UniqueName: \"kubernetes.io/projected/d8857f61-7b88-44cd-a25d-ce64ef219677-kube-api-access-6w5hw\") pod \"insights-operator-788bf58df5-qqf6x\" (UID: \"d8857f61-7b88-44cd-a25d-ce64ef219677\") " pod="openshift-insights/insights-operator-788bf58df5-qqf6x" Jun 03 00:20:40.562221 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:40.562146 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgqgc\" (UniqueName: \"kubernetes.io/projected/0013b882-e487-4334-971a-c4d1231c4bf0-kube-api-access-hgqgc\") pod \"volume-data-source-validator-7598fd5bd-rslkg\" (UID: \"0013b882-e487-4334-971a-c4d1231c4bf0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-rslkg" Jun 03 00:20:40.562221 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:40.562176 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8857f61-7b88-44cd-a25d-ce64ef219677-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-qqf6x\" (UID: \"d8857f61-7b88-44cd-a25d-ce64ef219677\") " pod="openshift-insights/insights-operator-788bf58df5-qqf6x" Jun 03 00:20:40.562221 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:40.562201 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8857f61-7b88-44cd-a25d-ce64ef219677-service-ca-bundle\") pod \"insights-operator-788bf58df5-qqf6x\" (UID: \"d8857f61-7b88-44cd-a25d-ce64ef219677\") " pod="openshift-insights/insights-operator-788bf58df5-qqf6x" Jun 03 00:20:40.562356 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:40.562229 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d8857f61-7b88-44cd-a25d-ce64ef219677-serving-cert\") pod \"insights-operator-788bf58df5-qqf6x\" (UID: \"d8857f61-7b88-44cd-a25d-ce64ef219677\") " pod="openshift-insights/insights-operator-788bf58df5-qqf6x" Jun 03 00:20:40.562356 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:40.562256 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8857f61-7b88-44cd-a25d-ce64ef219677-tmp\") pod \"insights-operator-788bf58df5-qqf6x\" (UID: \"d8857f61-7b88-44cd-a25d-ce64ef219677\") " pod="openshift-insights/insights-operator-788bf58df5-qqf6x" Jun 03 00:20:40.663041 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:40.662949 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8857f61-7b88-44cd-a25d-ce64ef219677-tmp\") pod \"insights-operator-788bf58df5-qqf6x\" (UID: \"d8857f61-7b88-44cd-a25d-ce64ef219677\") " pod="openshift-insights/insights-operator-788bf58df5-qqf6x" Jun 03 00:20:40.663041 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:40.662988 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d8857f61-7b88-44cd-a25d-ce64ef219677-snapshots\") pod \"insights-operator-788bf58df5-qqf6x\" (UID: \"d8857f61-7b88-44cd-a25d-ce64ef219677\") " pod="openshift-insights/insights-operator-788bf58df5-qqf6x" Jun 03 00:20:40.663253 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:40.663068 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6w5hw\" (UniqueName: \"kubernetes.io/projected/d8857f61-7b88-44cd-a25d-ce64ef219677-kube-api-access-6w5hw\") pod \"insights-operator-788bf58df5-qqf6x\" (UID: \"d8857f61-7b88-44cd-a25d-ce64ef219677\") " pod="openshift-insights/insights-operator-788bf58df5-qqf6x" Jun 03 00:20:40.663253 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:40.663160 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hgqgc\" (UniqueName: \"kubernetes.io/projected/0013b882-e487-4334-971a-c4d1231c4bf0-kube-api-access-hgqgc\") pod \"volume-data-source-validator-7598fd5bd-rslkg\" (UID: \"0013b882-e487-4334-971a-c4d1231c4bf0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-rslkg" Jun 03 00:20:40.663253 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:40.663179 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8857f61-7b88-44cd-a25d-ce64ef219677-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-qqf6x\" (UID: \"d8857f61-7b88-44cd-a25d-ce64ef219677\") " pod="openshift-insights/insights-operator-788bf58df5-qqf6x" Jun 03 00:20:40.663253 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:40.663195 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8857f61-7b88-44cd-a25d-ce64ef219677-service-ca-bundle\") pod \"insights-operator-788bf58df5-qqf6x\" (UID: \"d8857f61-7b88-44cd-a25d-ce64ef219677\") " pod="openshift-insights/insights-operator-788bf58df5-qqf6x" Jun 03 00:20:40.663253 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:40.663220 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d8857f61-7b88-44cd-a25d-ce64ef219677-serving-cert\") pod \"insights-operator-788bf58df5-qqf6x\" (UID: \"d8857f61-7b88-44cd-a25d-ce64ef219677\") " pod="openshift-insights/insights-operator-788bf58df5-qqf6x" Jun 03 00:20:40.663634 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:40.663612 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d8857f61-7b88-44cd-a25d-ce64ef219677-snapshots\") pod \"insights-operator-788bf58df5-qqf6x\" (UID: \"d8857f61-7b88-44cd-a25d-ce64ef219677\") " pod="openshift-insights/insights-operator-788bf58df5-qqf6x" Jun 03 00:20:40.663754 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:40.663613 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8857f61-7b88-44cd-a25d-ce64ef219677-tmp\") pod \"insights-operator-788bf58df5-qqf6x\" (UID: \"d8857f61-7b88-44cd-a25d-ce64ef219677\") " pod="openshift-insights/insights-operator-788bf58df5-qqf6x" Jun 03 00:20:40.663825 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:40.663807 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8857f61-7b88-44cd-a25d-ce64ef219677-service-ca-bundle\") pod \"insights-operator-788bf58df5-qqf6x\" (UID: \"d8857f61-7b88-44cd-a25d-ce64ef219677\") " pod="openshift-insights/insights-operator-788bf58df5-qqf6x" Jun 03 00:20:40.664077 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:40.664055 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8857f61-7b88-44cd-a25d-ce64ef219677-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-qqf6x\" (UID: \"d8857f61-7b88-44cd-a25d-ce64ef219677\") " pod="openshift-insights/insights-operator-788bf58df5-qqf6x" Jun 03 00:20:40.665996 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:40.665975 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d8857f61-7b88-44cd-a25d-ce64ef219677-serving-cert\") pod \"insights-operator-788bf58df5-qqf6x\" (UID: \"d8857f61-7b88-44cd-a25d-ce64ef219677\") " pod="openshift-insights/insights-operator-788bf58df5-qqf6x" Jun 03 00:20:40.673424 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:40.673399 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6w5hw\" (UniqueName: \"kubernetes.io/projected/d8857f61-7b88-44cd-a25d-ce64ef219677-kube-api-access-6w5hw\") pod \"insights-operator-788bf58df5-qqf6x\" (UID: \"d8857f61-7b88-44cd-a25d-ce64ef219677\") " pod="openshift-insights/insights-operator-788bf58df5-qqf6x" Jun 03 00:20:40.673779 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:40.673758 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgqgc\" (UniqueName: \"kubernetes.io/projected/0013b882-e487-4334-971a-c4d1231c4bf0-kube-api-access-hgqgc\") pod \"volume-data-source-validator-7598fd5bd-rslkg\" (UID: \"0013b882-e487-4334-971a-c4d1231c4bf0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-rslkg" Jun 03 00:20:40.706141 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:40.706099 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-qqf6x" Jun 03 00:20:40.711866 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:40.711840 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-rslkg" Jun 03 00:20:40.861640 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:40.861604 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-qqf6x"] Jun 03 00:20:40.864913 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:20:40.864887 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8857f61_7b88_44cd_a25d_ce64ef219677.slice/crio-8f62e8a7d4226fa251f0f05df116e43463d8e1846a6d01ebe121418f9c4cf38b WatchSource:0}: Error finding container 8f62e8a7d4226fa251f0f05df116e43463d8e1846a6d01ebe121418f9c4cf38b: Status 404 returned error can't find the container with id 8f62e8a7d4226fa251f0f05df116e43463d8e1846a6d01ebe121418f9c4cf38b Jun 03 00:20:40.871224 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:40.871199 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-rslkg"] Jun 03 00:20:40.873989 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:20:40.873963 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0013b882_e487_4334_971a_c4d1231c4bf0.slice/crio-e37197997fecb30f35c7ad3070698acc2ac20beebd4aab7b5a1ef6ba18a34868 WatchSource:0}: Error finding container e37197997fecb30f35c7ad3070698acc2ac20beebd4aab7b5a1ef6ba18a34868: Status 404 returned error can't find the container with id e37197997fecb30f35c7ad3070698acc2ac20beebd4aab7b5a1ef6ba18a34868 Jun 03 00:20:41.366226 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:41.366183 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-7n7x2"] Jun 03 00:20:41.368351 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:41.368328 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-7n7x2" Jun 03 00:20:41.370401 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:41.370380 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 03 00:20:41.371139 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:41.371113 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-xg96k\"" Jun 03 00:20:41.371265 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:41.371251 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 03 00:20:41.372106 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:41.372076 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 03 00:20:41.373655 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:41.372820 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 03 00:20:41.376472 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:41.376448 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-7n7x2"] Jun 03 00:20:41.379831 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:41.379807 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 03 00:20:41.468734 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:41.468698 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ec539906-3be0-4a60-9ea2-5f07074c913a-config\") pod \"console-operator-86d7c6cc77-7n7x2\" (UID: \"ec539906-3be0-4a60-9ea2-5f07074c913a\") " pod="openshift-console-operator/console-operator-86d7c6cc77-7n7x2" Jun 03 00:20:41.468734 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:41.468738 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ec539906-3be0-4a60-9ea2-5f07074c913a-serving-cert\") pod \"console-operator-86d7c6cc77-7n7x2\" (UID: \"ec539906-3be0-4a60-9ea2-5f07074c913a\") " pod="openshift-console-operator/console-operator-86d7c6cc77-7n7x2" Jun 03 00:20:41.469127 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:41.468807 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ec539906-3be0-4a60-9ea2-5f07074c913a-trusted-ca\") pod \"console-operator-86d7c6cc77-7n7x2\" (UID: \"ec539906-3be0-4a60-9ea2-5f07074c913a\") " pod="openshift-console-operator/console-operator-86d7c6cc77-7n7x2" Jun 03 00:20:41.469127 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:41.468846 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xd2mh\" (UniqueName: \"kubernetes.io/projected/ec539906-3be0-4a60-9ea2-5f07074c913a-kube-api-access-xd2mh\") pod \"console-operator-86d7c6cc77-7n7x2\" (UID: \"ec539906-3be0-4a60-9ea2-5f07074c913a\") " pod="openshift-console-operator/console-operator-86d7c6cc77-7n7x2" Jun 03 00:20:41.570300 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:41.570261 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ec539906-3be0-4a60-9ea2-5f07074c913a-config\") pod \"console-operator-86d7c6cc77-7n7x2\" (UID: \"ec539906-3be0-4a60-9ea2-5f07074c913a\") " pod="openshift-console-operator/console-operator-86d7c6cc77-7n7x2" Jun 03 00:20:41.570492 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:41.570308 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ec539906-3be0-4a60-9ea2-5f07074c913a-serving-cert\") pod \"console-operator-86d7c6cc77-7n7x2\" (UID: \"ec539906-3be0-4a60-9ea2-5f07074c913a\") " pod="openshift-console-operator/console-operator-86d7c6cc77-7n7x2" Jun 03 00:20:41.570492 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:41.570334 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ec539906-3be0-4a60-9ea2-5f07074c913a-trusted-ca\") pod \"console-operator-86d7c6cc77-7n7x2\" (UID: \"ec539906-3be0-4a60-9ea2-5f07074c913a\") " pod="openshift-console-operator/console-operator-86d7c6cc77-7n7x2" Jun 03 00:20:41.570492 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:41.570388 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xd2mh\" (UniqueName: \"kubernetes.io/projected/ec539906-3be0-4a60-9ea2-5f07074c913a-kube-api-access-xd2mh\") pod \"console-operator-86d7c6cc77-7n7x2\" (UID: \"ec539906-3be0-4a60-9ea2-5f07074c913a\") " pod="openshift-console-operator/console-operator-86d7c6cc77-7n7x2" Jun 03 00:20:41.571752 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:41.571720 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ec539906-3be0-4a60-9ea2-5f07074c913a-config\") pod \"console-operator-86d7c6cc77-7n7x2\" (UID: \"ec539906-3be0-4a60-9ea2-5f07074c913a\") " pod="openshift-console-operator/console-operator-86d7c6cc77-7n7x2" Jun 03 00:20:41.571894 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:41.571784 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ec539906-3be0-4a60-9ea2-5f07074c913a-trusted-ca\") pod \"console-operator-86d7c6cc77-7n7x2\" (UID: \"ec539906-3be0-4a60-9ea2-5f07074c913a\") " pod="openshift-console-operator/console-operator-86d7c6cc77-7n7x2" Jun 03 00:20:41.573200 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:41.573171 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ec539906-3be0-4a60-9ea2-5f07074c913a-serving-cert\") pod \"console-operator-86d7c6cc77-7n7x2\" (UID: \"ec539906-3be0-4a60-9ea2-5f07074c913a\") " pod="openshift-console-operator/console-operator-86d7c6cc77-7n7x2" Jun 03 00:20:41.578320 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:41.578295 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xd2mh\" (UniqueName: \"kubernetes.io/projected/ec539906-3be0-4a60-9ea2-5f07074c913a-kube-api-access-xd2mh\") pod \"console-operator-86d7c6cc77-7n7x2\" (UID: \"ec539906-3be0-4a60-9ea2-5f07074c913a\") " pod="openshift-console-operator/console-operator-86d7c6cc77-7n7x2" Jun 03 00:20:41.621527 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:41.621446 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-rslkg" event={"ID":"0013b882-e487-4334-971a-c4d1231c4bf0","Type":"ContainerStarted","Data":"e37197997fecb30f35c7ad3070698acc2ac20beebd4aab7b5a1ef6ba18a34868"} Jun 03 00:20:41.622304 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:41.622283 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-qqf6x" event={"ID":"d8857f61-7b88-44cd-a25d-ce64ef219677","Type":"ContainerStarted","Data":"8f62e8a7d4226fa251f0f05df116e43463d8e1846a6d01ebe121418f9c4cf38b"} Jun 03 00:20:41.682355 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:41.682319 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-7n7x2" Jun 03 00:20:41.829625 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:41.829589 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-7n7x2"] Jun 03 00:20:41.833160 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:20:41.833125 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec539906_3be0_4a60_9ea2_5f07074c913a.slice/crio-3177011cb258c2632a712e018d3d952b56b0eb0a9a8d30389d5375068e10d350 WatchSource:0}: Error finding container 3177011cb258c2632a712e018d3d952b56b0eb0a9a8d30389d5375068e10d350: Status 404 returned error can't find the container with id 3177011cb258c2632a712e018d3d952b56b0eb0a9a8d30389d5375068e10d350 Jun 03 00:20:42.625200 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:42.625159 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-7n7x2" event={"ID":"ec539906-3be0-4a60-9ea2-5f07074c913a","Type":"ContainerStarted","Data":"3177011cb258c2632a712e018d3d952b56b0eb0a9a8d30389d5375068e10d350"} Jun 03 00:20:43.628808 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:43.628707 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-rslkg" event={"ID":"0013b882-e487-4334-971a-c4d1231c4bf0","Type":"ContainerStarted","Data":"d2598c34eaf9b14271911bc711ceb2484633ec1ba243a2ed0ae3c2be26c8dc9b"} Jun 03 00:20:43.630171 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:43.630147 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-qqf6x" event={"ID":"d8857f61-7b88-44cd-a25d-ce64ef219677","Type":"ContainerStarted","Data":"75da966ec317722b032068b1d077d705ef1133418ec758fb7b8cad00732b4cc4"} Jun 03 00:20:43.641656 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:43.641618 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-rslkg" podStartSLOduration=1.87817508 podStartE2EDuration="3.641605517s" podCreationTimestamp="2026-06-03 00:20:40 +0000 UTC" firstStartedPulling="2026-06-03 00:20:40.87574458 +0000 UTC m=+62.095667133" lastFinishedPulling="2026-06-03 00:20:42.639175016 +0000 UTC m=+63.859097570" observedRunningTime="2026-06-03 00:20:43.640895821 +0000 UTC m=+64.860818396" watchObservedRunningTime="2026-06-03 00:20:43.641605517 +0000 UTC m=+64.861528092" Jun 03 00:20:43.659776 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:43.659715 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-788bf58df5-qqf6x" podStartSLOduration=1.177761777 podStartE2EDuration="3.65967913s" podCreationTimestamp="2026-06-03 00:20:40 +0000 UTC" firstStartedPulling="2026-06-03 00:20:40.866728807 +0000 UTC m=+62.086651360" lastFinishedPulling="2026-06-03 00:20:43.348646157 +0000 UTC m=+64.568568713" observedRunningTime="2026-06-03 00:20:43.658674726 +0000 UTC m=+64.878597295" watchObservedRunningTime="2026-06-03 00:20:43.65967913 +0000 UTC m=+64.879601707" Jun 03 00:20:45.097574 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:45.097465 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-54n7j\" (UniqueName: \"kubernetes.io/projected/0d640da7-6701-4c49-b1c4-efac1a49bea8-kube-api-access-54n7j\") pod \"network-check-target-jwt8n\" (UID: \"0d640da7-6701-4c49-b1c4-efac1a49bea8\") " pod="openshift-network-diagnostics/network-check-target-jwt8n" Jun 03 00:20:45.097574 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:45.097520 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf-metrics-certs\") pod \"network-metrics-daemon-h7qxw\" (UID: \"3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf\") " pod="openshift-multus/network-metrics-daemon-h7qxw" Jun 03 00:20:45.099594 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:45.099575 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 00:20:45.099643 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:45.099584 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 00:20:45.108205 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:20:45.108175 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 00:20:45.108329 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:20:45.108243 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf-metrics-certs podName:3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf nodeName:}" failed. No retries permitted until 2026-06-03 00:21:49.108224191 +0000 UTC m=+130.328146744 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf-metrics-certs") pod "network-metrics-daemon-h7qxw" (UID: "3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf") : secret "metrics-daemon-secret" not found Jun 03 00:20:45.109980 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:45.109960 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 00:20:45.120868 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:45.120843 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54n7j\" (UniqueName: \"kubernetes.io/projected/0d640da7-6701-4c49-b1c4-efac1a49bea8-kube-api-access-54n7j\") pod \"network-check-target-jwt8n\" (UID: \"0d640da7-6701-4c49-b1c4-efac1a49bea8\") " pod="openshift-network-diagnostics/network-check-target-jwt8n" Jun 03 00:20:45.274497 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:45.274461 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nw924\"" Jun 03 00:20:45.283014 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:45.282994 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwt8n" Jun 03 00:20:45.363182 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:45.363149 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-2q4gf"] Jun 03 00:20:45.365648 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:45.365625 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-2q4gf" Jun 03 00:20:45.368062 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:45.367709 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 03 00:20:45.368062 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:45.367720 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 03 00:20:45.368062 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:45.367720 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-76xsk\"" Jun 03 00:20:45.368297 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:45.368126 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 03 00:20:45.368297 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:45.368188 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 03 00:20:45.381428 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:45.381402 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-2q4gf"] Jun 03 00:20:45.402604 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:45.402576 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jwt8n"] Jun 03 00:20:45.405525 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:20:45.405500 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d640da7_6701_4c49_b1c4_efac1a49bea8.slice/crio-2a3b4b6347e2a3cafad1702dc2637a8d559681a1a87d28aeb78ae3b23f5236ab WatchSource:0}: Error finding container 2a3b4b6347e2a3cafad1702dc2637a8d559681a1a87d28aeb78ae3b23f5236ab: Status 404 returned error can't find the container with id 2a3b4b6347e2a3cafad1702dc2637a8d559681a1a87d28aeb78ae3b23f5236ab Jun 03 00:20:45.500537 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:45.500500 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6e1df638-ab07-40df-9344-ca095d3158cf-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-2q4gf\" (UID: \"6e1df638-ab07-40df-9344-ca095d3158cf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-2q4gf" Jun 03 00:20:45.500537 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:45.500538 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6e1df638-ab07-40df-9344-ca095d3158cf-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-2q4gf\" (UID: \"6e1df638-ab07-40df-9344-ca095d3158cf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-2q4gf" Jun 03 00:20:45.500783 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:45.500562 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66tmm\" (UniqueName: \"kubernetes.io/projected/6e1df638-ab07-40df-9344-ca095d3158cf-kube-api-access-66tmm\") pod \"kube-storage-version-migrator-operator-96ddc787c-2q4gf\" (UID: \"6e1df638-ab07-40df-9344-ca095d3158cf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-2q4gf" Jun 03 00:20:45.600894 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:45.600862 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7ed00dab-a3f9-41cf-8bfc-80db5e4ea202-cert\") pod \"ingress-canary-lr49h\" (UID: \"7ed00dab-a3f9-41cf-8bfc-80db5e4ea202\") " pod="openshift-ingress-canary/ingress-canary-lr49h" Jun 03 00:20:45.600894 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:45.600904 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6e1df638-ab07-40df-9344-ca095d3158cf-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-2q4gf\" (UID: \"6e1df638-ab07-40df-9344-ca095d3158cf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-2q4gf" Jun 03 00:20:45.601145 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:45.600929 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6e1df638-ab07-40df-9344-ca095d3158cf-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-2q4gf\" (UID: \"6e1df638-ab07-40df-9344-ca095d3158cf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-2q4gf" Jun 03 00:20:45.601145 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:20:45.601014 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 00:20:45.601145 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:20:45.601069 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ed00dab-a3f9-41cf-8bfc-80db5e4ea202-cert podName:7ed00dab-a3f9-41cf-8bfc-80db5e4ea202 nodeName:}" failed. No retries permitted until 2026-06-03 00:21:17.601054492 +0000 UTC m=+98.820977045 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7ed00dab-a3f9-41cf-8bfc-80db5e4ea202-cert") pod "ingress-canary-lr49h" (UID: "7ed00dab-a3f9-41cf-8bfc-80db5e4ea202") : secret "canary-serving-cert" not found Jun 03 00:20:45.601145 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:45.601064 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-66tmm\" (UniqueName: \"kubernetes.io/projected/6e1df638-ab07-40df-9344-ca095d3158cf-kube-api-access-66tmm\") pod \"kube-storage-version-migrator-operator-96ddc787c-2q4gf\" (UID: \"6e1df638-ab07-40df-9344-ca095d3158cf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-2q4gf" Jun 03 00:20:45.601355 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:45.601142 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65351302-04fd-49bb-b5dc-836203281ad2-metrics-tls\") pod \"dns-default-w2z46\" (UID: \"65351302-04fd-49bb-b5dc-836203281ad2\") " pod="openshift-dns/dns-default-w2z46" Jun 03 00:20:45.601355 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:20:45.601267 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 00:20:45.601355 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:20:45.601317 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65351302-04fd-49bb-b5dc-836203281ad2-metrics-tls podName:65351302-04fd-49bb-b5dc-836203281ad2 nodeName:}" failed. No retries permitted until 2026-06-03 00:21:17.601301662 +0000 UTC m=+98.821224219 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65351302-04fd-49bb-b5dc-836203281ad2-metrics-tls") pod "dns-default-w2z46" (UID: "65351302-04fd-49bb-b5dc-836203281ad2") : secret "dns-default-metrics-tls" not found Jun 03 00:20:45.601652 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:45.601633 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6e1df638-ab07-40df-9344-ca095d3158cf-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-2q4gf\" (UID: \"6e1df638-ab07-40df-9344-ca095d3158cf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-2q4gf" Jun 03 00:20:45.603177 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:45.603160 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6e1df638-ab07-40df-9344-ca095d3158cf-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-2q4gf\" (UID: \"6e1df638-ab07-40df-9344-ca095d3158cf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-2q4gf" Jun 03 00:20:45.607989 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:45.607942 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66tmm\" (UniqueName: \"kubernetes.io/projected/6e1df638-ab07-40df-9344-ca095d3158cf-kube-api-access-66tmm\") pod \"kube-storage-version-migrator-operator-96ddc787c-2q4gf\" (UID: \"6e1df638-ab07-40df-9344-ca095d3158cf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-2q4gf" Jun 03 00:20:45.636762 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:45.636737 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-7n7x2_ec539906-3be0-4a60-9ea2-5f07074c913a/console-operator/0.log" Jun 03 00:20:45.636916 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:45.636779 2559 generic.go:358] "Generic (PLEG): container finished" podID="ec539906-3be0-4a60-9ea2-5f07074c913a" containerID="d531ad70bba1fc22bca9eeb4069ab6a4c65f25ea2abdca398e11a7ff043ff29f" exitCode=255 Jun 03 00:20:45.636916 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:45.636871 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-7n7x2" event={"ID":"ec539906-3be0-4a60-9ea2-5f07074c913a","Type":"ContainerDied","Data":"d531ad70bba1fc22bca9eeb4069ab6a4c65f25ea2abdca398e11a7ff043ff29f"} Jun 03 00:20:45.637128 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:45.637106 2559 scope.go:117] "RemoveContainer" containerID="d531ad70bba1fc22bca9eeb4069ab6a4c65f25ea2abdca398e11a7ff043ff29f" Jun 03 00:20:45.637926 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:45.637905 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jwt8n" event={"ID":"0d640da7-6701-4c49-b1c4-efac1a49bea8","Type":"ContainerStarted","Data":"2a3b4b6347e2a3cafad1702dc2637a8d559681a1a87d28aeb78ae3b23f5236ab"} Jun 03 00:20:45.676433 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:45.676411 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-2q4gf" Jun 03 00:20:45.806943 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:45.806909 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-2q4gf"] Jun 03 00:20:45.810494 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:20:45.810467 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e1df638_ab07_40df_9344_ca095d3158cf.slice/crio-a9ad94928adf660e8096b9dc011f40d8890cb59f4433912058f76e3fcd2dfe2d WatchSource:0}: Error finding container a9ad94928adf660e8096b9dc011f40d8890cb59f4433912058f76e3fcd2dfe2d: Status 404 returned error can't find the container with id a9ad94928adf660e8096b9dc011f40d8890cb59f4433912058f76e3fcd2dfe2d Jun 03 00:20:46.418170 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:46.418144 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cg2vj_fc278c33-3725-483e-971f-7465ef42f509/dns-node-resolver/0.log" Jun 03 00:20:46.642203 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:46.642173 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-7n7x2_ec539906-3be0-4a60-9ea2-5f07074c913a/console-operator/1.log" Jun 03 00:20:46.642643 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:46.642626 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-7n7x2_ec539906-3be0-4a60-9ea2-5f07074c913a/console-operator/0.log" Jun 03 00:20:46.642769 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:46.642668 2559 generic.go:358] "Generic (PLEG): container finished" podID="ec539906-3be0-4a60-9ea2-5f07074c913a" containerID="1c245cf1d51a84afe8fd745e65685ee2bf9a45bcd2e78411042cc1b068e5f2b4" exitCode=255 Jun 03 00:20:46.642769 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:46.642751 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-7n7x2" event={"ID":"ec539906-3be0-4a60-9ea2-5f07074c913a","Type":"ContainerDied","Data":"1c245cf1d51a84afe8fd745e65685ee2bf9a45bcd2e78411042cc1b068e5f2b4"} Jun 03 00:20:46.642931 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:46.642786 2559 scope.go:117] "RemoveContainer" containerID="d531ad70bba1fc22bca9eeb4069ab6a4c65f25ea2abdca398e11a7ff043ff29f" Jun 03 00:20:46.643070 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:46.643052 2559 scope.go:117] "RemoveContainer" containerID="1c245cf1d51a84afe8fd745e65685ee2bf9a45bcd2e78411042cc1b068e5f2b4" Jun 03 00:20:46.643276 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:20:46.643252 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-7n7x2_openshift-console-operator(ec539906-3be0-4a60-9ea2-5f07074c913a)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-7n7x2" podUID="ec539906-3be0-4a60-9ea2-5f07074c913a" Jun 03 00:20:46.644062 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:46.644032 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-2q4gf" event={"ID":"6e1df638-ab07-40df-9344-ca095d3158cf","Type":"ContainerStarted","Data":"a9ad94928adf660e8096b9dc011f40d8890cb59f4433912058f76e3fcd2dfe2d"} Jun 03 00:20:47.618526 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:47.618495 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-p6rbs_a8382002-46e9-42fa-b498-3d6de2fe6a85/node-ca/0.log" Jun 03 00:20:47.648256 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:47.648231 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-7n7x2_ec539906-3be0-4a60-9ea2-5f07074c913a/console-operator/1.log" Jun 03 00:20:47.648627 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:47.648604 2559 scope.go:117] "RemoveContainer" containerID="1c245cf1d51a84afe8fd745e65685ee2bf9a45bcd2e78411042cc1b068e5f2b4" Jun 03 00:20:47.648847 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:20:47.648821 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-7n7x2_openshift-console-operator(ec539906-3be0-4a60-9ea2-5f07074c913a)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-7n7x2" podUID="ec539906-3be0-4a60-9ea2-5f07074c913a" Jun 03 00:20:48.651999 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:48.651901 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jwt8n" event={"ID":"0d640da7-6701-4c49-b1c4-efac1a49bea8","Type":"ContainerStarted","Data":"7a37b1e60d5e45ff5cf91b79f5c550baa4d6d9ebbe410089941747ded12216b5"} Jun 03 00:20:48.652371 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:48.652031 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jwt8n" Jun 03 00:20:48.665039 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:48.664988 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jwt8n" podStartSLOduration=66.799045042 podStartE2EDuration="1m9.66497212s" podCreationTimestamp="2026-06-03 00:19:39 +0000 UTC" firstStartedPulling="2026-06-03 00:20:45.407317604 +0000 UTC m=+66.627240160" lastFinishedPulling="2026-06-03 00:20:48.273244685 +0000 UTC m=+69.493167238" observedRunningTime="2026-06-03 00:20:48.664222266 +0000 UTC m=+69.884144841" watchObservedRunningTime="2026-06-03 00:20:48.66497212 +0000 UTC m=+69.884894695" Jun 03 00:20:48.745248 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:48.745217 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-zmjh5"] Jun 03 00:20:48.747028 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:48.747013 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-zmjh5" Jun 03 00:20:48.748735 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:48.748714 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-9xlnk\"" Jun 03 00:20:48.753847 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:48.753820 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-zmjh5"] Jun 03 00:20:48.827891 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:48.827851 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nv2lf\" (UniqueName: \"kubernetes.io/projected/41e1ca17-3186-4bfb-ba59-8034b881dc22-kube-api-access-nv2lf\") pod \"network-check-source-56d84b9f44-zmjh5\" (UID: \"41e1ca17-3186-4bfb-ba59-8034b881dc22\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-zmjh5" Jun 03 00:20:48.929093 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:48.929008 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nv2lf\" (UniqueName: \"kubernetes.io/projected/41e1ca17-3186-4bfb-ba59-8034b881dc22-kube-api-access-nv2lf\") pod \"network-check-source-56d84b9f44-zmjh5\" (UID: \"41e1ca17-3186-4bfb-ba59-8034b881dc22\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-zmjh5" Jun 03 00:20:48.937488 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:48.937456 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nv2lf\" (UniqueName: \"kubernetes.io/projected/41e1ca17-3186-4bfb-ba59-8034b881dc22-kube-api-access-nv2lf\") pod \"network-check-source-56d84b9f44-zmjh5\" (UID: \"41e1ca17-3186-4bfb-ba59-8034b881dc22\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-zmjh5" Jun 03 00:20:49.056710 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:49.056639 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-zmjh5" Jun 03 00:20:49.175926 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:49.175897 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-zmjh5"] Jun 03 00:20:49.179075 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:20:49.179048 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41e1ca17_3186_4bfb_ba59_8034b881dc22.slice/crio-7d977663f137595a8911922a82ec09a8ff90128880efe7b4836fcef9fe598d75 WatchSource:0}: Error finding container 7d977663f137595a8911922a82ec09a8ff90128880efe7b4836fcef9fe598d75: Status 404 returned error can't find the container with id 7d977663f137595a8911922a82ec09a8ff90128880efe7b4836fcef9fe598d75 Jun 03 00:20:49.656040 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:49.655964 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-zmjh5" event={"ID":"41e1ca17-3186-4bfb-ba59-8034b881dc22","Type":"ContainerStarted","Data":"5a79f54298951f2fb99d06dfa4868f546a748dccdc82cc20617c42b86d454d8d"} Jun 03 00:20:49.656040 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:49.656012 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-zmjh5" event={"ID":"41e1ca17-3186-4bfb-ba59-8034b881dc22","Type":"ContainerStarted","Data":"7d977663f137595a8911922a82ec09a8ff90128880efe7b4836fcef9fe598d75"} Jun 03 00:20:49.669326 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:49.669269 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-zmjh5" podStartSLOduration=1.669250292 podStartE2EDuration="1.669250292s" podCreationTimestamp="2026-06-03 00:20:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 00:20:49.66836946 +0000 UTC m=+70.888292027" watchObservedRunningTime="2026-06-03 00:20:49.669250292 +0000 UTC m=+70.889172868" Jun 03 00:20:50.659410 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:50.659370 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-2q4gf" event={"ID":"6e1df638-ab07-40df-9344-ca095d3158cf","Type":"ContainerStarted","Data":"b0d7ba9b4a9c7594d10f669a51eb7a9251b2371301f8113fd513bf20953263bb"} Jun 03 00:20:50.673096 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:50.673044 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-2q4gf" podStartSLOduration=1.402094588 podStartE2EDuration="5.673026458s" podCreationTimestamp="2026-06-03 00:20:45 +0000 UTC" firstStartedPulling="2026-06-03 00:20:45.812910801 +0000 UTC m=+67.032833360" lastFinishedPulling="2026-06-03 00:20:50.08384267 +0000 UTC m=+71.303765230" observedRunningTime="2026-06-03 00:20:50.67232985 +0000 UTC m=+71.892252428" watchObservedRunningTime="2026-06-03 00:20:50.673026458 +0000 UTC m=+71.892949035" Jun 03 00:20:51.493009 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:51.492974 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-xgq44"] Jun 03 00:20:51.494760 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:51.494745 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-xgq44" Jun 03 00:20:51.496806 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:51.496784 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 03 00:20:51.496917 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:51.496813 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-wtm7f\"" Jun 03 00:20:51.497275 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:51.497261 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 03 00:20:51.503139 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:51.503115 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-xgq44"] Jun 03 00:20:51.652400 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:51.652358 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-965lk\" (UniqueName: \"kubernetes.io/projected/35ac742c-b4f1-47ca-b43c-4becc89a6a8c-kube-api-access-965lk\") pod \"migrator-96c6f749-xgq44\" (UID: \"35ac742c-b4f1-47ca-b43c-4becc89a6a8c\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-xgq44" Jun 03 00:20:51.682956 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:51.682920 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-7n7x2" Jun 03 00:20:51.682956 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:51.682959 2559 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-7n7x2" Jun 03 00:20:51.683335 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:51.683281 2559 scope.go:117] "RemoveContainer" containerID="1c245cf1d51a84afe8fd745e65685ee2bf9a45bcd2e78411042cc1b068e5f2b4" Jun 03 00:20:51.683446 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:20:51.683429 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-7n7x2_openshift-console-operator(ec539906-3be0-4a60-9ea2-5f07074c913a)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-7n7x2" podUID="ec539906-3be0-4a60-9ea2-5f07074c913a" Jun 03 00:20:51.753085 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:51.752986 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-965lk\" (UniqueName: \"kubernetes.io/projected/35ac742c-b4f1-47ca-b43c-4becc89a6a8c-kube-api-access-965lk\") pod \"migrator-96c6f749-xgq44\" (UID: \"35ac742c-b4f1-47ca-b43c-4becc89a6a8c\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-xgq44" Jun 03 00:20:51.760285 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:51.760262 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-965lk\" (UniqueName: \"kubernetes.io/projected/35ac742c-b4f1-47ca-b43c-4becc89a6a8c-kube-api-access-965lk\") pod \"migrator-96c6f749-xgq44\" (UID: \"35ac742c-b4f1-47ca-b43c-4becc89a6a8c\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-xgq44" Jun 03 00:20:51.804355 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:51.804316 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-xgq44" Jun 03 00:20:51.923748 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:51.923714 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-xgq44"] Jun 03 00:20:51.928099 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:20:51.928058 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35ac742c_b4f1_47ca_b43c_4becc89a6a8c.slice/crio-536bcedec40445430a40fcfb6fb250ca2d1277e1032671e3d9b7d6b18646da23 WatchSource:0}: Error finding container 536bcedec40445430a40fcfb6fb250ca2d1277e1032671e3d9b7d6b18646da23: Status 404 returned error can't find the container with id 536bcedec40445430a40fcfb6fb250ca2d1277e1032671e3d9b7d6b18646da23 Jun 03 00:20:52.665329 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:52.665297 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-xgq44" event={"ID":"35ac742c-b4f1-47ca-b43c-4becc89a6a8c","Type":"ContainerStarted","Data":"536bcedec40445430a40fcfb6fb250ca2d1277e1032671e3d9b7d6b18646da23"} Jun 03 00:20:54.671533 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:54.671496 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-xgq44" event={"ID":"35ac742c-b4f1-47ca-b43c-4becc89a6a8c","Type":"ContainerStarted","Data":"fd585d2614303ecd572c05dce7300b5fe32d32ad7df16275c461df398e8508ff"} Jun 03 00:20:54.671533 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:54.671535 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-xgq44" event={"ID":"35ac742c-b4f1-47ca-b43c-4becc89a6a8c","Type":"ContainerStarted","Data":"8452e3a640e7cc8fbd75ff542724b71c5dcc919b79da982e2835161f274f0572"} Jun 03 00:20:54.684153 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:20:54.684014 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-xgq44" podStartSLOduration=1.693443375 podStartE2EDuration="3.684001189s" podCreationTimestamp="2026-06-03 00:20:51 +0000 UTC" firstStartedPulling="2026-06-03 00:20:51.929888461 +0000 UTC m=+73.149811014" lastFinishedPulling="2026-06-03 00:20:53.920446269 +0000 UTC m=+75.140368828" observedRunningTime="2026-06-03 00:20:54.683612297 +0000 UTC m=+75.903534873" watchObservedRunningTime="2026-06-03 00:20:54.684001189 +0000 UTC m=+75.903923763" Jun 03 00:21:03.363713 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:03.363657 2559 scope.go:117] "RemoveContainer" containerID="1c245cf1d51a84afe8fd745e65685ee2bf9a45bcd2e78411042cc1b068e5f2b4" Jun 03 00:21:03.695387 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:03.695305 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-7n7x2_ec539906-3be0-4a60-9ea2-5f07074c913a/console-operator/1.log" Jun 03 00:21:03.695387 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:03.695372 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-7n7x2" event={"ID":"ec539906-3be0-4a60-9ea2-5f07074c913a","Type":"ContainerStarted","Data":"c5f51919593f95472661d1137d936ccaf03f53d53e041349bf349fbe4aebeab6"} Jun 03 00:21:03.695728 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:03.695706 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-7n7x2" Jun 03 00:21:03.712288 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:03.712239 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-86d7c6cc77-7n7x2" podStartSLOduration=19.754691173 podStartE2EDuration="22.712224433s" podCreationTimestamp="2026-06-03 00:20:41 +0000 UTC" firstStartedPulling="2026-06-03 00:20:41.837124752 +0000 UTC m=+63.057047318" lastFinishedPulling="2026-06-03 00:20:44.794658022 +0000 UTC m=+66.014580578" observedRunningTime="2026-06-03 00:21:03.711555251 +0000 UTC m=+84.931477831" watchObservedRunningTime="2026-06-03 00:21:03.712224433 +0000 UTC m=+84.932147009" Jun 03 00:21:03.740531 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:03.740502 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-86d7c6cc77-7n7x2" Jun 03 00:21:17.651363 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.651309 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7ed00dab-a3f9-41cf-8bfc-80db5e4ea202-cert\") pod \"ingress-canary-lr49h\" (UID: \"7ed00dab-a3f9-41cf-8bfc-80db5e4ea202\") " pod="openshift-ingress-canary/ingress-canary-lr49h" Jun 03 00:21:17.651363 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.651381 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65351302-04fd-49bb-b5dc-836203281ad2-metrics-tls\") pod \"dns-default-w2z46\" (UID: \"65351302-04fd-49bb-b5dc-836203281ad2\") " pod="openshift-dns/dns-default-w2z46" Jun 03 00:21:17.653788 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.653763 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65351302-04fd-49bb-b5dc-836203281ad2-metrics-tls\") pod \"dns-default-w2z46\" (UID: \"65351302-04fd-49bb-b5dc-836203281ad2\") " pod="openshift-dns/dns-default-w2z46" Jun 03 00:21:17.653852 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.653767 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7ed00dab-a3f9-41cf-8bfc-80db5e4ea202-cert\") pod \"ingress-canary-lr49h\" (UID: \"7ed00dab-a3f9-41cf-8bfc-80db5e4ea202\") " pod="openshift-ingress-canary/ingress-canary-lr49h" Jun 03 00:21:17.665599 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.665578 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8cxnz\"" Jun 03 00:21:17.666862 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.666840 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d646dc7b8-xjjzv"] Jun 03 00:21:17.669573 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.669559 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d646dc7b8-xjjzv" Jun 03 00:21:17.672142 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.672120 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 03 00:21:17.672347 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.672331 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 03 00:21:17.672437 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.672351 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-252v4\"" Jun 03 00:21:17.672493 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.672468 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 03 00:21:17.672832 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.672816 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 03 00:21:17.673654 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.673639 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lr49h" Jun 03 00:21:17.681182 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.681158 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d646dc7b8-xjjzv"] Jun 03 00:21:17.752724 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.752671 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/66fbb338-e901-4575-bf33-01d23397c9cb-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5d646dc7b8-xjjzv\" (UID: \"66fbb338-e901-4575-bf33-01d23397c9cb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d646dc7b8-xjjzv" Jun 03 00:21:17.752863 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.752755 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7vhg\" (UniqueName: \"kubernetes.io/projected/66fbb338-e901-4575-bf33-01d23397c9cb-kube-api-access-l7vhg\") pod \"managed-serviceaccount-addon-agent-5d646dc7b8-xjjzv\" (UID: \"66fbb338-e901-4575-bf33-01d23397c9cb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d646dc7b8-xjjzv" Jun 03 00:21:17.771083 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.771051 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-sch94"] Jun 03 00:21:17.773745 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.773723 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-sch94" Jun 03 00:21:17.774853 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.774830 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-976cb9cff-vmcj8"] Jun 03 00:21:17.776660 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.776592 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-zxpct\"" Jun 03 00:21:17.776660 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.776609 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-976cb9cff-vmcj8" Jun 03 00:21:17.776868 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.776851 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 03 00:21:17.778214 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.778184 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 03 00:21:17.779280 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.779196 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 03 00:21:17.779393 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.779304 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 03 00:21:17.779393 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.779377 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vhztx\"" Jun 03 00:21:17.779659 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.779641 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 03 00:21:17.784669 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.784643 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 03 00:21:17.796074 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.796052 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-sch94"] Jun 03 00:21:17.798427 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.798384 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-976cb9cff-vmcj8"] Jun 03 00:21:17.799093 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.799075 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fmlb9"] Jun 03 00:21:17.800940 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.800923 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fmlb9" Jun 03 00:21:17.803082 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.803064 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 00:21:17.803182 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.803083 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ljkj8\"" Jun 03 00:21:17.803245 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.803181 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 00:21:17.813730 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.813631 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lr49h"] Jun 03 00:21:17.815092 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.815068 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fmlb9"] Jun 03 00:21:17.819024 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:21:17.818998 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ed00dab_a3f9_41cf_8bfc_80db5e4ea202.slice/crio-9c90c477fea2c1cd857fc9b7f128a206e355de55a7dc5abfe8b775510a26f2b2 WatchSource:0}: Error finding container 9c90c477fea2c1cd857fc9b7f128a206e355de55a7dc5abfe8b775510a26f2b2: Status 404 returned error can't find the container with id 9c90c477fea2c1cd857fc9b7f128a206e355de55a7dc5abfe8b775510a26f2b2 Jun 03 00:21:17.853345 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.853314 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d1622544-685f-4c8d-acb2-ee46a7d320f7-registry-tls\") pod \"image-registry-976cb9cff-vmcj8\" (UID: \"d1622544-685f-4c8d-acb2-ee46a7d320f7\") " pod="openshift-image-registry/image-registry-976cb9cff-vmcj8" Jun 03 00:21:17.853345 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.853346 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d1622544-685f-4c8d-acb2-ee46a7d320f7-trusted-ca\") pod \"image-registry-976cb9cff-vmcj8\" (UID: \"d1622544-685f-4c8d-acb2-ee46a7d320f7\") " pod="openshift-image-registry/image-registry-976cb9cff-vmcj8" Jun 03 00:21:17.853608 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.853402 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/66fbb338-e901-4575-bf33-01d23397c9cb-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5d646dc7b8-xjjzv\" (UID: \"66fbb338-e901-4575-bf33-01d23397c9cb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d646dc7b8-xjjzv" Jun 03 00:21:17.853608 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.853459 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l7vhg\" (UniqueName: \"kubernetes.io/projected/66fbb338-e901-4575-bf33-01d23397c9cb-kube-api-access-l7vhg\") pod \"managed-serviceaccount-addon-agent-5d646dc7b8-xjjzv\" (UID: \"66fbb338-e901-4575-bf33-01d23397c9cb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d646dc7b8-xjjzv" Jun 03 00:21:17.853608 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.853507 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d075e4d5-e344-490f-8b8c-10fe1f201844-crio-socket\") pod \"insights-runtime-extractor-fmlb9\" (UID: \"d075e4d5-e344-490f-8b8c-10fe1f201844\") " pod="openshift-insights/insights-runtime-extractor-fmlb9" Jun 03 00:21:17.853608 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.853535 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpwdc\" (UniqueName: \"kubernetes.io/projected/d1622544-685f-4c8d-acb2-ee46a7d320f7-kube-api-access-xpwdc\") pod \"image-registry-976cb9cff-vmcj8\" (UID: \"d1622544-685f-4c8d-acb2-ee46a7d320f7\") " pod="openshift-image-registry/image-registry-976cb9cff-vmcj8" Jun 03 00:21:17.853608 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.853556 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d075e4d5-e344-490f-8b8c-10fe1f201844-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fmlb9\" (UID: \"d075e4d5-e344-490f-8b8c-10fe1f201844\") " pod="openshift-insights/insights-runtime-extractor-fmlb9" Jun 03 00:21:17.853608 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.853590 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/95c4995b-b310-4ff7-994f-6d298a147d1f-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-sch94\" (UID: \"95c4995b-b310-4ff7-994f-6d298a147d1f\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-sch94" Jun 03 00:21:17.853872 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.853628 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d1622544-685f-4c8d-acb2-ee46a7d320f7-image-registry-private-configuration\") pod \"image-registry-976cb9cff-vmcj8\" (UID: \"d1622544-685f-4c8d-acb2-ee46a7d320f7\") " pod="openshift-image-registry/image-registry-976cb9cff-vmcj8" Jun 03 00:21:17.853872 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.853731 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d1622544-685f-4c8d-acb2-ee46a7d320f7-ca-trust-extracted\") pod \"image-registry-976cb9cff-vmcj8\" (UID: \"d1622544-685f-4c8d-acb2-ee46a7d320f7\") " pod="openshift-image-registry/image-registry-976cb9cff-vmcj8" Jun 03 00:21:17.853872 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.853783 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d075e4d5-e344-490f-8b8c-10fe1f201844-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fmlb9\" (UID: \"d075e4d5-e344-490f-8b8c-10fe1f201844\") " pod="openshift-insights/insights-runtime-extractor-fmlb9" Jun 03 00:21:17.853872 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.853806 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsxmh\" (UniqueName: \"kubernetes.io/projected/d075e4d5-e344-490f-8b8c-10fe1f201844-kube-api-access-zsxmh\") pod \"insights-runtime-extractor-fmlb9\" (UID: \"d075e4d5-e344-490f-8b8c-10fe1f201844\") " pod="openshift-insights/insights-runtime-extractor-fmlb9" Jun 03 00:21:17.853872 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.853845 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d1622544-685f-4c8d-acb2-ee46a7d320f7-bound-sa-token\") pod \"image-registry-976cb9cff-vmcj8\" (UID: \"d1622544-685f-4c8d-acb2-ee46a7d320f7\") " pod="openshift-image-registry/image-registry-976cb9cff-vmcj8" Jun 03 00:21:17.854030 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.853905 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d1622544-685f-4c8d-acb2-ee46a7d320f7-registry-certificates\") pod \"image-registry-976cb9cff-vmcj8\" (UID: \"d1622544-685f-4c8d-acb2-ee46a7d320f7\") " pod="openshift-image-registry/image-registry-976cb9cff-vmcj8" Jun 03 00:21:17.854030 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.853936 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d075e4d5-e344-490f-8b8c-10fe1f201844-data-volume\") pod \"insights-runtime-extractor-fmlb9\" (UID: \"d075e4d5-e344-490f-8b8c-10fe1f201844\") " pod="openshift-insights/insights-runtime-extractor-fmlb9" Jun 03 00:21:17.854030 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.853965 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/95c4995b-b310-4ff7-994f-6d298a147d1f-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-sch94\" (UID: \"95c4995b-b310-4ff7-994f-6d298a147d1f\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-sch94" Jun 03 00:21:17.854030 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.853982 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d1622544-685f-4c8d-acb2-ee46a7d320f7-installation-pull-secrets\") pod \"image-registry-976cb9cff-vmcj8\" (UID: \"d1622544-685f-4c8d-acb2-ee46a7d320f7\") " pod="openshift-image-registry/image-registry-976cb9cff-vmcj8" Jun 03 00:21:17.856072 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.856053 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/66fbb338-e901-4575-bf33-01d23397c9cb-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5d646dc7b8-xjjzv\" (UID: \"66fbb338-e901-4575-bf33-01d23397c9cb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d646dc7b8-xjjzv" Jun 03 00:21:17.863824 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.863798 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7vhg\" (UniqueName: \"kubernetes.io/projected/66fbb338-e901-4575-bf33-01d23397c9cb-kube-api-access-l7vhg\") pod \"managed-serviceaccount-addon-agent-5d646dc7b8-xjjzv\" (UID: \"66fbb338-e901-4575-bf33-01d23397c9cb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d646dc7b8-xjjzv" Jun 03 00:21:17.943642 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.943563 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5c68x\"" Jun 03 00:21:17.952236 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.952221 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w2z46" Jun 03 00:21:17.955088 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.955064 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d075e4d5-e344-490f-8b8c-10fe1f201844-data-volume\") pod \"insights-runtime-extractor-fmlb9\" (UID: \"d075e4d5-e344-490f-8b8c-10fe1f201844\") " pod="openshift-insights/insights-runtime-extractor-fmlb9" Jun 03 00:21:17.955214 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.955103 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/95c4995b-b310-4ff7-994f-6d298a147d1f-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-sch94\" (UID: \"95c4995b-b310-4ff7-994f-6d298a147d1f\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-sch94" Jun 03 00:21:17.955214 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.955124 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d1622544-685f-4c8d-acb2-ee46a7d320f7-installation-pull-secrets\") pod \"image-registry-976cb9cff-vmcj8\" (UID: \"d1622544-685f-4c8d-acb2-ee46a7d320f7\") " pod="openshift-image-registry/image-registry-976cb9cff-vmcj8" Jun 03 00:21:17.955214 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.955144 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d1622544-685f-4c8d-acb2-ee46a7d320f7-registry-tls\") pod \"image-registry-976cb9cff-vmcj8\" (UID: \"d1622544-685f-4c8d-acb2-ee46a7d320f7\") " pod="openshift-image-registry/image-registry-976cb9cff-vmcj8" Jun 03 00:21:17.955214 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.955164 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d1622544-685f-4c8d-acb2-ee46a7d320f7-trusted-ca\") pod \"image-registry-976cb9cff-vmcj8\" (UID: \"d1622544-685f-4c8d-acb2-ee46a7d320f7\") " pod="openshift-image-registry/image-registry-976cb9cff-vmcj8" Jun 03 00:21:17.955214 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.955197 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d075e4d5-e344-490f-8b8c-10fe1f201844-crio-socket\") pod \"insights-runtime-extractor-fmlb9\" (UID: \"d075e4d5-e344-490f-8b8c-10fe1f201844\") " pod="openshift-insights/insights-runtime-extractor-fmlb9" Jun 03 00:21:17.955469 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.955222 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xpwdc\" (UniqueName: \"kubernetes.io/projected/d1622544-685f-4c8d-acb2-ee46a7d320f7-kube-api-access-xpwdc\") pod \"image-registry-976cb9cff-vmcj8\" (UID: \"d1622544-685f-4c8d-acb2-ee46a7d320f7\") " pod="openshift-image-registry/image-registry-976cb9cff-vmcj8" Jun 03 00:21:17.955469 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.955245 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d075e4d5-e344-490f-8b8c-10fe1f201844-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fmlb9\" (UID: \"d075e4d5-e344-490f-8b8c-10fe1f201844\") " pod="openshift-insights/insights-runtime-extractor-fmlb9" Jun 03 00:21:17.955469 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.955271 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/95c4995b-b310-4ff7-994f-6d298a147d1f-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-sch94\" (UID: \"95c4995b-b310-4ff7-994f-6d298a147d1f\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-sch94" Jun 03 00:21:17.955469 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.955308 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d1622544-685f-4c8d-acb2-ee46a7d320f7-image-registry-private-configuration\") pod \"image-registry-976cb9cff-vmcj8\" (UID: \"d1622544-685f-4c8d-acb2-ee46a7d320f7\") " pod="openshift-image-registry/image-registry-976cb9cff-vmcj8" Jun 03 00:21:17.955469 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.955331 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d1622544-685f-4c8d-acb2-ee46a7d320f7-ca-trust-extracted\") pod \"image-registry-976cb9cff-vmcj8\" (UID: \"d1622544-685f-4c8d-acb2-ee46a7d320f7\") " pod="openshift-image-registry/image-registry-976cb9cff-vmcj8" Jun 03 00:21:17.955469 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.955376 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d075e4d5-e344-490f-8b8c-10fe1f201844-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fmlb9\" (UID: \"d075e4d5-e344-490f-8b8c-10fe1f201844\") " pod="openshift-insights/insights-runtime-extractor-fmlb9" Jun 03 00:21:17.955469 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.955399 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zsxmh\" (UniqueName: \"kubernetes.io/projected/d075e4d5-e344-490f-8b8c-10fe1f201844-kube-api-access-zsxmh\") pod \"insights-runtime-extractor-fmlb9\" (UID: \"d075e4d5-e344-490f-8b8c-10fe1f201844\") " pod="openshift-insights/insights-runtime-extractor-fmlb9" Jun 03 00:21:17.955469 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.955429 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d1622544-685f-4c8d-acb2-ee46a7d320f7-bound-sa-token\") pod \"image-registry-976cb9cff-vmcj8\" (UID: \"d1622544-685f-4c8d-acb2-ee46a7d320f7\") " pod="openshift-image-registry/image-registry-976cb9cff-vmcj8" Jun 03 00:21:17.955469 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.955428 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d075e4d5-e344-490f-8b8c-10fe1f201844-data-volume\") pod \"insights-runtime-extractor-fmlb9\" (UID: \"d075e4d5-e344-490f-8b8c-10fe1f201844\") " pod="openshift-insights/insights-runtime-extractor-fmlb9" Jun 03 00:21:17.955469 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.955461 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d1622544-685f-4c8d-acb2-ee46a7d320f7-registry-certificates\") pod \"image-registry-976cb9cff-vmcj8\" (UID: \"d1622544-685f-4c8d-acb2-ee46a7d320f7\") " pod="openshift-image-registry/image-registry-976cb9cff-vmcj8" Jun 03 00:21:17.955939 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.955785 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d075e4d5-e344-490f-8b8c-10fe1f201844-crio-socket\") pod \"insights-runtime-extractor-fmlb9\" (UID: \"d075e4d5-e344-490f-8b8c-10fe1f201844\") " pod="openshift-insights/insights-runtime-extractor-fmlb9" Jun 03 00:21:17.956011 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.955989 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/95c4995b-b310-4ff7-994f-6d298a147d1f-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-sch94\" (UID: \"95c4995b-b310-4ff7-994f-6d298a147d1f\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-sch94" Jun 03 00:21:17.956319 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.956293 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d075e4d5-e344-490f-8b8c-10fe1f201844-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fmlb9\" (UID: \"d075e4d5-e344-490f-8b8c-10fe1f201844\") " pod="openshift-insights/insights-runtime-extractor-fmlb9" Jun 03 00:21:17.956427 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.956370 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d1622544-685f-4c8d-acb2-ee46a7d320f7-ca-trust-extracted\") pod \"image-registry-976cb9cff-vmcj8\" (UID: \"d1622544-685f-4c8d-acb2-ee46a7d320f7\") " pod="openshift-image-registry/image-registry-976cb9cff-vmcj8" Jun 03 00:21:17.956933 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.956906 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d1622544-685f-4c8d-acb2-ee46a7d320f7-trusted-ca\") pod \"image-registry-976cb9cff-vmcj8\" (UID: \"d1622544-685f-4c8d-acb2-ee46a7d320f7\") " pod="openshift-image-registry/image-registry-976cb9cff-vmcj8" Jun 03 00:21:17.957160 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.957138 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d1622544-685f-4c8d-acb2-ee46a7d320f7-registry-certificates\") pod \"image-registry-976cb9cff-vmcj8\" (UID: \"d1622544-685f-4c8d-acb2-ee46a7d320f7\") " pod="openshift-image-registry/image-registry-976cb9cff-vmcj8" Jun 03 00:21:17.958044 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.958026 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d1622544-685f-4c8d-acb2-ee46a7d320f7-registry-tls\") pod \"image-registry-976cb9cff-vmcj8\" (UID: \"d1622544-685f-4c8d-acb2-ee46a7d320f7\") " pod="openshift-image-registry/image-registry-976cb9cff-vmcj8" Jun 03 00:21:17.958191 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.958165 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d1622544-685f-4c8d-acb2-ee46a7d320f7-installation-pull-secrets\") pod \"image-registry-976cb9cff-vmcj8\" (UID: \"d1622544-685f-4c8d-acb2-ee46a7d320f7\") " pod="openshift-image-registry/image-registry-976cb9cff-vmcj8" Jun 03 00:21:17.958332 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.958314 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/95c4995b-b310-4ff7-994f-6d298a147d1f-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-sch94\" (UID: \"95c4995b-b310-4ff7-994f-6d298a147d1f\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-sch94" Jun 03 00:21:17.958557 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.958538 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d1622544-685f-4c8d-acb2-ee46a7d320f7-image-registry-private-configuration\") pod \"image-registry-976cb9cff-vmcj8\" (UID: \"d1622544-685f-4c8d-acb2-ee46a7d320f7\") " pod="openshift-image-registry/image-registry-976cb9cff-vmcj8" Jun 03 00:21:17.958919 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.958901 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d075e4d5-e344-490f-8b8c-10fe1f201844-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fmlb9\" (UID: \"d075e4d5-e344-490f-8b8c-10fe1f201844\") " pod="openshift-insights/insights-runtime-extractor-fmlb9" Jun 03 00:21:17.964287 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.964264 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d1622544-685f-4c8d-acb2-ee46a7d320f7-bound-sa-token\") pod \"image-registry-976cb9cff-vmcj8\" (UID: \"d1622544-685f-4c8d-acb2-ee46a7d320f7\") " pod="openshift-image-registry/image-registry-976cb9cff-vmcj8" Jun 03 00:21:17.964513 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.964497 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpwdc\" (UniqueName: \"kubernetes.io/projected/d1622544-685f-4c8d-acb2-ee46a7d320f7-kube-api-access-xpwdc\") pod \"image-registry-976cb9cff-vmcj8\" (UID: \"d1622544-685f-4c8d-acb2-ee46a7d320f7\") " pod="openshift-image-registry/image-registry-976cb9cff-vmcj8" Jun 03 00:21:17.964871 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.964852 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsxmh\" (UniqueName: \"kubernetes.io/projected/d075e4d5-e344-490f-8b8c-10fe1f201844-kube-api-access-zsxmh\") pod \"insights-runtime-extractor-fmlb9\" (UID: \"d075e4d5-e344-490f-8b8c-10fe1f201844\") " pod="openshift-insights/insights-runtime-extractor-fmlb9" Jun 03 00:21:17.990668 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:17.990635 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d646dc7b8-xjjzv" Jun 03 00:21:18.081102 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:18.081017 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-w2z46"] Jun 03 00:21:18.084353 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:21:18.084297 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65351302_04fd_49bb_b5dc_836203281ad2.slice/crio-6d8b420b28fd3576254f9e863e8de4c1adfa9231f0df491c925edba099b1ea68 WatchSource:0}: Error finding container 6d8b420b28fd3576254f9e863e8de4c1adfa9231f0df491c925edba099b1ea68: Status 404 returned error can't find the container with id 6d8b420b28fd3576254f9e863e8de4c1adfa9231f0df491c925edba099b1ea68 Jun 03 00:21:18.085970 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:18.085952 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-sch94" Jun 03 00:21:18.092080 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:18.091999 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-976cb9cff-vmcj8" Jun 03 00:21:18.110742 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:18.110712 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fmlb9" Jun 03 00:21:18.131302 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:18.131246 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d646dc7b8-xjjzv"] Jun 03 00:21:18.136721 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:21:18.136669 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod66fbb338_e901_4575_bf33_01d23397c9cb.slice/crio-fa7ffab8447879b143c9471db0f0abe9edda5e023fac8d5ac1ed69a3a0a4ebb3 WatchSource:0}: Error finding container fa7ffab8447879b143c9471db0f0abe9edda5e023fac8d5ac1ed69a3a0a4ebb3: Status 404 returned error can't find the container with id fa7ffab8447879b143c9471db0f0abe9edda5e023fac8d5ac1ed69a3a0a4ebb3 Jun 03 00:21:18.261510 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:18.261462 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-sch94"] Jun 03 00:21:18.272010 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:21:18.271971 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95c4995b_b310_4ff7_994f_6d298a147d1f.slice/crio-2a02e1ac05f370c4a83f05a09c677888399473b58a3411b9d2abb6a8164d1fee WatchSource:0}: Error finding container 2a02e1ac05f370c4a83f05a09c677888399473b58a3411b9d2abb6a8164d1fee: Status 404 returned error can't find the container with id 2a02e1ac05f370c4a83f05a09c677888399473b58a3411b9d2abb6a8164d1fee Jun 03 00:21:18.310823 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:18.310787 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fmlb9"] Jun 03 00:21:18.314326 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:21:18.314295 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd075e4d5_e344_490f_8b8c_10fe1f201844.slice/crio-e358a038fc857584a3b3db0f947dbacdd3b5057f1042eba3f08b02a2f24b1099 WatchSource:0}: Error finding container e358a038fc857584a3b3db0f947dbacdd3b5057f1042eba3f08b02a2f24b1099: Status 404 returned error can't find the container with id e358a038fc857584a3b3db0f947dbacdd3b5057f1042eba3f08b02a2f24b1099 Jun 03 00:21:18.326224 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:18.326145 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-976cb9cff-vmcj8"] Jun 03 00:21:18.330795 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:21:18.330767 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1622544_685f_4c8d_acb2_ee46a7d320f7.slice/crio-b7af52fd8e8ef15d1cee816391743a2828d03134a0c86ab35c3f63d5a4e31c0f WatchSource:0}: Error finding container b7af52fd8e8ef15d1cee816391743a2828d03134a0c86ab35c3f63d5a4e31c0f: Status 404 returned error can't find the container with id b7af52fd8e8ef15d1cee816391743a2828d03134a0c86ab35c3f63d5a4e31c0f Jun 03 00:21:18.737633 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:18.737577 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w2z46" event={"ID":"65351302-04fd-49bb-b5dc-836203281ad2","Type":"ContainerStarted","Data":"6d8b420b28fd3576254f9e863e8de4c1adfa9231f0df491c925edba099b1ea68"} Jun 03 00:21:18.739254 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:18.739219 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fmlb9" event={"ID":"d075e4d5-e344-490f-8b8c-10fe1f201844","Type":"ContainerStarted","Data":"d502f2221636420e05206c6d74f08ba10eba6afa372d5b188a5bc980f6d7c09c"} Jun 03 00:21:18.739388 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:18.739257 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fmlb9" event={"ID":"d075e4d5-e344-490f-8b8c-10fe1f201844","Type":"ContainerStarted","Data":"e358a038fc857584a3b3db0f947dbacdd3b5057f1042eba3f08b02a2f24b1099"} Jun 03 00:21:18.740972 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:18.740918 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-976cb9cff-vmcj8" event={"ID":"d1622544-685f-4c8d-acb2-ee46a7d320f7","Type":"ContainerStarted","Data":"d68f004f0eb02b6373d5e55cd2e81b74181eafeeed01a8a826a8936f152c261d"} Jun 03 00:21:18.740972 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:18.740945 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-976cb9cff-vmcj8" event={"ID":"d1622544-685f-4c8d-acb2-ee46a7d320f7","Type":"ContainerStarted","Data":"b7af52fd8e8ef15d1cee816391743a2828d03134a0c86ab35c3f63d5a4e31c0f"} Jun 03 00:21:18.741161 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:18.741065 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-976cb9cff-vmcj8" Jun 03 00:21:18.742607 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:18.742575 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d646dc7b8-xjjzv" event={"ID":"66fbb338-e901-4575-bf33-01d23397c9cb","Type":"ContainerStarted","Data":"fa7ffab8447879b143c9471db0f0abe9edda5e023fac8d5ac1ed69a3a0a4ebb3"} Jun 03 00:21:18.744037 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:18.744012 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lr49h" event={"ID":"7ed00dab-a3f9-41cf-8bfc-80db5e4ea202","Type":"ContainerStarted","Data":"9c90c477fea2c1cd857fc9b7f128a206e355de55a7dc5abfe8b775510a26f2b2"} Jun 03 00:21:18.745126 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:18.745096 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-sch94" event={"ID":"95c4995b-b310-4ff7-994f-6d298a147d1f","Type":"ContainerStarted","Data":"2a02e1ac05f370c4a83f05a09c677888399473b58a3411b9d2abb6a8164d1fee"} Jun 03 00:21:18.757392 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:18.757336 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-976cb9cff-vmcj8" podStartSLOduration=1.757319147 podStartE2EDuration="1.757319147s" podCreationTimestamp="2026-06-03 00:21:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 00:21:18.756155789 +0000 UTC m=+99.976078365" watchObservedRunningTime="2026-06-03 00:21:18.757319147 +0000 UTC m=+99.977241721" Jun 03 00:21:19.658912 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:19.658875 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jwt8n" Jun 03 00:21:21.758289 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:21.758184 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fmlb9" event={"ID":"d075e4d5-e344-490f-8b8c-10fe1f201844","Type":"ContainerStarted","Data":"b6309d7d1057e5d79a134bba3672fdeccca6603205b516204e7e12ebcda92b62"} Jun 03 00:21:21.759753 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:21.759709 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d646dc7b8-xjjzv" event={"ID":"66fbb338-e901-4575-bf33-01d23397c9cb","Type":"ContainerStarted","Data":"c4bcf03a2414e19a2735354919e2c2827d62fb934f9d023a8ccbf6966e7ca60a"} Jun 03 00:21:21.760950 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:21.760927 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lr49h" event={"ID":"7ed00dab-a3f9-41cf-8bfc-80db5e4ea202","Type":"ContainerStarted","Data":"e9575ff8c7a383afd4e3445b1cc3925158651287c1c7bd80b7233ccf3ced9020"} Jun 03 00:21:21.762130 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:21.762107 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-sch94" event={"ID":"95c4995b-b310-4ff7-994f-6d298a147d1f","Type":"ContainerStarted","Data":"6b2fe3c7b2b596eec7bb17ad18a49b43474545d21ab7f5666eacdd2125741ccf"} Jun 03 00:21:21.763431 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:21.763408 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w2z46" event={"ID":"65351302-04fd-49bb-b5dc-836203281ad2","Type":"ContainerStarted","Data":"ecfc06b2a58cfd8c5b6b794a0f067a2b2ab96991b76ba32feda4e3fb4f503aab"} Jun 03 00:21:21.763492 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:21.763439 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w2z46" event={"ID":"65351302-04fd-49bb-b5dc-836203281ad2","Type":"ContainerStarted","Data":"bab55982f3164da93393ce7e16ee3dae68c5bb83cc25ef221cec4e2dce997e36"} Jun 03 00:21:21.763575 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:21.763560 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-w2z46" Jun 03 00:21:21.790463 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:21.790377 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d646dc7b8-xjjzv" podStartSLOduration=1.397183952 podStartE2EDuration="4.790362133s" podCreationTimestamp="2026-06-03 00:21:17 +0000 UTC" firstStartedPulling="2026-06-03 00:21:18.140657601 +0000 UTC m=+99.360580168" lastFinishedPulling="2026-06-03 00:21:21.533835773 +0000 UTC m=+102.753758349" observedRunningTime="2026-06-03 00:21:21.790295061 +0000 UTC m=+103.010217636" watchObservedRunningTime="2026-06-03 00:21:21.790362133 +0000 UTC m=+103.010284708" Jun 03 00:21:21.810368 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:21.810317 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-w2z46" podStartSLOduration=65.411144379 podStartE2EDuration="1m8.810303611s" podCreationTimestamp="2026-06-03 00:20:13 +0000 UTC" firstStartedPulling="2026-06-03 00:21:18.086492372 +0000 UTC m=+99.306414924" lastFinishedPulling="2026-06-03 00:21:21.485651593 +0000 UTC m=+102.705574156" observedRunningTime="2026-06-03 00:21:21.809495965 +0000 UTC m=+103.029418540" watchObservedRunningTime="2026-06-03 00:21:21.810303611 +0000 UTC m=+103.030226186" Jun 03 00:21:21.828024 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:21.827975 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lr49h" podStartSLOduration=65.163383946 podStartE2EDuration="1m8.827961195s" podCreationTimestamp="2026-06-03 00:20:13 +0000 UTC" firstStartedPulling="2026-06-03 00:21:17.82123215 +0000 UTC m=+99.041154703" lastFinishedPulling="2026-06-03 00:21:21.485809395 +0000 UTC m=+102.705731952" observedRunningTime="2026-06-03 00:21:21.827843706 +0000 UTC m=+103.047766280" watchObservedRunningTime="2026-06-03 00:21:21.827961195 +0000 UTC m=+103.047883770" Jun 03 00:21:21.844615 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:21.844556 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-sch94" podStartSLOduration=1.633636737 podStartE2EDuration="4.844536667s" podCreationTimestamp="2026-06-03 00:21:17 +0000 UTC" firstStartedPulling="2026-06-03 00:21:18.274956047 +0000 UTC m=+99.494878614" lastFinishedPulling="2026-06-03 00:21:21.485855985 +0000 UTC m=+102.705778544" observedRunningTime="2026-06-03 00:21:21.843639372 +0000 UTC m=+103.063561946" watchObservedRunningTime="2026-06-03 00:21:21.844536667 +0000 UTC m=+103.064459243" Jun 03 00:21:23.771665 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:23.771624 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fmlb9" event={"ID":"d075e4d5-e344-490f-8b8c-10fe1f201844","Type":"ContainerStarted","Data":"93f88df3099748ab4fdef49ff6b0f055390e14430030936ec98c48461ffab118"} Jun 03 00:21:23.787698 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:23.787638 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fmlb9" podStartSLOduration=1.714315018 podStartE2EDuration="6.787624256s" podCreationTimestamp="2026-06-03 00:21:17 +0000 UTC" firstStartedPulling="2026-06-03 00:21:18.374638902 +0000 UTC m=+99.594561472" lastFinishedPulling="2026-06-03 00:21:23.447948141 +0000 UTC m=+104.667870710" observedRunningTime="2026-06-03 00:21:23.786043032 +0000 UTC m=+105.005965620" watchObservedRunningTime="2026-06-03 00:21:23.787624256 +0000 UTC m=+105.007546830" Jun 03 00:21:27.729853 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:27.729804 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-5gn5k"] Jun 03 00:21:27.732765 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:27.732748 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-5gn5k" Jun 03 00:21:27.734712 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:27.734673 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 03 00:21:27.734835 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:27.734762 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-wkgkb\"" Jun 03 00:21:27.734915 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:27.734901 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 00:21:27.734972 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:27.734962 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 03 00:21:27.735451 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:27.735413 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 00:21:27.735507 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:27.735425 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 00:21:27.741006 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:27.740985 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-5gn5k"] Jun 03 00:21:27.767667 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:27.767636 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-w5sxt"] Jun 03 00:21:27.769814 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:27.769792 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-w5sxt" Jun 03 00:21:27.771760 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:27.771733 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 00:21:27.771868 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:27.771763 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 00:21:27.771868 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:27.771775 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 00:21:27.771868 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:27.771841 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vbjhq\"" Jun 03 00:21:27.848659 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:27.848625 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5857928b-6643-428a-9e8d-df6dee75696f-root\") pod \"node-exporter-w5sxt\" (UID: \"5857928b-6643-428a-9e8d-df6dee75696f\") " pod="openshift-monitoring/node-exporter-w5sxt" Jun 03 00:21:27.848659 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:27.848664 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07ee71a7-234b-4ce1-90c2-8cd922683c58-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-5gn5k\" (UID: \"07ee71a7-234b-4ce1-90c2-8cd922683c58\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-5gn5k" Jun 03 00:21:27.848874 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:27.848711 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wl6df\" (UniqueName: \"kubernetes.io/projected/5857928b-6643-428a-9e8d-df6dee75696f-kube-api-access-wl6df\") pod \"node-exporter-w5sxt\" (UID: \"5857928b-6643-428a-9e8d-df6dee75696f\") " pod="openshift-monitoring/node-exporter-w5sxt" Jun 03 00:21:27.848874 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:27.848794 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/07ee71a7-234b-4ce1-90c2-8cd922683c58-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-5gn5k\" (UID: \"07ee71a7-234b-4ce1-90c2-8cd922683c58\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-5gn5k" Jun 03 00:21:27.848874 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:27.848823 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5857928b-6643-428a-9e8d-df6dee75696f-sys\") pod \"node-exporter-w5sxt\" (UID: \"5857928b-6643-428a-9e8d-df6dee75696f\") " pod="openshift-monitoring/node-exporter-w5sxt" Jun 03 00:21:27.848874 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:27.848840 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5857928b-6643-428a-9e8d-df6dee75696f-node-exporter-wtmp\") pod \"node-exporter-w5sxt\" (UID: \"5857928b-6643-428a-9e8d-df6dee75696f\") " pod="openshift-monitoring/node-exporter-w5sxt" Jun 03 00:21:27.848874 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:27.848862 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5857928b-6643-428a-9e8d-df6dee75696f-node-exporter-tls\") pod \"node-exporter-w5sxt\" (UID: \"5857928b-6643-428a-9e8d-df6dee75696f\") " pod="openshift-monitoring/node-exporter-w5sxt" Jun 03 00:21:27.849026 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:27.848883 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5857928b-6643-428a-9e8d-df6dee75696f-metrics-client-ca\") pod \"node-exporter-w5sxt\" (UID: \"5857928b-6643-428a-9e8d-df6dee75696f\") " pod="openshift-monitoring/node-exporter-w5sxt" Jun 03 00:21:27.849026 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:27.848922 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/07ee71a7-234b-4ce1-90c2-8cd922683c58-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-5gn5k\" (UID: \"07ee71a7-234b-4ce1-90c2-8cd922683c58\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-5gn5k" Jun 03 00:21:27.849026 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:27.848960 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5857928b-6643-428a-9e8d-df6dee75696f-node-exporter-textfile\") pod \"node-exporter-w5sxt\" (UID: \"5857928b-6643-428a-9e8d-df6dee75696f\") " pod="openshift-monitoring/node-exporter-w5sxt" Jun 03 00:21:27.849026 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:27.848996 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5857928b-6643-428a-9e8d-df6dee75696f-node-exporter-accelerators-collector-config\") pod \"node-exporter-w5sxt\" (UID: \"5857928b-6643-428a-9e8d-df6dee75696f\") " pod="openshift-monitoring/node-exporter-w5sxt" Jun 03 00:21:27.849148 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:27.849047 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5857928b-6643-428a-9e8d-df6dee75696f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w5sxt\" (UID: \"5857928b-6643-428a-9e8d-df6dee75696f\") " pod="openshift-monitoring/node-exporter-w5sxt" Jun 03 00:21:27.849148 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:27.849084 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r46zn\" (UniqueName: \"kubernetes.io/projected/07ee71a7-234b-4ce1-90c2-8cd922683c58-kube-api-access-r46zn\") pod \"openshift-state-metrics-85658796db-5gn5k\" (UID: \"07ee71a7-234b-4ce1-90c2-8cd922683c58\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-5gn5k" Jun 03 00:21:27.949736 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:27.949663 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/07ee71a7-234b-4ce1-90c2-8cd922683c58-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-5gn5k\" (UID: \"07ee71a7-234b-4ce1-90c2-8cd922683c58\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-5gn5k" Jun 03 00:21:27.949736 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:27.949749 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5857928b-6643-428a-9e8d-df6dee75696f-sys\") pod \"node-exporter-w5sxt\" (UID: \"5857928b-6643-428a-9e8d-df6dee75696f\") " pod="openshift-monitoring/node-exporter-w5sxt" Jun 03 00:21:27.950008 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:27.949770 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5857928b-6643-428a-9e8d-df6dee75696f-node-exporter-wtmp\") pod \"node-exporter-w5sxt\" (UID: \"5857928b-6643-428a-9e8d-df6dee75696f\") " pod="openshift-monitoring/node-exporter-w5sxt" Jun 03 00:21:27.950008 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:27.949791 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5857928b-6643-428a-9e8d-df6dee75696f-node-exporter-tls\") pod \"node-exporter-w5sxt\" (UID: \"5857928b-6643-428a-9e8d-df6dee75696f\") " pod="openshift-monitoring/node-exporter-w5sxt" Jun 03 00:21:27.950008 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:27.949806 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5857928b-6643-428a-9e8d-df6dee75696f-metrics-client-ca\") pod \"node-exporter-w5sxt\" (UID: \"5857928b-6643-428a-9e8d-df6dee75696f\") " pod="openshift-monitoring/node-exporter-w5sxt" Jun 03 00:21:27.950008 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:27.949900 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5857928b-6643-428a-9e8d-df6dee75696f-sys\") pod \"node-exporter-w5sxt\" (UID: \"5857928b-6643-428a-9e8d-df6dee75696f\") " pod="openshift-monitoring/node-exporter-w5sxt" Jun 03 00:21:27.950008 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:21:27.949917 2559 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 03 00:21:27.950008 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:27.949898 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/07ee71a7-234b-4ce1-90c2-8cd922683c58-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-5gn5k\" (UID: \"07ee71a7-234b-4ce1-90c2-8cd922683c58\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-5gn5k" Jun 03 00:21:27.950008 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:27.949946 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5857928b-6643-428a-9e8d-df6dee75696f-node-exporter-wtmp\") pod \"node-exporter-w5sxt\" (UID: \"5857928b-6643-428a-9e8d-df6dee75696f\") " pod="openshift-monitoring/node-exporter-w5sxt" Jun 03 00:21:27.950008 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:21:27.949985 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5857928b-6643-428a-9e8d-df6dee75696f-node-exporter-tls podName:5857928b-6643-428a-9e8d-df6dee75696f nodeName:}" failed. No retries permitted until 2026-06-03 00:21:28.449960929 +0000 UTC m=+109.669883483 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/5857928b-6643-428a-9e8d-df6dee75696f-node-exporter-tls") pod "node-exporter-w5sxt" (UID: "5857928b-6643-428a-9e8d-df6dee75696f") : secret "node-exporter-tls" not found Jun 03 00:21:27.950452 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:27.950034 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5857928b-6643-428a-9e8d-df6dee75696f-node-exporter-textfile\") pod \"node-exporter-w5sxt\" (UID: \"5857928b-6643-428a-9e8d-df6dee75696f\") " pod="openshift-monitoring/node-exporter-w5sxt" Jun 03 00:21:27.950452 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:27.950087 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5857928b-6643-428a-9e8d-df6dee75696f-node-exporter-accelerators-collector-config\") pod \"node-exporter-w5sxt\" (UID: \"5857928b-6643-428a-9e8d-df6dee75696f\") " pod="openshift-monitoring/node-exporter-w5sxt" Jun 03 00:21:27.950452 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:27.950124 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5857928b-6643-428a-9e8d-df6dee75696f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w5sxt\" (UID: \"5857928b-6643-428a-9e8d-df6dee75696f\") " pod="openshift-monitoring/node-exporter-w5sxt" Jun 03 00:21:27.950452 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:27.950169 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r46zn\" (UniqueName: \"kubernetes.io/projected/07ee71a7-234b-4ce1-90c2-8cd922683c58-kube-api-access-r46zn\") pod \"openshift-state-metrics-85658796db-5gn5k\" (UID: \"07ee71a7-234b-4ce1-90c2-8cd922683c58\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-5gn5k" Jun 03 00:21:27.950452 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:27.950212 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5857928b-6643-428a-9e8d-df6dee75696f-root\") pod \"node-exporter-w5sxt\" (UID: \"5857928b-6643-428a-9e8d-df6dee75696f\") " pod="openshift-monitoring/node-exporter-w5sxt" Jun 03 00:21:27.950452 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:27.950266 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07ee71a7-234b-4ce1-90c2-8cd922683c58-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-5gn5k\" (UID: \"07ee71a7-234b-4ce1-90c2-8cd922683c58\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-5gn5k" Jun 03 00:21:27.950452 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:27.950323 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wl6df\" (UniqueName: \"kubernetes.io/projected/5857928b-6643-428a-9e8d-df6dee75696f-kube-api-access-wl6df\") pod \"node-exporter-w5sxt\" (UID: \"5857928b-6643-428a-9e8d-df6dee75696f\") " pod="openshift-monitoring/node-exporter-w5sxt" Jun 03 00:21:27.950452 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:27.950373 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5857928b-6643-428a-9e8d-df6dee75696f-node-exporter-textfile\") pod \"node-exporter-w5sxt\" (UID: \"5857928b-6643-428a-9e8d-df6dee75696f\") " pod="openshift-monitoring/node-exporter-w5sxt" Jun 03 00:21:27.950452 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:27.950446 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5857928b-6643-428a-9e8d-df6dee75696f-root\") pod \"node-exporter-w5sxt\" (UID: \"5857928b-6643-428a-9e8d-df6dee75696f\") " pod="openshift-monitoring/node-exporter-w5sxt" Jun 03 00:21:27.950452 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:27.950452 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5857928b-6643-428a-9e8d-df6dee75696f-metrics-client-ca\") pod \"node-exporter-w5sxt\" (UID: \"5857928b-6643-428a-9e8d-df6dee75696f\") " pod="openshift-monitoring/node-exporter-w5sxt" Jun 03 00:21:27.951007 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:27.950662 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5857928b-6643-428a-9e8d-df6dee75696f-node-exporter-accelerators-collector-config\") pod \"node-exporter-w5sxt\" (UID: \"5857928b-6643-428a-9e8d-df6dee75696f\") " pod="openshift-monitoring/node-exporter-w5sxt" Jun 03 00:21:27.951203 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:27.951180 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07ee71a7-234b-4ce1-90c2-8cd922683c58-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-5gn5k\" (UID: \"07ee71a7-234b-4ce1-90c2-8cd922683c58\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-5gn5k" Jun 03 00:21:27.952444 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:27.952413 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/07ee71a7-234b-4ce1-90c2-8cd922683c58-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-5gn5k\" (UID: \"07ee71a7-234b-4ce1-90c2-8cd922683c58\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-5gn5k" Jun 03 00:21:27.952444 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:27.952414 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/07ee71a7-234b-4ce1-90c2-8cd922683c58-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-5gn5k\" (UID: \"07ee71a7-234b-4ce1-90c2-8cd922683c58\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-5gn5k" Jun 03 00:21:27.952585 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:27.952454 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5857928b-6643-428a-9e8d-df6dee75696f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w5sxt\" (UID: \"5857928b-6643-428a-9e8d-df6dee75696f\") " pod="openshift-monitoring/node-exporter-w5sxt" Jun 03 00:21:27.958851 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:27.958830 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r46zn\" (UniqueName: \"kubernetes.io/projected/07ee71a7-234b-4ce1-90c2-8cd922683c58-kube-api-access-r46zn\") pod \"openshift-state-metrics-85658796db-5gn5k\" (UID: \"07ee71a7-234b-4ce1-90c2-8cd922683c58\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-5gn5k" Jun 03 00:21:27.962227 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:27.962200 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wl6df\" (UniqueName: \"kubernetes.io/projected/5857928b-6643-428a-9e8d-df6dee75696f-kube-api-access-wl6df\") pod \"node-exporter-w5sxt\" (UID: \"5857928b-6643-428a-9e8d-df6dee75696f\") " pod="openshift-monitoring/node-exporter-w5sxt" Jun 03 00:21:28.042388 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:28.042304 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-5gn5k" Jun 03 00:21:28.168193 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:28.168164 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-5gn5k"] Jun 03 00:21:28.171317 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:21:28.171240 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07ee71a7_234b_4ce1_90c2_8cd922683c58.slice/crio-8fbd5702b09afbbe801905f2d8ceedea8924e05414ebd5c557b0f41542c250b4 WatchSource:0}: Error finding container 8fbd5702b09afbbe801905f2d8ceedea8924e05414ebd5c557b0f41542c250b4: Status 404 returned error can't find the container with id 8fbd5702b09afbbe801905f2d8ceedea8924e05414ebd5c557b0f41542c250b4 Jun 03 00:21:28.456938 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:28.456845 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5857928b-6643-428a-9e8d-df6dee75696f-node-exporter-tls\") pod \"node-exporter-w5sxt\" (UID: \"5857928b-6643-428a-9e8d-df6dee75696f\") " pod="openshift-monitoring/node-exporter-w5sxt" Jun 03 00:21:28.459091 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:28.459073 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5857928b-6643-428a-9e8d-df6dee75696f-node-exporter-tls\") pod \"node-exporter-w5sxt\" (UID: \"5857928b-6643-428a-9e8d-df6dee75696f\") " pod="openshift-monitoring/node-exporter-w5sxt" Jun 03 00:21:28.679190 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:28.679137 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-w5sxt" Jun 03 00:21:28.687195 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:21:28.687167 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5857928b_6643_428a_9e8d_df6dee75696f.slice/crio-b625353baaaab2d3da568433b38c8207e382aeff1343941d02745170a7cb00de WatchSource:0}: Error finding container b625353baaaab2d3da568433b38c8207e382aeff1343941d02745170a7cb00de: Status 404 returned error can't find the container with id b625353baaaab2d3da568433b38c8207e382aeff1343941d02745170a7cb00de Jun 03 00:21:28.788805 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:28.788765 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w5sxt" event={"ID":"5857928b-6643-428a-9e8d-df6dee75696f","Type":"ContainerStarted","Data":"b625353baaaab2d3da568433b38c8207e382aeff1343941d02745170a7cb00de"} Jun 03 00:21:28.790469 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:28.790446 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-5gn5k" event={"ID":"07ee71a7-234b-4ce1-90c2-8cd922683c58","Type":"ContainerStarted","Data":"2f7b2f313807fea9f609e54b64f151c54aedfd2e6d22b2939a5e652d076234fa"} Jun 03 00:21:28.790469 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:28.790471 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-5gn5k" event={"ID":"07ee71a7-234b-4ce1-90c2-8cd922683c58","Type":"ContainerStarted","Data":"a7a7cedf30ac81574f694f681cb9f81d86d713712c151695e76eeeb58d5e955e"} Jun 03 00:21:28.790617 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:28.790481 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-5gn5k" event={"ID":"07ee71a7-234b-4ce1-90c2-8cd922683c58","Type":"ContainerStarted","Data":"8fbd5702b09afbbe801905f2d8ceedea8924e05414ebd5c557b0f41542c250b4"} Jun 03 00:21:28.821861 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:28.821827 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 00:21:28.824615 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:28.824593 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:21:28.826631 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:28.826606 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 03 00:21:28.827248 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:28.827221 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 03 00:21:28.827248 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:28.827221 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 03 00:21:28.827408 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:28.827356 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 03 00:21:28.827492 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:28.827473 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 03 00:21:28.827726 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:28.827647 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 03 00:21:28.827726 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:28.827674 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 03 00:21:28.827726 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:28.827700 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-46qkf\"" Jun 03 00:21:28.827981 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:28.827648 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 03 00:21:28.827981 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:28.827675 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 03 00:21:28.838542 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:28.838518 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 00:21:28.962090 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:28.962062 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-config-out\") pod \"alertmanager-main-0\" (UID: \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:21:28.962255 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:28.962101 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-web-config\") pod \"alertmanager-main-0\" (UID: \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:21:28.962255 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:28.962149 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-config-volume\") pod \"alertmanager-main-0\" (UID: \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:21:28.962255 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:28.962178 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:21:28.962255 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:28.962208 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:21:28.962387 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:28.962280 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:21:28.962387 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:28.962314 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:21:28.962387 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:28.962334 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hprhh\" (UniqueName: \"kubernetes.io/projected/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-kube-api-access-hprhh\") pod \"alertmanager-main-0\" (UID: \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:21:28.962483 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:28.962378 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:21:28.962483 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:28.962448 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:21:28.962552 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:28.962511 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:21:28.962552 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:28.962540 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:21:28.962620 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:28.962560 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-tls-assets\") pod \"alertmanager-main-0\" (UID: \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:21:29.064261 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:29.063984 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:21:29.064415 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:29.064267 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:21:29.064415 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:29.064305 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:21:29.064415 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:29.064325 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-tls-assets\") pod \"alertmanager-main-0\" (UID: \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:21:29.064415 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:29.064350 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-config-out\") pod \"alertmanager-main-0\" (UID: \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:21:29.064650 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:29.064411 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-web-config\") pod \"alertmanager-main-0\" (UID: \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:21:29.064650 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:21:29.064464 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-alertmanager-trusted-ca-bundle podName:14817a19-4c7f-4ca4-af0c-d63f5bab6e66 nodeName:}" failed. No retries permitted until 2026-06-03 00:21:29.564438574 +0000 UTC m=+110.784361141 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "14817a19-4c7f-4ca4-af0c-d63f5bab6e66") : configmap references non-existent config key: ca-bundle.crt Jun 03 00:21:29.064650 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:29.064551 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-config-volume\") pod \"alertmanager-main-0\" (UID: \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:21:29.064650 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:29.064612 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:21:29.064885 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:29.064652 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:21:29.064885 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:29.064707 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:21:29.064885 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:29.064753 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:21:29.064885 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:29.064781 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hprhh\" (UniqueName: \"kubernetes.io/projected/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-kube-api-access-hprhh\") pod \"alertmanager-main-0\" (UID: \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:21:29.064885 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:29.064825 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:21:29.066135 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:29.065817 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:21:29.066541 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:29.066474 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:21:29.067573 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:29.067528 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-web-config\") pod \"alertmanager-main-0\" (UID: \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:21:29.067714 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:29.067627 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:21:29.067714 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:29.067627 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:21:29.068599 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:29.068578 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-config-volume\") pod \"alertmanager-main-0\" (UID: \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:21:29.068888 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:29.068866 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-config-out\") pod \"alertmanager-main-0\" (UID: \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:21:29.069236 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:29.069215 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:21:29.069305 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:29.069224 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:21:29.069305 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:29.069278 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-tls-assets\") pod \"alertmanager-main-0\" (UID: \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:21:29.069628 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:29.069605 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:21:29.073158 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:29.073136 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hprhh\" (UniqueName: \"kubernetes.io/projected/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-kube-api-access-hprhh\") pod \"alertmanager-main-0\" (UID: \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:21:29.569961 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:29.569919 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:21:29.570875 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:29.570850 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:21:29.735703 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:29.735653 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:21:29.797348 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:29.797308 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w5sxt" event={"ID":"5857928b-6643-428a-9e8d-df6dee75696f","Type":"ContainerStarted","Data":"d3efa5201cd966e3e405565bb6a5dde3d18530f8e392dae0daae3fcf78250204"} Jun 03 00:21:29.803064 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:29.801327 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-5gn5k" event={"ID":"07ee71a7-234b-4ce1-90c2-8cd922683c58","Type":"ContainerStarted","Data":"8604ba070206ef80fa299ac6b244885c0b5501ed1b4b9a0abcc9b90d180e977c"} Jun 03 00:21:29.833918 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:29.833857 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-85658796db-5gn5k" podStartSLOduration=1.440491922 podStartE2EDuration="2.833837145s" podCreationTimestamp="2026-06-03 00:21:27 +0000 UTC" firstStartedPulling="2026-06-03 00:21:28.285791521 +0000 UTC m=+109.505714090" lastFinishedPulling="2026-06-03 00:21:29.679136755 +0000 UTC m=+110.899059313" observedRunningTime="2026-06-03 00:21:29.832235777 +0000 UTC m=+111.052158353" watchObservedRunningTime="2026-06-03 00:21:29.833837145 +0000 UTC m=+111.053759721" Jun 03 00:21:29.880747 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:29.880717 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 00:21:29.903614 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:21:29.903583 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14817a19_4c7f_4ca4_af0c_d63f5bab6e66.slice/crio-c966c8612bf06d43d4f14ad64fb87704ae296c5c49f13f088bb63f42e6b913aa WatchSource:0}: Error finding container c966c8612bf06d43d4f14ad64fb87704ae296c5c49f13f088bb63f42e6b913aa: Status 404 returned error can't find the container with id c966c8612bf06d43d4f14ad64fb87704ae296c5c49f13f088bb63f42e6b913aa Jun 03 00:21:30.805367 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:30.805313 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"14817a19-4c7f-4ca4-af0c-d63f5bab6e66","Type":"ContainerStarted","Data":"c966c8612bf06d43d4f14ad64fb87704ae296c5c49f13f088bb63f42e6b913aa"} Jun 03 00:21:30.806718 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:30.806661 2559 generic.go:358] "Generic (PLEG): container finished" podID="5857928b-6643-428a-9e8d-df6dee75696f" containerID="d3efa5201cd966e3e405565bb6a5dde3d18530f8e392dae0daae3fcf78250204" exitCode=0 Jun 03 00:21:30.806857 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:30.806718 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w5sxt" event={"ID":"5857928b-6643-428a-9e8d-df6dee75696f","Type":"ContainerDied","Data":"d3efa5201cd966e3e405565bb6a5dde3d18530f8e392dae0daae3fcf78250204"} Jun 03 00:21:31.769422 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:31.769392 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-w2z46" Jun 03 00:21:31.816291 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:31.816258 2559 generic.go:358] "Generic (PLEG): container finished" podID="14817a19-4c7f-4ca4-af0c-d63f5bab6e66" containerID="19f18f6582a747b341435f441f7a077fb66071d9156517061c3db17c1a77ffc3" exitCode=0 Jun 03 00:21:31.816753 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:31.816352 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"14817a19-4c7f-4ca4-af0c-d63f5bab6e66","Type":"ContainerDied","Data":"19f18f6582a747b341435f441f7a077fb66071d9156517061c3db17c1a77ffc3"} Jun 03 00:21:31.818648 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:31.818592 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w5sxt" event={"ID":"5857928b-6643-428a-9e8d-df6dee75696f","Type":"ContainerStarted","Data":"7c8c13d69c304996e4b5d61485c5028bb26c32046e5fee84700335011c5d4236"} Jun 03 00:21:31.818648 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:31.818622 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w5sxt" event={"ID":"5857928b-6643-428a-9e8d-df6dee75696f","Type":"ContainerStarted","Data":"6b0d5a64f5f957a0c1c6ef33b4bbe7a2b86a11a35a9ee53953a94c7daeb40f73"} Jun 03 00:21:31.853477 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:31.853417 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-w5sxt" podStartSLOduration=3.840826311 podStartE2EDuration="4.853403058s" podCreationTimestamp="2026-06-03 00:21:27 +0000 UTC" firstStartedPulling="2026-06-03 00:21:28.688797584 +0000 UTC m=+109.908720141" lastFinishedPulling="2026-06-03 00:21:29.701374333 +0000 UTC m=+110.921296888" observedRunningTime="2026-06-03 00:21:31.85285759 +0000 UTC m=+113.072780178" watchObservedRunningTime="2026-06-03 00:21:31.853403058 +0000 UTC m=+113.073325633" Jun 03 00:21:32.045635 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:32.045538 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-865df7bc55-4dvhg"] Jun 03 00:21:32.047819 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:32.047804 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-865df7bc55-4dvhg" Jun 03 00:21:32.050596 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:32.050573 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 03 00:21:32.050735 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:32.050660 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 03 00:21:32.050735 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:32.050663 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 03 00:21:32.050735 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:32.050711 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 03 00:21:32.050735 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:32.050723 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-bhsck\"" Jun 03 00:21:32.050912 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:32.050793 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-ck3136o9p4vmh\"" Jun 03 00:21:32.061276 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:32.061249 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-865df7bc55-4dvhg"] Jun 03 00:21:32.194513 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:32.194470 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/10dc6710-cdcd-44be-b3b8-251d7c7beaa4-secret-metrics-server-client-certs\") pod \"metrics-server-865df7bc55-4dvhg\" (UID: \"10dc6710-cdcd-44be-b3b8-251d7c7beaa4\") " pod="openshift-monitoring/metrics-server-865df7bc55-4dvhg" Jun 03 00:21:32.194729 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:32.194562 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10dc6710-cdcd-44be-b3b8-251d7c7beaa4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-865df7bc55-4dvhg\" (UID: \"10dc6710-cdcd-44be-b3b8-251d7c7beaa4\") " pod="openshift-monitoring/metrics-server-865df7bc55-4dvhg" Jun 03 00:21:32.194729 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:32.194585 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7n8w\" (UniqueName: \"kubernetes.io/projected/10dc6710-cdcd-44be-b3b8-251d7c7beaa4-kube-api-access-m7n8w\") pod \"metrics-server-865df7bc55-4dvhg\" (UID: \"10dc6710-cdcd-44be-b3b8-251d7c7beaa4\") " pod="openshift-monitoring/metrics-server-865df7bc55-4dvhg" Jun 03 00:21:32.194729 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:32.194604 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/10dc6710-cdcd-44be-b3b8-251d7c7beaa4-secret-metrics-server-tls\") pod \"metrics-server-865df7bc55-4dvhg\" (UID: \"10dc6710-cdcd-44be-b3b8-251d7c7beaa4\") " pod="openshift-monitoring/metrics-server-865df7bc55-4dvhg" Jun 03 00:21:32.194729 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:32.194625 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/10dc6710-cdcd-44be-b3b8-251d7c7beaa4-metrics-server-audit-profiles\") pod \"metrics-server-865df7bc55-4dvhg\" (UID: \"10dc6710-cdcd-44be-b3b8-251d7c7beaa4\") " pod="openshift-monitoring/metrics-server-865df7bc55-4dvhg" Jun 03 00:21:32.194729 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:32.194714 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/10dc6710-cdcd-44be-b3b8-251d7c7beaa4-audit-log\") pod \"metrics-server-865df7bc55-4dvhg\" (UID: \"10dc6710-cdcd-44be-b3b8-251d7c7beaa4\") " pod="openshift-monitoring/metrics-server-865df7bc55-4dvhg" Jun 03 00:21:32.194905 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:32.194755 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/10dc6710-cdcd-44be-b3b8-251d7c7beaa4-client-ca-bundle\") pod \"metrics-server-865df7bc55-4dvhg\" (UID: \"10dc6710-cdcd-44be-b3b8-251d7c7beaa4\") " pod="openshift-monitoring/metrics-server-865df7bc55-4dvhg" Jun 03 00:21:32.295975 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:32.295888 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/10dc6710-cdcd-44be-b3b8-251d7c7beaa4-secret-metrics-server-client-certs\") pod \"metrics-server-865df7bc55-4dvhg\" (UID: \"10dc6710-cdcd-44be-b3b8-251d7c7beaa4\") " pod="openshift-monitoring/metrics-server-865df7bc55-4dvhg" Jun 03 00:21:32.295975 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:32.295965 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10dc6710-cdcd-44be-b3b8-251d7c7beaa4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-865df7bc55-4dvhg\" (UID: \"10dc6710-cdcd-44be-b3b8-251d7c7beaa4\") " pod="openshift-monitoring/metrics-server-865df7bc55-4dvhg" Jun 03 00:21:32.296133 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:32.295982 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m7n8w\" (UniqueName: \"kubernetes.io/projected/10dc6710-cdcd-44be-b3b8-251d7c7beaa4-kube-api-access-m7n8w\") pod \"metrics-server-865df7bc55-4dvhg\" (UID: \"10dc6710-cdcd-44be-b3b8-251d7c7beaa4\") " pod="openshift-monitoring/metrics-server-865df7bc55-4dvhg" Jun 03 00:21:32.296133 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:32.296002 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/10dc6710-cdcd-44be-b3b8-251d7c7beaa4-secret-metrics-server-tls\") pod \"metrics-server-865df7bc55-4dvhg\" (UID: \"10dc6710-cdcd-44be-b3b8-251d7c7beaa4\") " pod="openshift-monitoring/metrics-server-865df7bc55-4dvhg" Jun 03 00:21:32.296133 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:32.296018 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/10dc6710-cdcd-44be-b3b8-251d7c7beaa4-metrics-server-audit-profiles\") pod \"metrics-server-865df7bc55-4dvhg\" (UID: \"10dc6710-cdcd-44be-b3b8-251d7c7beaa4\") " pod="openshift-monitoring/metrics-server-865df7bc55-4dvhg" Jun 03 00:21:32.296133 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:32.296043 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/10dc6710-cdcd-44be-b3b8-251d7c7beaa4-audit-log\") pod \"metrics-server-865df7bc55-4dvhg\" (UID: \"10dc6710-cdcd-44be-b3b8-251d7c7beaa4\") " pod="openshift-monitoring/metrics-server-865df7bc55-4dvhg" Jun 03 00:21:32.296133 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:32.296067 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/10dc6710-cdcd-44be-b3b8-251d7c7beaa4-client-ca-bundle\") pod \"metrics-server-865df7bc55-4dvhg\" (UID: \"10dc6710-cdcd-44be-b3b8-251d7c7beaa4\") " pod="openshift-monitoring/metrics-server-865df7bc55-4dvhg" Jun 03 00:21:32.296763 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:32.296713 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/10dc6710-cdcd-44be-b3b8-251d7c7beaa4-audit-log\") pod \"metrics-server-865df7bc55-4dvhg\" (UID: \"10dc6710-cdcd-44be-b3b8-251d7c7beaa4\") " pod="openshift-monitoring/metrics-server-865df7bc55-4dvhg" Jun 03 00:21:32.296875 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:32.296817 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10dc6710-cdcd-44be-b3b8-251d7c7beaa4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-865df7bc55-4dvhg\" (UID: \"10dc6710-cdcd-44be-b3b8-251d7c7beaa4\") " pod="openshift-monitoring/metrics-server-865df7bc55-4dvhg" Jun 03 00:21:32.297032 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:32.297015 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/10dc6710-cdcd-44be-b3b8-251d7c7beaa4-metrics-server-audit-profiles\") pod \"metrics-server-865df7bc55-4dvhg\" (UID: \"10dc6710-cdcd-44be-b3b8-251d7c7beaa4\") " pod="openshift-monitoring/metrics-server-865df7bc55-4dvhg" Jun 03 00:21:32.298605 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:32.298585 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/10dc6710-cdcd-44be-b3b8-251d7c7beaa4-secret-metrics-server-tls\") pod \"metrics-server-865df7bc55-4dvhg\" (UID: \"10dc6710-cdcd-44be-b3b8-251d7c7beaa4\") " pod="openshift-monitoring/metrics-server-865df7bc55-4dvhg" Jun 03 00:21:32.298943 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:32.298927 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/10dc6710-cdcd-44be-b3b8-251d7c7beaa4-secret-metrics-server-client-certs\") pod \"metrics-server-865df7bc55-4dvhg\" (UID: \"10dc6710-cdcd-44be-b3b8-251d7c7beaa4\") " pod="openshift-monitoring/metrics-server-865df7bc55-4dvhg" Jun 03 00:21:32.299014 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:32.298966 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/10dc6710-cdcd-44be-b3b8-251d7c7beaa4-client-ca-bundle\") pod \"metrics-server-865df7bc55-4dvhg\" (UID: \"10dc6710-cdcd-44be-b3b8-251d7c7beaa4\") " pod="openshift-monitoring/metrics-server-865df7bc55-4dvhg" Jun 03 00:21:32.302835 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:32.302815 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7n8w\" (UniqueName: \"kubernetes.io/projected/10dc6710-cdcd-44be-b3b8-251d7c7beaa4-kube-api-access-m7n8w\") pod \"metrics-server-865df7bc55-4dvhg\" (UID: \"10dc6710-cdcd-44be-b3b8-251d7c7beaa4\") " pod="openshift-monitoring/metrics-server-865df7bc55-4dvhg" Jun 03 00:21:32.356832 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:32.356796 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-865df7bc55-4dvhg" Jun 03 00:21:32.482274 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:32.482114 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-865df7bc55-4dvhg"] Jun 03 00:21:32.484829 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:21:32.484800 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10dc6710_cdcd_44be_b3b8_251d7c7beaa4.slice/crio-c36ea07c4f8c6bb05705e8d0e8414d19f69f8e7a04f6479dc4b4a7c6d4067fa8 WatchSource:0}: Error finding container c36ea07c4f8c6bb05705e8d0e8414d19f69f8e7a04f6479dc4b4a7c6d4067fa8: Status 404 returned error can't find the container with id c36ea07c4f8c6bb05705e8d0e8414d19f69f8e7a04f6479dc4b4a7c6d4067fa8 Jun 03 00:21:32.822170 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:32.822130 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-865df7bc55-4dvhg" event={"ID":"10dc6710-cdcd-44be-b3b8-251d7c7beaa4","Type":"ContainerStarted","Data":"c36ea07c4f8c6bb05705e8d0e8414d19f69f8e7a04f6479dc4b4a7c6d4067fa8"} Jun 03 00:21:33.967096 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:33.967057 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 00:21:33.969955 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:33.969932 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:33.972040 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:33.972017 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-cdhvm9ptdfq4j\"" Jun 03 00:21:33.972209 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:33.972066 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 03 00:21:33.972308 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:33.972283 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 03 00:21:33.972411 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:33.972392 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 03 00:21:33.972903 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:33.972885 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 03 00:21:33.973029 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:33.972988 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 03 00:21:33.973029 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:33.973017 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 03 00:21:33.973170 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:33.973017 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 03 00:21:33.973170 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:33.973103 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hmmsz\"" Jun 03 00:21:33.973710 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:33.973531 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 03 00:21:33.973710 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:33.973589 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 03 00:21:33.973710 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:33.973607 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 03 00:21:33.975374 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:33.975352 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 03 00:21:33.978788 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:33.978766 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 03 00:21:33.987954 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:33.987915 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 00:21:34.112977 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.112932 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f834c99c-c30c-41e5-bd46-0c5862bc0331-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.113138 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.112987 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfj5t\" (UniqueName: \"kubernetes.io/projected/f834c99c-c30c-41e5-bd46-0c5862bc0331-kube-api-access-rfj5t\") pod \"prometheus-k8s-0\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.113138 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.113018 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f834c99c-c30c-41e5-bd46-0c5862bc0331-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.113138 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.113048 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f834c99c-c30c-41e5-bd46-0c5862bc0331-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.113138 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.113077 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f834c99c-c30c-41e5-bd46-0c5862bc0331-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.113138 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.113094 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f834c99c-c30c-41e5-bd46-0c5862bc0331-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.113138 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.113118 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f834c99c-c30c-41e5-bd46-0c5862bc0331-config-out\") pod \"prometheus-k8s-0\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.113138 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.113138 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f834c99c-c30c-41e5-bd46-0c5862bc0331-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.113490 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.113269 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f834c99c-c30c-41e5-bd46-0c5862bc0331-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.113490 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.113315 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f834c99c-c30c-41e5-bd46-0c5862bc0331-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.113490 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.113352 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f834c99c-c30c-41e5-bd46-0c5862bc0331-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.113490 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.113393 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f834c99c-c30c-41e5-bd46-0c5862bc0331-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.113490 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.113420 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f834c99c-c30c-41e5-bd46-0c5862bc0331-web-config\") pod \"prometheus-k8s-0\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.113490 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.113456 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f834c99c-c30c-41e5-bd46-0c5862bc0331-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.113775 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.113521 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f834c99c-c30c-41e5-bd46-0c5862bc0331-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.113775 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.113565 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f834c99c-c30c-41e5-bd46-0c5862bc0331-config\") pod \"prometheus-k8s-0\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.113775 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.113588 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f834c99c-c30c-41e5-bd46-0c5862bc0331-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.113775 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.113636 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f834c99c-c30c-41e5-bd46-0c5862bc0331-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.215131 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.215083 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f834c99c-c30c-41e5-bd46-0c5862bc0331-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.215301 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.215158 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f834c99c-c30c-41e5-bd46-0c5862bc0331-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.215301 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.215204 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f834c99c-c30c-41e5-bd46-0c5862bc0331-config\") pod \"prometheus-k8s-0\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.215301 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.215229 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f834c99c-c30c-41e5-bd46-0c5862bc0331-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.215301 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.215260 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f834c99c-c30c-41e5-bd46-0c5862bc0331-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.215301 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.215299 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f834c99c-c30c-41e5-bd46-0c5862bc0331-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.215559 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.215326 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rfj5t\" (UniqueName: \"kubernetes.io/projected/f834c99c-c30c-41e5-bd46-0c5862bc0331-kube-api-access-rfj5t\") pod \"prometheus-k8s-0\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.215559 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.215357 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f834c99c-c30c-41e5-bd46-0c5862bc0331-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.215559 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.215394 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f834c99c-c30c-41e5-bd46-0c5862bc0331-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.215559 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.215422 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f834c99c-c30c-41e5-bd46-0c5862bc0331-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.215559 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.215447 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f834c99c-c30c-41e5-bd46-0c5862bc0331-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.215559 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.215483 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f834c99c-c30c-41e5-bd46-0c5862bc0331-config-out\") pod \"prometheus-k8s-0\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.215559 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.215507 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f834c99c-c30c-41e5-bd46-0c5862bc0331-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.215559 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.215551 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f834c99c-c30c-41e5-bd46-0c5862bc0331-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.216000 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.215576 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f834c99c-c30c-41e5-bd46-0c5862bc0331-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.216000 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.215609 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f834c99c-c30c-41e5-bd46-0c5862bc0331-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.216000 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.215637 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f834c99c-c30c-41e5-bd46-0c5862bc0331-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.216000 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.215662 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f834c99c-c30c-41e5-bd46-0c5862bc0331-web-config\") pod \"prometheus-k8s-0\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.216194 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.215995 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f834c99c-c30c-41e5-bd46-0c5862bc0331-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.216334 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.216309 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f834c99c-c30c-41e5-bd46-0c5862bc0331-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.218548 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.218183 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f834c99c-c30c-41e5-bd46-0c5862bc0331-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.218548 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.218374 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f834c99c-c30c-41e5-bd46-0c5862bc0331-config-out\") pod \"prometheus-k8s-0\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.218548 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.218425 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f834c99c-c30c-41e5-bd46-0c5862bc0331-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.218806 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.218548 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f834c99c-c30c-41e5-bd46-0c5862bc0331-web-config\") pod \"prometheus-k8s-0\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.218806 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.218647 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f834c99c-c30c-41e5-bd46-0c5862bc0331-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.218806 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.218656 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f834c99c-c30c-41e5-bd46-0c5862bc0331-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.219057 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.219032 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f834c99c-c30c-41e5-bd46-0c5862bc0331-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.219401 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.219335 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f834c99c-c30c-41e5-bd46-0c5862bc0331-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.219664 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.219549 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f834c99c-c30c-41e5-bd46-0c5862bc0331-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.219831 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.219806 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f834c99c-c30c-41e5-bd46-0c5862bc0331-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.220581 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.220555 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f834c99c-c30c-41e5-bd46-0c5862bc0331-config\") pod \"prometheus-k8s-0\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.221026 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.220984 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f834c99c-c30c-41e5-bd46-0c5862bc0331-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.221275 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.221251 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f834c99c-c30c-41e5-bd46-0c5862bc0331-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.221438 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.221415 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f834c99c-c30c-41e5-bd46-0c5862bc0331-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.222757 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.222737 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f834c99c-c30c-41e5-bd46-0c5862bc0331-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.223342 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.223323 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfj5t\" (UniqueName: \"kubernetes.io/projected/f834c99c-c30c-41e5-bd46-0c5862bc0331-kube-api-access-rfj5t\") pod \"prometheus-k8s-0\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.283104 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.283055 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:34.832880 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.832825 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"14817a19-4c7f-4ca4-af0c-d63f5bab6e66","Type":"ContainerStarted","Data":"6ea1c038e8417a4087cf0266aa03c5b65f5a66bcaf6bfb459e1fbf32d2782d46"} Jun 03 00:21:34.835138 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.834146 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-865df7bc55-4dvhg" event={"ID":"10dc6710-cdcd-44be-b3b8-251d7c7beaa4","Type":"ContainerStarted","Data":"f57af918933d6e85e38b05b39aa4f9ae2b10c0e8261a14ede0bae10386bd6d6e"} Jun 03 00:21:34.851499 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.851370 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-865df7bc55-4dvhg" podStartSLOduration=0.621207442 podStartE2EDuration="2.85135148s" podCreationTimestamp="2026-06-03 00:21:32 +0000 UTC" firstStartedPulling="2026-06-03 00:21:32.486829385 +0000 UTC m=+113.706751945" lastFinishedPulling="2026-06-03 00:21:34.716973416 +0000 UTC m=+115.936895983" observedRunningTime="2026-06-03 00:21:34.849278347 +0000 UTC m=+116.069200925" watchObservedRunningTime="2026-06-03 00:21:34.85135148 +0000 UTC m=+116.071274060" Jun 03 00:21:34.872594 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:34.872449 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 00:21:34.876778 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:21:34.876729 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf834c99c_c30c_41e5_bd46_0c5862bc0331.slice/crio-336fb9c2001664e7c23a2a1b5ed15ca81c538057de7caae7d99a2699cac44a10 WatchSource:0}: Error finding container 336fb9c2001664e7c23a2a1b5ed15ca81c538057de7caae7d99a2699cac44a10: Status 404 returned error can't find the container with id 336fb9c2001664e7c23a2a1b5ed15ca81c538057de7caae7d99a2699cac44a10 Jun 03 00:21:35.838080 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:35.838042 2559 generic.go:358] "Generic (PLEG): container finished" podID="f834c99c-c30c-41e5-bd46-0c5862bc0331" containerID="8e6816b7682f86068f98edc732bc7c50acaa06514020eac00f863bce936e579a" exitCode=0 Jun 03 00:21:35.838545 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:35.838122 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f834c99c-c30c-41e5-bd46-0c5862bc0331","Type":"ContainerDied","Data":"8e6816b7682f86068f98edc732bc7c50acaa06514020eac00f863bce936e579a"} Jun 03 00:21:35.838545 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:35.838153 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f834c99c-c30c-41e5-bd46-0c5862bc0331","Type":"ContainerStarted","Data":"336fb9c2001664e7c23a2a1b5ed15ca81c538057de7caae7d99a2699cac44a10"} Jun 03 00:21:35.841347 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:35.841321 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"14817a19-4c7f-4ca4-af0c-d63f5bab6e66","Type":"ContainerStarted","Data":"151df944a023c537e58b4cea1c5fe329b6f7a65153a70f1801c07c96075b6f87"} Jun 03 00:21:35.841430 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:35.841357 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"14817a19-4c7f-4ca4-af0c-d63f5bab6e66","Type":"ContainerStarted","Data":"f950f010ada78248a5f691967f493972ce8651c746d7f8b1ed9f0a4a3bd086bb"} Jun 03 00:21:35.841430 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:35.841366 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"14817a19-4c7f-4ca4-af0c-d63f5bab6e66","Type":"ContainerStarted","Data":"d2040aed5df3734abf822084655795b471fce6665a42df110ecb492cb2af88f2"} Jun 03 00:21:35.841430 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:35.841375 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"14817a19-4c7f-4ca4-af0c-d63f5bab6e66","Type":"ContainerStarted","Data":"1d513ab22956f42453edab326dc3d5acb4a5f27511bd489747f094506e4c293f"} Jun 03 00:21:35.841430 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:35.841385 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"14817a19-4c7f-4ca4-af0c-d63f5bab6e66","Type":"ContainerStarted","Data":"7b76d06dc7b8c2d484967e1e039494f38ced177b02978f2f016eba94681c2bfc"} Jun 03 00:21:35.888817 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:35.887618 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.103671611 podStartE2EDuration="7.887597513s" podCreationTimestamp="2026-06-03 00:21:28 +0000 UTC" firstStartedPulling="2026-06-03 00:21:29.905428455 +0000 UTC m=+111.125351008" lastFinishedPulling="2026-06-03 00:21:35.689354357 +0000 UTC m=+116.909276910" observedRunningTime="2026-06-03 00:21:35.887093847 +0000 UTC m=+117.107016421" watchObservedRunningTime="2026-06-03 00:21:35.887597513 +0000 UTC m=+117.107520089" Jun 03 00:21:38.853009 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:38.852977 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f834c99c-c30c-41e5-bd46-0c5862bc0331","Type":"ContainerStarted","Data":"121530060eecfc95e67659f1f9c94c6b5a64598ebbf916e3aa9f0445b7b04535"} Jun 03 00:21:39.754961 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:39.754931 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-976cb9cff-vmcj8" Jun 03 00:21:39.860542 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:39.860500 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f834c99c-c30c-41e5-bd46-0c5862bc0331","Type":"ContainerStarted","Data":"0d4bbdf22bb29da54f3c0d785f60bca46076ed55511267bfb385545922cf348b"} Jun 03 00:21:41.868592 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:41.868561 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f834c99c-c30c-41e5-bd46-0c5862bc0331","Type":"ContainerStarted","Data":"4be96feebe600b5317110b0e557b335d8593395276ee726b9b1f484ed1809ab3"} Jun 03 00:21:41.868592 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:41.868597 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f834c99c-c30c-41e5-bd46-0c5862bc0331","Type":"ContainerStarted","Data":"df64e18607a8fd491cfff2c95adc848d6d9bc1d563295bde7f5c1f60e57582e0"} Jun 03 00:21:41.869020 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:41.868609 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f834c99c-c30c-41e5-bd46-0c5862bc0331","Type":"ContainerStarted","Data":"0bee0c6f3ae55002e058aa17f9699d55afc78bf9ae910ad122ce71e66026811e"} Jun 03 00:21:41.869020 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:41.868618 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f834c99c-c30c-41e5-bd46-0c5862bc0331","Type":"ContainerStarted","Data":"2a4c1fb3b4b07a661666a8246a12acebad2a43df3e080d5be94120058fabf623"} Jun 03 00:21:41.894549 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:41.894492 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.540280062 podStartE2EDuration="8.894479282s" podCreationTimestamp="2026-06-03 00:21:33 +0000 UTC" firstStartedPulling="2026-06-03 00:21:35.839348349 +0000 UTC m=+117.059270906" lastFinishedPulling="2026-06-03 00:21:41.193547574 +0000 UTC m=+122.413470126" observedRunningTime="2026-06-03 00:21:41.893094253 +0000 UTC m=+123.113016862" watchObservedRunningTime="2026-06-03 00:21:41.894479282 +0000 UTC m=+123.114401857" Jun 03 00:21:44.283889 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:44.283850 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:21:49.159907 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:49.159850 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf-metrics-certs\") pod \"network-metrics-daemon-h7qxw\" (UID: \"3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf\") " pod="openshift-multus/network-metrics-daemon-h7qxw" Jun 03 00:21:49.162509 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:49.162483 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf-metrics-certs\") pod \"network-metrics-daemon-h7qxw\" (UID: \"3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf\") " pod="openshift-multus/network-metrics-daemon-h7qxw" Jun 03 00:21:49.274903 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:49.274868 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-88bpn\"" Jun 03 00:21:49.283506 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:49.283480 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h7qxw" Jun 03 00:21:49.428449 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:49.428362 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-h7qxw"] Jun 03 00:21:49.432205 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:21:49.432179 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e7f6cca_dec8_44ef_bc6b_1473aa0abcbf.slice/crio-d8524fa84319c7bd55b810dad0878ace5502667ea2f3216e4f4f7c12af3ade9a WatchSource:0}: Error finding container d8524fa84319c7bd55b810dad0878ace5502667ea2f3216e4f4f7c12af3ade9a: Status 404 returned error can't find the container with id d8524fa84319c7bd55b810dad0878ace5502667ea2f3216e4f4f7c12af3ade9a Jun 03 00:21:49.894026 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:49.893985 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h7qxw" event={"ID":"3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf","Type":"ContainerStarted","Data":"d8524fa84319c7bd55b810dad0878ace5502667ea2f3216e4f4f7c12af3ade9a"} Jun 03 00:21:51.901261 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:51.901218 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h7qxw" event={"ID":"3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf","Type":"ContainerStarted","Data":"30a50f120647482aed8ed447a3b1c62bd3404e700371aa468545204f1f21ad24"} Jun 03 00:21:51.901261 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:51.901258 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h7qxw" event={"ID":"3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf","Type":"ContainerStarted","Data":"d4c19c43ed101b22ca60999702e74f8e8f4a081c4289ab0c2847faaf5229b14c"} Jun 03 00:21:51.916200 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:51.916147 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-h7qxw" podStartSLOduration=131.21623445 podStartE2EDuration="2m12.916127899s" podCreationTimestamp="2026-06-03 00:19:39 +0000 UTC" firstStartedPulling="2026-06-03 00:21:49.434118049 +0000 UTC m=+130.654040603" lastFinishedPulling="2026-06-03 00:21:51.134011496 +0000 UTC m=+132.353934052" observedRunningTime="2026-06-03 00:21:51.914811621 +0000 UTC m=+133.134734196" watchObservedRunningTime="2026-06-03 00:21:51.916127899 +0000 UTC m=+133.136050475" Jun 03 00:21:52.357923 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:52.357888 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-865df7bc55-4dvhg" Jun 03 00:21:52.358071 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:21:52.357974 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-865df7bc55-4dvhg" Jun 03 00:22:12.362441 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:12.362407 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-865df7bc55-4dvhg" Jun 03 00:22:12.366180 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:12.366138 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-865df7bc55-4dvhg" Jun 03 00:22:15.974390 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:15.974311 2559 generic.go:358] "Generic (PLEG): container finished" podID="6e1df638-ab07-40df-9344-ca095d3158cf" containerID="b0d7ba9b4a9c7594d10f669a51eb7a9251b2371301f8113fd513bf20953263bb" exitCode=0 Jun 03 00:22:15.974390 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:15.974370 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-2q4gf" event={"ID":"6e1df638-ab07-40df-9344-ca095d3158cf","Type":"ContainerDied","Data":"b0d7ba9b4a9c7594d10f669a51eb7a9251b2371301f8113fd513bf20953263bb"} Jun 03 00:22:15.974784 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:15.974753 2559 scope.go:117] "RemoveContainer" containerID="b0d7ba9b4a9c7594d10f669a51eb7a9251b2371301f8113fd513bf20953263bb" Jun 03 00:22:16.978653 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:16.978617 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-2q4gf" event={"ID":"6e1df638-ab07-40df-9344-ca095d3158cf","Type":"ContainerStarted","Data":"677f08e839390478d3f91e2f47b7fc1dc82d23196936c972ac6f263cb62b3beb"} Jun 03 00:22:19.989860 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:19.989828 2559 generic.go:358] "Generic (PLEG): container finished" podID="d8857f61-7b88-44cd-a25d-ce64ef219677" containerID="75da966ec317722b032068b1d077d705ef1133418ec758fb7b8cad00732b4cc4" exitCode=0 Jun 03 00:22:19.990263 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:19.989905 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-qqf6x" event={"ID":"d8857f61-7b88-44cd-a25d-ce64ef219677","Type":"ContainerDied","Data":"75da966ec317722b032068b1d077d705ef1133418ec758fb7b8cad00732b4cc4"} Jun 03 00:22:19.990310 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:19.990264 2559 scope.go:117] "RemoveContainer" containerID="75da966ec317722b032068b1d077d705ef1133418ec758fb7b8cad00732b4cc4" Jun 03 00:22:20.994751 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:20.994707 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-qqf6x" event={"ID":"d8857f61-7b88-44cd-a25d-ce64ef219677","Type":"ContainerStarted","Data":"51e275422ebd8db34cdbeb1c9188936e55df6423eb090f0dbcfc1155ba5f4ee1"} Jun 03 00:22:34.283936 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:34.283845 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:34.310502 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:34.310098 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:35.054955 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:35.054925 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:47.975822 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:47.975789 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 00:22:47.976379 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:47.976339 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="14817a19-4c7f-4ca4-af0c-d63f5bab6e66" containerName="kube-rbac-proxy-metric" containerID="cri-o://f950f010ada78248a5f691967f493972ce8651c746d7f8b1ed9f0a4a3bd086bb" gracePeriod=120 Jun 03 00:22:47.976521 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:47.976396 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="14817a19-4c7f-4ca4-af0c-d63f5bab6e66" containerName="prom-label-proxy" containerID="cri-o://151df944a023c537e58b4cea1c5fe329b6f7a65153a70f1801c07c96075b6f87" gracePeriod=120 Jun 03 00:22:47.976521 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:47.976449 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="14817a19-4c7f-4ca4-af0c-d63f5bab6e66" containerName="kube-rbac-proxy" containerID="cri-o://d2040aed5df3734abf822084655795b471fce6665a42df110ecb492cb2af88f2" gracePeriod=120 Jun 03 00:22:47.976521 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:47.976448 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="14817a19-4c7f-4ca4-af0c-d63f5bab6e66" containerName="config-reloader" containerID="cri-o://7b76d06dc7b8c2d484967e1e039494f38ced177b02978f2f016eba94681c2bfc" gracePeriod=120 Jun 03 00:22:47.976521 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:47.976435 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="14817a19-4c7f-4ca4-af0c-d63f5bab6e66" containerName="kube-rbac-proxy-web" containerID="cri-o://1d513ab22956f42453edab326dc3d5acb4a5f27511bd489747f094506e4c293f" gracePeriod=120 Jun 03 00:22:47.976753 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:47.976326 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="14817a19-4c7f-4ca4-af0c-d63f5bab6e66" containerName="alertmanager" containerID="cri-o://6ea1c038e8417a4087cf0266aa03c5b65f5a66bcaf6bfb459e1fbf32d2782d46" gracePeriod=120 Jun 03 00:22:49.084634 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:49.084597 2559 generic.go:358] "Generic (PLEG): container finished" podID="14817a19-4c7f-4ca4-af0c-d63f5bab6e66" containerID="151df944a023c537e58b4cea1c5fe329b6f7a65153a70f1801c07c96075b6f87" exitCode=0 Jun 03 00:22:49.084634 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:49.084633 2559 generic.go:358] "Generic (PLEG): container finished" podID="14817a19-4c7f-4ca4-af0c-d63f5bab6e66" containerID="d2040aed5df3734abf822084655795b471fce6665a42df110ecb492cb2af88f2" exitCode=0 Jun 03 00:22:49.085012 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:49.084642 2559 generic.go:358] "Generic (PLEG): container finished" podID="14817a19-4c7f-4ca4-af0c-d63f5bab6e66" containerID="7b76d06dc7b8c2d484967e1e039494f38ced177b02978f2f016eba94681c2bfc" exitCode=0 Jun 03 00:22:49.085012 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:49.084651 2559 generic.go:358] "Generic (PLEG): container finished" podID="14817a19-4c7f-4ca4-af0c-d63f5bab6e66" containerID="6ea1c038e8417a4087cf0266aa03c5b65f5a66bcaf6bfb459e1fbf32d2782d46" exitCode=0 Jun 03 00:22:49.085012 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:49.084675 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"14817a19-4c7f-4ca4-af0c-d63f5bab6e66","Type":"ContainerDied","Data":"151df944a023c537e58b4cea1c5fe329b6f7a65153a70f1801c07c96075b6f87"} Jun 03 00:22:49.085012 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:49.084735 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"14817a19-4c7f-4ca4-af0c-d63f5bab6e66","Type":"ContainerDied","Data":"d2040aed5df3734abf822084655795b471fce6665a42df110ecb492cb2af88f2"} Jun 03 00:22:49.085012 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:49.084751 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"14817a19-4c7f-4ca4-af0c-d63f5bab6e66","Type":"ContainerDied","Data":"7b76d06dc7b8c2d484967e1e039494f38ced177b02978f2f016eba94681c2bfc"} Jun 03 00:22:49.085012 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:49.084764 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"14817a19-4c7f-4ca4-af0c-d63f5bab6e66","Type":"ContainerDied","Data":"6ea1c038e8417a4087cf0266aa03c5b65f5a66bcaf6bfb459e1fbf32d2782d46"} Jun 03 00:22:49.227338 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:49.227310 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:22:49.277226 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:49.277150 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-config-out\") pod \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\" (UID: \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\") " Jun 03 00:22:49.277226 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:49.277193 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-secret-alertmanager-kube-rbac-proxy-metric\") pod \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\" (UID: \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\") " Jun 03 00:22:49.277226 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:49.277213 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-secret-alertmanager-kube-rbac-proxy-web\") pod \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\" (UID: \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\") " Jun 03 00:22:49.277484 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:49.277249 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-web-config\") pod \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\" (UID: \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\") " Jun 03 00:22:49.277484 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:49.277291 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-secret-alertmanager-main-tls\") pod \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\" (UID: \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\") " Jun 03 00:22:49.277484 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:49.277320 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-alertmanager-main-db\") pod \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\" (UID: \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\") " Jun 03 00:22:49.277715 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:49.277662 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "14817a19-4c7f-4ca4-af0c-d63f5bab6e66" (UID: "14817a19-4c7f-4ca4-af0c-d63f5bab6e66"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 00:22:49.277831 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:49.277343 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-cluster-tls-config\") pod \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\" (UID: \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\") " Jun 03 00:22:49.277831 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:49.277805 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-secret-alertmanager-kube-rbac-proxy\") pod \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\" (UID: \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\") " Jun 03 00:22:49.278350 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:49.278112 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hprhh\" (UniqueName: \"kubernetes.io/projected/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-kube-api-access-hprhh\") pod \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\" (UID: \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\") " Jun 03 00:22:49.278350 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:49.278153 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-config-volume\") pod \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\" (UID: \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\") " Jun 03 00:22:49.278350 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:49.278187 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-tls-assets\") pod \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\" (UID: \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\") " Jun 03 00:22:49.278599 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:49.278575 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-metrics-client-ca\") pod \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\" (UID: \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\") " Jun 03 00:22:49.278704 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:49.278669 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-alertmanager-trusted-ca-bundle\") pod \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\" (UID: \"14817a19-4c7f-4ca4-af0c-d63f5bab6e66\") " Jun 03 00:22:49.279007 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:49.278984 2559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-alertmanager-main-db\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Jun 03 00:22:49.279576 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:49.279549 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "14817a19-4c7f-4ca4-af0c-d63f5bab6e66" (UID: "14817a19-4c7f-4ca4-af0c-d63f5bab6e66"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 00:22:49.279809 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:49.279787 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "14817a19-4c7f-4ca4-af0c-d63f5bab6e66" (UID: "14817a19-4c7f-4ca4-af0c-d63f5bab6e66"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 00:22:49.280503 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:49.280457 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "14817a19-4c7f-4ca4-af0c-d63f5bab6e66" (UID: "14817a19-4c7f-4ca4-af0c-d63f5bab6e66"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 00:22:49.280840 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:49.280811 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "14817a19-4c7f-4ca4-af0c-d63f5bab6e66" (UID: "14817a19-4c7f-4ca4-af0c-d63f5bab6e66"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 00:22:49.281014 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:49.280986 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "14817a19-4c7f-4ca4-af0c-d63f5bab6e66" (UID: "14817a19-4c7f-4ca4-af0c-d63f5bab6e66"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 00:22:49.281362 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:49.281332 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "14817a19-4c7f-4ca4-af0c-d63f5bab6e66" (UID: "14817a19-4c7f-4ca4-af0c-d63f5bab6e66"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 00:22:49.281471 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:49.281374 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "14817a19-4c7f-4ca4-af0c-d63f5bab6e66" (UID: "14817a19-4c7f-4ca4-af0c-d63f5bab6e66"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 00:22:49.281960 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:49.281918 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-config-out" (OuterVolumeSpecName: "config-out") pod "14817a19-4c7f-4ca4-af0c-d63f5bab6e66" (UID: "14817a19-4c7f-4ca4-af0c-d63f5bab6e66"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 00:22:49.282884 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:49.282836 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-kube-api-access-hprhh" (OuterVolumeSpecName: "kube-api-access-hprhh") pod "14817a19-4c7f-4ca4-af0c-d63f5bab6e66" (UID: "14817a19-4c7f-4ca4-af0c-d63f5bab6e66"). InnerVolumeSpecName "kube-api-access-hprhh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 00:22:49.282973 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:49.282952 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-config-volume" (OuterVolumeSpecName: "config-volume") pod "14817a19-4c7f-4ca4-af0c-d63f5bab6e66" (UID: "14817a19-4c7f-4ca4-af0c-d63f5bab6e66"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 00:22:49.286587 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:49.286549 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "14817a19-4c7f-4ca4-af0c-d63f5bab6e66" (UID: "14817a19-4c7f-4ca4-af0c-d63f5bab6e66"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 00:22:49.293425 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:49.293400 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-web-config" (OuterVolumeSpecName: "web-config") pod "14817a19-4c7f-4ca4-af0c-d63f5bab6e66" (UID: "14817a19-4c7f-4ca4-af0c-d63f5bab6e66"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 00:22:49.380144 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:49.380120 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hprhh\" (UniqueName: \"kubernetes.io/projected/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-kube-api-access-hprhh\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Jun 03 00:22:49.380144 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:49.380146 2559 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-config-volume\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Jun 03 00:22:49.380292 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:49.380155 2559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-tls-assets\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Jun 03 00:22:49.380292 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:49.380165 2559 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-metrics-client-ca\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Jun 03 00:22:49.380292 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:49.380175 2559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Jun 03 00:22:49.380292 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:49.380201 2559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-config-out\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Jun 03 00:22:49.380292 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:49.380210 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Jun 03 00:22:49.380292 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:49.380221 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Jun 03 00:22:49.380292 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:49.380229 2559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-web-config\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Jun 03 00:22:49.380292 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:49.380237 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-secret-alertmanager-main-tls\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Jun 03 00:22:49.380292 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:49.380247 2559 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-cluster-tls-config\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Jun 03 00:22:49.380292 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:49.380256 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/14817a19-4c7f-4ca4-af0c-d63f5bab6e66-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Jun 03 00:22:50.092488 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.092455 2559 generic.go:358] "Generic (PLEG): container finished" podID="14817a19-4c7f-4ca4-af0c-d63f5bab6e66" containerID="f950f010ada78248a5f691967f493972ce8651c746d7f8b1ed9f0a4a3bd086bb" exitCode=0 Jun 03 00:22:50.092488 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.092482 2559 generic.go:358] "Generic (PLEG): container finished" podID="14817a19-4c7f-4ca4-af0c-d63f5bab6e66" containerID="1d513ab22956f42453edab326dc3d5acb4a5f27511bd489747f094506e4c293f" exitCode=0 Jun 03 00:22:50.093021 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.092518 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"14817a19-4c7f-4ca4-af0c-d63f5bab6e66","Type":"ContainerDied","Data":"f950f010ada78248a5f691967f493972ce8651c746d7f8b1ed9f0a4a3bd086bb"} Jun 03 00:22:50.093021 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.092545 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"14817a19-4c7f-4ca4-af0c-d63f5bab6e66","Type":"ContainerDied","Data":"1d513ab22956f42453edab326dc3d5acb4a5f27511bd489747f094506e4c293f"} Jun 03 00:22:50.093021 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.092556 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"14817a19-4c7f-4ca4-af0c-d63f5bab6e66","Type":"ContainerDied","Data":"c966c8612bf06d43d4f14ad64fb87704ae296c5c49f13f088bb63f42e6b913aa"} Jun 03 00:22:50.093021 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.092571 2559 scope.go:117] "RemoveContainer" containerID="151df944a023c537e58b4cea1c5fe329b6f7a65153a70f1801c07c96075b6f87" Jun 03 00:22:50.093021 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.092569 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:22:50.100033 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.100012 2559 scope.go:117] "RemoveContainer" containerID="f950f010ada78248a5f691967f493972ce8651c746d7f8b1ed9f0a4a3bd086bb" Jun 03 00:22:50.107234 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.107211 2559 scope.go:117] "RemoveContainer" containerID="d2040aed5df3734abf822084655795b471fce6665a42df110ecb492cb2af88f2" Jun 03 00:22:50.114190 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.114144 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 00:22:50.115176 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.115155 2559 scope.go:117] "RemoveContainer" containerID="1d513ab22956f42453edab326dc3d5acb4a5f27511bd489747f094506e4c293f" Jun 03 00:22:50.117122 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.117101 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 00:22:50.122632 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.122610 2559 scope.go:117] "RemoveContainer" containerID="7b76d06dc7b8c2d484967e1e039494f38ced177b02978f2f016eba94681c2bfc" Jun 03 00:22:50.129273 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.129257 2559 scope.go:117] "RemoveContainer" containerID="6ea1c038e8417a4087cf0266aa03c5b65f5a66bcaf6bfb459e1fbf32d2782d46" Jun 03 00:22:50.136002 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.135983 2559 scope.go:117] "RemoveContainer" containerID="19f18f6582a747b341435f441f7a077fb66071d9156517061c3db17c1a77ffc3" Jun 03 00:22:50.142747 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.142729 2559 scope.go:117] "RemoveContainer" containerID="151df944a023c537e58b4cea1c5fe329b6f7a65153a70f1801c07c96075b6f87" Jun 03 00:22:50.143091 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:22:50.143064 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"151df944a023c537e58b4cea1c5fe329b6f7a65153a70f1801c07c96075b6f87\": container with ID starting with 151df944a023c537e58b4cea1c5fe329b6f7a65153a70f1801c07c96075b6f87 not found: ID does not exist" containerID="151df944a023c537e58b4cea1c5fe329b6f7a65153a70f1801c07c96075b6f87" Jun 03 00:22:50.143162 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.143100 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"151df944a023c537e58b4cea1c5fe329b6f7a65153a70f1801c07c96075b6f87"} err="failed to get container status \"151df944a023c537e58b4cea1c5fe329b6f7a65153a70f1801c07c96075b6f87\": rpc error: code = NotFound desc = could not find container \"151df944a023c537e58b4cea1c5fe329b6f7a65153a70f1801c07c96075b6f87\": container with ID starting with 151df944a023c537e58b4cea1c5fe329b6f7a65153a70f1801c07c96075b6f87 not found: ID does not exist" Jun 03 00:22:50.143162 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.143134 2559 scope.go:117] "RemoveContainer" containerID="f950f010ada78248a5f691967f493972ce8651c746d7f8b1ed9f0a4a3bd086bb" Jun 03 00:22:50.143362 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:22:50.143344 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f950f010ada78248a5f691967f493972ce8651c746d7f8b1ed9f0a4a3bd086bb\": container with ID starting with f950f010ada78248a5f691967f493972ce8651c746d7f8b1ed9f0a4a3bd086bb not found: ID does not exist" containerID="f950f010ada78248a5f691967f493972ce8651c746d7f8b1ed9f0a4a3bd086bb" Jun 03 00:22:50.143422 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.143364 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f950f010ada78248a5f691967f493972ce8651c746d7f8b1ed9f0a4a3bd086bb"} err="failed to get container status \"f950f010ada78248a5f691967f493972ce8651c746d7f8b1ed9f0a4a3bd086bb\": rpc error: code = NotFound desc = could not find container \"f950f010ada78248a5f691967f493972ce8651c746d7f8b1ed9f0a4a3bd086bb\": container with ID starting with f950f010ada78248a5f691967f493972ce8651c746d7f8b1ed9f0a4a3bd086bb not found: ID does not exist" Jun 03 00:22:50.143422 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.143390 2559 scope.go:117] "RemoveContainer" containerID="d2040aed5df3734abf822084655795b471fce6665a42df110ecb492cb2af88f2" Jun 03 00:22:50.143589 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.143572 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 00:22:50.143635 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:22:50.143602 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2040aed5df3734abf822084655795b471fce6665a42df110ecb492cb2af88f2\": container with ID starting with d2040aed5df3734abf822084655795b471fce6665a42df110ecb492cb2af88f2 not found: ID does not exist" containerID="d2040aed5df3734abf822084655795b471fce6665a42df110ecb492cb2af88f2" Jun 03 00:22:50.143635 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.143620 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2040aed5df3734abf822084655795b471fce6665a42df110ecb492cb2af88f2"} err="failed to get container status \"d2040aed5df3734abf822084655795b471fce6665a42df110ecb492cb2af88f2\": rpc error: code = NotFound desc = could not find container \"d2040aed5df3734abf822084655795b471fce6665a42df110ecb492cb2af88f2\": container with ID starting with d2040aed5df3734abf822084655795b471fce6665a42df110ecb492cb2af88f2 not found: ID does not exist" Jun 03 00:22:50.143635 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.143633 2559 scope.go:117] "RemoveContainer" containerID="1d513ab22956f42453edab326dc3d5acb4a5f27511bd489747f094506e4c293f" Jun 03 00:22:50.143907 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:22:50.143889 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d513ab22956f42453edab326dc3d5acb4a5f27511bd489747f094506e4c293f\": container with ID starting with 1d513ab22956f42453edab326dc3d5acb4a5f27511bd489747f094506e4c293f not found: ID does not exist" containerID="1d513ab22956f42453edab326dc3d5acb4a5f27511bd489747f094506e4c293f" Jun 03 00:22:50.143969 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.143906 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14817a19-4c7f-4ca4-af0c-d63f5bab6e66" containerName="prom-label-proxy" Jun 03 00:22:50.143969 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.143918 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="14817a19-4c7f-4ca4-af0c-d63f5bab6e66" containerName="prom-label-proxy" Jun 03 00:22:50.143969 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.143914 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d513ab22956f42453edab326dc3d5acb4a5f27511bd489747f094506e4c293f"} err="failed to get container status \"1d513ab22956f42453edab326dc3d5acb4a5f27511bd489747f094506e4c293f\": rpc error: code = NotFound desc = could not find container \"1d513ab22956f42453edab326dc3d5acb4a5f27511bd489747f094506e4c293f\": container with ID starting with 1d513ab22956f42453edab326dc3d5acb4a5f27511bd489747f094506e4c293f not found: ID does not exist" Jun 03 00:22:50.143969 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.143929 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14817a19-4c7f-4ca4-af0c-d63f5bab6e66" containerName="config-reloader" Jun 03 00:22:50.143969 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.143938 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="14817a19-4c7f-4ca4-af0c-d63f5bab6e66" containerName="config-reloader" Jun 03 00:22:50.143969 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.143949 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14817a19-4c7f-4ca4-af0c-d63f5bab6e66" containerName="kube-rbac-proxy-web" Jun 03 00:22:50.143969 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.143955 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="14817a19-4c7f-4ca4-af0c-d63f5bab6e66" containerName="kube-rbac-proxy-web" Jun 03 00:22:50.143969 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.143965 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14817a19-4c7f-4ca4-af0c-d63f5bab6e66" containerName="init-config-reloader" Jun 03 00:22:50.143969 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.143971 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="14817a19-4c7f-4ca4-af0c-d63f5bab6e66" containerName="init-config-reloader" Jun 03 00:22:50.144373 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.143977 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14817a19-4c7f-4ca4-af0c-d63f5bab6e66" containerName="alertmanager" Jun 03 00:22:50.144373 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.143982 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="14817a19-4c7f-4ca4-af0c-d63f5bab6e66" containerName="alertmanager" Jun 03 00:22:50.144373 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.143992 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14817a19-4c7f-4ca4-af0c-d63f5bab6e66" containerName="kube-rbac-proxy" Jun 03 00:22:50.144373 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.143998 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="14817a19-4c7f-4ca4-af0c-d63f5bab6e66" containerName="kube-rbac-proxy" Jun 03 00:22:50.144373 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.144004 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14817a19-4c7f-4ca4-af0c-d63f5bab6e66" containerName="kube-rbac-proxy-metric" Jun 03 00:22:50.144373 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.143938 2559 scope.go:117] "RemoveContainer" containerID="7b76d06dc7b8c2d484967e1e039494f38ced177b02978f2f016eba94681c2bfc" Jun 03 00:22:50.144373 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.144011 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="14817a19-4c7f-4ca4-af0c-d63f5bab6e66" containerName="kube-rbac-proxy-metric" Jun 03 00:22:50.144373 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.144164 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="14817a19-4c7f-4ca4-af0c-d63f5bab6e66" containerName="prom-label-proxy" Jun 03 00:22:50.144373 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.144178 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="14817a19-4c7f-4ca4-af0c-d63f5bab6e66" containerName="kube-rbac-proxy-web" Jun 03 00:22:50.144373 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.144189 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="14817a19-4c7f-4ca4-af0c-d63f5bab6e66" containerName="config-reloader" Jun 03 00:22:50.144373 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.144201 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="14817a19-4c7f-4ca4-af0c-d63f5bab6e66" containerName="kube-rbac-proxy-metric" Jun 03 00:22:50.144373 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.144215 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="14817a19-4c7f-4ca4-af0c-d63f5bab6e66" containerName="kube-rbac-proxy" Jun 03 00:22:50.144373 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.144226 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="14817a19-4c7f-4ca4-af0c-d63f5bab6e66" containerName="alertmanager" Jun 03 00:22:50.144373 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:22:50.144278 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b76d06dc7b8c2d484967e1e039494f38ced177b02978f2f016eba94681c2bfc\": container with ID starting with 7b76d06dc7b8c2d484967e1e039494f38ced177b02978f2f016eba94681c2bfc not found: ID does not exist" containerID="7b76d06dc7b8c2d484967e1e039494f38ced177b02978f2f016eba94681c2bfc" Jun 03 00:22:50.144373 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.144300 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b76d06dc7b8c2d484967e1e039494f38ced177b02978f2f016eba94681c2bfc"} err="failed to get container status \"7b76d06dc7b8c2d484967e1e039494f38ced177b02978f2f016eba94681c2bfc\": rpc error: code = NotFound desc = could not find container \"7b76d06dc7b8c2d484967e1e039494f38ced177b02978f2f016eba94681c2bfc\": container with ID starting with 7b76d06dc7b8c2d484967e1e039494f38ced177b02978f2f016eba94681c2bfc not found: ID does not exist" Jun 03 00:22:50.144373 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.144317 2559 scope.go:117] "RemoveContainer" containerID="6ea1c038e8417a4087cf0266aa03c5b65f5a66bcaf6bfb459e1fbf32d2782d46" Jun 03 00:22:50.145143 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:22:50.144525 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ea1c038e8417a4087cf0266aa03c5b65f5a66bcaf6bfb459e1fbf32d2782d46\": container with ID starting with 6ea1c038e8417a4087cf0266aa03c5b65f5a66bcaf6bfb459e1fbf32d2782d46 not found: ID does not exist" containerID="6ea1c038e8417a4087cf0266aa03c5b65f5a66bcaf6bfb459e1fbf32d2782d46" Jun 03 00:22:50.145143 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.144540 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ea1c038e8417a4087cf0266aa03c5b65f5a66bcaf6bfb459e1fbf32d2782d46"} err="failed to get container status \"6ea1c038e8417a4087cf0266aa03c5b65f5a66bcaf6bfb459e1fbf32d2782d46\": rpc error: code = NotFound desc = could not find container \"6ea1c038e8417a4087cf0266aa03c5b65f5a66bcaf6bfb459e1fbf32d2782d46\": container with ID starting with 6ea1c038e8417a4087cf0266aa03c5b65f5a66bcaf6bfb459e1fbf32d2782d46 not found: ID does not exist" Jun 03 00:22:50.145143 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.144552 2559 scope.go:117] "RemoveContainer" containerID="19f18f6582a747b341435f441f7a077fb66071d9156517061c3db17c1a77ffc3" Jun 03 00:22:50.145143 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:22:50.144783 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19f18f6582a747b341435f441f7a077fb66071d9156517061c3db17c1a77ffc3\": container with ID starting with 19f18f6582a747b341435f441f7a077fb66071d9156517061c3db17c1a77ffc3 not found: ID does not exist" containerID="19f18f6582a747b341435f441f7a077fb66071d9156517061c3db17c1a77ffc3" Jun 03 00:22:50.145143 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.144803 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19f18f6582a747b341435f441f7a077fb66071d9156517061c3db17c1a77ffc3"} err="failed to get container status \"19f18f6582a747b341435f441f7a077fb66071d9156517061c3db17c1a77ffc3\": rpc error: code = NotFound desc = could not find container \"19f18f6582a747b341435f441f7a077fb66071d9156517061c3db17c1a77ffc3\": container with ID starting with 19f18f6582a747b341435f441f7a077fb66071d9156517061c3db17c1a77ffc3 not found: ID does not exist" Jun 03 00:22:50.145143 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.144817 2559 scope.go:117] "RemoveContainer" containerID="151df944a023c537e58b4cea1c5fe329b6f7a65153a70f1801c07c96075b6f87" Jun 03 00:22:50.145143 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.145014 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"151df944a023c537e58b4cea1c5fe329b6f7a65153a70f1801c07c96075b6f87"} err="failed to get container status \"151df944a023c537e58b4cea1c5fe329b6f7a65153a70f1801c07c96075b6f87\": rpc error: code = NotFound desc = could not find container \"151df944a023c537e58b4cea1c5fe329b6f7a65153a70f1801c07c96075b6f87\": container with ID starting with 151df944a023c537e58b4cea1c5fe329b6f7a65153a70f1801c07c96075b6f87 not found: ID does not exist" Jun 03 00:22:50.145143 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.145033 2559 scope.go:117] "RemoveContainer" containerID="f950f010ada78248a5f691967f493972ce8651c746d7f8b1ed9f0a4a3bd086bb" Jun 03 00:22:50.145525 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.145222 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f950f010ada78248a5f691967f493972ce8651c746d7f8b1ed9f0a4a3bd086bb"} err="failed to get container status \"f950f010ada78248a5f691967f493972ce8651c746d7f8b1ed9f0a4a3bd086bb\": rpc error: code = NotFound desc = could not find container \"f950f010ada78248a5f691967f493972ce8651c746d7f8b1ed9f0a4a3bd086bb\": container with ID starting with f950f010ada78248a5f691967f493972ce8651c746d7f8b1ed9f0a4a3bd086bb not found: ID does not exist" Jun 03 00:22:50.145525 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.145237 2559 scope.go:117] "RemoveContainer" containerID="d2040aed5df3734abf822084655795b471fce6665a42df110ecb492cb2af88f2" Jun 03 00:22:50.145525 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.145385 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2040aed5df3734abf822084655795b471fce6665a42df110ecb492cb2af88f2"} err="failed to get container status \"d2040aed5df3734abf822084655795b471fce6665a42df110ecb492cb2af88f2\": rpc error: code = NotFound desc = could not find container \"d2040aed5df3734abf822084655795b471fce6665a42df110ecb492cb2af88f2\": container with ID starting with d2040aed5df3734abf822084655795b471fce6665a42df110ecb492cb2af88f2 not found: ID does not exist" Jun 03 00:22:50.145525 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.145398 2559 scope.go:117] "RemoveContainer" containerID="1d513ab22956f42453edab326dc3d5acb4a5f27511bd489747f094506e4c293f" Jun 03 00:22:50.145744 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.145591 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d513ab22956f42453edab326dc3d5acb4a5f27511bd489747f094506e4c293f"} err="failed to get container status \"1d513ab22956f42453edab326dc3d5acb4a5f27511bd489747f094506e4c293f\": rpc error: code = NotFound desc = could not find container \"1d513ab22956f42453edab326dc3d5acb4a5f27511bd489747f094506e4c293f\": container with ID starting with 1d513ab22956f42453edab326dc3d5acb4a5f27511bd489747f094506e4c293f not found: ID does not exist" Jun 03 00:22:50.145744 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.145604 2559 scope.go:117] "RemoveContainer" containerID="7b76d06dc7b8c2d484967e1e039494f38ced177b02978f2f016eba94681c2bfc" Jun 03 00:22:50.145852 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.145800 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b76d06dc7b8c2d484967e1e039494f38ced177b02978f2f016eba94681c2bfc"} err="failed to get container status \"7b76d06dc7b8c2d484967e1e039494f38ced177b02978f2f016eba94681c2bfc\": rpc error: code = NotFound desc = could not find container \"7b76d06dc7b8c2d484967e1e039494f38ced177b02978f2f016eba94681c2bfc\": container with ID starting with 7b76d06dc7b8c2d484967e1e039494f38ced177b02978f2f016eba94681c2bfc not found: ID does not exist" Jun 03 00:22:50.145852 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.145821 2559 scope.go:117] "RemoveContainer" containerID="6ea1c038e8417a4087cf0266aa03c5b65f5a66bcaf6bfb459e1fbf32d2782d46" Jun 03 00:22:50.146036 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.146018 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ea1c038e8417a4087cf0266aa03c5b65f5a66bcaf6bfb459e1fbf32d2782d46"} err="failed to get container status \"6ea1c038e8417a4087cf0266aa03c5b65f5a66bcaf6bfb459e1fbf32d2782d46\": rpc error: code = NotFound desc = could not find container \"6ea1c038e8417a4087cf0266aa03c5b65f5a66bcaf6bfb459e1fbf32d2782d46\": container with ID starting with 6ea1c038e8417a4087cf0266aa03c5b65f5a66bcaf6bfb459e1fbf32d2782d46 not found: ID does not exist" Jun 03 00:22:50.146089 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.146034 2559 scope.go:117] "RemoveContainer" containerID="19f18f6582a747b341435f441f7a077fb66071d9156517061c3db17c1a77ffc3" Jun 03 00:22:50.146235 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.146215 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19f18f6582a747b341435f441f7a077fb66071d9156517061c3db17c1a77ffc3"} err="failed to get container status \"19f18f6582a747b341435f441f7a077fb66071d9156517061c3db17c1a77ffc3\": rpc error: code = NotFound desc = could not find container \"19f18f6582a747b341435f441f7a077fb66071d9156517061c3db17c1a77ffc3\": container with ID starting with 19f18f6582a747b341435f441f7a077fb66071d9156517061c3db17c1a77ffc3 not found: ID does not exist" Jun 03 00:22:50.148426 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.148409 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:22:50.150473 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.150441 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 03 00:22:50.150473 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.150444 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 03 00:22:50.150672 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.150450 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-46qkf\"" Jun 03 00:22:50.150672 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.150487 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 03 00:22:50.150672 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.150485 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 03 00:22:50.150802 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.150773 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 03 00:22:50.150835 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.150796 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 03 00:22:50.150835 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.150823 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 03 00:22:50.150896 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.150775 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 03 00:22:50.156288 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.156001 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 03 00:22:50.157579 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.157557 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 00:22:50.186553 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.186518 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e219078d-510d-4c17-9a7a-6601a0c28eac-config-volume\") pod \"alertmanager-main-0\" (UID: \"e219078d-510d-4c17-9a7a-6601a0c28eac\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:22:50.186553 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.186555 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e219078d-510d-4c17-9a7a-6601a0c28eac-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e219078d-510d-4c17-9a7a-6601a0c28eac\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:22:50.186798 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.186579 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjmm8\" (UniqueName: \"kubernetes.io/projected/e219078d-510d-4c17-9a7a-6601a0c28eac-kube-api-access-sjmm8\") pod \"alertmanager-main-0\" (UID: \"e219078d-510d-4c17-9a7a-6601a0c28eac\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:22:50.186798 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.186604 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e219078d-510d-4c17-9a7a-6601a0c28eac-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e219078d-510d-4c17-9a7a-6601a0c28eac\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:22:50.186798 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.186656 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e219078d-510d-4c17-9a7a-6601a0c28eac-config-out\") pod \"alertmanager-main-0\" (UID: \"e219078d-510d-4c17-9a7a-6601a0c28eac\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:22:50.186798 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.186704 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e219078d-510d-4c17-9a7a-6601a0c28eac-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e219078d-510d-4c17-9a7a-6601a0c28eac\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:22:50.186798 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.186747 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e219078d-510d-4c17-9a7a-6601a0c28eac-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e219078d-510d-4c17-9a7a-6601a0c28eac\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:22:50.186798 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.186789 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e219078d-510d-4c17-9a7a-6601a0c28eac-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e219078d-510d-4c17-9a7a-6601a0c28eac\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:22:50.187018 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.186807 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e219078d-510d-4c17-9a7a-6601a0c28eac-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e219078d-510d-4c17-9a7a-6601a0c28eac\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:22:50.187018 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.186855 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e219078d-510d-4c17-9a7a-6601a0c28eac-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e219078d-510d-4c17-9a7a-6601a0c28eac\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:22:50.187018 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.186877 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e219078d-510d-4c17-9a7a-6601a0c28eac-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e219078d-510d-4c17-9a7a-6601a0c28eac\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:22:50.187018 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.186898 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e219078d-510d-4c17-9a7a-6601a0c28eac-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e219078d-510d-4c17-9a7a-6601a0c28eac\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:22:50.187018 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.186923 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e219078d-510d-4c17-9a7a-6601a0c28eac-web-config\") pod \"alertmanager-main-0\" (UID: \"e219078d-510d-4c17-9a7a-6601a0c28eac\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:22:50.288107 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.288018 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e219078d-510d-4c17-9a7a-6601a0c28eac-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e219078d-510d-4c17-9a7a-6601a0c28eac\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:22:50.288107 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.288062 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e219078d-510d-4c17-9a7a-6601a0c28eac-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e219078d-510d-4c17-9a7a-6601a0c28eac\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:22:50.288305 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.288181 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e219078d-510d-4c17-9a7a-6601a0c28eac-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e219078d-510d-4c17-9a7a-6601a0c28eac\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:22:50.288305 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.288221 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e219078d-510d-4c17-9a7a-6601a0c28eac-web-config\") pod \"alertmanager-main-0\" (UID: \"e219078d-510d-4c17-9a7a-6601a0c28eac\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:22:50.288305 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.288263 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e219078d-510d-4c17-9a7a-6601a0c28eac-config-volume\") pod \"alertmanager-main-0\" (UID: \"e219078d-510d-4c17-9a7a-6601a0c28eac\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:22:50.288305 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.288284 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e219078d-510d-4c17-9a7a-6601a0c28eac-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e219078d-510d-4c17-9a7a-6601a0c28eac\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:22:50.288305 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.288301 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sjmm8\" (UniqueName: \"kubernetes.io/projected/e219078d-510d-4c17-9a7a-6601a0c28eac-kube-api-access-sjmm8\") pod \"alertmanager-main-0\" (UID: \"e219078d-510d-4c17-9a7a-6601a0c28eac\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:22:50.288537 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.288335 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e219078d-510d-4c17-9a7a-6601a0c28eac-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e219078d-510d-4c17-9a7a-6601a0c28eac\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:22:50.288791 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.288770 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e219078d-510d-4c17-9a7a-6601a0c28eac-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e219078d-510d-4c17-9a7a-6601a0c28eac\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:22:50.288868 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.288834 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e219078d-510d-4c17-9a7a-6601a0c28eac-config-out\") pod \"alertmanager-main-0\" (UID: \"e219078d-510d-4c17-9a7a-6601a0c28eac\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:22:50.288920 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.288896 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e219078d-510d-4c17-9a7a-6601a0c28eac-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e219078d-510d-4c17-9a7a-6601a0c28eac\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:22:50.288972 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.288929 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e219078d-510d-4c17-9a7a-6601a0c28eac-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e219078d-510d-4c17-9a7a-6601a0c28eac\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:22:50.288972 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.288842 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e219078d-510d-4c17-9a7a-6601a0c28eac-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e219078d-510d-4c17-9a7a-6601a0c28eac\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:22:50.289077 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.288981 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e219078d-510d-4c17-9a7a-6601a0c28eac-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e219078d-510d-4c17-9a7a-6601a0c28eac\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:22:50.289077 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.289014 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e219078d-510d-4c17-9a7a-6601a0c28eac-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e219078d-510d-4c17-9a7a-6601a0c28eac\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:22:50.289419 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.289350 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e219078d-510d-4c17-9a7a-6601a0c28eac-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e219078d-510d-4c17-9a7a-6601a0c28eac\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:22:50.291412 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.291383 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e219078d-510d-4c17-9a7a-6601a0c28eac-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e219078d-510d-4c17-9a7a-6601a0c28eac\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:22:50.291412 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.291443 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e219078d-510d-4c17-9a7a-6601a0c28eac-config-out\") pod \"alertmanager-main-0\" (UID: \"e219078d-510d-4c17-9a7a-6601a0c28eac\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:22:50.291675 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.291545 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e219078d-510d-4c17-9a7a-6601a0c28eac-config-volume\") pod \"alertmanager-main-0\" (UID: \"e219078d-510d-4c17-9a7a-6601a0c28eac\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:22:50.291675 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.291599 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e219078d-510d-4c17-9a7a-6601a0c28eac-web-config\") pod \"alertmanager-main-0\" (UID: \"e219078d-510d-4c17-9a7a-6601a0c28eac\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:22:50.291675 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.291651 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e219078d-510d-4c17-9a7a-6601a0c28eac-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e219078d-510d-4c17-9a7a-6601a0c28eac\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:22:50.291859 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.291732 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e219078d-510d-4c17-9a7a-6601a0c28eac-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e219078d-510d-4c17-9a7a-6601a0c28eac\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:22:50.291980 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.291961 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e219078d-510d-4c17-9a7a-6601a0c28eac-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e219078d-510d-4c17-9a7a-6601a0c28eac\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:22:50.292105 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.292086 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e219078d-510d-4c17-9a7a-6601a0c28eac-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e219078d-510d-4c17-9a7a-6601a0c28eac\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:22:50.293304 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.293282 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e219078d-510d-4c17-9a7a-6601a0c28eac-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e219078d-510d-4c17-9a7a-6601a0c28eac\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:22:50.295645 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.295625 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjmm8\" (UniqueName: \"kubernetes.io/projected/e219078d-510d-4c17-9a7a-6601a0c28eac-kube-api-access-sjmm8\") pod \"alertmanager-main-0\" (UID: \"e219078d-510d-4c17-9a7a-6601a0c28eac\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:22:50.461791 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.461737 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 00:22:50.589959 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:50.589893 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 00:22:50.592698 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:22:50.592662 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode219078d_510d_4c17_9a7a_6601a0c28eac.slice/crio-cea633fdc3db122aaad8bf33680c56a0c12897e06a2a741c3b1e157b99d621b4 WatchSource:0}: Error finding container cea633fdc3db122aaad8bf33680c56a0c12897e06a2a741c3b1e157b99d621b4: Status 404 returned error can't find the container with id cea633fdc3db122aaad8bf33680c56a0c12897e06a2a741c3b1e157b99d621b4 Jun 03 00:22:51.096972 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:51.096938 2559 generic.go:358] "Generic (PLEG): container finished" podID="e219078d-510d-4c17-9a7a-6601a0c28eac" containerID="623ea40a7b2abe2c7588e29e67e65244722f3fdae625e39a9e526b8598f59317" exitCode=0 Jun 03 00:22:51.097361 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:51.097030 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e219078d-510d-4c17-9a7a-6601a0c28eac","Type":"ContainerDied","Data":"623ea40a7b2abe2c7588e29e67e65244722f3fdae625e39a9e526b8598f59317"} Jun 03 00:22:51.097361 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:51.097068 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e219078d-510d-4c17-9a7a-6601a0c28eac","Type":"ContainerStarted","Data":"cea633fdc3db122aaad8bf33680c56a0c12897e06a2a741c3b1e157b99d621b4"} Jun 03 00:22:51.368556 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:51.368522 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14817a19-4c7f-4ca4-af0c-d63f5bab6e66" path="/var/lib/kubelet/pods/14817a19-4c7f-4ca4-af0c-d63f5bab6e66/volumes" Jun 03 00:22:52.104544 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:52.104509 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e219078d-510d-4c17-9a7a-6601a0c28eac","Type":"ContainerStarted","Data":"98a4452530744954ed6a0457d9efb4815e332d6f88a8037efc52738b6eb99b9b"} Jun 03 00:22:52.104544 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:52.104545 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e219078d-510d-4c17-9a7a-6601a0c28eac","Type":"ContainerStarted","Data":"b17c30f8a1808d68461fab17c3cccc0867c4a903e08746c19d188f85d49f11fb"} Jun 03 00:22:52.104979 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:52.104553 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e219078d-510d-4c17-9a7a-6601a0c28eac","Type":"ContainerStarted","Data":"957eea23b13f9f165976112d72705fa8a4c2a1eeacf28b5a65d0c44aa003cb7b"} Jun 03 00:22:52.104979 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:52.104563 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e219078d-510d-4c17-9a7a-6601a0c28eac","Type":"ContainerStarted","Data":"1bad5d0caa9a496c455a8c2ec17c8fbc6e88978cc08b79d3a30bafeead807918"} Jun 03 00:22:52.104979 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:52.104572 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e219078d-510d-4c17-9a7a-6601a0c28eac","Type":"ContainerStarted","Data":"feeec88b54f91922b4291552da391bd8681b100751cb5d7935d3ae331484baca"} Jun 03 00:22:52.104979 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:52.104580 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e219078d-510d-4c17-9a7a-6601a0c28eac","Type":"ContainerStarted","Data":"3207a8938e07bc1ff53310a9364b1d0dd71094bc31295c5b4e7cd6353cc4ef01"} Jun 03 00:22:52.128584 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:52.128536 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.128520453 podStartE2EDuration="2.128520453s" podCreationTimestamp="2026-06-03 00:22:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 00:22:52.126592923 +0000 UTC m=+193.346515498" watchObservedRunningTime="2026-06-03 00:22:52.128520453 +0000 UTC m=+193.348443028" Jun 03 00:22:52.298171 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:52.298129 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 00:22:52.298672 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:52.298600 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f834c99c-c30c-41e5-bd46-0c5862bc0331" containerName="thanos-sidecar" containerID="cri-o://2a4c1fb3b4b07a661666a8246a12acebad2a43df3e080d5be94120058fabf623" gracePeriod=600 Jun 03 00:22:52.298672 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:52.298635 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f834c99c-c30c-41e5-bd46-0c5862bc0331" containerName="kube-rbac-proxy-thanos" containerID="cri-o://4be96feebe600b5317110b0e557b335d8593395276ee726b9b1f484ed1809ab3" gracePeriod=600 Jun 03 00:22:52.298857 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:52.298596 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f834c99c-c30c-41e5-bd46-0c5862bc0331" containerName="kube-rbac-proxy" containerID="cri-o://df64e18607a8fd491cfff2c95adc848d6d9bc1d563295bde7f5c1f60e57582e0" gracePeriod=600 Jun 03 00:22:52.298857 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:52.298581 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f834c99c-c30c-41e5-bd46-0c5862bc0331" containerName="prometheus" containerID="cri-o://121530060eecfc95e67659f1f9c94c6b5a64598ebbf916e3aa9f0445b7b04535" gracePeriod=600 Jun 03 00:22:52.298857 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:52.298635 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f834c99c-c30c-41e5-bd46-0c5862bc0331" containerName="config-reloader" containerID="cri-o://0d4bbdf22bb29da54f3c0d785f60bca46076ed55511267bfb385545922cf348b" gracePeriod=600 Jun 03 00:22:52.298857 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:52.298616 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f834c99c-c30c-41e5-bd46-0c5862bc0331" containerName="kube-rbac-proxy-web" containerID="cri-o://0bee0c6f3ae55002e058aa17f9699d55afc78bf9ae910ad122ce71e66026811e" gracePeriod=600 Jun 03 00:22:53.112125 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.112084 2559 generic.go:358] "Generic (PLEG): container finished" podID="f834c99c-c30c-41e5-bd46-0c5862bc0331" containerID="4be96feebe600b5317110b0e557b335d8593395276ee726b9b1f484ed1809ab3" exitCode=0 Jun 03 00:22:53.112125 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.112112 2559 generic.go:358] "Generic (PLEG): container finished" podID="f834c99c-c30c-41e5-bd46-0c5862bc0331" containerID="df64e18607a8fd491cfff2c95adc848d6d9bc1d563295bde7f5c1f60e57582e0" exitCode=0 Jun 03 00:22:53.112125 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.112124 2559 generic.go:358] "Generic (PLEG): container finished" podID="f834c99c-c30c-41e5-bd46-0c5862bc0331" containerID="2a4c1fb3b4b07a661666a8246a12acebad2a43df3e080d5be94120058fabf623" exitCode=0 Jun 03 00:22:53.112125 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.112132 2559 generic.go:358] "Generic (PLEG): container finished" podID="f834c99c-c30c-41e5-bd46-0c5862bc0331" containerID="0d4bbdf22bb29da54f3c0d785f60bca46076ed55511267bfb385545922cf348b" exitCode=0 Jun 03 00:22:53.112756 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.112140 2559 generic.go:358] "Generic (PLEG): container finished" podID="f834c99c-c30c-41e5-bd46-0c5862bc0331" containerID="121530060eecfc95e67659f1f9c94c6b5a64598ebbf916e3aa9f0445b7b04535" exitCode=0 Jun 03 00:22:53.112756 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.112152 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f834c99c-c30c-41e5-bd46-0c5862bc0331","Type":"ContainerDied","Data":"4be96feebe600b5317110b0e557b335d8593395276ee726b9b1f484ed1809ab3"} Jun 03 00:22:53.112756 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.112183 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f834c99c-c30c-41e5-bd46-0c5862bc0331","Type":"ContainerDied","Data":"df64e18607a8fd491cfff2c95adc848d6d9bc1d563295bde7f5c1f60e57582e0"} Jun 03 00:22:53.112756 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.112196 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f834c99c-c30c-41e5-bd46-0c5862bc0331","Type":"ContainerDied","Data":"2a4c1fb3b4b07a661666a8246a12acebad2a43df3e080d5be94120058fabf623"} Jun 03 00:22:53.112756 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.112206 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f834c99c-c30c-41e5-bd46-0c5862bc0331","Type":"ContainerDied","Data":"0d4bbdf22bb29da54f3c0d785f60bca46076ed55511267bfb385545922cf348b"} Jun 03 00:22:53.112756 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.112215 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f834c99c-c30c-41e5-bd46-0c5862bc0331","Type":"ContainerDied","Data":"121530060eecfc95e67659f1f9c94c6b5a64598ebbf916e3aa9f0445b7b04535"} Jun 03 00:22:53.551738 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.551713 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:53.619545 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.619457 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f834c99c-c30c-41e5-bd46-0c5862bc0331-prometheus-k8s-rulefiles-0\") pod \"f834c99c-c30c-41e5-bd46-0c5862bc0331\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " Jun 03 00:22:53.619545 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.619507 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f834c99c-c30c-41e5-bd46-0c5862bc0331-prometheus-k8s-db\") pod \"f834c99c-c30c-41e5-bd46-0c5862bc0331\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " Jun 03 00:22:53.619768 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.619548 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rfj5t\" (UniqueName: \"kubernetes.io/projected/f834c99c-c30c-41e5-bd46-0c5862bc0331-kube-api-access-rfj5t\") pod \"f834c99c-c30c-41e5-bd46-0c5862bc0331\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " Jun 03 00:22:53.619768 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.619581 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f834c99c-c30c-41e5-bd46-0c5862bc0331-secret-prometheus-k8s-tls\") pod \"f834c99c-c30c-41e5-bd46-0c5862bc0331\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " Jun 03 00:22:53.619768 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.619610 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f834c99c-c30c-41e5-bd46-0c5862bc0331-prometheus-trusted-ca-bundle\") pod \"f834c99c-c30c-41e5-bd46-0c5862bc0331\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " Jun 03 00:22:53.619768 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.619655 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f834c99c-c30c-41e5-bd46-0c5862bc0331-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"f834c99c-c30c-41e5-bd46-0c5862bc0331\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " Jun 03 00:22:53.619768 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.619719 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f834c99c-c30c-41e5-bd46-0c5862bc0331-configmap-kubelet-serving-ca-bundle\") pod \"f834c99c-c30c-41e5-bd46-0c5862bc0331\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " Jun 03 00:22:53.619768 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.619745 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f834c99c-c30c-41e5-bd46-0c5862bc0331-thanos-prometheus-http-client-file\") pod \"f834c99c-c30c-41e5-bd46-0c5862bc0331\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " Jun 03 00:22:53.620061 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.619771 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f834c99c-c30c-41e5-bd46-0c5862bc0331-configmap-metrics-client-ca\") pod \"f834c99c-c30c-41e5-bd46-0c5862bc0331\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " Jun 03 00:22:53.620061 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.619802 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f834c99c-c30c-41e5-bd46-0c5862bc0331-secret-metrics-client-certs\") pod \"f834c99c-c30c-41e5-bd46-0c5862bc0331\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " Jun 03 00:22:53.620061 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.619829 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f834c99c-c30c-41e5-bd46-0c5862bc0331-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"f834c99c-c30c-41e5-bd46-0c5862bc0331\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " Jun 03 00:22:53.620061 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.619872 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f834c99c-c30c-41e5-bd46-0c5862bc0331-secret-grpc-tls\") pod \"f834c99c-c30c-41e5-bd46-0c5862bc0331\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " Jun 03 00:22:53.620061 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.619902 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f834c99c-c30c-41e5-bd46-0c5862bc0331-config\") pod \"f834c99c-c30c-41e5-bd46-0c5862bc0331\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " Jun 03 00:22:53.620061 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.619962 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f834c99c-c30c-41e5-bd46-0c5862bc0331-secret-kube-rbac-proxy\") pod \"f834c99c-c30c-41e5-bd46-0c5862bc0331\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " Jun 03 00:22:53.620061 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.619996 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f834c99c-c30c-41e5-bd46-0c5862bc0331-configmap-serving-certs-ca-bundle\") pod \"f834c99c-c30c-41e5-bd46-0c5862bc0331\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " Jun 03 00:22:53.620061 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.620026 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f834c99c-c30c-41e5-bd46-0c5862bc0331-tls-assets\") pod \"f834c99c-c30c-41e5-bd46-0c5862bc0331\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " Jun 03 00:22:53.620061 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.620053 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f834c99c-c30c-41e5-bd46-0c5862bc0331-web-config\") pod \"f834c99c-c30c-41e5-bd46-0c5862bc0331\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " Jun 03 00:22:53.620455 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.620085 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f834c99c-c30c-41e5-bd46-0c5862bc0331-config-out\") pod \"f834c99c-c30c-41e5-bd46-0c5862bc0331\" (UID: \"f834c99c-c30c-41e5-bd46-0c5862bc0331\") " Jun 03 00:22:53.620455 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.620426 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f834c99c-c30c-41e5-bd46-0c5862bc0331-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "f834c99c-c30c-41e5-bd46-0c5862bc0331" (UID: "f834c99c-c30c-41e5-bd46-0c5862bc0331"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 00:22:53.620890 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.620859 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f834c99c-c30c-41e5-bd46-0c5862bc0331-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "f834c99c-c30c-41e5-bd46-0c5862bc0331" (UID: "f834c99c-c30c-41e5-bd46-0c5862bc0331"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 00:22:53.621048 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.620869 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f834c99c-c30c-41e5-bd46-0c5862bc0331-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "f834c99c-c30c-41e5-bd46-0c5862bc0331" (UID: "f834c99c-c30c-41e5-bd46-0c5862bc0331"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 00:22:53.621261 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.621237 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f834c99c-c30c-41e5-bd46-0c5862bc0331-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "f834c99c-c30c-41e5-bd46-0c5862bc0331" (UID: "f834c99c-c30c-41e5-bd46-0c5862bc0331"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 00:22:53.621343 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.621300 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f834c99c-c30c-41e5-bd46-0c5862bc0331-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "f834c99c-c30c-41e5-bd46-0c5862bc0331" (UID: "f834c99c-c30c-41e5-bd46-0c5862bc0331"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 00:22:53.621764 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.621734 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f834c99c-c30c-41e5-bd46-0c5862bc0331-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "f834c99c-c30c-41e5-bd46-0c5862bc0331" (UID: "f834c99c-c30c-41e5-bd46-0c5862bc0331"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 00:22:53.623079 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.623055 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f834c99c-c30c-41e5-bd46-0c5862bc0331-config-out" (OuterVolumeSpecName: "config-out") pod "f834c99c-c30c-41e5-bd46-0c5862bc0331" (UID: "f834c99c-c30c-41e5-bd46-0c5862bc0331"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 00:22:53.623161 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.623115 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f834c99c-c30c-41e5-bd46-0c5862bc0331-config" (OuterVolumeSpecName: "config") pod "f834c99c-c30c-41e5-bd46-0c5862bc0331" (UID: "f834c99c-c30c-41e5-bd46-0c5862bc0331"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 00:22:53.623562 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.623449 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f834c99c-c30c-41e5-bd46-0c5862bc0331-kube-api-access-rfj5t" (OuterVolumeSpecName: "kube-api-access-rfj5t") pod "f834c99c-c30c-41e5-bd46-0c5862bc0331" (UID: "f834c99c-c30c-41e5-bd46-0c5862bc0331"). InnerVolumeSpecName "kube-api-access-rfj5t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 00:22:53.624190 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.623624 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f834c99c-c30c-41e5-bd46-0c5862bc0331-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "f834c99c-c30c-41e5-bd46-0c5862bc0331" (UID: "f834c99c-c30c-41e5-bd46-0c5862bc0331"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 00:22:53.624190 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.624055 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f834c99c-c30c-41e5-bd46-0c5862bc0331-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "f834c99c-c30c-41e5-bd46-0c5862bc0331" (UID: "f834c99c-c30c-41e5-bd46-0c5862bc0331"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 00:22:53.624721 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.624666 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f834c99c-c30c-41e5-bd46-0c5862bc0331-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "f834c99c-c30c-41e5-bd46-0c5862bc0331" (UID: "f834c99c-c30c-41e5-bd46-0c5862bc0331"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 00:22:53.625368 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.625334 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f834c99c-c30c-41e5-bd46-0c5862bc0331-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "f834c99c-c30c-41e5-bd46-0c5862bc0331" (UID: "f834c99c-c30c-41e5-bd46-0c5862bc0331"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 00:22:53.625584 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.625526 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f834c99c-c30c-41e5-bd46-0c5862bc0331-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "f834c99c-c30c-41e5-bd46-0c5862bc0331" (UID: "f834c99c-c30c-41e5-bd46-0c5862bc0331"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 00:22:53.625584 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.625543 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f834c99c-c30c-41e5-bd46-0c5862bc0331-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "f834c99c-c30c-41e5-bd46-0c5862bc0331" (UID: "f834c99c-c30c-41e5-bd46-0c5862bc0331"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 00:22:53.625584 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.625565 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f834c99c-c30c-41e5-bd46-0c5862bc0331-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "f834c99c-c30c-41e5-bd46-0c5862bc0331" (UID: "f834c99c-c30c-41e5-bd46-0c5862bc0331"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 00:22:53.626346 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.626313 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f834c99c-c30c-41e5-bd46-0c5862bc0331-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "f834c99c-c30c-41e5-bd46-0c5862bc0331" (UID: "f834c99c-c30c-41e5-bd46-0c5862bc0331"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 00:22:53.635619 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.635597 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f834c99c-c30c-41e5-bd46-0c5862bc0331-web-config" (OuterVolumeSpecName: "web-config") pod "f834c99c-c30c-41e5-bd46-0c5862bc0331" (UID: "f834c99c-c30c-41e5-bd46-0c5862bc0331"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 00:22:53.721357 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.721325 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfj5t\" (UniqueName: \"kubernetes.io/projected/f834c99c-c30c-41e5-bd46-0c5862bc0331-kube-api-access-rfj5t\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Jun 03 00:22:53.721357 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.721353 2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f834c99c-c30c-41e5-bd46-0c5862bc0331-secret-prometheus-k8s-tls\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Jun 03 00:22:53.721357 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.721364 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f834c99c-c30c-41e5-bd46-0c5862bc0331-prometheus-trusted-ca-bundle\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Jun 03 00:22:53.721573 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.721374 2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f834c99c-c30c-41e5-bd46-0c5862bc0331-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Jun 03 00:22:53.721573 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.721384 2559 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f834c99c-c30c-41e5-bd46-0c5862bc0331-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Jun 03 00:22:53.721573 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.721395 2559 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f834c99c-c30c-41e5-bd46-0c5862bc0331-thanos-prometheus-http-client-file\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Jun 03 00:22:53.721573 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.721405 2559 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f834c99c-c30c-41e5-bd46-0c5862bc0331-configmap-metrics-client-ca\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Jun 03 00:22:53.721573 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.721413 2559 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f834c99c-c30c-41e5-bd46-0c5862bc0331-secret-metrics-client-certs\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Jun 03 00:22:53.721573 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.721422 2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f834c99c-c30c-41e5-bd46-0c5862bc0331-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Jun 03 00:22:53.721573 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.721432 2559 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f834c99c-c30c-41e5-bd46-0c5862bc0331-secret-grpc-tls\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Jun 03 00:22:53.721573 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.721442 2559 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/f834c99c-c30c-41e5-bd46-0c5862bc0331-config\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Jun 03 00:22:53.721573 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.721449 2559 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f834c99c-c30c-41e5-bd46-0c5862bc0331-secret-kube-rbac-proxy\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Jun 03 00:22:53.721573 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.721459 2559 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f834c99c-c30c-41e5-bd46-0c5862bc0331-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Jun 03 00:22:53.721573 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.721468 2559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f834c99c-c30c-41e5-bd46-0c5862bc0331-tls-assets\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Jun 03 00:22:53.721573 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.721477 2559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f834c99c-c30c-41e5-bd46-0c5862bc0331-web-config\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Jun 03 00:22:53.721573 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.721484 2559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f834c99c-c30c-41e5-bd46-0c5862bc0331-config-out\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Jun 03 00:22:53.721573 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.721492 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f834c99c-c30c-41e5-bd46-0c5862bc0331-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Jun 03 00:22:53.721573 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:53.721502 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f834c99c-c30c-41e5-bd46-0c5862bc0331-prometheus-k8s-db\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Jun 03 00:22:54.117869 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.117831 2559 generic.go:358] "Generic (PLEG): container finished" podID="f834c99c-c30c-41e5-bd46-0c5862bc0331" containerID="0bee0c6f3ae55002e058aa17f9699d55afc78bf9ae910ad122ce71e66026811e" exitCode=0 Jun 03 00:22:54.118287 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.117907 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f834c99c-c30c-41e5-bd46-0c5862bc0331","Type":"ContainerDied","Data":"0bee0c6f3ae55002e058aa17f9699d55afc78bf9ae910ad122ce71e66026811e"} Jun 03 00:22:54.118287 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.117944 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f834c99c-c30c-41e5-bd46-0c5862bc0331","Type":"ContainerDied","Data":"336fb9c2001664e7c23a2a1b5ed15ca81c538057de7caae7d99a2699cac44a10"} Jun 03 00:22:54.118287 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.117959 2559 scope.go:117] "RemoveContainer" containerID="4be96feebe600b5317110b0e557b335d8593395276ee726b9b1f484ed1809ab3" Jun 03 00:22:54.118287 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.117966 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.126375 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.126211 2559 scope.go:117] "RemoveContainer" containerID="df64e18607a8fd491cfff2c95adc848d6d9bc1d563295bde7f5c1f60e57582e0" Jun 03 00:22:54.133637 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.133614 2559 scope.go:117] "RemoveContainer" containerID="0bee0c6f3ae55002e058aa17f9699d55afc78bf9ae910ad122ce71e66026811e" Jun 03 00:22:54.140954 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.140932 2559 scope.go:117] "RemoveContainer" containerID="2a4c1fb3b4b07a661666a8246a12acebad2a43df3e080d5be94120058fabf623" Jun 03 00:22:54.141936 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.141810 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 00:22:54.145830 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.145809 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 00:22:54.148344 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.148312 2559 scope.go:117] "RemoveContainer" containerID="0d4bbdf22bb29da54f3c0d785f60bca46076ed55511267bfb385545922cf348b" Jun 03 00:22:54.154621 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.154603 2559 scope.go:117] "RemoveContainer" containerID="121530060eecfc95e67659f1f9c94c6b5a64598ebbf916e3aa9f0445b7b04535" Jun 03 00:22:54.161413 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.161397 2559 scope.go:117] "RemoveContainer" containerID="8e6816b7682f86068f98edc732bc7c50acaa06514020eac00f863bce936e579a" Jun 03 00:22:54.166583 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.166561 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 00:22:54.166901 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.166886 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f834c99c-c30c-41e5-bd46-0c5862bc0331" containerName="prometheus" Jun 03 00:22:54.166901 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.166902 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f834c99c-c30c-41e5-bd46-0c5862bc0331" containerName="prometheus" Jun 03 00:22:54.167017 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.166912 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f834c99c-c30c-41e5-bd46-0c5862bc0331" containerName="config-reloader" Jun 03 00:22:54.167017 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.166919 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f834c99c-c30c-41e5-bd46-0c5862bc0331" containerName="config-reloader" Jun 03 00:22:54.167017 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.166925 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f834c99c-c30c-41e5-bd46-0c5862bc0331" containerName="kube-rbac-proxy-thanos" Jun 03 00:22:54.167017 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.166931 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f834c99c-c30c-41e5-bd46-0c5862bc0331" containerName="kube-rbac-proxy-thanos" Jun 03 00:22:54.167017 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.166942 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f834c99c-c30c-41e5-bd46-0c5862bc0331" containerName="thanos-sidecar" Jun 03 00:22:54.167017 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.166951 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f834c99c-c30c-41e5-bd46-0c5862bc0331" containerName="thanos-sidecar" Jun 03 00:22:54.167017 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.166959 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f834c99c-c30c-41e5-bd46-0c5862bc0331" containerName="init-config-reloader" Jun 03 00:22:54.167017 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.166965 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f834c99c-c30c-41e5-bd46-0c5862bc0331" containerName="init-config-reloader" Jun 03 00:22:54.167017 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.166974 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f834c99c-c30c-41e5-bd46-0c5862bc0331" containerName="kube-rbac-proxy-web" Jun 03 00:22:54.167017 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.166979 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f834c99c-c30c-41e5-bd46-0c5862bc0331" containerName="kube-rbac-proxy-web" Jun 03 00:22:54.167017 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.166986 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f834c99c-c30c-41e5-bd46-0c5862bc0331" containerName="kube-rbac-proxy" Jun 03 00:22:54.167017 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.166993 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f834c99c-c30c-41e5-bd46-0c5862bc0331" containerName="kube-rbac-proxy" Jun 03 00:22:54.167397 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.167045 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="f834c99c-c30c-41e5-bd46-0c5862bc0331" containerName="kube-rbac-proxy-web" Jun 03 00:22:54.167397 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.167054 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="f834c99c-c30c-41e5-bd46-0c5862bc0331" containerName="config-reloader" Jun 03 00:22:54.167397 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.167061 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="f834c99c-c30c-41e5-bd46-0c5862bc0331" containerName="kube-rbac-proxy" Jun 03 00:22:54.167397 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.167068 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="f834c99c-c30c-41e5-bd46-0c5862bc0331" containerName="kube-rbac-proxy-thanos" Jun 03 00:22:54.167397 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.167074 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="f834c99c-c30c-41e5-bd46-0c5862bc0331" containerName="prometheus" Jun 03 00:22:54.167397 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.167079 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="f834c99c-c30c-41e5-bd46-0c5862bc0331" containerName="thanos-sidecar" Jun 03 00:22:54.168116 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.168097 2559 scope.go:117] "RemoveContainer" containerID="4be96feebe600b5317110b0e557b335d8593395276ee726b9b1f484ed1809ab3" Jun 03 00:22:54.168385 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:22:54.168368 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4be96feebe600b5317110b0e557b335d8593395276ee726b9b1f484ed1809ab3\": container with ID starting with 4be96feebe600b5317110b0e557b335d8593395276ee726b9b1f484ed1809ab3 not found: ID does not exist" containerID="4be96feebe600b5317110b0e557b335d8593395276ee726b9b1f484ed1809ab3" Jun 03 00:22:54.168434 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.168396 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4be96feebe600b5317110b0e557b335d8593395276ee726b9b1f484ed1809ab3"} err="failed to get container status \"4be96feebe600b5317110b0e557b335d8593395276ee726b9b1f484ed1809ab3\": rpc error: code = NotFound desc = could not find container \"4be96feebe600b5317110b0e557b335d8593395276ee726b9b1f484ed1809ab3\": container with ID starting with 4be96feebe600b5317110b0e557b335d8593395276ee726b9b1f484ed1809ab3 not found: ID does not exist" Jun 03 00:22:54.168434 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.168414 2559 scope.go:117] "RemoveContainer" containerID="df64e18607a8fd491cfff2c95adc848d6d9bc1d563295bde7f5c1f60e57582e0" Jun 03 00:22:54.168659 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:22:54.168641 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df64e18607a8fd491cfff2c95adc848d6d9bc1d563295bde7f5c1f60e57582e0\": container with ID starting with df64e18607a8fd491cfff2c95adc848d6d9bc1d563295bde7f5c1f60e57582e0 not found: ID does not exist" containerID="df64e18607a8fd491cfff2c95adc848d6d9bc1d563295bde7f5c1f60e57582e0" Jun 03 00:22:54.168753 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.168664 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df64e18607a8fd491cfff2c95adc848d6d9bc1d563295bde7f5c1f60e57582e0"} err="failed to get container status \"df64e18607a8fd491cfff2c95adc848d6d9bc1d563295bde7f5c1f60e57582e0\": rpc error: code = NotFound desc = could not find container \"df64e18607a8fd491cfff2c95adc848d6d9bc1d563295bde7f5c1f60e57582e0\": container with ID starting with df64e18607a8fd491cfff2c95adc848d6d9bc1d563295bde7f5c1f60e57582e0 not found: ID does not exist" Jun 03 00:22:54.168753 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.168706 2559 scope.go:117] "RemoveContainer" containerID="0bee0c6f3ae55002e058aa17f9699d55afc78bf9ae910ad122ce71e66026811e" Jun 03 00:22:54.168951 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:22:54.168934 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bee0c6f3ae55002e058aa17f9699d55afc78bf9ae910ad122ce71e66026811e\": container with ID starting with 0bee0c6f3ae55002e058aa17f9699d55afc78bf9ae910ad122ce71e66026811e not found: ID does not exist" containerID="0bee0c6f3ae55002e058aa17f9699d55afc78bf9ae910ad122ce71e66026811e" Jun 03 00:22:54.168994 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.168955 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bee0c6f3ae55002e058aa17f9699d55afc78bf9ae910ad122ce71e66026811e"} err="failed to get container status \"0bee0c6f3ae55002e058aa17f9699d55afc78bf9ae910ad122ce71e66026811e\": rpc error: code = NotFound desc = could not find container \"0bee0c6f3ae55002e058aa17f9699d55afc78bf9ae910ad122ce71e66026811e\": container with ID starting with 0bee0c6f3ae55002e058aa17f9699d55afc78bf9ae910ad122ce71e66026811e not found: ID does not exist" Jun 03 00:22:54.168994 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.168968 2559 scope.go:117] "RemoveContainer" containerID="2a4c1fb3b4b07a661666a8246a12acebad2a43df3e080d5be94120058fabf623" Jun 03 00:22:54.169181 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:22:54.169163 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a4c1fb3b4b07a661666a8246a12acebad2a43df3e080d5be94120058fabf623\": container with ID starting with 2a4c1fb3b4b07a661666a8246a12acebad2a43df3e080d5be94120058fabf623 not found: ID does not exist" containerID="2a4c1fb3b4b07a661666a8246a12acebad2a43df3e080d5be94120058fabf623" Jun 03 00:22:54.169219 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.169187 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a4c1fb3b4b07a661666a8246a12acebad2a43df3e080d5be94120058fabf623"} err="failed to get container status \"2a4c1fb3b4b07a661666a8246a12acebad2a43df3e080d5be94120058fabf623\": rpc error: code = NotFound desc = could not find container \"2a4c1fb3b4b07a661666a8246a12acebad2a43df3e080d5be94120058fabf623\": container with ID starting with 2a4c1fb3b4b07a661666a8246a12acebad2a43df3e080d5be94120058fabf623 not found: ID does not exist" Jun 03 00:22:54.169219 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.169203 2559 scope.go:117] "RemoveContainer" containerID="0d4bbdf22bb29da54f3c0d785f60bca46076ed55511267bfb385545922cf348b" Jun 03 00:22:54.169431 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:22:54.169415 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d4bbdf22bb29da54f3c0d785f60bca46076ed55511267bfb385545922cf348b\": container with ID starting with 0d4bbdf22bb29da54f3c0d785f60bca46076ed55511267bfb385545922cf348b not found: ID does not exist" containerID="0d4bbdf22bb29da54f3c0d785f60bca46076ed55511267bfb385545922cf348b" Jun 03 00:22:54.169483 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.169434 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d4bbdf22bb29da54f3c0d785f60bca46076ed55511267bfb385545922cf348b"} err="failed to get container status \"0d4bbdf22bb29da54f3c0d785f60bca46076ed55511267bfb385545922cf348b\": rpc error: code = NotFound desc = could not find container \"0d4bbdf22bb29da54f3c0d785f60bca46076ed55511267bfb385545922cf348b\": container with ID starting with 0d4bbdf22bb29da54f3c0d785f60bca46076ed55511267bfb385545922cf348b not found: ID does not exist" Jun 03 00:22:54.169483 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.169449 2559 scope.go:117] "RemoveContainer" containerID="121530060eecfc95e67659f1f9c94c6b5a64598ebbf916e3aa9f0445b7b04535" Jun 03 00:22:54.169707 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:22:54.169673 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"121530060eecfc95e67659f1f9c94c6b5a64598ebbf916e3aa9f0445b7b04535\": container with ID starting with 121530060eecfc95e67659f1f9c94c6b5a64598ebbf916e3aa9f0445b7b04535 not found: ID does not exist" containerID="121530060eecfc95e67659f1f9c94c6b5a64598ebbf916e3aa9f0445b7b04535" Jun 03 00:22:54.169763 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.169714 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"121530060eecfc95e67659f1f9c94c6b5a64598ebbf916e3aa9f0445b7b04535"} err="failed to get container status \"121530060eecfc95e67659f1f9c94c6b5a64598ebbf916e3aa9f0445b7b04535\": rpc error: code = NotFound desc = could not find container \"121530060eecfc95e67659f1f9c94c6b5a64598ebbf916e3aa9f0445b7b04535\": container with ID starting with 121530060eecfc95e67659f1f9c94c6b5a64598ebbf916e3aa9f0445b7b04535 not found: ID does not exist" Jun 03 00:22:54.169763 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.169732 2559 scope.go:117] "RemoveContainer" containerID="8e6816b7682f86068f98edc732bc7c50acaa06514020eac00f863bce936e579a" Jun 03 00:22:54.169941 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:22:54.169926 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e6816b7682f86068f98edc732bc7c50acaa06514020eac00f863bce936e579a\": container with ID starting with 8e6816b7682f86068f98edc732bc7c50acaa06514020eac00f863bce936e579a not found: ID does not exist" containerID="8e6816b7682f86068f98edc732bc7c50acaa06514020eac00f863bce936e579a" Jun 03 00:22:54.169977 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.169944 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e6816b7682f86068f98edc732bc7c50acaa06514020eac00f863bce936e579a"} err="failed to get container status \"8e6816b7682f86068f98edc732bc7c50acaa06514020eac00f863bce936e579a\": rpc error: code = NotFound desc = could not find container \"8e6816b7682f86068f98edc732bc7c50acaa06514020eac00f863bce936e579a\": container with ID starting with 8e6816b7682f86068f98edc732bc7c50acaa06514020eac00f863bce936e579a not found: ID does not exist" Jun 03 00:22:54.170804 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.170787 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.173076 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.173054 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 03 00:22:54.173194 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.173081 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 03 00:22:54.173194 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.173136 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-cdhvm9ptdfq4j\"" Jun 03 00:22:54.173194 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.173081 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 03 00:22:54.173194 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.173141 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 03 00:22:54.173387 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.173285 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 03 00:22:54.173387 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.173356 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 03 00:22:54.173472 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.173440 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 03 00:22:54.173794 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.173777 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hmmsz\"" Jun 03 00:22:54.173870 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.173823 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 03 00:22:54.174128 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.174112 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 03 00:22:54.174212 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.174131 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 03 00:22:54.176170 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.176148 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 03 00:22:54.178970 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.178948 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 03 00:22:54.181877 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.181855 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 00:22:54.225058 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.225028 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5465dd84-99b4-4b8e-802e-0fae25684e76-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5465dd84-99b4-4b8e-802e-0fae25684e76\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.225058 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.225061 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5465dd84-99b4-4b8e-802e-0fae25684e76-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5465dd84-99b4-4b8e-802e-0fae25684e76\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.225264 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.225096 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5465dd84-99b4-4b8e-802e-0fae25684e76-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5465dd84-99b4-4b8e-802e-0fae25684e76\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.225264 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.225153 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5465dd84-99b4-4b8e-802e-0fae25684e76-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5465dd84-99b4-4b8e-802e-0fae25684e76\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.225264 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.225198 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5465dd84-99b4-4b8e-802e-0fae25684e76-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5465dd84-99b4-4b8e-802e-0fae25684e76\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.225264 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.225223 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5465dd84-99b4-4b8e-802e-0fae25684e76-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5465dd84-99b4-4b8e-802e-0fae25684e76\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.225264 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.225241 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5465dd84-99b4-4b8e-802e-0fae25684e76-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5465dd84-99b4-4b8e-802e-0fae25684e76\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.225264 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.225258 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5465dd84-99b4-4b8e-802e-0fae25684e76-config\") pod \"prometheus-k8s-0\" (UID: \"5465dd84-99b4-4b8e-802e-0fae25684e76\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.225474 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.225283 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2szsz\" (UniqueName: \"kubernetes.io/projected/5465dd84-99b4-4b8e-802e-0fae25684e76-kube-api-access-2szsz\") pod \"prometheus-k8s-0\" (UID: \"5465dd84-99b4-4b8e-802e-0fae25684e76\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.225474 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.225307 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5465dd84-99b4-4b8e-802e-0fae25684e76-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5465dd84-99b4-4b8e-802e-0fae25684e76\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.225474 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.225328 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5465dd84-99b4-4b8e-802e-0fae25684e76-web-config\") pod \"prometheus-k8s-0\" (UID: \"5465dd84-99b4-4b8e-802e-0fae25684e76\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.225474 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.225371 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5465dd84-99b4-4b8e-802e-0fae25684e76-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5465dd84-99b4-4b8e-802e-0fae25684e76\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.225474 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.225390 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5465dd84-99b4-4b8e-802e-0fae25684e76-config-out\") pod \"prometheus-k8s-0\" (UID: \"5465dd84-99b4-4b8e-802e-0fae25684e76\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.225474 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.225408 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5465dd84-99b4-4b8e-802e-0fae25684e76-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5465dd84-99b4-4b8e-802e-0fae25684e76\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.225474 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.225429 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5465dd84-99b4-4b8e-802e-0fae25684e76-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5465dd84-99b4-4b8e-802e-0fae25684e76\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.225474 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.225469 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5465dd84-99b4-4b8e-802e-0fae25684e76-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5465dd84-99b4-4b8e-802e-0fae25684e76\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.225719 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.225487 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5465dd84-99b4-4b8e-802e-0fae25684e76-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5465dd84-99b4-4b8e-802e-0fae25684e76\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.225719 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.225528 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5465dd84-99b4-4b8e-802e-0fae25684e76-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5465dd84-99b4-4b8e-802e-0fae25684e76\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.326578 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.326488 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5465dd84-99b4-4b8e-802e-0fae25684e76-config-out\") pod \"prometheus-k8s-0\" (UID: \"5465dd84-99b4-4b8e-802e-0fae25684e76\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.326578 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.326533 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5465dd84-99b4-4b8e-802e-0fae25684e76-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5465dd84-99b4-4b8e-802e-0fae25684e76\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.326578 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.326555 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5465dd84-99b4-4b8e-802e-0fae25684e76-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5465dd84-99b4-4b8e-802e-0fae25684e76\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.326578 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.326579 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5465dd84-99b4-4b8e-802e-0fae25684e76-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5465dd84-99b4-4b8e-802e-0fae25684e76\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.326961 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.326595 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5465dd84-99b4-4b8e-802e-0fae25684e76-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5465dd84-99b4-4b8e-802e-0fae25684e76\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.326961 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.326615 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5465dd84-99b4-4b8e-802e-0fae25684e76-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5465dd84-99b4-4b8e-802e-0fae25684e76\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.326961 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.326664 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5465dd84-99b4-4b8e-802e-0fae25684e76-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5465dd84-99b4-4b8e-802e-0fae25684e76\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.326961 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.326715 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5465dd84-99b4-4b8e-802e-0fae25684e76-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5465dd84-99b4-4b8e-802e-0fae25684e76\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.326961 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.326754 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5465dd84-99b4-4b8e-802e-0fae25684e76-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5465dd84-99b4-4b8e-802e-0fae25684e76\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.326961 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.326780 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5465dd84-99b4-4b8e-802e-0fae25684e76-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5465dd84-99b4-4b8e-802e-0fae25684e76\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.326961 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.326812 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5465dd84-99b4-4b8e-802e-0fae25684e76-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5465dd84-99b4-4b8e-802e-0fae25684e76\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.326961 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.326837 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5465dd84-99b4-4b8e-802e-0fae25684e76-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5465dd84-99b4-4b8e-802e-0fae25684e76\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.326961 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.326863 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5465dd84-99b4-4b8e-802e-0fae25684e76-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5465dd84-99b4-4b8e-802e-0fae25684e76\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.326961 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.326887 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5465dd84-99b4-4b8e-802e-0fae25684e76-config\") pod \"prometheus-k8s-0\" (UID: \"5465dd84-99b4-4b8e-802e-0fae25684e76\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.326961 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.326918 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2szsz\" (UniqueName: \"kubernetes.io/projected/5465dd84-99b4-4b8e-802e-0fae25684e76-kube-api-access-2szsz\") pod \"prometheus-k8s-0\" (UID: \"5465dd84-99b4-4b8e-802e-0fae25684e76\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.326961 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.326954 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5465dd84-99b4-4b8e-802e-0fae25684e76-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5465dd84-99b4-4b8e-802e-0fae25684e76\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.327511 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.326986 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5465dd84-99b4-4b8e-802e-0fae25684e76-web-config\") pod \"prometheus-k8s-0\" (UID: \"5465dd84-99b4-4b8e-802e-0fae25684e76\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.327511 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.327028 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5465dd84-99b4-4b8e-802e-0fae25684e76-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5465dd84-99b4-4b8e-802e-0fae25684e76\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.327615 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.327592 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5465dd84-99b4-4b8e-802e-0fae25684e76-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5465dd84-99b4-4b8e-802e-0fae25684e76\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.327673 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.326981 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5465dd84-99b4-4b8e-802e-0fae25684e76-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5465dd84-99b4-4b8e-802e-0fae25684e76\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.327673 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.327652 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5465dd84-99b4-4b8e-802e-0fae25684e76-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5465dd84-99b4-4b8e-802e-0fae25684e76\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.327795 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.327719 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5465dd84-99b4-4b8e-802e-0fae25684e76-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5465dd84-99b4-4b8e-802e-0fae25684e76\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.329961 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.328414 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5465dd84-99b4-4b8e-802e-0fae25684e76-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5465dd84-99b4-4b8e-802e-0fae25684e76\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.329961 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.329868 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5465dd84-99b4-4b8e-802e-0fae25684e76-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5465dd84-99b4-4b8e-802e-0fae25684e76\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.330427 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.330404 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5465dd84-99b4-4b8e-802e-0fae25684e76-config-out\") pod \"prometheus-k8s-0\" (UID: \"5465dd84-99b4-4b8e-802e-0fae25684e76\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.330604 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.330518 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5465dd84-99b4-4b8e-802e-0fae25684e76-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5465dd84-99b4-4b8e-802e-0fae25684e76\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.331765 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.330954 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5465dd84-99b4-4b8e-802e-0fae25684e76-web-config\") pod \"prometheus-k8s-0\" (UID: \"5465dd84-99b4-4b8e-802e-0fae25684e76\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.331765 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.331190 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5465dd84-99b4-4b8e-802e-0fae25684e76-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5465dd84-99b4-4b8e-802e-0fae25684e76\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.331765 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.331641 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5465dd84-99b4-4b8e-802e-0fae25684e76-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5465dd84-99b4-4b8e-802e-0fae25684e76\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.331765 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.331725 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5465dd84-99b4-4b8e-802e-0fae25684e76-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5465dd84-99b4-4b8e-802e-0fae25684e76\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.332111 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.332085 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5465dd84-99b4-4b8e-802e-0fae25684e76-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5465dd84-99b4-4b8e-802e-0fae25684e76\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.332279 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.332261 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5465dd84-99b4-4b8e-802e-0fae25684e76-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5465dd84-99b4-4b8e-802e-0fae25684e76\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.332369 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.332353 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5465dd84-99b4-4b8e-802e-0fae25684e76-config\") pod \"prometheus-k8s-0\" (UID: \"5465dd84-99b4-4b8e-802e-0fae25684e76\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.332414 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.332376 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5465dd84-99b4-4b8e-802e-0fae25684e76-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5465dd84-99b4-4b8e-802e-0fae25684e76\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.333239 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.333224 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5465dd84-99b4-4b8e-802e-0fae25684e76-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5465dd84-99b4-4b8e-802e-0fae25684e76\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.335302 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.335285 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2szsz\" (UniqueName: \"kubernetes.io/projected/5465dd84-99b4-4b8e-802e-0fae25684e76-kube-api-access-2szsz\") pod \"prometheus-k8s-0\" (UID: \"5465dd84-99b4-4b8e-802e-0fae25684e76\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.480959 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.480922 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:22:54.618808 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:54.618781 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 00:22:54.620267 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:22:54.620245 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5465dd84_99b4_4b8e_802e_0fae25684e76.slice/crio-ea6ce44897e30f2b83d0ed5633fb4788334c3448ed297a801adbfc534ea718dc WatchSource:0}: Error finding container ea6ce44897e30f2b83d0ed5633fb4788334c3448ed297a801adbfc534ea718dc: Status 404 returned error can't find the container with id ea6ce44897e30f2b83d0ed5633fb4788334c3448ed297a801adbfc534ea718dc Jun 03 00:22:55.130436 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:55.130394 2559 generic.go:358] "Generic (PLEG): container finished" podID="5465dd84-99b4-4b8e-802e-0fae25684e76" containerID="2d72b0762e02b541c51749547284a96e71b8b3a996aaba86aa4b840c3418c146" exitCode=0 Jun 03 00:22:55.130847 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:55.130482 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5465dd84-99b4-4b8e-802e-0fae25684e76","Type":"ContainerDied","Data":"2d72b0762e02b541c51749547284a96e71b8b3a996aaba86aa4b840c3418c146"} Jun 03 00:22:55.130847 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:55.130521 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5465dd84-99b4-4b8e-802e-0fae25684e76","Type":"ContainerStarted","Data":"ea6ce44897e30f2b83d0ed5633fb4788334c3448ed297a801adbfc534ea718dc"} Jun 03 00:22:55.370554 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:55.369818 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f834c99c-c30c-41e5-bd46-0c5862bc0331" path="/var/lib/kubelet/pods/f834c99c-c30c-41e5-bd46-0c5862bc0331/volumes" Jun 03 00:22:56.136728 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:56.136679 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5465dd84-99b4-4b8e-802e-0fae25684e76","Type":"ContainerStarted","Data":"17b7a5b403a473045b8eb3a3ec98b023a39c484df005debc373d404acec92d4a"} Jun 03 00:22:56.136728 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:56.136733 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5465dd84-99b4-4b8e-802e-0fae25684e76","Type":"ContainerStarted","Data":"97bf0f23be736a312e6f59c56c78ee5c33bc8a5080182dbd294eb81b47761027"} Jun 03 00:22:56.137132 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:56.136744 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5465dd84-99b4-4b8e-802e-0fae25684e76","Type":"ContainerStarted","Data":"e52120073919d06c581bc522330808364b8e843965db22df7be74e0eaa928c0e"} Jun 03 00:22:56.137132 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:56.136754 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5465dd84-99b4-4b8e-802e-0fae25684e76","Type":"ContainerStarted","Data":"9fc4567b957ebc5951876fcd100a818c209cd77459a78d5420f08fef7bf4ec4d"} Jun 03 00:22:56.137132 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:56.136762 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5465dd84-99b4-4b8e-802e-0fae25684e76","Type":"ContainerStarted","Data":"1ad5e9b2a6eb348c391ed6e94c9b66a7ed40ac8c7bd51f244f47afaf330bc2be"} Jun 03 00:22:56.137132 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:56.136770 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5465dd84-99b4-4b8e-802e-0fae25684e76","Type":"ContainerStarted","Data":"d2b3c83a8ddc8bb54039cef18d9c6b3da18dd42f12ef251db739c1737efb03a2"} Jun 03 00:22:56.161264 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:56.161217 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.161200994 podStartE2EDuration="2.161200994s" podCreationTimestamp="2026-06-03 00:22:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 00:22:56.159069405 +0000 UTC m=+197.378991981" watchObservedRunningTime="2026-06-03 00:22:56.161200994 +0000 UTC m=+197.381123591" Jun 03 00:22:59.481875 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:22:59.481836 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:23:54.481757 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:23:54.481635 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:23:54.497037 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:23:54.497010 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:23:55.326803 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:23:55.326778 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 00:24:39.233871 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:24:39.233834 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-7n7x2_ec539906-3be0-4a60-9ea2-5f07074c913a/console-operator/1.log" Jun 03 00:24:39.234435 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:24:39.234417 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-7n7x2_ec539906-3be0-4a60-9ea2-5f07074c913a/console-operator/1.log" Jun 03 00:24:39.240373 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:24:39.240353 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7gbw_25936d51-9126-434b-be53-677c56a0a8f7/ovn-acl-logging/0.log" Jun 03 00:24:39.240859 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:24:39.240836 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7gbw_25936d51-9126-434b-be53-677c56a0a8f7/ovn-acl-logging/0.log" Jun 03 00:24:39.250376 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:24:39.250352 2559 kubelet.go:1628] "Image garbage collection succeeded" Jun 03 00:24:59.248591 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:24:59.248557 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-bm4vd"] Jun 03 00:24:59.250632 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:24:59.250612 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bm4vd" Jun 03 00:24:59.252562 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:24:59.252546 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 00:24:59.260103 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:24:59.260081 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bm4vd"] Jun 03 00:24:59.303507 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:24:59.303471 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38b19569-bea3-4fb5-a34a-4f88f97feac0-original-pull-secret\") pod \"global-pull-secret-syncer-bm4vd\" (UID: \"38b19569-bea3-4fb5-a34a-4f88f97feac0\") " pod="kube-system/global-pull-secret-syncer-bm4vd" Jun 03 00:24:59.303507 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:24:59.303509 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/38b19569-bea3-4fb5-a34a-4f88f97feac0-kubelet-config\") pod \"global-pull-secret-syncer-bm4vd\" (UID: \"38b19569-bea3-4fb5-a34a-4f88f97feac0\") " pod="kube-system/global-pull-secret-syncer-bm4vd" Jun 03 00:24:59.303759 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:24:59.303546 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/38b19569-bea3-4fb5-a34a-4f88f97feac0-dbus\") pod \"global-pull-secret-syncer-bm4vd\" (UID: \"38b19569-bea3-4fb5-a34a-4f88f97feac0\") " pod="kube-system/global-pull-secret-syncer-bm4vd" Jun 03 00:24:59.404089 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:24:59.404052 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38b19569-bea3-4fb5-a34a-4f88f97feac0-original-pull-secret\") pod \"global-pull-secret-syncer-bm4vd\" (UID: \"38b19569-bea3-4fb5-a34a-4f88f97feac0\") " pod="kube-system/global-pull-secret-syncer-bm4vd" Jun 03 00:24:59.404089 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:24:59.404094 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/38b19569-bea3-4fb5-a34a-4f88f97feac0-kubelet-config\") pod \"global-pull-secret-syncer-bm4vd\" (UID: \"38b19569-bea3-4fb5-a34a-4f88f97feac0\") " pod="kube-system/global-pull-secret-syncer-bm4vd" Jun 03 00:24:59.404348 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:24:59.404213 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/38b19569-bea3-4fb5-a34a-4f88f97feac0-dbus\") pod \"global-pull-secret-syncer-bm4vd\" (UID: \"38b19569-bea3-4fb5-a34a-4f88f97feac0\") " pod="kube-system/global-pull-secret-syncer-bm4vd" Jun 03 00:24:59.404348 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:24:59.404318 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/38b19569-bea3-4fb5-a34a-4f88f97feac0-kubelet-config\") pod \"global-pull-secret-syncer-bm4vd\" (UID: \"38b19569-bea3-4fb5-a34a-4f88f97feac0\") " pod="kube-system/global-pull-secret-syncer-bm4vd" Jun 03 00:24:59.404454 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:24:59.404384 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/38b19569-bea3-4fb5-a34a-4f88f97feac0-dbus\") pod \"global-pull-secret-syncer-bm4vd\" (UID: \"38b19569-bea3-4fb5-a34a-4f88f97feac0\") " pod="kube-system/global-pull-secret-syncer-bm4vd" Jun 03 00:24:59.406445 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:24:59.406426 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38b19569-bea3-4fb5-a34a-4f88f97feac0-original-pull-secret\") pod \"global-pull-secret-syncer-bm4vd\" (UID: \"38b19569-bea3-4fb5-a34a-4f88f97feac0\") " pod="kube-system/global-pull-secret-syncer-bm4vd" Jun 03 00:24:59.560568 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:24:59.560479 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bm4vd" Jun 03 00:24:59.681076 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:24:59.681048 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bm4vd"] Jun 03 00:24:59.683643 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:24:59.683609 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38b19569_bea3_4fb5_a34a_4f88f97feac0.slice/crio-535f50a06f8deef60eacc5816e9bff5b546bf5d188bf5a4565c1c326cc2c0a8d WatchSource:0}: Error finding container 535f50a06f8deef60eacc5816e9bff5b546bf5d188bf5a4565c1c326cc2c0a8d: Status 404 returned error can't find the container with id 535f50a06f8deef60eacc5816e9bff5b546bf5d188bf5a4565c1c326cc2c0a8d Jun 03 00:24:59.685186 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:24:59.685168 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 00:25:00.492223 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:25:00.492186 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bm4vd" event={"ID":"38b19569-bea3-4fb5-a34a-4f88f97feac0","Type":"ContainerStarted","Data":"535f50a06f8deef60eacc5816e9bff5b546bf5d188bf5a4565c1c326cc2c0a8d"} Jun 03 00:25:05.512527 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:25:05.512488 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bm4vd" event={"ID":"38b19569-bea3-4fb5-a34a-4f88f97feac0","Type":"ContainerStarted","Data":"4083f6ca14fb3f9e49139758b1d23a2f064f638d7ade6d4c259cc62681b9fe02"} Jun 03 00:25:05.525869 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:25:05.525810 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bm4vd" podStartSLOduration=1.066011874 podStartE2EDuration="6.525792101s" podCreationTimestamp="2026-06-03 00:24:59 +0000 UTC" firstStartedPulling="2026-06-03 00:24:59.685295046 +0000 UTC m=+320.905217599" lastFinishedPulling="2026-06-03 00:25:05.145075264 +0000 UTC m=+326.364997826" observedRunningTime="2026-06-03 00:25:05.525069527 +0000 UTC m=+326.744992105" watchObservedRunningTime="2026-06-03 00:25:05.525792101 +0000 UTC m=+326.745714721" Jun 03 00:26:48.030807 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:26:48.030776 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76cf9fb4b6-r2dm7"] Jun 03 00:26:48.033197 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:26:48.033181 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-76cf9fb4b6-r2dm7" Jun 03 00:26:48.035756 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:26:48.035735 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 03 00:26:48.035904 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:26:48.035841 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 03 00:26:48.036022 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:26:48.036001 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 03 00:26:48.036139 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:26:48.036053 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 03 00:26:48.036202 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:26:48.036175 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zd9z4\"" Jun 03 00:26:48.054369 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:26:48.054341 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76cf9fb4b6-r2dm7"] Jun 03 00:26:48.162799 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:26:48.162758 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a2da7b60-49c1-4091-aef3-d70ebef6c609-tmp\") pod \"opendatahub-operator-controller-manager-76cf9fb4b6-r2dm7\" (UID: \"a2da7b60-49c1-4091-aef3-d70ebef6c609\") " pod="opendatahub/opendatahub-operator-controller-manager-76cf9fb4b6-r2dm7" Jun 03 00:26:48.162969 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:26:48.162823 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a2da7b60-49c1-4091-aef3-d70ebef6c609-manifests\") pod \"opendatahub-operator-controller-manager-76cf9fb4b6-r2dm7\" (UID: \"a2da7b60-49c1-4091-aef3-d70ebef6c609\") " pod="opendatahub/opendatahub-operator-controller-manager-76cf9fb4b6-r2dm7" Jun 03 00:26:48.162969 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:26:48.162848 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7rhg\" (UniqueName: \"kubernetes.io/projected/a2da7b60-49c1-4091-aef3-d70ebef6c609-kube-api-access-g7rhg\") pod \"opendatahub-operator-controller-manager-76cf9fb4b6-r2dm7\" (UID: \"a2da7b60-49c1-4091-aef3-d70ebef6c609\") " pod="opendatahub/opendatahub-operator-controller-manager-76cf9fb4b6-r2dm7" Jun 03 00:26:48.162969 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:26:48.162867 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a2da7b60-49c1-4091-aef3-d70ebef6c609-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76cf9fb4b6-r2dm7\" (UID: \"a2da7b60-49c1-4091-aef3-d70ebef6c609\") " pod="opendatahub/opendatahub-operator-controller-manager-76cf9fb4b6-r2dm7" Jun 03 00:26:48.162969 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:26:48.162946 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a2da7b60-49c1-4091-aef3-d70ebef6c609-webhook-cert\") pod \"opendatahub-operator-controller-manager-76cf9fb4b6-r2dm7\" (UID: \"a2da7b60-49c1-4091-aef3-d70ebef6c609\") " pod="opendatahub/opendatahub-operator-controller-manager-76cf9fb4b6-r2dm7" Jun 03 00:26:48.264246 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:26:48.264197 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a2da7b60-49c1-4091-aef3-d70ebef6c609-tmp\") pod \"opendatahub-operator-controller-manager-76cf9fb4b6-r2dm7\" (UID: \"a2da7b60-49c1-4091-aef3-d70ebef6c609\") " pod="opendatahub/opendatahub-operator-controller-manager-76cf9fb4b6-r2dm7" Jun 03 00:26:48.264400 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:26:48.264265 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a2da7b60-49c1-4091-aef3-d70ebef6c609-manifests\") pod \"opendatahub-operator-controller-manager-76cf9fb4b6-r2dm7\" (UID: \"a2da7b60-49c1-4091-aef3-d70ebef6c609\") " pod="opendatahub/opendatahub-operator-controller-manager-76cf9fb4b6-r2dm7" Jun 03 00:26:48.264400 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:26:48.264285 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g7rhg\" (UniqueName: \"kubernetes.io/projected/a2da7b60-49c1-4091-aef3-d70ebef6c609-kube-api-access-g7rhg\") pod \"opendatahub-operator-controller-manager-76cf9fb4b6-r2dm7\" (UID: \"a2da7b60-49c1-4091-aef3-d70ebef6c609\") " pod="opendatahub/opendatahub-operator-controller-manager-76cf9fb4b6-r2dm7" Jun 03 00:26:48.264400 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:26:48.264304 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a2da7b60-49c1-4091-aef3-d70ebef6c609-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76cf9fb4b6-r2dm7\" (UID: \"a2da7b60-49c1-4091-aef3-d70ebef6c609\") " pod="opendatahub/opendatahub-operator-controller-manager-76cf9fb4b6-r2dm7" Jun 03 00:26:48.264554 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:26:48.264444 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a2da7b60-49c1-4091-aef3-d70ebef6c609-webhook-cert\") pod \"opendatahub-operator-controller-manager-76cf9fb4b6-r2dm7\" (UID: \"a2da7b60-49c1-4091-aef3-d70ebef6c609\") " pod="opendatahub/opendatahub-operator-controller-manager-76cf9fb4b6-r2dm7" Jun 03 00:26:48.264760 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:26:48.264740 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a2da7b60-49c1-4091-aef3-d70ebef6c609-manifests\") pod \"opendatahub-operator-controller-manager-76cf9fb4b6-r2dm7\" (UID: \"a2da7b60-49c1-4091-aef3-d70ebef6c609\") " pod="opendatahub/opendatahub-operator-controller-manager-76cf9fb4b6-r2dm7" Jun 03 00:26:48.266615 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:26:48.266588 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a2da7b60-49c1-4091-aef3-d70ebef6c609-tmp\") pod \"opendatahub-operator-controller-manager-76cf9fb4b6-r2dm7\" (UID: \"a2da7b60-49c1-4091-aef3-d70ebef6c609\") " pod="opendatahub/opendatahub-operator-controller-manager-76cf9fb4b6-r2dm7" Jun 03 00:26:48.266850 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:26:48.266832 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a2da7b60-49c1-4091-aef3-d70ebef6c609-webhook-cert\") pod \"opendatahub-operator-controller-manager-76cf9fb4b6-r2dm7\" (UID: \"a2da7b60-49c1-4091-aef3-d70ebef6c609\") " pod="opendatahub/opendatahub-operator-controller-manager-76cf9fb4b6-r2dm7" Jun 03 00:26:48.266850 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:26:48.266844 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a2da7b60-49c1-4091-aef3-d70ebef6c609-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76cf9fb4b6-r2dm7\" (UID: \"a2da7b60-49c1-4091-aef3-d70ebef6c609\") " pod="opendatahub/opendatahub-operator-controller-manager-76cf9fb4b6-r2dm7" Jun 03 00:26:48.274194 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:26:48.274172 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7rhg\" (UniqueName: \"kubernetes.io/projected/a2da7b60-49c1-4091-aef3-d70ebef6c609-kube-api-access-g7rhg\") pod \"opendatahub-operator-controller-manager-76cf9fb4b6-r2dm7\" (UID: \"a2da7b60-49c1-4091-aef3-d70ebef6c609\") " pod="opendatahub/opendatahub-operator-controller-manager-76cf9fb4b6-r2dm7" Jun 03 00:26:48.342903 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:26:48.342822 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-76cf9fb4b6-r2dm7" Jun 03 00:26:48.474716 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:26:48.474667 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76cf9fb4b6-r2dm7"] Jun 03 00:26:48.477160 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:26:48.477132 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2da7b60_49c1_4091_aef3_d70ebef6c609.slice/crio-7906b5e5fd3df7c39cbaf40537bb97067068b1d3c788f6bb335319a4a8e995e5 WatchSource:0}: Error finding container 7906b5e5fd3df7c39cbaf40537bb97067068b1d3c788f6bb335319a4a8e995e5: Status 404 returned error can't find the container with id 7906b5e5fd3df7c39cbaf40537bb97067068b1d3c788f6bb335319a4a8e995e5 Jun 03 00:26:48.816473 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:26:48.816437 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76cf9fb4b6-r2dm7" event={"ID":"a2da7b60-49c1-4091-aef3-d70ebef6c609","Type":"ContainerStarted","Data":"7906b5e5fd3df7c39cbaf40537bb97067068b1d3c788f6bb335319a4a8e995e5"} Jun 03 00:26:52.832067 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:26:52.832032 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76cf9fb4b6-r2dm7" event={"ID":"a2da7b60-49c1-4091-aef3-d70ebef6c609","Type":"ContainerStarted","Data":"8e0bcb81d44b482dc115918f528a7fd94458647e144084400387837bd2d70a6e"} Jun 03 00:26:53.836269 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:26:53.836226 2559 generic.go:358] "Generic (PLEG): container finished" podID="a2da7b60-49c1-4091-aef3-d70ebef6c609" containerID="8e0bcb81d44b482dc115918f528a7fd94458647e144084400387837bd2d70a6e" exitCode=0 Jun 03 00:26:53.836677 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:26:53.836321 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76cf9fb4b6-r2dm7" event={"ID":"a2da7b60-49c1-4091-aef3-d70ebef6c609","Type":"ContainerDied","Data":"8e0bcb81d44b482dc115918f528a7fd94458647e144084400387837bd2d70a6e"} Jun 03 00:26:54.842060 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:26:54.842023 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76cf9fb4b6-r2dm7" event={"ID":"a2da7b60-49c1-4091-aef3-d70ebef6c609","Type":"ContainerStarted","Data":"c14c2cffb142e50c2eb7ba566496345f148a1cf6241d54e9ca6e18706d3cd37c"} Jun 03 00:26:54.842447 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:26:54.842146 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-76cf9fb4b6-r2dm7" Jun 03 00:26:54.863184 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:26:54.863135 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-76cf9fb4b6-r2dm7" podStartSLOduration=1.165842711 podStartE2EDuration="6.86312044s" podCreationTimestamp="2026-06-03 00:26:48 +0000 UTC" firstStartedPulling="2026-06-03 00:26:48.478855018 +0000 UTC m=+429.698777575" lastFinishedPulling="2026-06-03 00:26:54.176132751 +0000 UTC m=+435.396055304" observedRunningTime="2026-06-03 00:26:54.861218747 +0000 UTC m=+436.081141321" watchObservedRunningTime="2026-06-03 00:26:54.86312044 +0000 UTC m=+436.083043015" Jun 03 00:27:05.848104 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:05.848070 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-76cf9fb4b6-r2dm7" Jun 03 00:27:16.285647 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:16.285614 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-db866fbbd-vg7cp"] Jun 03 00:27:16.296935 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:16.296905 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-db866fbbd-vg7cp" Jun 03 00:27:16.298803 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:16.298771 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-db866fbbd-vg7cp"] Jun 03 00:27:16.298979 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:16.298942 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-wf7gv\"" Jun 03 00:27:16.299808 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:16.299775 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 03 00:27:16.299808 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:16.299806 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 03 00:27:16.299983 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:16.299775 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 03 00:27:16.299983 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:16.299881 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 03 00:27:16.300091 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:16.300054 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 03 00:27:16.419465 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:16.419424 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e9e2bd16-5099-4981-8624-ab82ed9788c8-metrics-cert\") pod \"lws-controller-manager-db866fbbd-vg7cp\" (UID: \"e9e2bd16-5099-4981-8624-ab82ed9788c8\") " pod="openshift-lws-operator/lws-controller-manager-db866fbbd-vg7cp" Jun 03 00:27:16.419659 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:16.419473 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjs9p\" (UniqueName: \"kubernetes.io/projected/e9e2bd16-5099-4981-8624-ab82ed9788c8-kube-api-access-xjs9p\") pod \"lws-controller-manager-db866fbbd-vg7cp\" (UID: \"e9e2bd16-5099-4981-8624-ab82ed9788c8\") " pod="openshift-lws-operator/lws-controller-manager-db866fbbd-vg7cp" Jun 03 00:27:16.419659 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:16.419551 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9e2bd16-5099-4981-8624-ab82ed9788c8-cert\") pod \"lws-controller-manager-db866fbbd-vg7cp\" (UID: \"e9e2bd16-5099-4981-8624-ab82ed9788c8\") " pod="openshift-lws-operator/lws-controller-manager-db866fbbd-vg7cp" Jun 03 00:27:16.419659 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:16.419587 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e9e2bd16-5099-4981-8624-ab82ed9788c8-manager-config\") pod \"lws-controller-manager-db866fbbd-vg7cp\" (UID: \"e9e2bd16-5099-4981-8624-ab82ed9788c8\") " pod="openshift-lws-operator/lws-controller-manager-db866fbbd-vg7cp" Jun 03 00:27:16.520889 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:16.520852 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9e2bd16-5099-4981-8624-ab82ed9788c8-cert\") pod \"lws-controller-manager-db866fbbd-vg7cp\" (UID: \"e9e2bd16-5099-4981-8624-ab82ed9788c8\") " pod="openshift-lws-operator/lws-controller-manager-db866fbbd-vg7cp" Jun 03 00:27:16.521002 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:16.520897 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e9e2bd16-5099-4981-8624-ab82ed9788c8-manager-config\") pod \"lws-controller-manager-db866fbbd-vg7cp\" (UID: \"e9e2bd16-5099-4981-8624-ab82ed9788c8\") " pod="openshift-lws-operator/lws-controller-manager-db866fbbd-vg7cp" Jun 03 00:27:16.521002 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:16.520941 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e9e2bd16-5099-4981-8624-ab82ed9788c8-metrics-cert\") pod \"lws-controller-manager-db866fbbd-vg7cp\" (UID: \"e9e2bd16-5099-4981-8624-ab82ed9788c8\") " pod="openshift-lws-operator/lws-controller-manager-db866fbbd-vg7cp" Jun 03 00:27:16.521002 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:16.520962 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xjs9p\" (UniqueName: \"kubernetes.io/projected/e9e2bd16-5099-4981-8624-ab82ed9788c8-kube-api-access-xjs9p\") pod \"lws-controller-manager-db866fbbd-vg7cp\" (UID: \"e9e2bd16-5099-4981-8624-ab82ed9788c8\") " pod="openshift-lws-operator/lws-controller-manager-db866fbbd-vg7cp" Jun 03 00:27:16.521659 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:16.521635 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e9e2bd16-5099-4981-8624-ab82ed9788c8-manager-config\") pod \"lws-controller-manager-db866fbbd-vg7cp\" (UID: \"e9e2bd16-5099-4981-8624-ab82ed9788c8\") " pod="openshift-lws-operator/lws-controller-manager-db866fbbd-vg7cp" Jun 03 00:27:16.523379 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:16.523357 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9e2bd16-5099-4981-8624-ab82ed9788c8-cert\") pod \"lws-controller-manager-db866fbbd-vg7cp\" (UID: \"e9e2bd16-5099-4981-8624-ab82ed9788c8\") " pod="openshift-lws-operator/lws-controller-manager-db866fbbd-vg7cp" Jun 03 00:27:16.523534 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:16.523514 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e9e2bd16-5099-4981-8624-ab82ed9788c8-metrics-cert\") pod \"lws-controller-manager-db866fbbd-vg7cp\" (UID: \"e9e2bd16-5099-4981-8624-ab82ed9788c8\") " pod="openshift-lws-operator/lws-controller-manager-db866fbbd-vg7cp" Jun 03 00:27:16.529062 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:16.529039 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjs9p\" (UniqueName: \"kubernetes.io/projected/e9e2bd16-5099-4981-8624-ab82ed9788c8-kube-api-access-xjs9p\") pod \"lws-controller-manager-db866fbbd-vg7cp\" (UID: \"e9e2bd16-5099-4981-8624-ab82ed9788c8\") " pod="openshift-lws-operator/lws-controller-manager-db866fbbd-vg7cp" Jun 03 00:27:16.608122 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:16.608039 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-db866fbbd-vg7cp" Jun 03 00:27:16.731502 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:16.731473 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-db866fbbd-vg7cp"] Jun 03 00:27:16.734070 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:27:16.734042 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9e2bd16_5099_4981_8624_ab82ed9788c8.slice/crio-286bb86075320242437dc7fbdb0afc09d3656492ff711cbad26eda06e0a9a8af WatchSource:0}: Error finding container 286bb86075320242437dc7fbdb0afc09d3656492ff711cbad26eda06e0a9a8af: Status 404 returned error can't find the container with id 286bb86075320242437dc7fbdb0afc09d3656492ff711cbad26eda06e0a9a8af Jun 03 00:27:16.914713 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:16.914618 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-db866fbbd-vg7cp" event={"ID":"e9e2bd16-5099-4981-8624-ab82ed9788c8","Type":"ContainerStarted","Data":"286bb86075320242437dc7fbdb0afc09d3656492ff711cbad26eda06e0a9a8af"} Jun 03 00:27:19.930049 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:19.930006 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-db866fbbd-vg7cp" event={"ID":"e9e2bd16-5099-4981-8624-ab82ed9788c8","Type":"ContainerStarted","Data":"314a49a310f494f47aa3312c1c20e59524ca40bba9c11157a6a11fb21bb4d3e7"} Jun 03 00:27:19.930485 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:19.930137 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-db866fbbd-vg7cp" Jun 03 00:27:19.946636 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:19.946587 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-db866fbbd-vg7cp" podStartSLOduration=1.462484424 podStartE2EDuration="3.946574233s" podCreationTimestamp="2026-06-03 00:27:16 +0000 UTC" firstStartedPulling="2026-06-03 00:27:16.735810793 +0000 UTC m=+457.955733350" lastFinishedPulling="2026-06-03 00:27:19.219900605 +0000 UTC m=+460.439823159" observedRunningTime="2026-06-03 00:27:19.944834157 +0000 UTC m=+461.164756731" watchObservedRunningTime="2026-06-03 00:27:19.946574233 +0000 UTC m=+461.166496806" Jun 03 00:27:30.935558 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:30.935527 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-db866fbbd-vg7cp" Jun 03 00:27:43.868379 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:43.868336 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-767d585f79-5pf8k"] Jun 03 00:27:43.871465 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:43.871441 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-767d585f79-5pf8k" Jun 03 00:27:43.873391 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:43.873369 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-snq46\"" Jun 03 00:27:43.873498 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:43.873369 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 03 00:27:43.879537 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:43.879513 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-767d585f79-5pf8k"] Jun 03 00:27:43.969211 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:43.969164 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/186ba058-d978-4ea5-bfde-0a54c577f041-redirect-config\") pod \"dashboard-redirect-767d585f79-5pf8k\" (UID: \"186ba058-d978-4ea5-bfde-0a54c577f041\") " pod="opendatahub/dashboard-redirect-767d585f79-5pf8k" Jun 03 00:27:43.969382 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:43.969221 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr44z\" (UniqueName: \"kubernetes.io/projected/186ba058-d978-4ea5-bfde-0a54c577f041-kube-api-access-vr44z\") pod \"dashboard-redirect-767d585f79-5pf8k\" (UID: \"186ba058-d978-4ea5-bfde-0a54c577f041\") " pod="opendatahub/dashboard-redirect-767d585f79-5pf8k" Jun 03 00:27:44.069601 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:44.069564 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vr44z\" (UniqueName: \"kubernetes.io/projected/186ba058-d978-4ea5-bfde-0a54c577f041-kube-api-access-vr44z\") pod \"dashboard-redirect-767d585f79-5pf8k\" (UID: \"186ba058-d978-4ea5-bfde-0a54c577f041\") " pod="opendatahub/dashboard-redirect-767d585f79-5pf8k" Jun 03 00:27:44.069794 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:44.069648 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/186ba058-d978-4ea5-bfde-0a54c577f041-redirect-config\") pod \"dashboard-redirect-767d585f79-5pf8k\" (UID: \"186ba058-d978-4ea5-bfde-0a54c577f041\") " pod="opendatahub/dashboard-redirect-767d585f79-5pf8k" Jun 03 00:27:44.070291 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:44.070273 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/186ba058-d978-4ea5-bfde-0a54c577f041-redirect-config\") pod \"dashboard-redirect-767d585f79-5pf8k\" (UID: \"186ba058-d978-4ea5-bfde-0a54c577f041\") " pod="opendatahub/dashboard-redirect-767d585f79-5pf8k" Jun 03 00:27:44.077606 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:44.077579 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr44z\" (UniqueName: \"kubernetes.io/projected/186ba058-d978-4ea5-bfde-0a54c577f041-kube-api-access-vr44z\") pod \"dashboard-redirect-767d585f79-5pf8k\" (UID: \"186ba058-d978-4ea5-bfde-0a54c577f041\") " pod="opendatahub/dashboard-redirect-767d585f79-5pf8k" Jun 03 00:27:44.184628 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:44.184528 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-767d585f79-5pf8k" Jun 03 00:27:44.315997 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:44.315974 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-767d585f79-5pf8k"] Jun 03 00:27:44.318116 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:27:44.318090 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod186ba058_d978_4ea5_bfde_0a54c577f041.slice/crio-be156aab42de7e57df0b7b1f6c9e15420338c02bdfad50d982239f5102fb2cb6 WatchSource:0}: Error finding container be156aab42de7e57df0b7b1f6c9e15420338c02bdfad50d982239f5102fb2cb6: Status 404 returned error can't find the container with id be156aab42de7e57df0b7b1f6c9e15420338c02bdfad50d982239f5102fb2cb6 Jun 03 00:27:45.018306 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:45.018267 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-767d585f79-5pf8k" event={"ID":"186ba058-d978-4ea5-bfde-0a54c577f041","Type":"ContainerStarted","Data":"be156aab42de7e57df0b7b1f6c9e15420338c02bdfad50d982239f5102fb2cb6"} Jun 03 00:27:47.025761 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:47.025722 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-767d585f79-5pf8k" event={"ID":"186ba058-d978-4ea5-bfde-0a54c577f041","Type":"ContainerStarted","Data":"5ac5876e0edf18f20e2c839b4d8ee11bbb46f41cd6c70f4574748a4a08abbb4f"} Jun 03 00:27:47.041632 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:47.041574 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-767d585f79-5pf8k" podStartSLOduration=1.971154153 podStartE2EDuration="4.041555075s" podCreationTimestamp="2026-06-03 00:27:43 +0000 UTC" firstStartedPulling="2026-06-03 00:27:44.319346774 +0000 UTC m=+485.539269332" lastFinishedPulling="2026-06-03 00:27:46.389747687 +0000 UTC m=+487.609670254" observedRunningTime="2026-06-03 00:27:47.040558707 +0000 UTC m=+488.260481284" watchObservedRunningTime="2026-06-03 00:27:47.041555075 +0000 UTC m=+488.261477651" Jun 03 00:27:48.416047 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:48.416011 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjczjc"] Jun 03 00:27:48.419086 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:48.419066 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjczjc" Jun 03 00:27:48.421093 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:48.421062 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 00:27:48.421238 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:48.421123 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 00:27:48.421238 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:48.421148 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 03 00:27:48.421238 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:48.421186 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-qsc8l\"" Jun 03 00:27:48.427779 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:48.427675 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjczjc"] Jun 03 00:27:48.504606 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:48.504571 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bjczjc\" (UID: \"3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjczjc" Jun 03 00:27:48.504843 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:48.504624 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bjczjc\" (UID: \"3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjczjc" Jun 03 00:27:48.504843 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:48.504665 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bjczjc\" (UID: \"3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjczjc" Jun 03 00:27:48.504843 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:48.504736 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bjczjc\" (UID: \"3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjczjc" Jun 03 00:27:48.504843 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:48.504760 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bjczjc\" (UID: \"3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjczjc" Jun 03 00:27:48.504843 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:48.504835 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bjczjc\" (UID: \"3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjczjc" Jun 03 00:27:48.505029 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:48.504863 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bjczjc\" (UID: \"3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjczjc" Jun 03 00:27:48.505029 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:48.504916 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckbzv\" (UniqueName: \"kubernetes.io/projected/3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b-kube-api-access-ckbzv\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bjczjc\" (UID: \"3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjczjc" Jun 03 00:27:48.505029 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:48.504958 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bjczjc\" (UID: \"3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjczjc" Jun 03 00:27:48.605849 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:48.605813 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bjczjc\" (UID: \"3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjczjc" Jun 03 00:27:48.605849 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:48.605855 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bjczjc\" (UID: \"3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjczjc" Jun 03 00:27:48.606097 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:48.605880 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bjczjc\" (UID: \"3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjczjc" Jun 03 00:27:48.606097 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:48.605898 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bjczjc\" (UID: \"3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjczjc" Jun 03 00:27:48.606097 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:48.605916 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bjczjc\" (UID: \"3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjczjc" Jun 03 00:27:48.606097 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:48.605961 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bjczjc\" (UID: \"3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjczjc" Jun 03 00:27:48.606097 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:48.605980 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bjczjc\" (UID: \"3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjczjc" Jun 03 00:27:48.606097 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:48.606010 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ckbzv\" (UniqueName: \"kubernetes.io/projected/3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b-kube-api-access-ckbzv\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bjczjc\" (UID: \"3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjczjc" Jun 03 00:27:48.606097 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:48.606057 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bjczjc\" (UID: \"3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjczjc" Jun 03 00:27:48.606529 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:48.606357 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bjczjc\" (UID: \"3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjczjc" Jun 03 00:27:48.606529 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:48.606408 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bjczjc\" (UID: \"3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjczjc" Jun 03 00:27:48.606529 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:48.606450 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bjczjc\" (UID: \"3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjczjc" Jun 03 00:27:48.606719 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:48.606525 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bjczjc\" (UID: \"3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjczjc" Jun 03 00:27:48.606775 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:48.606719 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bjczjc\" (UID: \"3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjczjc" Jun 03 00:27:48.608336 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:48.608315 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bjczjc\" (UID: \"3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjczjc" Jun 03 00:27:48.608668 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:48.608647 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bjczjc\" (UID: \"3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjczjc" Jun 03 00:27:48.612921 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:48.612895 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bjczjc\" (UID: \"3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjczjc" Jun 03 00:27:48.613020 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:48.612961 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckbzv\" (UniqueName: \"kubernetes.io/projected/3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b-kube-api-access-ckbzv\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bjczjc\" (UID: \"3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjczjc" Jun 03 00:27:48.731047 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:48.731010 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjczjc" Jun 03 00:27:48.860702 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:48.860650 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjczjc"] Jun 03 00:27:48.865638 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:27:48.865614 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fb1455d_eb69_4c02_9b72_bdbdca6b4c4b.slice/crio-51b68b214a4ca476be0e7df18d891d60ca3f8f87bbcc466c5c09016cbdb54aeb WatchSource:0}: Error finding container 51b68b214a4ca476be0e7df18d891d60ca3f8f87bbcc466c5c09016cbdb54aeb: Status 404 returned error can't find the container with id 51b68b214a4ca476be0e7df18d891d60ca3f8f87bbcc466c5c09016cbdb54aeb Jun 03 00:27:49.033084 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:49.032996 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjczjc" event={"ID":"3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b","Type":"ContainerStarted","Data":"51b68b214a4ca476be0e7df18d891d60ca3f8f87bbcc466c5c09016cbdb54aeb"} Jun 03 00:27:51.382969 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:51.382932 2559 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 03 00:27:51.383286 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:51.383001 2559 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 03 00:27:51.383286 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:51.383029 2559 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 03 00:27:52.045609 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:52.045576 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjczjc" event={"ID":"3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b","Type":"ContainerStarted","Data":"b433c17c7eb581662fd74421fe3da7703b12350f09ab126615af413e81386104"} Jun 03 00:27:52.062736 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:52.062679 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjczjc" podStartSLOduration=1.5482098 podStartE2EDuration="4.06266254s" podCreationTimestamp="2026-06-03 00:27:48 +0000 UTC" firstStartedPulling="2026-06-03 00:27:48.86821224 +0000 UTC m=+490.088134796" lastFinishedPulling="2026-06-03 00:27:51.38266498 +0000 UTC m=+492.602587536" observedRunningTime="2026-06-03 00:27:52.061191567 +0000 UTC m=+493.281114142" watchObservedRunningTime="2026-06-03 00:27:52.06266254 +0000 UTC m=+493.282585116" Jun 03 00:27:52.731667 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:52.731628 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjczjc" Jun 03 00:27:52.736535 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:52.736510 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjczjc" Jun 03 00:27:53.049120 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:53.049045 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjczjc" Jun 03 00:27:53.049895 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:27:53.049877 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjczjc" Jun 03 00:28:09.061595 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:09.061559 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-d5v5s"] Jun 03 00:28:09.064294 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:09.064275 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-d5v5s" Jun 03 00:28:09.066533 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:09.066503 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 00:28:09.067207 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:09.067189 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-6bsf4\"" Jun 03 00:28:09.067311 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:09.067219 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 00:28:09.071183 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:09.071160 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-d5v5s"] Jun 03 00:28:09.192768 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:09.192734 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqn7f\" (UniqueName: \"kubernetes.io/projected/f04099c7-316f-4be1-a726-2544eaa8dc52-kube-api-access-gqn7f\") pod \"kuadrant-operator-catalog-d5v5s\" (UID: \"f04099c7-316f-4be1-a726-2544eaa8dc52\") " pod="kuadrant-system/kuadrant-operator-catalog-d5v5s" Jun 03 00:28:09.294129 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:09.294089 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gqn7f\" (UniqueName: \"kubernetes.io/projected/f04099c7-316f-4be1-a726-2544eaa8dc52-kube-api-access-gqn7f\") pod \"kuadrant-operator-catalog-d5v5s\" (UID: \"f04099c7-316f-4be1-a726-2544eaa8dc52\") " pod="kuadrant-system/kuadrant-operator-catalog-d5v5s" Jun 03 00:28:09.301159 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:09.301133 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqn7f\" (UniqueName: \"kubernetes.io/projected/f04099c7-316f-4be1-a726-2544eaa8dc52-kube-api-access-gqn7f\") pod \"kuadrant-operator-catalog-d5v5s\" (UID: \"f04099c7-316f-4be1-a726-2544eaa8dc52\") " pod="kuadrant-system/kuadrant-operator-catalog-d5v5s" Jun 03 00:28:09.375313 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:09.375230 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-d5v5s" Jun 03 00:28:09.434572 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:09.434525 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-d5v5s"] Jun 03 00:28:09.501384 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:09.501354 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-d5v5s"] Jun 03 00:28:09.505042 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:28:09.505009 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf04099c7_316f_4be1_a726_2544eaa8dc52.slice/crio-23bc439478db98ee6f8b95ecc274d93ae57e3033af9852cf8a4e3cd24d7849ca WatchSource:0}: Error finding container 23bc439478db98ee6f8b95ecc274d93ae57e3033af9852cf8a4e3cd24d7849ca: Status 404 returned error can't find the container with id 23bc439478db98ee6f8b95ecc274d93ae57e3033af9852cf8a4e3cd24d7849ca Jun 03 00:28:09.639906 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:09.639826 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zrwvz"] Jun 03 00:28:09.642860 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:09.642844 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zrwvz" Jun 03 00:28:09.651084 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:09.651058 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zrwvz"] Jun 03 00:28:09.697352 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:09.697305 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqqgd\" (UniqueName: \"kubernetes.io/projected/34920fad-5da4-4994-a55f-0f83ace8b250-kube-api-access-kqqgd\") pod \"kuadrant-operator-catalog-zrwvz\" (UID: \"34920fad-5da4-4994-a55f-0f83ace8b250\") " pod="kuadrant-system/kuadrant-operator-catalog-zrwvz" Jun 03 00:28:09.798383 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:09.798349 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kqqgd\" (UniqueName: \"kubernetes.io/projected/34920fad-5da4-4994-a55f-0f83ace8b250-kube-api-access-kqqgd\") pod \"kuadrant-operator-catalog-zrwvz\" (UID: \"34920fad-5da4-4994-a55f-0f83ace8b250\") " pod="kuadrant-system/kuadrant-operator-catalog-zrwvz" Jun 03 00:28:09.805867 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:09.805838 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqqgd\" (UniqueName: \"kubernetes.io/projected/34920fad-5da4-4994-a55f-0f83ace8b250-kube-api-access-kqqgd\") pod \"kuadrant-operator-catalog-zrwvz\" (UID: \"34920fad-5da4-4994-a55f-0f83ace8b250\") " pod="kuadrant-system/kuadrant-operator-catalog-zrwvz" Jun 03 00:28:09.953117 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:09.953024 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zrwvz" Jun 03 00:28:10.089389 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:10.089363 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zrwvz"] Jun 03 00:28:10.102194 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:10.102151 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-d5v5s" event={"ID":"f04099c7-316f-4be1-a726-2544eaa8dc52","Type":"ContainerStarted","Data":"23bc439478db98ee6f8b95ecc274d93ae57e3033af9852cf8a4e3cd24d7849ca"} Jun 03 00:28:10.113423 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:28:10.113392 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34920fad_5da4_4994_a55f_0f83ace8b250.slice/crio-7a3a2dc93ff90544549085572965377eb1ee2bc6e247e1a7f5ac040eeb6d6b86 WatchSource:0}: Error finding container 7a3a2dc93ff90544549085572965377eb1ee2bc6e247e1a7f5ac040eeb6d6b86: Status 404 returned error can't find the container with id 7a3a2dc93ff90544549085572965377eb1ee2bc6e247e1a7f5ac040eeb6d6b86 Jun 03 00:28:11.108160 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:11.108114 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zrwvz" event={"ID":"34920fad-5da4-4994-a55f-0f83ace8b250","Type":"ContainerStarted","Data":"7a3a2dc93ff90544549085572965377eb1ee2bc6e247e1a7f5ac040eeb6d6b86"} Jun 03 00:28:12.112741 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:12.112706 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-d5v5s" event={"ID":"f04099c7-316f-4be1-a726-2544eaa8dc52","Type":"ContainerStarted","Data":"e4236241026c3390dd047f55703b6681ce6db1cd78235800a95580044108e4c9"} Jun 03 00:28:12.113177 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:12.112765 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-d5v5s" podUID="f04099c7-316f-4be1-a726-2544eaa8dc52" containerName="registry-server" containerID="cri-o://e4236241026c3390dd047f55703b6681ce6db1cd78235800a95580044108e4c9" gracePeriod=2 Jun 03 00:28:12.114142 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:12.114119 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zrwvz" event={"ID":"34920fad-5da4-4994-a55f-0f83ace8b250","Type":"ContainerStarted","Data":"281211b2390c8242a367291c586b2a49199d5246f638f38c1cbc7fd474aded2c"} Jun 03 00:28:12.125535 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:12.125487 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-d5v5s" podStartSLOduration=0.667182283 podStartE2EDuration="3.125473072s" podCreationTimestamp="2026-06-03 00:28:09 +0000 UTC" firstStartedPulling="2026-06-03 00:28:09.506322926 +0000 UTC m=+510.726245492" lastFinishedPulling="2026-06-03 00:28:11.964613721 +0000 UTC m=+513.184536281" observedRunningTime="2026-06-03 00:28:12.124741112 +0000 UTC m=+513.344663688" watchObservedRunningTime="2026-06-03 00:28:12.125473072 +0000 UTC m=+513.345395654" Jun 03 00:28:12.137611 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:12.137565 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-zrwvz" podStartSLOduration=1.301558666 podStartE2EDuration="3.137550635s" podCreationTimestamp="2026-06-03 00:28:09 +0000 UTC" firstStartedPulling="2026-06-03 00:28:10.114649324 +0000 UTC m=+511.334571878" lastFinishedPulling="2026-06-03 00:28:11.950641281 +0000 UTC m=+513.170563847" observedRunningTime="2026-06-03 00:28:12.136538205 +0000 UTC m=+513.356460792" watchObservedRunningTime="2026-06-03 00:28:12.137550635 +0000 UTC m=+513.357473210" Jun 03 00:28:12.352910 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:12.352889 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-d5v5s_f04099c7-316f-4be1-a726-2544eaa8dc52/registry-server/0.log" Jun 03 00:28:12.353032 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:12.352943 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-d5v5s" Jun 03 00:28:12.422537 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:12.422510 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gqn7f\" (UniqueName: \"kubernetes.io/projected/f04099c7-316f-4be1-a726-2544eaa8dc52-kube-api-access-gqn7f\") pod \"f04099c7-316f-4be1-a726-2544eaa8dc52\" (UID: \"f04099c7-316f-4be1-a726-2544eaa8dc52\") " Jun 03 00:28:12.424657 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:12.424630 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f04099c7-316f-4be1-a726-2544eaa8dc52-kube-api-access-gqn7f" (OuterVolumeSpecName: "kube-api-access-gqn7f") pod "f04099c7-316f-4be1-a726-2544eaa8dc52" (UID: "f04099c7-316f-4be1-a726-2544eaa8dc52"). InnerVolumeSpecName "kube-api-access-gqn7f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 00:28:12.523921 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:12.523839 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqn7f\" (UniqueName: \"kubernetes.io/projected/f04099c7-316f-4be1-a726-2544eaa8dc52-kube-api-access-gqn7f\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Jun 03 00:28:13.118591 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:13.118564 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-d5v5s_f04099c7-316f-4be1-a726-2544eaa8dc52/registry-server/0.log" Jun 03 00:28:13.119007 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:13.118602 2559 generic.go:358] "Generic (PLEG): container finished" podID="f04099c7-316f-4be1-a726-2544eaa8dc52" containerID="e4236241026c3390dd047f55703b6681ce6db1cd78235800a95580044108e4c9" exitCode=1 Jun 03 00:28:13.119007 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:13.118669 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-d5v5s" Jun 03 00:28:13.119007 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:13.118716 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-d5v5s" event={"ID":"f04099c7-316f-4be1-a726-2544eaa8dc52","Type":"ContainerDied","Data":"e4236241026c3390dd047f55703b6681ce6db1cd78235800a95580044108e4c9"} Jun 03 00:28:13.119007 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:13.118756 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-d5v5s" event={"ID":"f04099c7-316f-4be1-a726-2544eaa8dc52","Type":"ContainerDied","Data":"23bc439478db98ee6f8b95ecc274d93ae57e3033af9852cf8a4e3cd24d7849ca"} Jun 03 00:28:13.119007 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:13.118775 2559 scope.go:117] "RemoveContainer" containerID="e4236241026c3390dd047f55703b6681ce6db1cd78235800a95580044108e4c9" Jun 03 00:28:13.127886 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:13.127867 2559 scope.go:117] "RemoveContainer" containerID="e4236241026c3390dd047f55703b6681ce6db1cd78235800a95580044108e4c9" Jun 03 00:28:13.128143 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:28:13.128126 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4236241026c3390dd047f55703b6681ce6db1cd78235800a95580044108e4c9\": container with ID starting with e4236241026c3390dd047f55703b6681ce6db1cd78235800a95580044108e4c9 not found: ID does not exist" containerID="e4236241026c3390dd047f55703b6681ce6db1cd78235800a95580044108e4c9" Jun 03 00:28:13.128193 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:13.128151 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4236241026c3390dd047f55703b6681ce6db1cd78235800a95580044108e4c9"} err="failed to get container status \"e4236241026c3390dd047f55703b6681ce6db1cd78235800a95580044108e4c9\": rpc error: code = NotFound desc = could not find container \"e4236241026c3390dd047f55703b6681ce6db1cd78235800a95580044108e4c9\": container with ID starting with e4236241026c3390dd047f55703b6681ce6db1cd78235800a95580044108e4c9 not found: ID does not exist" Jun 03 00:28:13.139267 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:13.139241 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-d5v5s"] Jun 03 00:28:13.140652 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:13.140632 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-d5v5s"] Jun 03 00:28:13.367663 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:13.367586 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f04099c7-316f-4be1-a726-2544eaa8dc52" path="/var/lib/kubelet/pods/f04099c7-316f-4be1-a726-2544eaa8dc52/volumes" Jun 03 00:28:19.953741 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:19.953671 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-zrwvz" Jun 03 00:28:19.953741 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:19.953748 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-zrwvz" Jun 03 00:28:19.976947 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:19.976923 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-zrwvz" Jun 03 00:28:20.166993 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:20.166965 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-zrwvz" Jun 03 00:28:41.001516 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:41.001479 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-fhw48"] Jun 03 00:28:41.001930 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:41.001867 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f04099c7-316f-4be1-a726-2544eaa8dc52" containerName="registry-server" Jun 03 00:28:41.001930 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:41.001879 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f04099c7-316f-4be1-a726-2544eaa8dc52" containerName="registry-server" Jun 03 00:28:41.002002 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:41.001938 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="f04099c7-316f-4be1-a726-2544eaa8dc52" containerName="registry-server" Jun 03 00:28:41.007176 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:41.007159 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-fhw48" Jun 03 00:28:41.009248 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:41.009229 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-8hzgz\"" Jun 03 00:28:41.009336 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:41.009259 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 03 00:28:41.012511 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:41.012486 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-fhw48"] Jun 03 00:28:41.066788 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:41.066749 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sb4f\" (UniqueName: \"kubernetes.io/projected/7b4a8516-74e7-4507-adb3-8668d0363b20-kube-api-access-8sb4f\") pod \"dns-operator-controller-manager-648d5c98bc-fhw48\" (UID: \"7b4a8516-74e7-4507-adb3-8668d0363b20\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-fhw48" Jun 03 00:28:41.167588 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:41.167550 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8sb4f\" (UniqueName: \"kubernetes.io/projected/7b4a8516-74e7-4507-adb3-8668d0363b20-kube-api-access-8sb4f\") pod \"dns-operator-controller-manager-648d5c98bc-fhw48\" (UID: \"7b4a8516-74e7-4507-adb3-8668d0363b20\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-fhw48" Jun 03 00:28:41.188890 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:41.188852 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sb4f\" (UniqueName: \"kubernetes.io/projected/7b4a8516-74e7-4507-adb3-8668d0363b20-kube-api-access-8sb4f\") pod \"dns-operator-controller-manager-648d5c98bc-fhw48\" (UID: \"7b4a8516-74e7-4507-adb3-8668d0363b20\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-fhw48" Jun 03 00:28:41.318297 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:41.318218 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-fhw48" Jun 03 00:28:41.447545 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:41.447522 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-fhw48"] Jun 03 00:28:41.449774 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:28:41.449735 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b4a8516_74e7_4507_adb3_8668d0363b20.slice/crio-c4268395226af7067d98c0719a57b8fe30933a80201ed1a29189e2c22357b3e0 WatchSource:0}: Error finding container c4268395226af7067d98c0719a57b8fe30933a80201ed1a29189e2c22357b3e0: Status 404 returned error can't find the container with id c4268395226af7067d98c0719a57b8fe30933a80201ed1a29189e2c22357b3e0 Jun 03 00:28:42.217770 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:42.217736 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-fhw48" event={"ID":"7b4a8516-74e7-4507-adb3-8668d0363b20","Type":"ContainerStarted","Data":"c4268395226af7067d98c0719a57b8fe30933a80201ed1a29189e2c22357b3e0"} Jun 03 00:28:44.227396 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:44.227358 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-fhw48" event={"ID":"7b4a8516-74e7-4507-adb3-8668d0363b20","Type":"ContainerStarted","Data":"b4f1112b15bc2884e7592284fb8c5a76984a2c6aa07d1350244e033ba7fd1f25"} Jun 03 00:28:44.227853 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:44.227433 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-fhw48" Jun 03 00:28:44.264086 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:44.264041 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-fhw48" podStartSLOduration=2.094519617 podStartE2EDuration="4.264025111s" podCreationTimestamp="2026-06-03 00:28:40 +0000 UTC" firstStartedPulling="2026-06-03 00:28:41.451677302 +0000 UTC m=+542.671599855" lastFinishedPulling="2026-06-03 00:28:43.621182792 +0000 UTC m=+544.841105349" observedRunningTime="2026-06-03 00:28:44.262155527 +0000 UTC m=+545.482078103" watchObservedRunningTime="2026-06-03 00:28:44.264025111 +0000 UTC m=+545.483947754" Jun 03 00:28:46.268238 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:46.268197 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lbt5h"] Jun 03 00:28:46.271226 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:46.271209 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lbt5h" Jun 03 00:28:46.273321 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:46.273302 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-pm8jw\"" Jun 03 00:28:46.281748 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:46.281722 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lbt5h"] Jun 03 00:28:46.303233 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:46.303198 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/59af7e15-49be-4800-8e7c-3fffbeb02458-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-lbt5h\" (UID: \"59af7e15-49be-4800-8e7c-3fffbeb02458\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lbt5h" Jun 03 00:28:46.303374 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:46.303302 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzz48\" (UniqueName: \"kubernetes.io/projected/59af7e15-49be-4800-8e7c-3fffbeb02458-kube-api-access-lzz48\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-lbt5h\" (UID: \"59af7e15-49be-4800-8e7c-3fffbeb02458\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lbt5h" Jun 03 00:28:46.404128 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:46.404090 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lzz48\" (UniqueName: \"kubernetes.io/projected/59af7e15-49be-4800-8e7c-3fffbeb02458-kube-api-access-lzz48\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-lbt5h\" (UID: \"59af7e15-49be-4800-8e7c-3fffbeb02458\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lbt5h" Jun 03 00:28:46.404303 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:46.404151 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/59af7e15-49be-4800-8e7c-3fffbeb02458-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-lbt5h\" (UID: \"59af7e15-49be-4800-8e7c-3fffbeb02458\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lbt5h" Jun 03 00:28:46.404493 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:46.404477 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/59af7e15-49be-4800-8e7c-3fffbeb02458-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-lbt5h\" (UID: \"59af7e15-49be-4800-8e7c-3fffbeb02458\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lbt5h" Jun 03 00:28:46.413787 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:46.413756 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzz48\" (UniqueName: \"kubernetes.io/projected/59af7e15-49be-4800-8e7c-3fffbeb02458-kube-api-access-lzz48\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-lbt5h\" (UID: \"59af7e15-49be-4800-8e7c-3fffbeb02458\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lbt5h" Jun 03 00:28:46.582714 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:46.582611 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lbt5h" Jun 03 00:28:46.742505 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:46.742478 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lbt5h"] Jun 03 00:28:46.744411 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:28:46.744380 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59af7e15_49be_4800_8e7c_3fffbeb02458.slice/crio-b5b7e6f8536512f3b47693721728f4f7375f0a3a0afaafaf8dc7d819ca1e7914 WatchSource:0}: Error finding container b5b7e6f8536512f3b47693721728f4f7375f0a3a0afaafaf8dc7d819ca1e7914: Status 404 returned error can't find the container with id b5b7e6f8536512f3b47693721728f4f7375f0a3a0afaafaf8dc7d819ca1e7914 Jun 03 00:28:47.244840 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:47.244805 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lbt5h" event={"ID":"59af7e15-49be-4800-8e7c-3fffbeb02458","Type":"ContainerStarted","Data":"b5b7e6f8536512f3b47693721728f4f7375f0a3a0afaafaf8dc7d819ca1e7914"} Jun 03 00:28:49.402252 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:49.402215 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-htpqk"] Jun 03 00:28:49.404661 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:49.404639 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-htpqk" Jun 03 00:28:49.406966 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:49.406944 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-kvwg8\"" Jun 03 00:28:49.413873 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:49.413833 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-htpqk"] Jun 03 00:28:49.426518 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:49.426486 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hclgn\" (UniqueName: \"kubernetes.io/projected/acd5ab00-b94c-4d79-a814-98cba5228d20-kube-api-access-hclgn\") pod \"limitador-operator-controller-manager-85c4996f8c-htpqk\" (UID: \"acd5ab00-b94c-4d79-a814-98cba5228d20\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-htpqk" Jun 03 00:28:49.527405 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:49.527371 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hclgn\" (UniqueName: \"kubernetes.io/projected/acd5ab00-b94c-4d79-a814-98cba5228d20-kube-api-access-hclgn\") pod \"limitador-operator-controller-manager-85c4996f8c-htpqk\" (UID: \"acd5ab00-b94c-4d79-a814-98cba5228d20\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-htpqk" Jun 03 00:28:49.536565 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:49.536536 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hclgn\" (UniqueName: \"kubernetes.io/projected/acd5ab00-b94c-4d79-a814-98cba5228d20-kube-api-access-hclgn\") pod \"limitador-operator-controller-manager-85c4996f8c-htpqk\" (UID: \"acd5ab00-b94c-4d79-a814-98cba5228d20\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-htpqk" Jun 03 00:28:49.718919 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:49.718835 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-htpqk" Jun 03 00:28:49.853649 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:49.853623 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-htpqk"] Jun 03 00:28:49.856409 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:28:49.856380 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacd5ab00_b94c_4d79_a814_98cba5228d20.slice/crio-e2e78b3578007876296eb24cdad4f94259ab5a17a182ab252fe44870f11183c3 WatchSource:0}: Error finding container e2e78b3578007876296eb24cdad4f94259ab5a17a182ab252fe44870f11183c3: Status 404 returned error can't find the container with id e2e78b3578007876296eb24cdad4f94259ab5a17a182ab252fe44870f11183c3 Jun 03 00:28:50.257746 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:50.257711 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-htpqk" event={"ID":"acd5ab00-b94c-4d79-a814-98cba5228d20","Type":"ContainerStarted","Data":"e2e78b3578007876296eb24cdad4f94259ab5a17a182ab252fe44870f11183c3"} Jun 03 00:28:53.269333 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:53.269294 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lbt5h" event={"ID":"59af7e15-49be-4800-8e7c-3fffbeb02458","Type":"ContainerStarted","Data":"b855a37aa414a76e99190bd63d612bd7436ecab43bb5feb0e28758245dfa6860"} Jun 03 00:28:53.269779 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:53.269514 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lbt5h" Jun 03 00:28:53.270735 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:53.270711 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-htpqk" event={"ID":"acd5ab00-b94c-4d79-a814-98cba5228d20","Type":"ContainerStarted","Data":"3d0ed0b732732db10286fb8742806d4e793b977c6df0a6ac2bef8959556a54f0"} Jun 03 00:28:53.270870 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:53.270858 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-htpqk" Jun 03 00:28:53.290310 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:53.290260 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lbt5h" podStartSLOduration=1.737870308 podStartE2EDuration="7.29024428s" podCreationTimestamp="2026-06-03 00:28:46 +0000 UTC" firstStartedPulling="2026-06-03 00:28:46.746862476 +0000 UTC m=+547.966785028" lastFinishedPulling="2026-06-03 00:28:52.299236437 +0000 UTC m=+553.519159000" observedRunningTime="2026-06-03 00:28:53.287412851 +0000 UTC m=+554.507335426" watchObservedRunningTime="2026-06-03 00:28:53.29024428 +0000 UTC m=+554.510166856" Jun 03 00:28:53.301980 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:53.301930 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-htpqk" podStartSLOduration=1.875140441 podStartE2EDuration="4.301918144s" podCreationTimestamp="2026-06-03 00:28:49 +0000 UTC" firstStartedPulling="2026-06-03 00:28:49.858480175 +0000 UTC m=+551.078402731" lastFinishedPulling="2026-06-03 00:28:52.28525788 +0000 UTC m=+553.505180434" observedRunningTime="2026-06-03 00:28:53.301165865 +0000 UTC m=+554.521088442" watchObservedRunningTime="2026-06-03 00:28:53.301918144 +0000 UTC m=+554.521840742" Jun 03 00:28:55.233068 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:28:55.233036 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-fhw48" Jun 03 00:29:04.276434 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:04.276395 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lbt5h" Jun 03 00:29:04.276847 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:04.276552 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-htpqk" Jun 03 00:29:06.023337 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.023297 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lbt5h"] Jun 03 00:29:06.023774 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.023567 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lbt5h" podUID="59af7e15-49be-4800-8e7c-3fffbeb02458" containerName="manager" containerID="cri-o://b855a37aa414a76e99190bd63d612bd7436ecab43bb5feb0e28758245dfa6860" gracePeriod=2 Jun 03 00:29:06.031060 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.030998 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lbt5h"] Jun 03 00:29:06.039934 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.039902 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-htpqk"] Jun 03 00:29:06.040221 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.040196 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-htpqk" podUID="acd5ab00-b94c-4d79-a814-98cba5228d20" containerName="manager" containerID="cri-o://3d0ed0b732732db10286fb8742806d4e793b977c6df0a6ac2bef8959556a54f0" gracePeriod=2 Jun 03 00:29:06.042037 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.042004 2559 status_manager.go:895] "Failed to get status for pod" podUID="59af7e15-49be-4800-8e7c-3fffbeb02458" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lbt5h" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-lbt5h\" is forbidden: User \"system:node:ip-10-0-130-219.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-219.ec2.internal' and this object" Jun 03 00:29:06.043989 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.043862 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8t6k"] Jun 03 00:29:06.044435 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.044413 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59af7e15-49be-4800-8e7c-3fffbeb02458" containerName="manager" Jun 03 00:29:06.044435 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.044437 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="59af7e15-49be-4800-8e7c-3fffbeb02458" containerName="manager" Jun 03 00:29:06.044567 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.044516 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="59af7e15-49be-4800-8e7c-3fffbeb02458" containerName="manager" Jun 03 00:29:06.047749 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.047733 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8t6k" Jun 03 00:29:06.051618 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.051585 2559 status_manager.go:895] "Failed to get status for pod" podUID="acd5ab00-b94c-4d79-a814-98cba5228d20" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-htpqk" err="pods \"limitador-operator-controller-manager-85c4996f8c-htpqk\" is forbidden: User \"system:node:ip-10-0-130-219.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-219.ec2.internal' and this object" Jun 03 00:29:06.053135 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.053068 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-htpqk"] Jun 03 00:29:06.053309 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.053288 2559 status_manager.go:895] "Failed to get status for pod" podUID="59af7e15-49be-4800-8e7c-3fffbeb02458" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lbt5h" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-lbt5h\" is forbidden: User \"system:node:ip-10-0-130-219.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-219.ec2.internal' and this object" Jun 03 00:29:06.056542 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.056520 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8t6k"] Jun 03 00:29:06.064301 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.064279 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jnf2t"] Jun 03 00:29:06.064616 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.064604 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acd5ab00-b94c-4d79-a814-98cba5228d20" containerName="manager" Jun 03 00:29:06.064661 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.064617 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="acd5ab00-b94c-4d79-a814-98cba5228d20" containerName="manager" Jun 03 00:29:06.064740 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.064709 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="acd5ab00-b94c-4d79-a814-98cba5228d20" containerName="manager" Jun 03 00:29:06.067587 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.067570 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jnf2t" Jun 03 00:29:06.081352 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.081325 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jnf2t"] Jun 03 00:29:06.081697 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.081653 2559 status_manager.go:895] "Failed to get status for pod" podUID="59af7e15-49be-4800-8e7c-3fffbeb02458" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lbt5h" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-lbt5h\" is forbidden: User \"system:node:ip-10-0-130-219.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-219.ec2.internal' and this object" Jun 03 00:29:06.097613 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.097580 2559 status_manager.go:895] "Failed to get status for pod" podUID="acd5ab00-b94c-4d79-a814-98cba5228d20" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-htpqk" err="pods \"limitador-operator-controller-manager-85c4996f8c-htpqk\" is forbidden: User \"system:node:ip-10-0-130-219.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-219.ec2.internal' and this object" Jun 03 00:29:06.188917 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.188875 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxkzx\" (UniqueName: \"kubernetes.io/projected/f46a74e7-2bc1-4b40-b0ee-275bb61cead5-kube-api-access-bxkzx\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-n8t6k\" (UID: \"f46a74e7-2bc1-4b40-b0ee-275bb61cead5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8t6k" Jun 03 00:29:06.188917 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.188920 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f46a74e7-2bc1-4b40-b0ee-275bb61cead5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-n8t6k\" (UID: \"f46a74e7-2bc1-4b40-b0ee-275bb61cead5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8t6k" Jun 03 00:29:06.189176 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.189151 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5d2r\" (UniqueName: \"kubernetes.io/projected/eeb8055c-da6a-4aea-8162-25cca5ee19c5-kube-api-access-q5d2r\") pod \"limitador-operator-controller-manager-85c4996f8c-jnf2t\" (UID: \"eeb8055c-da6a-4aea-8162-25cca5ee19c5\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jnf2t" Jun 03 00:29:06.281043 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.280976 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lbt5h" Jun 03 00:29:06.281957 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.281932 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-w84xj"] Jun 03 00:29:06.282789 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.282752 2559 status_manager.go:895] "Failed to get status for pod" podUID="acd5ab00-b94c-4d79-a814-98cba5228d20" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-htpqk" err="pods \"limitador-operator-controller-manager-85c4996f8c-htpqk\" is forbidden: User \"system:node:ip-10-0-130-219.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-219.ec2.internal' and this object" Jun 03 00:29:06.284372 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.284353 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-htpqk" Jun 03 00:29:06.284441 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.284399 2559 status_manager.go:895] "Failed to get status for pod" podUID="59af7e15-49be-4800-8e7c-3fffbeb02458" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lbt5h" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-lbt5h\" is forbidden: User \"system:node:ip-10-0-130-219.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-219.ec2.internal' and this object" Jun 03 00:29:06.285500 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.285481 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-w84xj" Jun 03 00:29:06.285936 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.285907 2559 status_manager.go:895] "Failed to get status for pod" podUID="acd5ab00-b94c-4d79-a814-98cba5228d20" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-htpqk" err="pods \"limitador-operator-controller-manager-85c4996f8c-htpqk\" is forbidden: User \"system:node:ip-10-0-130-219.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-219.ec2.internal' and this object" Jun 03 00:29:06.287304 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.287282 2559 status_manager.go:895] "Failed to get status for pod" podUID="59af7e15-49be-4800-8e7c-3fffbeb02458" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lbt5h" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-lbt5h\" is forbidden: User \"system:node:ip-10-0-130-219.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-219.ec2.internal' and this object" Jun 03 00:29:06.288944 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.288923 2559 status_manager.go:895] "Failed to get status for pod" podUID="59af7e15-49be-4800-8e7c-3fffbeb02458" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lbt5h" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-lbt5h\" is forbidden: User \"system:node:ip-10-0-130-219.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-219.ec2.internal' and this object" Jun 03 00:29:06.290313 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.290291 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q5d2r\" (UniqueName: \"kubernetes.io/projected/eeb8055c-da6a-4aea-8162-25cca5ee19c5-kube-api-access-q5d2r\") pod \"limitador-operator-controller-manager-85c4996f8c-jnf2t\" (UID: \"eeb8055c-da6a-4aea-8162-25cca5ee19c5\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jnf2t" Jun 03 00:29:06.290387 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.290335 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bxkzx\" (UniqueName: \"kubernetes.io/projected/f46a74e7-2bc1-4b40-b0ee-275bb61cead5-kube-api-access-bxkzx\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-n8t6k\" (UID: \"f46a74e7-2bc1-4b40-b0ee-275bb61cead5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8t6k" Jun 03 00:29:06.290445 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.290431 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f46a74e7-2bc1-4b40-b0ee-275bb61cead5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-n8t6k\" (UID: \"f46a74e7-2bc1-4b40-b0ee-275bb61cead5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8t6k" Jun 03 00:29:06.290896 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.290873 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f46a74e7-2bc1-4b40-b0ee-275bb61cead5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-n8t6k\" (UID: \"f46a74e7-2bc1-4b40-b0ee-275bb61cead5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8t6k" Jun 03 00:29:06.296648 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.296623 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-w84xj"] Jun 03 00:29:06.302553 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.302520 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxkzx\" (UniqueName: \"kubernetes.io/projected/f46a74e7-2bc1-4b40-b0ee-275bb61cead5-kube-api-access-bxkzx\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-n8t6k\" (UID: \"f46a74e7-2bc1-4b40-b0ee-275bb61cead5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8t6k" Jun 03 00:29:06.302648 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.302600 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5d2r\" (UniqueName: \"kubernetes.io/projected/eeb8055c-da6a-4aea-8162-25cca5ee19c5-kube-api-access-q5d2r\") pod \"limitador-operator-controller-manager-85c4996f8c-jnf2t\" (UID: \"eeb8055c-da6a-4aea-8162-25cca5ee19c5\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jnf2t" Jun 03 00:29:06.312997 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.312962 2559 status_manager.go:895] "Failed to get status for pod" podUID="acd5ab00-b94c-4d79-a814-98cba5228d20" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-htpqk" err="pods \"limitador-operator-controller-manager-85c4996f8c-htpqk\" is forbidden: User \"system:node:ip-10-0-130-219.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-219.ec2.internal' and this object" Jun 03 00:29:06.316003 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.315977 2559 generic.go:358] "Generic (PLEG): container finished" podID="59af7e15-49be-4800-8e7c-3fffbeb02458" containerID="b855a37aa414a76e99190bd63d612bd7436ecab43bb5feb0e28758245dfa6860" exitCode=0 Jun 03 00:29:06.316089 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.316024 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lbt5h" Jun 03 00:29:06.316089 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.316071 2559 scope.go:117] "RemoveContainer" containerID="b855a37aa414a76e99190bd63d612bd7436ecab43bb5feb0e28758245dfa6860" Jun 03 00:29:06.317189 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.317166 2559 generic.go:358] "Generic (PLEG): container finished" podID="acd5ab00-b94c-4d79-a814-98cba5228d20" containerID="3d0ed0b732732db10286fb8742806d4e793b977c6df0a6ac2bef8959556a54f0" exitCode=0 Jun 03 00:29:06.317289 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.317220 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-htpqk" Jun 03 00:29:06.317911 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.317890 2559 status_manager.go:895] "Failed to get status for pod" podUID="acd5ab00-b94c-4d79-a814-98cba5228d20" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-htpqk" err="pods \"limitador-operator-controller-manager-85c4996f8c-htpqk\" is forbidden: User \"system:node:ip-10-0-130-219.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-219.ec2.internal' and this object" Jun 03 00:29:06.319251 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.319232 2559 status_manager.go:895] "Failed to get status for pod" podUID="59af7e15-49be-4800-8e7c-3fffbeb02458" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lbt5h" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-lbt5h\" is forbidden: User \"system:node:ip-10-0-130-219.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-219.ec2.internal' and this object" Jun 03 00:29:06.320593 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.320572 2559 status_manager.go:895] "Failed to get status for pod" podUID="59af7e15-49be-4800-8e7c-3fffbeb02458" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lbt5h" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-lbt5h\" is forbidden: User \"system:node:ip-10-0-130-219.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-219.ec2.internal' and this object" Jun 03 00:29:06.321991 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.321972 2559 status_manager.go:895] "Failed to get status for pod" podUID="acd5ab00-b94c-4d79-a814-98cba5228d20" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-htpqk" err="pods \"limitador-operator-controller-manager-85c4996f8c-htpqk\" is forbidden: User \"system:node:ip-10-0-130-219.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-219.ec2.internal' and this object" Jun 03 00:29:06.324724 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.324708 2559 scope.go:117] "RemoveContainer" containerID="b855a37aa414a76e99190bd63d612bd7436ecab43bb5feb0e28758245dfa6860" Jun 03 00:29:06.324999 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:29:06.324979 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b855a37aa414a76e99190bd63d612bd7436ecab43bb5feb0e28758245dfa6860\": container with ID starting with b855a37aa414a76e99190bd63d612bd7436ecab43bb5feb0e28758245dfa6860 not found: ID does not exist" containerID="b855a37aa414a76e99190bd63d612bd7436ecab43bb5feb0e28758245dfa6860" Jun 03 00:29:06.325086 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.325007 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b855a37aa414a76e99190bd63d612bd7436ecab43bb5feb0e28758245dfa6860"} err="failed to get container status \"b855a37aa414a76e99190bd63d612bd7436ecab43bb5feb0e28758245dfa6860\": rpc error: code = NotFound desc = could not find container \"b855a37aa414a76e99190bd63d612bd7436ecab43bb5feb0e28758245dfa6860\": container with ID starting with b855a37aa414a76e99190bd63d612bd7436ecab43bb5feb0e28758245dfa6860 not found: ID does not exist" Jun 03 00:29:06.325086 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.325027 2559 scope.go:117] "RemoveContainer" containerID="3d0ed0b732732db10286fb8742806d4e793b977c6df0a6ac2bef8959556a54f0" Jun 03 00:29:06.332604 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.332585 2559 scope.go:117] "RemoveContainer" containerID="3d0ed0b732732db10286fb8742806d4e793b977c6df0a6ac2bef8959556a54f0" Jun 03 00:29:06.332904 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:29:06.332885 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d0ed0b732732db10286fb8742806d4e793b977c6df0a6ac2bef8959556a54f0\": container with ID starting with 3d0ed0b732732db10286fb8742806d4e793b977c6df0a6ac2bef8959556a54f0 not found: ID does not exist" containerID="3d0ed0b732732db10286fb8742806d4e793b977c6df0a6ac2bef8959556a54f0" Jun 03 00:29:06.332975 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.332914 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d0ed0b732732db10286fb8742806d4e793b977c6df0a6ac2bef8959556a54f0"} err="failed to get container status \"3d0ed0b732732db10286fb8742806d4e793b977c6df0a6ac2bef8959556a54f0\": rpc error: code = NotFound desc = could not find container \"3d0ed0b732732db10286fb8742806d4e793b977c6df0a6ac2bef8959556a54f0\": container with ID starting with 3d0ed0b732732db10286fb8742806d4e793b977c6df0a6ac2bef8959556a54f0 not found: ID does not exist" Jun 03 00:29:06.391631 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.391591 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzz48\" (UniqueName: \"kubernetes.io/projected/59af7e15-49be-4800-8e7c-3fffbeb02458-kube-api-access-lzz48\") pod \"59af7e15-49be-4800-8e7c-3fffbeb02458\" (UID: \"59af7e15-49be-4800-8e7c-3fffbeb02458\") " Jun 03 00:29:06.391631 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.391632 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hclgn\" (UniqueName: \"kubernetes.io/projected/acd5ab00-b94c-4d79-a814-98cba5228d20-kube-api-access-hclgn\") pod \"acd5ab00-b94c-4d79-a814-98cba5228d20\" (UID: \"acd5ab00-b94c-4d79-a814-98cba5228d20\") " Jun 03 00:29:06.391878 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.391672 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/59af7e15-49be-4800-8e7c-3fffbeb02458-extensions-socket-volume\") pod \"59af7e15-49be-4800-8e7c-3fffbeb02458\" (UID: \"59af7e15-49be-4800-8e7c-3fffbeb02458\") " Jun 03 00:29:06.391932 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.391912 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5bd89fa2-5964-42fb-9c1a-e62e079afdc9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-w84xj\" (UID: \"5bd89fa2-5964-42fb-9c1a-e62e079afdc9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-w84xj" Jun 03 00:29:06.392142 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.392117 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7nrg\" (UniqueName: \"kubernetes.io/projected/5bd89fa2-5964-42fb-9c1a-e62e079afdc9-kube-api-access-v7nrg\") pod \"kuadrant-operator-controller-manager-55c7f4c975-w84xj\" (UID: \"5bd89fa2-5964-42fb-9c1a-e62e079afdc9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-w84xj" Jun 03 00:29:06.392270 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.392249 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59af7e15-49be-4800-8e7c-3fffbeb02458-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "59af7e15-49be-4800-8e7c-3fffbeb02458" (UID: "59af7e15-49be-4800-8e7c-3fffbeb02458"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 00:29:06.393839 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.393814 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acd5ab00-b94c-4d79-a814-98cba5228d20-kube-api-access-hclgn" (OuterVolumeSpecName: "kube-api-access-hclgn") pod "acd5ab00-b94c-4d79-a814-98cba5228d20" (UID: "acd5ab00-b94c-4d79-a814-98cba5228d20"). InnerVolumeSpecName "kube-api-access-hclgn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 00:29:06.393922 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.393819 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59af7e15-49be-4800-8e7c-3fffbeb02458-kube-api-access-lzz48" (OuterVolumeSpecName: "kube-api-access-lzz48") pod "59af7e15-49be-4800-8e7c-3fffbeb02458" (UID: "59af7e15-49be-4800-8e7c-3fffbeb02458"). InnerVolumeSpecName "kube-api-access-lzz48". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 00:29:06.469249 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.469212 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8t6k" Jun 03 00:29:06.477040 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.477020 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jnf2t" Jun 03 00:29:06.493037 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.493008 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v7nrg\" (UniqueName: \"kubernetes.io/projected/5bd89fa2-5964-42fb-9c1a-e62e079afdc9-kube-api-access-v7nrg\") pod \"kuadrant-operator-controller-manager-55c7f4c975-w84xj\" (UID: \"5bd89fa2-5964-42fb-9c1a-e62e079afdc9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-w84xj" Jun 03 00:29:06.493177 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.493048 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5bd89fa2-5964-42fb-9c1a-e62e079afdc9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-w84xj\" (UID: \"5bd89fa2-5964-42fb-9c1a-e62e079afdc9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-w84xj" Jun 03 00:29:06.493177 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.493101 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzz48\" (UniqueName: \"kubernetes.io/projected/59af7e15-49be-4800-8e7c-3fffbeb02458-kube-api-access-lzz48\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Jun 03 00:29:06.493177 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.493112 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hclgn\" (UniqueName: \"kubernetes.io/projected/acd5ab00-b94c-4d79-a814-98cba5228d20-kube-api-access-hclgn\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Jun 03 00:29:06.493177 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.493125 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/59af7e15-49be-4800-8e7c-3fffbeb02458-extensions-socket-volume\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Jun 03 00:29:06.493434 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.493413 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5bd89fa2-5964-42fb-9c1a-e62e079afdc9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-w84xj\" (UID: \"5bd89fa2-5964-42fb-9c1a-e62e079afdc9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-w84xj" Jun 03 00:29:06.503434 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.503403 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7nrg\" (UniqueName: \"kubernetes.io/projected/5bd89fa2-5964-42fb-9c1a-e62e079afdc9-kube-api-access-v7nrg\") pod \"kuadrant-operator-controller-manager-55c7f4c975-w84xj\" (UID: \"5bd89fa2-5964-42fb-9c1a-e62e079afdc9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-w84xj" Jun 03 00:29:06.597758 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.597725 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-w84xj" Jun 03 00:29:06.622668 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.622529 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8t6k"] Jun 03 00:29:06.626608 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:29:06.626565 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf46a74e7_2bc1_4b40_b0ee_275bb61cead5.slice/crio-ddb8333bb5a501546c1bed8f56413075a1f61fde3650029999aac92e27920375 WatchSource:0}: Error finding container ddb8333bb5a501546c1bed8f56413075a1f61fde3650029999aac92e27920375: Status 404 returned error can't find the container with id ddb8333bb5a501546c1bed8f56413075a1f61fde3650029999aac92e27920375 Jun 03 00:29:06.633299 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.633256 2559 status_manager.go:895] "Failed to get status for pod" podUID="59af7e15-49be-4800-8e7c-3fffbeb02458" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lbt5h" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-lbt5h\" is forbidden: User \"system:node:ip-10-0-130-219.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-219.ec2.internal' and this object" Jun 03 00:29:06.634743 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.634713 2559 status_manager.go:895] "Failed to get status for pod" podUID="acd5ab00-b94c-4d79-a814-98cba5228d20" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-htpqk" err="pods \"limitador-operator-controller-manager-85c4996f8c-htpqk\" is forbidden: User \"system:node:ip-10-0-130-219.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-219.ec2.internal' and this object" Jun 03 00:29:06.636100 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.636073 2559 status_manager.go:895] "Failed to get status for pod" podUID="acd5ab00-b94c-4d79-a814-98cba5228d20" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-htpqk" err="pods \"limitador-operator-controller-manager-85c4996f8c-htpqk\" is forbidden: User \"system:node:ip-10-0-130-219.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-219.ec2.internal' and this object" Jun 03 00:29:06.636214 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.636190 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jnf2t"] Jun 03 00:29:06.637205 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:29:06.637179 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeb8055c_da6a_4aea_8162_25cca5ee19c5.slice/crio-fbfb07e9c78e6c93fceed19016753e24b95208a2b51d6bd2effbb452320fe4a1 WatchSource:0}: Error finding container fbfb07e9c78e6c93fceed19016753e24b95208a2b51d6bd2effbb452320fe4a1: Status 404 returned error can't find the container with id fbfb07e9c78e6c93fceed19016753e24b95208a2b51d6bd2effbb452320fe4a1 Jun 03 00:29:06.637888 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.637834 2559 status_manager.go:895] "Failed to get status for pod" podUID="59af7e15-49be-4800-8e7c-3fffbeb02458" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lbt5h" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-lbt5h\" is forbidden: User \"system:node:ip-10-0-130-219.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-219.ec2.internal' and this object" Jun 03 00:29:06.745774 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:06.745749 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-w84xj"] Jun 03 00:29:06.748129 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:29:06.748103 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bd89fa2_5964_42fb_9c1a_e62e079afdc9.slice/crio-2040d502aca3c60f60631482dc30b6469aa26cc73bb35620bb56f23217dc670e WatchSource:0}: Error finding container 2040d502aca3c60f60631482dc30b6469aa26cc73bb35620bb56f23217dc670e: Status 404 returned error can't find the container with id 2040d502aca3c60f60631482dc30b6469aa26cc73bb35620bb56f23217dc670e Jun 03 00:29:07.322198 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:07.322162 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jnf2t" event={"ID":"eeb8055c-da6a-4aea-8162-25cca5ee19c5","Type":"ContainerStarted","Data":"6c3bba3e87a3d22d8c6b91006b56132b039e68cf19645ff121e16b927b32249f"} Jun 03 00:29:07.322198 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:07.322200 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jnf2t" event={"ID":"eeb8055c-da6a-4aea-8162-25cca5ee19c5","Type":"ContainerStarted","Data":"fbfb07e9c78e6c93fceed19016753e24b95208a2b51d6bd2effbb452320fe4a1"} Jun 03 00:29:07.322727 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:07.322220 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jnf2t" Jun 03 00:29:07.323663 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:07.323631 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-w84xj" event={"ID":"5bd89fa2-5964-42fb-9c1a-e62e079afdc9","Type":"ContainerStarted","Data":"d045d9be78d8f9858994a3ef8c4c8927332b32e2dfd3ec431b7ec2d0a7c78f45"} Jun 03 00:29:07.323791 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:07.323665 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-w84xj" event={"ID":"5bd89fa2-5964-42fb-9c1a-e62e079afdc9","Type":"ContainerStarted","Data":"2040d502aca3c60f60631482dc30b6469aa26cc73bb35620bb56f23217dc670e"} Jun 03 00:29:07.323791 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:07.323707 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-w84xj" Jun 03 00:29:07.324056 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:07.324029 2559 status_manager.go:895] "Failed to get status for pod" podUID="59af7e15-49be-4800-8e7c-3fffbeb02458" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lbt5h" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-lbt5h\" is forbidden: User \"system:node:ip-10-0-130-219.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-219.ec2.internal' and this object" Jun 03 00:29:07.325738 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:07.325717 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8t6k" event={"ID":"f46a74e7-2bc1-4b40-b0ee-275bb61cead5","Type":"ContainerStarted","Data":"5b4fd5f2372ca161a3376a4589eac5f31bf79382c0b6afa7123121d40308761f"} Jun 03 00:29:07.325825 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:07.325745 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8t6k" event={"ID":"f46a74e7-2bc1-4b40-b0ee-275bb61cead5","Type":"ContainerStarted","Data":"ddb8333bb5a501546c1bed8f56413075a1f61fde3650029999aac92e27920375"} Jun 03 00:29:07.325825 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:07.325818 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8t6k" Jun 03 00:29:07.336486 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:07.336435 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jnf2t" podStartSLOduration=1.3364222620000001 podStartE2EDuration="1.336422262s" podCreationTimestamp="2026-06-03 00:29:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 00:29:07.336071492 +0000 UTC m=+568.555994068" watchObservedRunningTime="2026-06-03 00:29:07.336422262 +0000 UTC m=+568.556344877" Jun 03 00:29:07.337664 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:07.337632 2559 status_manager.go:895] "Failed to get status for pod" podUID="acd5ab00-b94c-4d79-a814-98cba5228d20" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-htpqk" err="pods \"limitador-operator-controller-manager-85c4996f8c-htpqk\" is forbidden: User \"system:node:ip-10-0-130-219.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-219.ec2.internal' and this object" Jun 03 00:29:07.339160 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:07.339139 2559 status_manager.go:895] "Failed to get status for pod" podUID="acd5ab00-b94c-4d79-a814-98cba5228d20" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-htpqk" err="pods \"limitador-operator-controller-manager-85c4996f8c-htpqk\" is forbidden: User \"system:node:ip-10-0-130-219.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-219.ec2.internal' and this object" Jun 03 00:29:07.340545 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:07.340526 2559 status_manager.go:895] "Failed to get status for pod" podUID="59af7e15-49be-4800-8e7c-3fffbeb02458" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lbt5h" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-lbt5h\" is forbidden: User \"system:node:ip-10-0-130-219.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-219.ec2.internal' and this object" Jun 03 00:29:07.362211 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:07.362149 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8t6k" podStartSLOduration=1.3621360789999999 podStartE2EDuration="1.362136079s" podCreationTimestamp="2026-06-03 00:29:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 00:29:07.361436793 +0000 UTC m=+568.581359368" watchObservedRunningTime="2026-06-03 00:29:07.362136079 +0000 UTC m=+568.582058654" Jun 03 00:29:07.368575 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:07.368546 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59af7e15-49be-4800-8e7c-3fffbeb02458" path="/var/lib/kubelet/pods/59af7e15-49be-4800-8e7c-3fffbeb02458/volumes" Jun 03 00:29:07.368925 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:07.368912 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="acd5ab00-b94c-4d79-a814-98cba5228d20" path="/var/lib/kubelet/pods/acd5ab00-b94c-4d79-a814-98cba5228d20/volumes" Jun 03 00:29:07.379066 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:07.379025 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-w84xj" podStartSLOduration=1.379011113 podStartE2EDuration="1.379011113s" podCreationTimestamp="2026-06-03 00:29:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 00:29:07.376760766 +0000 UTC m=+568.596683341" watchObservedRunningTime="2026-06-03 00:29:07.379011113 +0000 UTC m=+568.598933682" Jun 03 00:29:18.332697 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:18.332662 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8t6k" Jun 03 00:29:18.333123 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:18.332874 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jnf2t" Jun 03 00:29:18.333123 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:18.332909 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-w84xj" Jun 03 00:29:18.412098 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:18.412068 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8t6k"] Jun 03 00:29:18.412329 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:18.412288 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8t6k" podUID="f46a74e7-2bc1-4b40-b0ee-275bb61cead5" containerName="manager" containerID="cri-o://5b4fd5f2372ca161a3376a4589eac5f31bf79382c0b6afa7123121d40308761f" gracePeriod=10 Jun 03 00:29:18.679460 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:18.679408 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8t6k" Jun 03 00:29:18.812972 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:18.812935 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxkzx\" (UniqueName: \"kubernetes.io/projected/f46a74e7-2bc1-4b40-b0ee-275bb61cead5-kube-api-access-bxkzx\") pod \"f46a74e7-2bc1-4b40-b0ee-275bb61cead5\" (UID: \"f46a74e7-2bc1-4b40-b0ee-275bb61cead5\") " Jun 03 00:29:18.813148 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:18.813001 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f46a74e7-2bc1-4b40-b0ee-275bb61cead5-extensions-socket-volume\") pod \"f46a74e7-2bc1-4b40-b0ee-275bb61cead5\" (UID: \"f46a74e7-2bc1-4b40-b0ee-275bb61cead5\") " Jun 03 00:29:18.813369 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:18.813342 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f46a74e7-2bc1-4b40-b0ee-275bb61cead5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f46a74e7-2bc1-4b40-b0ee-275bb61cead5" (UID: "f46a74e7-2bc1-4b40-b0ee-275bb61cead5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 00:29:18.815070 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:18.815046 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f46a74e7-2bc1-4b40-b0ee-275bb61cead5-kube-api-access-bxkzx" (OuterVolumeSpecName: "kube-api-access-bxkzx") pod "f46a74e7-2bc1-4b40-b0ee-275bb61cead5" (UID: "f46a74e7-2bc1-4b40-b0ee-275bb61cead5"). InnerVolumeSpecName "kube-api-access-bxkzx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 00:29:18.914804 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:18.914716 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxkzx\" (UniqueName: \"kubernetes.io/projected/f46a74e7-2bc1-4b40-b0ee-275bb61cead5-kube-api-access-bxkzx\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Jun 03 00:29:18.914804 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:18.914749 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f46a74e7-2bc1-4b40-b0ee-275bb61cead5-extensions-socket-volume\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Jun 03 00:29:19.375004 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:19.374972 2559 generic.go:358] "Generic (PLEG): container finished" podID="f46a74e7-2bc1-4b40-b0ee-275bb61cead5" containerID="5b4fd5f2372ca161a3376a4589eac5f31bf79382c0b6afa7123121d40308761f" exitCode=0 Jun 03 00:29:19.375427 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:19.375050 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8t6k" Jun 03 00:29:19.375427 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:19.375053 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8t6k" event={"ID":"f46a74e7-2bc1-4b40-b0ee-275bb61cead5","Type":"ContainerDied","Data":"5b4fd5f2372ca161a3376a4589eac5f31bf79382c0b6afa7123121d40308761f"} Jun 03 00:29:19.375427 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:19.375092 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8t6k" event={"ID":"f46a74e7-2bc1-4b40-b0ee-275bb61cead5","Type":"ContainerDied","Data":"ddb8333bb5a501546c1bed8f56413075a1f61fde3650029999aac92e27920375"} Jun 03 00:29:19.375427 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:19.375112 2559 scope.go:117] "RemoveContainer" containerID="5b4fd5f2372ca161a3376a4589eac5f31bf79382c0b6afa7123121d40308761f" Jun 03 00:29:19.384449 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:19.384432 2559 scope.go:117] "RemoveContainer" containerID="5b4fd5f2372ca161a3376a4589eac5f31bf79382c0b6afa7123121d40308761f" Jun 03 00:29:19.384716 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:29:19.384698 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b4fd5f2372ca161a3376a4589eac5f31bf79382c0b6afa7123121d40308761f\": container with ID starting with 5b4fd5f2372ca161a3376a4589eac5f31bf79382c0b6afa7123121d40308761f not found: ID does not exist" containerID="5b4fd5f2372ca161a3376a4589eac5f31bf79382c0b6afa7123121d40308761f" Jun 03 00:29:19.384768 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:19.384725 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b4fd5f2372ca161a3376a4589eac5f31bf79382c0b6afa7123121d40308761f"} err="failed to get container status \"5b4fd5f2372ca161a3376a4589eac5f31bf79382c0b6afa7123121d40308761f\": rpc error: code = NotFound desc = could not find container \"5b4fd5f2372ca161a3376a4589eac5f31bf79382c0b6afa7123121d40308761f\": container with ID starting with 5b4fd5f2372ca161a3376a4589eac5f31bf79382c0b6afa7123121d40308761f not found: ID does not exist" Jun 03 00:29:19.407897 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:19.407867 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8t6k"] Jun 03 00:29:19.413883 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:19.413855 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-n8t6k"] Jun 03 00:29:21.368484 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:21.368450 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f46a74e7-2bc1-4b40-b0ee-275bb61cead5" path="/var/lib/kubelet/pods/f46a74e7-2bc1-4b40-b0ee-275bb61cead5/volumes" Jun 03 00:29:34.692544 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:34.692508 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-tskp8"] Jun 03 00:29:34.693004 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:34.692986 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f46a74e7-2bc1-4b40-b0ee-275bb61cead5" containerName="manager" Jun 03 00:29:34.693049 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:34.693006 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f46a74e7-2bc1-4b40-b0ee-275bb61cead5" containerName="manager" Jun 03 00:29:34.693090 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:34.693081 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="f46a74e7-2bc1-4b40-b0ee-275bb61cead5" containerName="manager" Jun 03 00:29:34.696647 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:34.696621 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-tskp8" Jun 03 00:29:34.698896 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:34.698873 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-fbc75\"" Jun 03 00:29:34.709259 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:34.709231 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-tskp8"] Jun 03 00:29:34.753334 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:34.753298 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ca1759c-fc4f-4d73-98a0-e7dae17e70eb-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-tskp8\" (UID: \"9ca1759c-fc4f-4d73-98a0-e7dae17e70eb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-tskp8" Jun 03 00:29:34.753482 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:34.753350 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ca1759c-fc4f-4d73-98a0-e7dae17e70eb-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-tskp8\" (UID: \"9ca1759c-fc4f-4d73-98a0-e7dae17e70eb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-tskp8" Jun 03 00:29:34.753482 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:34.753413 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ca1759c-fc4f-4d73-98a0-e7dae17e70eb-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-tskp8\" (UID: \"9ca1759c-fc4f-4d73-98a0-e7dae17e70eb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-tskp8" Jun 03 00:29:34.753553 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:34.753488 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ca1759c-fc4f-4d73-98a0-e7dae17e70eb-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-tskp8\" (UID: \"9ca1759c-fc4f-4d73-98a0-e7dae17e70eb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-tskp8" Jun 03 00:29:34.753586 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:34.753547 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ca1759c-fc4f-4d73-98a0-e7dae17e70eb-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-tskp8\" (UID: \"9ca1759c-fc4f-4d73-98a0-e7dae17e70eb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-tskp8" Jun 03 00:29:34.753586 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:34.753576 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ca1759c-fc4f-4d73-98a0-e7dae17e70eb-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-tskp8\" (UID: \"9ca1759c-fc4f-4d73-98a0-e7dae17e70eb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-tskp8" Jun 03 00:29:34.753651 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:34.753592 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rp8j2\" (UniqueName: \"kubernetes.io/projected/9ca1759c-fc4f-4d73-98a0-e7dae17e70eb-kube-api-access-rp8j2\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-tskp8\" (UID: \"9ca1759c-fc4f-4d73-98a0-e7dae17e70eb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-tskp8" Jun 03 00:29:34.753651 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:34.753633 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ca1759c-fc4f-4d73-98a0-e7dae17e70eb-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-tskp8\" (UID: \"9ca1759c-fc4f-4d73-98a0-e7dae17e70eb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-tskp8" Jun 03 00:29:34.753745 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:34.753651 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ca1759c-fc4f-4d73-98a0-e7dae17e70eb-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-tskp8\" (UID: \"9ca1759c-fc4f-4d73-98a0-e7dae17e70eb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-tskp8" Jun 03 00:29:34.854746 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:34.854712 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ca1759c-fc4f-4d73-98a0-e7dae17e70eb-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-tskp8\" (UID: \"9ca1759c-fc4f-4d73-98a0-e7dae17e70eb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-tskp8" Jun 03 00:29:34.854989 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:34.854764 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ca1759c-fc4f-4d73-98a0-e7dae17e70eb-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-tskp8\" (UID: \"9ca1759c-fc4f-4d73-98a0-e7dae17e70eb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-tskp8" Jun 03 00:29:34.854989 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:34.854791 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ca1759c-fc4f-4d73-98a0-e7dae17e70eb-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-tskp8\" (UID: \"9ca1759c-fc4f-4d73-98a0-e7dae17e70eb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-tskp8" Jun 03 00:29:34.854989 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:34.854850 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ca1759c-fc4f-4d73-98a0-e7dae17e70eb-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-tskp8\" (UID: \"9ca1759c-fc4f-4d73-98a0-e7dae17e70eb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-tskp8" Jun 03 00:29:34.854989 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:34.854889 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ca1759c-fc4f-4d73-98a0-e7dae17e70eb-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-tskp8\" (UID: \"9ca1759c-fc4f-4d73-98a0-e7dae17e70eb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-tskp8" Jun 03 00:29:34.854989 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:34.854913 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ca1759c-fc4f-4d73-98a0-e7dae17e70eb-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-tskp8\" (UID: \"9ca1759c-fc4f-4d73-98a0-e7dae17e70eb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-tskp8" Jun 03 00:29:34.854989 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:34.854938 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rp8j2\" (UniqueName: \"kubernetes.io/projected/9ca1759c-fc4f-4d73-98a0-e7dae17e70eb-kube-api-access-rp8j2\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-tskp8\" (UID: \"9ca1759c-fc4f-4d73-98a0-e7dae17e70eb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-tskp8" Jun 03 00:29:34.855317 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:34.854993 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ca1759c-fc4f-4d73-98a0-e7dae17e70eb-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-tskp8\" (UID: \"9ca1759c-fc4f-4d73-98a0-e7dae17e70eb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-tskp8" Jun 03 00:29:34.855317 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:34.855070 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ca1759c-fc4f-4d73-98a0-e7dae17e70eb-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-tskp8\" (UID: \"9ca1759c-fc4f-4d73-98a0-e7dae17e70eb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-tskp8" Jun 03 00:29:34.855317 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:34.855292 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ca1759c-fc4f-4d73-98a0-e7dae17e70eb-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-tskp8\" (UID: \"9ca1759c-fc4f-4d73-98a0-e7dae17e70eb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-tskp8" Jun 03 00:29:34.855470 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:34.855315 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ca1759c-fc4f-4d73-98a0-e7dae17e70eb-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-tskp8\" (UID: \"9ca1759c-fc4f-4d73-98a0-e7dae17e70eb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-tskp8" Jun 03 00:29:34.855470 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:34.855373 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ca1759c-fc4f-4d73-98a0-e7dae17e70eb-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-tskp8\" (UID: \"9ca1759c-fc4f-4d73-98a0-e7dae17e70eb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-tskp8" Jun 03 00:29:34.855647 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:34.855624 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ca1759c-fc4f-4d73-98a0-e7dae17e70eb-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-tskp8\" (UID: \"9ca1759c-fc4f-4d73-98a0-e7dae17e70eb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-tskp8" Jun 03 00:29:34.855719 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:34.855704 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ca1759c-fc4f-4d73-98a0-e7dae17e70eb-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-tskp8\" (UID: \"9ca1759c-fc4f-4d73-98a0-e7dae17e70eb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-tskp8" Jun 03 00:29:34.857253 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:34.857219 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ca1759c-fc4f-4d73-98a0-e7dae17e70eb-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-tskp8\" (UID: \"9ca1759c-fc4f-4d73-98a0-e7dae17e70eb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-tskp8" Jun 03 00:29:34.857440 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:34.857424 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ca1759c-fc4f-4d73-98a0-e7dae17e70eb-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-tskp8\" (UID: \"9ca1759c-fc4f-4d73-98a0-e7dae17e70eb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-tskp8" Jun 03 00:29:34.862332 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:34.862310 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ca1759c-fc4f-4d73-98a0-e7dae17e70eb-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-tskp8\" (UID: \"9ca1759c-fc4f-4d73-98a0-e7dae17e70eb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-tskp8" Jun 03 00:29:34.862332 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:34.862324 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rp8j2\" (UniqueName: \"kubernetes.io/projected/9ca1759c-fc4f-4d73-98a0-e7dae17e70eb-kube-api-access-rp8j2\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-tskp8\" (UID: \"9ca1759c-fc4f-4d73-98a0-e7dae17e70eb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-tskp8" Jun 03 00:29:35.009832 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:35.009790 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-tskp8" Jun 03 00:29:35.146669 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:35.146640 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-tskp8"] Jun 03 00:29:35.148759 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:29:35.148732 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ca1759c_fc4f_4d73_98a0_e7dae17e70eb.slice/crio-25224faf68cd959f33122a9c77573a056ba1c8632cae169ea64b74db2d495548 WatchSource:0}: Error finding container 25224faf68cd959f33122a9c77573a056ba1c8632cae169ea64b74db2d495548: Status 404 returned error can't find the container with id 25224faf68cd959f33122a9c77573a056ba1c8632cae169ea64b74db2d495548 Jun 03 00:29:35.150764 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:35.150730 2559 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 03 00:29:35.150869 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:35.150792 2559 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 03 00:29:35.150869 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:35.150819 2559 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 03 00:29:35.431833 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:35.431750 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-tskp8" event={"ID":"9ca1759c-fc4f-4d73-98a0-e7dae17e70eb","Type":"ContainerStarted","Data":"a3ba04d93918043cb6ec76eccb1c9a63cccc057d896106da44b4350f00bb214b"} Jun 03 00:29:35.431833 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:35.431787 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-tskp8" event={"ID":"9ca1759c-fc4f-4d73-98a0-e7dae17e70eb","Type":"ContainerStarted","Data":"25224faf68cd959f33122a9c77573a056ba1c8632cae169ea64b74db2d495548"} Jun 03 00:29:35.449620 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:35.449565 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-tskp8" podStartSLOduration=1.449550656 podStartE2EDuration="1.449550656s" podCreationTimestamp="2026-06-03 00:29:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 00:29:35.448140176 +0000 UTC m=+596.668062748" watchObservedRunningTime="2026-06-03 00:29:35.449550656 +0000 UTC m=+596.669473230" Jun 03 00:29:36.010806 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:36.010766 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-tskp8" Jun 03 00:29:36.012450 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:36.012420 2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-7d6f447cf5-tskp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body= Jun 03 00:29:36.012578 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:36.012478 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-tskp8" podUID="9ca1759c-fc4f-4d73-98a0-e7dae17e70eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" Jun 03 00:29:37.014659 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:37.014629 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-tskp8" Jun 03 00:29:37.438525 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:37.438445 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-tskp8" Jun 03 00:29:37.439608 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:37.439587 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-tskp8" Jun 03 00:29:39.267490 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:39.267463 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-7n7x2_ec539906-3be0-4a60-9ea2-5f07074c913a/console-operator/1.log" Jun 03 00:29:39.268375 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:39.268355 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-7n7x2_ec539906-3be0-4a60-9ea2-5f07074c913a/console-operator/1.log" Jun 03 00:29:39.272549 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:39.272524 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7gbw_25936d51-9126-434b-be53-677c56a0a8f7/ovn-acl-logging/0.log" Jun 03 00:29:39.273660 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:39.273643 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7gbw_25936d51-9126-434b-be53-677c56a0a8f7/ovn-acl-logging/0.log" Jun 03 00:29:39.692783 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:39.692700 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-mhkdd"] Jun 03 00:29:39.697247 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:39.697223 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-mhkdd" Jun 03 00:29:39.699615 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:39.699589 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-mwv59\"" Jun 03 00:29:39.701017 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:39.700993 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-mhkdd"] Jun 03 00:29:39.804114 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:39.804074 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-749np\" (UniqueName: \"kubernetes.io/projected/a059976f-db93-4b2a-b580-011d91f432a1-kube-api-access-749np\") pod \"authorino-f99f4b5cd-mhkdd\" (UID: \"a059976f-db93-4b2a-b580-011d91f432a1\") " pod="kuadrant-system/authorino-f99f4b5cd-mhkdd" Jun 03 00:29:39.905337 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:39.905291 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-749np\" (UniqueName: \"kubernetes.io/projected/a059976f-db93-4b2a-b580-011d91f432a1-kube-api-access-749np\") pod \"authorino-f99f4b5cd-mhkdd\" (UID: \"a059976f-db93-4b2a-b580-011d91f432a1\") " pod="kuadrant-system/authorino-f99f4b5cd-mhkdd" Jun 03 00:29:39.913984 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:39.913956 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-749np\" (UniqueName: \"kubernetes.io/projected/a059976f-db93-4b2a-b580-011d91f432a1-kube-api-access-749np\") pod \"authorino-f99f4b5cd-mhkdd\" (UID: \"a059976f-db93-4b2a-b580-011d91f432a1\") " pod="kuadrant-system/authorino-f99f4b5cd-mhkdd" Jun 03 00:29:40.007306 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:40.007268 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-mhkdd" Jun 03 00:29:40.133919 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:40.133894 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-mhkdd"] Jun 03 00:29:40.135841 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:29:40.135815 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda059976f_db93_4b2a_b580_011d91f432a1.slice/crio-7fbe07e77a31c6728b7046a9722a1fffec39d3560df999e90cc12ed71b9447f9 WatchSource:0}: Error finding container 7fbe07e77a31c6728b7046a9722a1fffec39d3560df999e90cc12ed71b9447f9: Status 404 returned error can't find the container with id 7fbe07e77a31c6728b7046a9722a1fffec39d3560df999e90cc12ed71b9447f9 Jun 03 00:29:40.449024 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:40.448940 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-mhkdd" event={"ID":"a059976f-db93-4b2a-b580-011d91f432a1","Type":"ContainerStarted","Data":"7fbe07e77a31c6728b7046a9722a1fffec39d3560df999e90cc12ed71b9447f9"} Jun 03 00:29:44.466895 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:44.466856 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-mhkdd" event={"ID":"a059976f-db93-4b2a-b580-011d91f432a1","Type":"ContainerStarted","Data":"42903ff0271f2c17e91dc9e6c8a08edf9c2e2cab03bd2ffc1cf972327b4f808a"} Jun 03 00:29:44.480224 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:44.480170 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-mhkdd" podStartSLOduration=2.188634122 podStartE2EDuration="5.480154826s" podCreationTimestamp="2026-06-03 00:29:39 +0000 UTC" firstStartedPulling="2026-06-03 00:29:40.13720615 +0000 UTC m=+601.357128707" lastFinishedPulling="2026-06-03 00:29:43.428726852 +0000 UTC m=+604.648649411" observedRunningTime="2026-06-03 00:29:44.478163366 +0000 UTC m=+605.698085929" watchObservedRunningTime="2026-06-03 00:29:44.480154826 +0000 UTC m=+605.700077402" Jun 03 00:29:46.514051 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:46.513998 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-mhkdd"] Jun 03 00:29:46.514478 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:46.514221 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-mhkdd" podUID="a059976f-db93-4b2a-b580-011d91f432a1" containerName="authorino" containerID="cri-o://42903ff0271f2c17e91dc9e6c8a08edf9c2e2cab03bd2ffc1cf972327b4f808a" gracePeriod=30 Jun 03 00:29:46.768365 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:46.768296 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-mhkdd" Jun 03 00:29:46.872186 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:46.872147 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-749np\" (UniqueName: \"kubernetes.io/projected/a059976f-db93-4b2a-b580-011d91f432a1-kube-api-access-749np\") pod \"a059976f-db93-4b2a-b580-011d91f432a1\" (UID: \"a059976f-db93-4b2a-b580-011d91f432a1\") " Jun 03 00:29:46.874234 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:46.874195 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a059976f-db93-4b2a-b580-011d91f432a1-kube-api-access-749np" (OuterVolumeSpecName: "kube-api-access-749np") pod "a059976f-db93-4b2a-b580-011d91f432a1" (UID: "a059976f-db93-4b2a-b580-011d91f432a1"). InnerVolumeSpecName "kube-api-access-749np". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 00:29:46.973865 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:46.973825 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-749np\" (UniqueName: \"kubernetes.io/projected/a059976f-db93-4b2a-b580-011d91f432a1-kube-api-access-749np\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Jun 03 00:29:47.477641 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:47.477606 2559 generic.go:358] "Generic (PLEG): container finished" podID="a059976f-db93-4b2a-b580-011d91f432a1" containerID="42903ff0271f2c17e91dc9e6c8a08edf9c2e2cab03bd2ffc1cf972327b4f808a" exitCode=0 Jun 03 00:29:47.477930 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:47.477661 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-mhkdd" Jun 03 00:29:47.477930 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:47.477663 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-mhkdd" event={"ID":"a059976f-db93-4b2a-b580-011d91f432a1","Type":"ContainerDied","Data":"42903ff0271f2c17e91dc9e6c8a08edf9c2e2cab03bd2ffc1cf972327b4f808a"} Jun 03 00:29:47.477930 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:47.477825 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-mhkdd" event={"ID":"a059976f-db93-4b2a-b580-011d91f432a1","Type":"ContainerDied","Data":"7fbe07e77a31c6728b7046a9722a1fffec39d3560df999e90cc12ed71b9447f9"} Jun 03 00:29:47.477930 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:47.477850 2559 scope.go:117] "RemoveContainer" containerID="42903ff0271f2c17e91dc9e6c8a08edf9c2e2cab03bd2ffc1cf972327b4f808a" Jun 03 00:29:47.486591 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:47.486557 2559 scope.go:117] "RemoveContainer" containerID="42903ff0271f2c17e91dc9e6c8a08edf9c2e2cab03bd2ffc1cf972327b4f808a" Jun 03 00:29:47.486890 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:29:47.486871 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42903ff0271f2c17e91dc9e6c8a08edf9c2e2cab03bd2ffc1cf972327b4f808a\": container with ID starting with 42903ff0271f2c17e91dc9e6c8a08edf9c2e2cab03bd2ffc1cf972327b4f808a not found: ID does not exist" containerID="42903ff0271f2c17e91dc9e6c8a08edf9c2e2cab03bd2ffc1cf972327b4f808a" Jun 03 00:29:47.486968 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:47.486902 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42903ff0271f2c17e91dc9e6c8a08edf9c2e2cab03bd2ffc1cf972327b4f808a"} err="failed to get container status \"42903ff0271f2c17e91dc9e6c8a08edf9c2e2cab03bd2ffc1cf972327b4f808a\": rpc error: code = NotFound desc = could not find container \"42903ff0271f2c17e91dc9e6c8a08edf9c2e2cab03bd2ffc1cf972327b4f808a\": container with ID starting with 42903ff0271f2c17e91dc9e6c8a08edf9c2e2cab03bd2ffc1cf972327b4f808a not found: ID does not exist" Jun 03 00:29:47.491307 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:47.491283 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-mhkdd"] Jun 03 00:29:47.497109 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:47.497085 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-mhkdd"] Jun 03 00:29:49.367759 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:29:49.367727 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a059976f-db93-4b2a-b580-011d91f432a1" path="/var/lib/kubelet/pods/a059976f-db93-4b2a-b580-011d91f432a1/volumes" Jun 03 00:30:18.338258 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:30:18.338226 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-dfb7g"] Jun 03 00:30:18.338698 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:30:18.338607 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a059976f-db93-4b2a-b580-011d91f432a1" containerName="authorino" Jun 03 00:30:18.338698 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:30:18.338618 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a059976f-db93-4b2a-b580-011d91f432a1" containerName="authorino" Jun 03 00:30:18.338698 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:30:18.338677 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="a059976f-db93-4b2a-b580-011d91f432a1" containerName="authorino" Jun 03 00:30:18.340731 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:30:18.340717 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-dfb7g" Jun 03 00:30:18.342751 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:30:18.342731 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-b4m62\"" Jun 03 00:30:18.343556 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:30:18.343539 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 03 00:30:18.343643 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:30:18.343589 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 03 00:30:18.349926 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:30:18.349901 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-dfb7g"] Jun 03 00:30:18.373115 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:30:18.373082 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hqcv\" (UniqueName: \"kubernetes.io/projected/eead7f6b-6049-4da4-bb9e-ef572729cc45-kube-api-access-6hqcv\") pod \"keycloak-operator-7864d68cbd-dfb7g\" (UID: \"eead7f6b-6049-4da4-bb9e-ef572729cc45\") " pod="keycloak-system/keycloak-operator-7864d68cbd-dfb7g" Jun 03 00:30:18.475242 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:30:18.475192 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6hqcv\" (UniqueName: \"kubernetes.io/projected/eead7f6b-6049-4da4-bb9e-ef572729cc45-kube-api-access-6hqcv\") pod \"keycloak-operator-7864d68cbd-dfb7g\" (UID: \"eead7f6b-6049-4da4-bb9e-ef572729cc45\") " pod="keycloak-system/keycloak-operator-7864d68cbd-dfb7g" Jun 03 00:30:18.483765 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:30:18.483734 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hqcv\" (UniqueName: \"kubernetes.io/projected/eead7f6b-6049-4da4-bb9e-ef572729cc45-kube-api-access-6hqcv\") pod \"keycloak-operator-7864d68cbd-dfb7g\" (UID: \"eead7f6b-6049-4da4-bb9e-ef572729cc45\") " pod="keycloak-system/keycloak-operator-7864d68cbd-dfb7g" Jun 03 00:30:18.651876 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:30:18.651728 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-dfb7g" Jun 03 00:30:18.787889 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:30:18.787861 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-dfb7g"] Jun 03 00:30:18.790674 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:30:18.790648 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeead7f6b_6049_4da4_bb9e_ef572729cc45.slice/crio-adbd6cd94b1d8190337c18983259b9f382ef6bd7199ec7529bd8435b8057ca8a WatchSource:0}: Error finding container adbd6cd94b1d8190337c18983259b9f382ef6bd7199ec7529bd8435b8057ca8a: Status 404 returned error can't find the container with id adbd6cd94b1d8190337c18983259b9f382ef6bd7199ec7529bd8435b8057ca8a Jun 03 00:30:18.792608 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:30:18.792587 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 00:30:19.590312 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:30:19.590274 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-dfb7g" event={"ID":"eead7f6b-6049-4da4-bb9e-ef572729cc45","Type":"ContainerStarted","Data":"adbd6cd94b1d8190337c18983259b9f382ef6bd7199ec7529bd8435b8057ca8a"} Jun 03 00:30:24.611273 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:30:24.611231 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-dfb7g" event={"ID":"eead7f6b-6049-4da4-bb9e-ef572729cc45","Type":"ContainerStarted","Data":"d09a3e049be194ae6aa17fbf7a0b4a4d8548ba6efcc9d53ef2d912f7493b0b43"} Jun 03 00:30:24.625367 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:30:24.625315 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-7864d68cbd-dfb7g" podStartSLOduration=1.337761154 podStartE2EDuration="6.625300012s" podCreationTimestamp="2026-06-03 00:30:18 +0000 UTC" firstStartedPulling="2026-06-03 00:30:18.792796099 +0000 UTC m=+640.012718657" lastFinishedPulling="2026-06-03 00:30:24.080334963 +0000 UTC m=+645.300257515" observedRunningTime="2026-06-03 00:30:24.623710737 +0000 UTC m=+645.843633359" watchObservedRunningTime="2026-06-03 00:30:24.625300012 +0000 UTC m=+645.845222586" Jun 03 00:31:02.942374 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:31:02.942337 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58fb467479-4nhfz"] Jun 03 00:31:02.944941 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:31:02.944925 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58fb467479-4nhfz" Jun 03 00:31:02.947339 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:31:02.947316 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 03 00:31:02.947339 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:31:02.947333 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-mwv59\"" Jun 03 00:31:02.950577 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:31:02.950553 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58fb467479-4nhfz"] Jun 03 00:31:03.002228 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:31:03.002190 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a8786486-cec3-4a3d-bdc8-dc4ad9156f2d-tls-cert\") pod \"authorino-58fb467479-4nhfz\" (UID: \"a8786486-cec3-4a3d-bdc8-dc4ad9156f2d\") " pod="kuadrant-system/authorino-58fb467479-4nhfz" Jun 03 00:31:03.002448 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:31:03.002253 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhxz9\" (UniqueName: \"kubernetes.io/projected/a8786486-cec3-4a3d-bdc8-dc4ad9156f2d-kube-api-access-vhxz9\") pod \"authorino-58fb467479-4nhfz\" (UID: \"a8786486-cec3-4a3d-bdc8-dc4ad9156f2d\") " pod="kuadrant-system/authorino-58fb467479-4nhfz" Jun 03 00:31:03.103437 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:31:03.103399 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a8786486-cec3-4a3d-bdc8-dc4ad9156f2d-tls-cert\") pod \"authorino-58fb467479-4nhfz\" (UID: \"a8786486-cec3-4a3d-bdc8-dc4ad9156f2d\") " pod="kuadrant-system/authorino-58fb467479-4nhfz" Jun 03 00:31:03.103644 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:31:03.103482 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vhxz9\" (UniqueName: \"kubernetes.io/projected/a8786486-cec3-4a3d-bdc8-dc4ad9156f2d-kube-api-access-vhxz9\") pod \"authorino-58fb467479-4nhfz\" (UID: \"a8786486-cec3-4a3d-bdc8-dc4ad9156f2d\") " pod="kuadrant-system/authorino-58fb467479-4nhfz" Jun 03 00:31:03.105934 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:31:03.105912 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a8786486-cec3-4a3d-bdc8-dc4ad9156f2d-tls-cert\") pod \"authorino-58fb467479-4nhfz\" (UID: \"a8786486-cec3-4a3d-bdc8-dc4ad9156f2d\") " pod="kuadrant-system/authorino-58fb467479-4nhfz" Jun 03 00:31:03.110504 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:31:03.110477 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhxz9\" (UniqueName: \"kubernetes.io/projected/a8786486-cec3-4a3d-bdc8-dc4ad9156f2d-kube-api-access-vhxz9\") pod \"authorino-58fb467479-4nhfz\" (UID: \"a8786486-cec3-4a3d-bdc8-dc4ad9156f2d\") " pod="kuadrant-system/authorino-58fb467479-4nhfz" Jun 03 00:31:03.254509 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:31:03.254473 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58fb467479-4nhfz" Jun 03 00:31:03.388421 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:31:03.388395 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58fb467479-4nhfz"] Jun 03 00:31:03.390834 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:31:03.390806 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda8786486_cec3_4a3d_bdc8_dc4ad9156f2d.slice/crio-7bfe26b5a0c3345a6c3913ca7f497de77b257654fdddc24336a09e25b7e1e90c WatchSource:0}: Error finding container 7bfe26b5a0c3345a6c3913ca7f497de77b257654fdddc24336a09e25b7e1e90c: Status 404 returned error can't find the container with id 7bfe26b5a0c3345a6c3913ca7f497de77b257654fdddc24336a09e25b7e1e90c Jun 03 00:31:03.752717 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:31:03.752665 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58fb467479-4nhfz" event={"ID":"a8786486-cec3-4a3d-bdc8-dc4ad9156f2d","Type":"ContainerStarted","Data":"7bfe26b5a0c3345a6c3913ca7f497de77b257654fdddc24336a09e25b7e1e90c"} Jun 03 00:31:04.764198 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:31:04.764160 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58fb467479-4nhfz" event={"ID":"a8786486-cec3-4a3d-bdc8-dc4ad9156f2d","Type":"ContainerStarted","Data":"64be6699959973aede85fa243d7b782b1ad2670dc8ad0e3e7dde8066b43c4168"} Jun 03 00:31:04.777450 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:31:04.777399 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-58fb467479-4nhfz" podStartSLOduration=2.440813069 podStartE2EDuration="2.777385335s" podCreationTimestamp="2026-06-03 00:31:02 +0000 UTC" firstStartedPulling="2026-06-03 00:31:03.392037592 +0000 UTC m=+684.611960145" lastFinishedPulling="2026-06-03 00:31:03.728609859 +0000 UTC m=+684.948532411" observedRunningTime="2026-06-03 00:31:04.776625721 +0000 UTC m=+685.996548296" watchObservedRunningTime="2026-06-03 00:31:04.777385335 +0000 UTC m=+685.997307909" Jun 03 00:32:33.185003 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:32:33.184964 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58fb467479-4nhfz"] Jun 03 00:32:33.185563 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:32:33.185215 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-58fb467479-4nhfz" podUID="a8786486-cec3-4a3d-bdc8-dc4ad9156f2d" containerName="authorino" containerID="cri-o://64be6699959973aede85fa243d7b782b1ad2670dc8ad0e3e7dde8066b43c4168" gracePeriod=30 Jun 03 00:32:33.431447 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:32:33.431423 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58fb467479-4nhfz" Jun 03 00:32:33.540649 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:32:33.540602 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vhxz9\" (UniqueName: \"kubernetes.io/projected/a8786486-cec3-4a3d-bdc8-dc4ad9156f2d-kube-api-access-vhxz9\") pod \"a8786486-cec3-4a3d-bdc8-dc4ad9156f2d\" (UID: \"a8786486-cec3-4a3d-bdc8-dc4ad9156f2d\") " Jun 03 00:32:33.540853 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:32:33.540756 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a8786486-cec3-4a3d-bdc8-dc4ad9156f2d-tls-cert\") pod \"a8786486-cec3-4a3d-bdc8-dc4ad9156f2d\" (UID: \"a8786486-cec3-4a3d-bdc8-dc4ad9156f2d\") " Jun 03 00:32:33.542861 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:32:33.542826 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8786486-cec3-4a3d-bdc8-dc4ad9156f2d-kube-api-access-vhxz9" (OuterVolumeSpecName: "kube-api-access-vhxz9") pod "a8786486-cec3-4a3d-bdc8-dc4ad9156f2d" (UID: "a8786486-cec3-4a3d-bdc8-dc4ad9156f2d"). InnerVolumeSpecName "kube-api-access-vhxz9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 00:32:33.552499 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:32:33.552460 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8786486-cec3-4a3d-bdc8-dc4ad9156f2d-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "a8786486-cec3-4a3d-bdc8-dc4ad9156f2d" (UID: "a8786486-cec3-4a3d-bdc8-dc4ad9156f2d"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 00:32:33.642237 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:32:33.642189 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vhxz9\" (UniqueName: \"kubernetes.io/projected/a8786486-cec3-4a3d-bdc8-dc4ad9156f2d-kube-api-access-vhxz9\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Jun 03 00:32:33.642237 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:32:33.642232 2559 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a8786486-cec3-4a3d-bdc8-dc4ad9156f2d-tls-cert\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Jun 03 00:32:34.099170 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:32:34.099131 2559 generic.go:358] "Generic (PLEG): container finished" podID="a8786486-cec3-4a3d-bdc8-dc4ad9156f2d" containerID="64be6699959973aede85fa243d7b782b1ad2670dc8ad0e3e7dde8066b43c4168" exitCode=0 Jun 03 00:32:34.099364 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:32:34.099188 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58fb467479-4nhfz" Jun 03 00:32:34.099364 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:32:34.099194 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58fb467479-4nhfz" event={"ID":"a8786486-cec3-4a3d-bdc8-dc4ad9156f2d","Type":"ContainerDied","Data":"64be6699959973aede85fa243d7b782b1ad2670dc8ad0e3e7dde8066b43c4168"} Jun 03 00:32:34.099364 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:32:34.099222 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58fb467479-4nhfz" event={"ID":"a8786486-cec3-4a3d-bdc8-dc4ad9156f2d","Type":"ContainerDied","Data":"7bfe26b5a0c3345a6c3913ca7f497de77b257654fdddc24336a09e25b7e1e90c"} Jun 03 00:32:34.099364 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:32:34.099240 2559 scope.go:117] "RemoveContainer" containerID="64be6699959973aede85fa243d7b782b1ad2670dc8ad0e3e7dde8066b43c4168" Jun 03 00:32:34.109083 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:32:34.109059 2559 scope.go:117] "RemoveContainer" containerID="64be6699959973aede85fa243d7b782b1ad2670dc8ad0e3e7dde8066b43c4168" Jun 03 00:32:34.109359 ip-10-0-130-219 kubenswrapper[2559]: E0603 00:32:34.109338 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64be6699959973aede85fa243d7b782b1ad2670dc8ad0e3e7dde8066b43c4168\": container with ID starting with 64be6699959973aede85fa243d7b782b1ad2670dc8ad0e3e7dde8066b43c4168 not found: ID does not exist" containerID="64be6699959973aede85fa243d7b782b1ad2670dc8ad0e3e7dde8066b43c4168" Jun 03 00:32:34.109432 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:32:34.109368 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64be6699959973aede85fa243d7b782b1ad2670dc8ad0e3e7dde8066b43c4168"} err="failed to get container status \"64be6699959973aede85fa243d7b782b1ad2670dc8ad0e3e7dde8066b43c4168\": rpc error: code = NotFound desc = could not find container \"64be6699959973aede85fa243d7b782b1ad2670dc8ad0e3e7dde8066b43c4168\": container with ID starting with 64be6699959973aede85fa243d7b782b1ad2670dc8ad0e3e7dde8066b43c4168 not found: ID does not exist" Jun 03 00:32:34.118707 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:32:34.118656 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58fb467479-4nhfz"] Jun 03 00:32:34.123879 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:32:34.123851 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58fb467479-4nhfz"] Jun 03 00:32:35.367630 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:32:35.367593 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8786486-cec3-4a3d-bdc8-dc4ad9156f2d" path="/var/lib/kubelet/pods/a8786486-cec3-4a3d-bdc8-dc4ad9156f2d/volumes" Jun 03 00:34:39.297760 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:34:39.297667 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-7n7x2_ec539906-3be0-4a60-9ea2-5f07074c913a/console-operator/1.log" Jun 03 00:34:39.301762 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:34:39.301737 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-7n7x2_ec539906-3be0-4a60-9ea2-5f07074c913a/console-operator/1.log" Jun 03 00:34:39.304015 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:34:39.303995 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7gbw_25936d51-9126-434b-be53-677c56a0a8f7/ovn-acl-logging/0.log" Jun 03 00:34:39.307568 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:34:39.307550 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7gbw_25936d51-9126-434b-be53-677c56a0a8f7/ovn-acl-logging/0.log" Jun 03 00:39:17.440159 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:17.440128 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-767d585f79-5pf8k_186ba058-d978-4ea5-bfde-0a54c577f041/nginx/0.log" Jun 03 00:39:18.560038 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:18.560008 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76cf9fb4b6-r2dm7_a2da7b60-49c1-4091-aef3-d70ebef6c609/copy-manifests/0.log" Jun 03 00:39:18.566321 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:18.566293 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76cf9fb4b6-r2dm7_a2da7b60-49c1-4091-aef3-d70ebef6c609/manager/0.log" Jun 03 00:39:20.179842 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:20.179815 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-fhw48_7b4a8516-74e7-4507-adb3-8668d0363b20/manager/0.log" Jun 03 00:39:20.398265 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:20.398227 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-zrwvz_34920fad-5da4-4994-a55f-0f83ace8b250/registry-server/0.log" Jun 03 00:39:20.515109 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:20.515081 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-w84xj_5bd89fa2-5964-42fb-9c1a-e62e079afdc9/manager/0.log" Jun 03 00:39:20.737079 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:20.737045 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-jnf2t_eeb8055c-da6a-4aea-8162-25cca5ee19c5/manager/0.log" Jun 03 00:39:21.100863 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:21.100829 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bjczjc_3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b/istio-proxy/0.log" Jun 03 00:39:21.557854 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:21.557825 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-tskp8_9ca1759c-fc4f-4d73-98a0-e7dae17e70eb/istio-proxy/0.log" Jun 03 00:39:29.454669 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:29.454638 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bm4vd_38b19569-bea3-4fb5-a34a-4f88f97feac0/global-pull-secret-syncer/0.log" Jun 03 00:39:29.594335 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:29.594304 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xp7vr_f834652a-ce69-4c9d-ac77-548eeb90a911/konnectivity-agent/0.log" Jun 03 00:39:29.639287 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:29.639256 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-219.ec2.internal_19952b984930da1b15ba825fc7aad098/haproxy/0.log" Jun 03 00:39:33.364700 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:33.364655 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-fhw48_7b4a8516-74e7-4507-adb3-8668d0363b20/manager/0.log" Jun 03 00:39:33.432166 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:33.432133 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-zrwvz_34920fad-5da4-4994-a55f-0f83ace8b250/registry-server/0.log" Jun 03 00:39:33.473419 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:33.473388 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-w84xj_5bd89fa2-5964-42fb-9c1a-e62e079afdc9/manager/0.log" Jun 03 00:39:33.540519 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:33.540483 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-jnf2t_eeb8055c-da6a-4aea-8162-25cca5ee19c5/manager/0.log" Jun 03 00:39:34.871220 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:34.871192 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e219078d-510d-4c17-9a7a-6601a0c28eac/alertmanager/0.log" Jun 03 00:39:34.896634 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:34.896604 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e219078d-510d-4c17-9a7a-6601a0c28eac/config-reloader/0.log" Jun 03 00:39:34.919238 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:34.919207 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e219078d-510d-4c17-9a7a-6601a0c28eac/kube-rbac-proxy-web/0.log" Jun 03 00:39:34.940470 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:34.940428 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e219078d-510d-4c17-9a7a-6601a0c28eac/kube-rbac-proxy/0.log" Jun 03 00:39:34.962237 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:34.962211 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e219078d-510d-4c17-9a7a-6601a0c28eac/kube-rbac-proxy-metric/0.log" Jun 03 00:39:34.984273 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:34.984245 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e219078d-510d-4c17-9a7a-6601a0c28eac/prom-label-proxy/0.log" Jun 03 00:39:35.006314 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:35.006289 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e219078d-510d-4c17-9a7a-6601a0c28eac/init-config-reloader/0.log" Jun 03 00:39:35.149241 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:35.149159 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-865df7bc55-4dvhg_10dc6710-cdcd-44be-b3b8-251d7c7beaa4/metrics-server/0.log" Jun 03 00:39:35.290423 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:35.290393 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w5sxt_5857928b-6643-428a-9e8d-df6dee75696f/node-exporter/0.log" Jun 03 00:39:35.314305 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:35.314281 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w5sxt_5857928b-6643-428a-9e8d-df6dee75696f/kube-rbac-proxy/0.log" Jun 03 00:39:35.335531 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:35.335508 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w5sxt_5857928b-6643-428a-9e8d-df6dee75696f/init-textfile/0.log" Jun 03 00:39:35.434964 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:35.434889 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-5gn5k_07ee71a7-234b-4ce1-90c2-8cd922683c58/kube-rbac-proxy-main/0.log" Jun 03 00:39:35.457653 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:35.457622 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-5gn5k_07ee71a7-234b-4ce1-90c2-8cd922683c58/kube-rbac-proxy-self/0.log" Jun 03 00:39:35.480709 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:35.480636 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-5gn5k_07ee71a7-234b-4ce1-90c2-8cd922683c58/openshift-state-metrics/0.log" Jun 03 00:39:35.527650 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:35.527621 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5465dd84-99b4-4b8e-802e-0fae25684e76/prometheus/0.log" Jun 03 00:39:35.552730 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:35.552655 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5465dd84-99b4-4b8e-802e-0fae25684e76/config-reloader/0.log" Jun 03 00:39:35.577823 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:35.577795 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5465dd84-99b4-4b8e-802e-0fae25684e76/thanos-sidecar/0.log" Jun 03 00:39:35.607153 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:35.607105 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5465dd84-99b4-4b8e-802e-0fae25684e76/kube-rbac-proxy-web/0.log" Jun 03 00:39:35.632181 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:35.632134 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5465dd84-99b4-4b8e-802e-0fae25684e76/kube-rbac-proxy/0.log" Jun 03 00:39:35.654977 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:35.654941 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5465dd84-99b4-4b8e-802e-0fae25684e76/kube-rbac-proxy-thanos/0.log" Jun 03 00:39:35.680569 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:35.680541 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5465dd84-99b4-4b8e-802e-0fae25684e76/init-config-reloader/0.log" Jun 03 00:39:37.292640 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:37.292612 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-76c9bb5fdf-sch94_95c4995b-b310-4ff7-994f-6d298a147d1f/networking-console-plugin/0.log" Jun 03 00:39:37.837163 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:37.837133 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-7n7x2_ec539906-3be0-4a60-9ea2-5f07074c913a/console-operator/1.log" Jun 03 00:39:37.842992 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:37.842967 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-7n7x2_ec539906-3be0-4a60-9ea2-5f07074c913a/console-operator/2.log" Jun 03 00:39:38.863531 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:38.863504 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-7598fd5bd-rslkg_0013b882-e487-4334-971a-c4d1231c4bf0/volume-data-source-validator/0.log" Jun 03 00:39:39.193374 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:39.193291 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n6sc4/perf-node-gather-daemonset-z5v5g"] Jun 03 00:39:39.193749 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:39.193727 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8786486-cec3-4a3d-bdc8-dc4ad9156f2d" containerName="authorino" Jun 03 00:39:39.193749 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:39.193746 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8786486-cec3-4a3d-bdc8-dc4ad9156f2d" containerName="authorino" Jun 03 00:39:39.193946 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:39.193869 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="a8786486-cec3-4a3d-bdc8-dc4ad9156f2d" containerName="authorino" Jun 03 00:39:39.197059 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:39.197039 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n6sc4/perf-node-gather-daemonset-z5v5g" Jun 03 00:39:39.198906 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:39.198882 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-n6sc4\"/\"default-dockercfg-p48kg\"" Jun 03 00:39:39.199561 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:39.199537 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n6sc4\"/\"openshift-service-ca.crt\"" Jun 03 00:39:39.199673 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:39.199571 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n6sc4\"/\"kube-root-ca.crt\"" Jun 03 00:39:39.202122 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:39.202100 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n6sc4/perf-node-gather-daemonset-z5v5g"] Jun 03 00:39:39.325140 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:39.325111 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-7n7x2_ec539906-3be0-4a60-9ea2-5f07074c913a/console-operator/1.log" Jun 03 00:39:39.328725 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:39.328680 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7dm5\" (UniqueName: \"kubernetes.io/projected/ef496198-1fcb-4b1f-8bdc-f2d980d934ab-kube-api-access-x7dm5\") pod \"perf-node-gather-daemonset-z5v5g\" (UID: \"ef496198-1fcb-4b1f-8bdc-f2d980d934ab\") " pod="openshift-must-gather-n6sc4/perf-node-gather-daemonset-z5v5g" Jun 03 00:39:39.328880 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:39.328763 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef496198-1fcb-4b1f-8bdc-f2d980d934ab-sys\") pod \"perf-node-gather-daemonset-z5v5g\" (UID: \"ef496198-1fcb-4b1f-8bdc-f2d980d934ab\") " pod="openshift-must-gather-n6sc4/perf-node-gather-daemonset-z5v5g" Jun 03 00:39:39.328880 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:39.328769 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-7n7x2_ec539906-3be0-4a60-9ea2-5f07074c913a/console-operator/1.log" Jun 03 00:39:39.328880 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:39.328817 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ef496198-1fcb-4b1f-8bdc-f2d980d934ab-proc\") pod \"perf-node-gather-daemonset-z5v5g\" (UID: \"ef496198-1fcb-4b1f-8bdc-f2d980d934ab\") " pod="openshift-must-gather-n6sc4/perf-node-gather-daemonset-z5v5g" Jun 03 00:39:39.328880 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:39.328845 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ef496198-1fcb-4b1f-8bdc-f2d980d934ab-podres\") pod \"perf-node-gather-daemonset-z5v5g\" (UID: \"ef496198-1fcb-4b1f-8bdc-f2d980d934ab\") " pod="openshift-must-gather-n6sc4/perf-node-gather-daemonset-z5v5g" Jun 03 00:39:39.329077 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:39.328943 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ef496198-1fcb-4b1f-8bdc-f2d980d934ab-lib-modules\") pod \"perf-node-gather-daemonset-z5v5g\" (UID: \"ef496198-1fcb-4b1f-8bdc-f2d980d934ab\") " pod="openshift-must-gather-n6sc4/perf-node-gather-daemonset-z5v5g" Jun 03 00:39:39.330568 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:39.330549 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7gbw_25936d51-9126-434b-be53-677c56a0a8f7/ovn-acl-logging/0.log" Jun 03 00:39:39.334189 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:39.334164 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7gbw_25936d51-9126-434b-be53-677c56a0a8f7/ovn-acl-logging/0.log" Jun 03 00:39:39.430469 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:39.430437 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ef496198-1fcb-4b1f-8bdc-f2d980d934ab-lib-modules\") pod \"perf-node-gather-daemonset-z5v5g\" (UID: \"ef496198-1fcb-4b1f-8bdc-f2d980d934ab\") " pod="openshift-must-gather-n6sc4/perf-node-gather-daemonset-z5v5g" Jun 03 00:39:39.430656 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:39.430513 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x7dm5\" (UniqueName: \"kubernetes.io/projected/ef496198-1fcb-4b1f-8bdc-f2d980d934ab-kube-api-access-x7dm5\") pod \"perf-node-gather-daemonset-z5v5g\" (UID: \"ef496198-1fcb-4b1f-8bdc-f2d980d934ab\") " pod="openshift-must-gather-n6sc4/perf-node-gather-daemonset-z5v5g" Jun 03 00:39:39.430656 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:39.430552 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef496198-1fcb-4b1f-8bdc-f2d980d934ab-sys\") pod \"perf-node-gather-daemonset-z5v5g\" (UID: \"ef496198-1fcb-4b1f-8bdc-f2d980d934ab\") " pod="openshift-must-gather-n6sc4/perf-node-gather-daemonset-z5v5g" Jun 03 00:39:39.430656 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:39.430583 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ef496198-1fcb-4b1f-8bdc-f2d980d934ab-proc\") pod \"perf-node-gather-daemonset-z5v5g\" (UID: \"ef496198-1fcb-4b1f-8bdc-f2d980d934ab\") " pod="openshift-must-gather-n6sc4/perf-node-gather-daemonset-z5v5g" Jun 03 00:39:39.430656 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:39.430622 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ef496198-1fcb-4b1f-8bdc-f2d980d934ab-podres\") pod \"perf-node-gather-daemonset-z5v5g\" (UID: \"ef496198-1fcb-4b1f-8bdc-f2d980d934ab\") " pod="openshift-must-gather-n6sc4/perf-node-gather-daemonset-z5v5g" Jun 03 00:39:39.430656 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:39.430624 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ef496198-1fcb-4b1f-8bdc-f2d980d934ab-lib-modules\") pod \"perf-node-gather-daemonset-z5v5g\" (UID: \"ef496198-1fcb-4b1f-8bdc-f2d980d934ab\") " pod="openshift-must-gather-n6sc4/perf-node-gather-daemonset-z5v5g" Jun 03 00:39:39.430924 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:39.430658 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef496198-1fcb-4b1f-8bdc-f2d980d934ab-sys\") pod \"perf-node-gather-daemonset-z5v5g\" (UID: \"ef496198-1fcb-4b1f-8bdc-f2d980d934ab\") " pod="openshift-must-gather-n6sc4/perf-node-gather-daemonset-z5v5g" Jun 03 00:39:39.430924 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:39.430678 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ef496198-1fcb-4b1f-8bdc-f2d980d934ab-proc\") pod \"perf-node-gather-daemonset-z5v5g\" (UID: \"ef496198-1fcb-4b1f-8bdc-f2d980d934ab\") " pod="openshift-must-gather-n6sc4/perf-node-gather-daemonset-z5v5g" Jun 03 00:39:39.430924 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:39.430780 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ef496198-1fcb-4b1f-8bdc-f2d980d934ab-podres\") pod \"perf-node-gather-daemonset-z5v5g\" (UID: \"ef496198-1fcb-4b1f-8bdc-f2d980d934ab\") " pod="openshift-must-gather-n6sc4/perf-node-gather-daemonset-z5v5g" Jun 03 00:39:39.437667 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:39.437647 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n6sc4\"/\"kube-root-ca.crt\"" Jun 03 00:39:39.448171 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:39.448103 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n6sc4\"/\"openshift-service-ca.crt\"" Jun 03 00:39:39.459198 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:39.459165 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7dm5\" (UniqueName: \"kubernetes.io/projected/ef496198-1fcb-4b1f-8bdc-f2d980d934ab-kube-api-access-x7dm5\") pod \"perf-node-gather-daemonset-z5v5g\" (UID: \"ef496198-1fcb-4b1f-8bdc-f2d980d934ab\") " pod="openshift-must-gather-n6sc4/perf-node-gather-daemonset-z5v5g" Jun 03 00:39:39.509837 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:39.509807 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-n6sc4\"/\"default-dockercfg-p48kg\"" Jun 03 00:39:39.518841 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:39.518818 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n6sc4/perf-node-gather-daemonset-z5v5g" Jun 03 00:39:39.656123 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:39.656099 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n6sc4/perf-node-gather-daemonset-z5v5g"] Jun 03 00:39:39.658457 ip-10-0-130-219 kubenswrapper[2559]: W0603 00:39:39.658427 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podef496198_1fcb_4b1f_8bdc_f2d980d934ab.slice/crio-a7afdbbe4f57333908fd97aaf37420da5428c481dbca5f079602edfa10cfb035 WatchSource:0}: Error finding container a7afdbbe4f57333908fd97aaf37420da5428c481dbca5f079602edfa10cfb035: Status 404 returned error can't find the container with id a7afdbbe4f57333908fd97aaf37420da5428c481dbca5f079602edfa10cfb035 Jun 03 00:39:39.660262 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:39.660240 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 00:39:39.864189 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:39.864164 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w2z46_65351302-04fd-49bb-b5dc-836203281ad2/dns/0.log" Jun 03 00:39:39.888740 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:39.888711 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w2z46_65351302-04fd-49bb-b5dc-836203281ad2/kube-rbac-proxy/0.log" Jun 03 00:39:39.965791 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:39.965763 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cg2vj_fc278c33-3725-483e-971f-7465ef42f509/dns-node-resolver/0.log" Jun 03 00:39:40.465435 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:40.465394 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-976cb9cff-vmcj8_d1622544-685f-4c8d-acb2-ee46a7d320f7/registry/0.log" Jun 03 00:39:40.507629 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:40.507592 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-p6rbs_a8382002-46e9-42fa-b498-3d6de2fe6a85/node-ca/0.log" Jun 03 00:39:40.627540 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:40.627502 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n6sc4/perf-node-gather-daemonset-z5v5g" event={"ID":"ef496198-1fcb-4b1f-8bdc-f2d980d934ab","Type":"ContainerStarted","Data":"c98b678cf1926158aa31fba38a9ff74f68e9a8941a2bf11f47e70b041249bc77"} Jun 03 00:39:40.627540 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:40.627539 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n6sc4/perf-node-gather-daemonset-z5v5g" event={"ID":"ef496198-1fcb-4b1f-8bdc-f2d980d934ab","Type":"ContainerStarted","Data":"a7afdbbe4f57333908fd97aaf37420da5428c481dbca5f079602edfa10cfb035"} Jun 03 00:39:40.627830 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:40.627571 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-n6sc4/perf-node-gather-daemonset-z5v5g" Jun 03 00:39:40.642220 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:40.642162 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-n6sc4/perf-node-gather-daemonset-z5v5g" podStartSLOduration=1.642145671 podStartE2EDuration="1.642145671s" podCreationTimestamp="2026-06-03 00:39:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 00:39:40.640520661 +0000 UTC m=+1201.860443236" watchObservedRunningTime="2026-06-03 00:39:40.642145671 +0000 UTC m=+1201.862068284" Jun 03 00:39:41.308115 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:41.308078 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bjczjc_3fb1455d-eb69-4c02-9b72-bdbdca6b4c4b/istio-proxy/0.log" Jun 03 00:39:41.436846 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:41.436817 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-tskp8_9ca1759c-fc4f-4d73-98a0-e7dae17e70eb/istio-proxy/0.log" Jun 03 00:39:42.013504 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:42.013456 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lr49h_7ed00dab-a3f9-41cf-8bfc-80db5e4ea202/serve-healthcheck-canary/0.log" Jun 03 00:39:42.443608 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:42.443519 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-qqf6x_d8857f61-7b88-44cd-a25d-ce64ef219677/insights-operator/1.log" Jun 03 00:39:42.444016 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:42.443913 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-qqf6x_d8857f61-7b88-44cd-a25d-ce64ef219677/insights-operator/0.log" Jun 03 00:39:42.526583 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:42.526556 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fmlb9_d075e4d5-e344-490f-8b8c-10fe1f201844/kube-rbac-proxy/0.log" Jun 03 00:39:42.546265 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:42.546241 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fmlb9_d075e4d5-e344-490f-8b8c-10fe1f201844/exporter/0.log" Jun 03 00:39:42.566544 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:42.566513 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fmlb9_d075e4d5-e344-490f-8b8c-10fe1f201844/extractor/0.log" Jun 03 00:39:44.526888 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:44.526858 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-767d585f79-5pf8k_186ba058-d978-4ea5-bfde-0a54c577f041/nginx/0.log" Jun 03 00:39:44.868912 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:44.868809 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76cf9fb4b6-r2dm7_a2da7b60-49c1-4091-aef3-d70ebef6c609/manager/0.log" Jun 03 00:39:44.888611 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:44.888582 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76cf9fb4b6-r2dm7_a2da7b60-49c1-4091-aef3-d70ebef6c609/copy-manifests/0.log" Jun 03 00:39:46.138357 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:46.138327 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-db866fbbd-vg7cp_e9e2bd16-5099-4981-8624-ab82ed9788c8/manager/0.log" Jun 03 00:39:46.641476 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:46.641451 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-n6sc4/perf-node-gather-daemonset-z5v5g" Jun 03 00:39:50.794356 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:50.794328 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-xgq44_35ac742c-b4f1-47ca-b43c-4becc89a6a8c/migrator/0.log" Jun 03 00:39:50.817067 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:50.817036 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-xgq44_35ac742c-b4f1-47ca-b43c-4becc89a6a8c/graceful-termination/0.log" Jun 03 00:39:51.148652 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:51.148569 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-2q4gf_6e1df638-ab07-40df-9344-ca095d3158cf/kube-storage-version-migrator-operator/1.log" Jun 03 00:39:51.149515 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:51.149494 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-2q4gf_6e1df638-ab07-40df-9344-ca095d3158cf/kube-storage-version-migrator-operator/0.log" Jun 03 00:39:52.307764 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:52.307735 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vns2z_418186d3-434f-4d2f-afbf-2ba437ececd4/kube-multus-additional-cni-plugins/0.log" Jun 03 00:39:52.346931 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:52.346902 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vns2z_418186d3-434f-4d2f-afbf-2ba437ececd4/egress-router-binary-copy/0.log" Jun 03 00:39:52.370291 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:52.370264 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vns2z_418186d3-434f-4d2f-afbf-2ba437ececd4/cni-plugins/0.log" Jun 03 00:39:52.391489 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:52.391457 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vns2z_418186d3-434f-4d2f-afbf-2ba437ececd4/bond-cni-plugin/0.log" Jun 03 00:39:52.412303 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:52.412272 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vns2z_418186d3-434f-4d2f-afbf-2ba437ececd4/routeoverride-cni/0.log" Jun 03 00:39:52.432888 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:52.432862 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vns2z_418186d3-434f-4d2f-afbf-2ba437ececd4/whereabouts-cni-bincopy/0.log" Jun 03 00:39:52.457977 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:52.457950 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vns2z_418186d3-434f-4d2f-afbf-2ba437ececd4/whereabouts-cni/0.log" Jun 03 00:39:52.643071 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:52.642993 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-bpmj9_83a1d409-7d22-41cf-9905-80f917032d5d/kube-multus/0.log" Jun 03 00:39:52.738304 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:52.738273 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-h7qxw_3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf/network-metrics-daemon/0.log" Jun 03 00:39:52.758146 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:52.758120 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-h7qxw_3e7f6cca-dec8-44ef-bc6b-1473aa0abcbf/kube-rbac-proxy/0.log" Jun 03 00:39:54.178516 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:54.178485 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7gbw_25936d51-9126-434b-be53-677c56a0a8f7/ovn-controller/0.log" Jun 03 00:39:54.196667 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:54.196641 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7gbw_25936d51-9126-434b-be53-677c56a0a8f7/ovn-acl-logging/0.log" Jun 03 00:39:54.203150 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:54.203124 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7gbw_25936d51-9126-434b-be53-677c56a0a8f7/ovn-acl-logging/1.log" Jun 03 00:39:54.221123 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:54.221093 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7gbw_25936d51-9126-434b-be53-677c56a0a8f7/kube-rbac-proxy-node/0.log" Jun 03 00:39:54.241093 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:54.241038 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7gbw_25936d51-9126-434b-be53-677c56a0a8f7/kube-rbac-proxy-ovn-metrics/0.log" Jun 03 00:39:54.259713 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:54.259676 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7gbw_25936d51-9126-434b-be53-677c56a0a8f7/northd/0.log" Jun 03 00:39:54.279470 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:54.279446 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7gbw_25936d51-9126-434b-be53-677c56a0a8f7/nbdb/0.log" Jun 03 00:39:54.300967 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:54.300943 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7gbw_25936d51-9126-434b-be53-677c56a0a8f7/sbdb/0.log" Jun 03 00:39:54.407587 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:54.407552 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7gbw_25936d51-9126-434b-be53-677c56a0a8f7/ovnkube-controller/0.log" Jun 03 00:39:55.485188 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:55.485152 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-56d84b9f44-zmjh5_41e1ca17-3186-4bfb-ba59-8034b881dc22/check-endpoints/0.log" Jun 03 00:39:55.522360 ip-10-0-130-219 kubenswrapper[2559]: I0603 00:39:55.522327 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-jwt8n_0d640da7-6701-4c49-b1c4-efac1a49bea8/network-check-target-container/0.log"