Jun 03 21:03:21.719057 ip-10-0-137-203 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 03 21:03:21.719069 ip-10-0-137-203 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 03 21:03:21.719078 ip-10-0-137-203 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 03 21:03:21.719282 ip-10-0-137-203 systemd[1]: Failed to start Kubernetes Kubelet. Jun 03 21:03:31.815939 ip-10-0-137-203 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 03 21:03:31.815957 ip-10-0-137-203 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 0b92ce8e96dc4028960649a1bf5c82d7 -- Jun 03 21:06:01.735031 ip-10-0-137-203 systemd[1]: Starting Kubernetes Kubelet... Jun 03 21:06:02.115616 ip-10-0-137-203 kubenswrapper[2557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 21:06:02.115616 ip-10-0-137-203 kubenswrapper[2557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 21:06:02.115616 ip-10-0-137-203 kubenswrapper[2557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 21:06:02.115616 ip-10-0-137-203 kubenswrapper[2557]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 21:06:02.115616 ip-10-0-137-203 kubenswrapper[2557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 21:06:02.117315 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.117226 2557 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 21:06:02.121606 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121552 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 21:06:02.121606 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121599 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 21:06:02.121606 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121603 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 21:06:02.121606 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121606 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 21:06:02.121606 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121609 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 21:06:02.121606 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121613 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 21:06:02.121606 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121616 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 21:06:02.121882 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121622 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 21:06:02.121882 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121626 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 21:06:02.121882 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121630 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 21:06:02.121882 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121634 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 21:06:02.121882 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121637 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 21:06:02.121882 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121640 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 21:06:02.121882 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121642 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 21:06:02.121882 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121645 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 21:06:02.121882 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121648 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 21:06:02.121882 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121651 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 21:06:02.121882 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121653 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 21:06:02.121882 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121656 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 21:06:02.121882 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121659 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 21:06:02.121882 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121661 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 21:06:02.121882 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121664 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 21:06:02.121882 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121667 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 21:06:02.121882 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121669 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 21:06:02.121882 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121672 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 21:06:02.121882 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121674 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 21:06:02.121882 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121677 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 21:06:02.122388 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121679 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 21:06:02.122388 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121682 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 21:06:02.122388 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121685 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 21:06:02.122388 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121687 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 21:06:02.122388 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121691 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 21:06:02.122388 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121693 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 21:06:02.122388 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121696 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 21:06:02.122388 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121699 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 21:06:02.122388 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121701 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 21:06:02.122388 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121704 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 21:06:02.122388 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121726 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 21:06:02.122388 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121731 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 21:06:02.122388 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121735 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 21:06:02.122388 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121741 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 21:06:02.122388 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121744 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 21:06:02.122388 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121747 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 21:06:02.122388 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121750 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 21:06:02.122388 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121754 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 21:06:02.122388 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121756 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 21:06:02.122959 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121759 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 21:06:02.122959 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121762 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 21:06:02.122959 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121764 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 21:06:02.122959 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121767 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 21:06:02.122959 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121771 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 21:06:02.122959 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121774 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 21:06:02.122959 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121777 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 21:06:02.122959 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121780 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 21:06:02.122959 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121783 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 21:06:02.122959 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121786 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 21:06:02.122959 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121789 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 21:06:02.122959 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121792 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 21:06:02.122959 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121795 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 21:06:02.122959 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121798 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 21:06:02.122959 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121800 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 21:06:02.122959 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121803 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 21:06:02.122959 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121806 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 21:06:02.122959 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121808 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 21:06:02.122959 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121811 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 21:06:02.122959 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121814 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 21:06:02.123459 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121816 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 21:06:02.123459 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121819 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 21:06:02.123459 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121821 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 21:06:02.123459 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121824 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 21:06:02.123459 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121826 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 21:06:02.123459 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121829 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 21:06:02.123459 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121832 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 21:06:02.123459 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121835 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 21:06:02.123459 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121838 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 21:06:02.123459 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121841 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 21:06:02.123459 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121843 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 21:06:02.123459 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121847 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 21:06:02.123459 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121850 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 21:06:02.123459 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121853 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 21:06:02.123459 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121856 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 21:06:02.123459 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121859 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 21:06:02.123459 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121861 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 21:06:02.123459 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121864 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 21:06:02.123459 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121866 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 21:06:02.123459 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121869 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 21:06:02.123966 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121871 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 21:06:02.123966 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121874 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 21:06:02.123966 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121876 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 03 21:06:02.123966 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121879 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 21:06:02.123966 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121882 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 21:06:02.123966 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121884 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 21:06:02.123966 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121887 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 21:06:02.123966 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121890 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 21:06:02.123966 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121893 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 21:06:02.123966 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121896 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 21:06:02.123966 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121916 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 21:06:02.123966 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.121920 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 21:06:02.123966 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122655 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 21:06:02.123966 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122662 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 21:06:02.123966 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122666 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 21:06:02.123966 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122670 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 21:06:02.123966 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122673 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 21:06:02.123966 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122676 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 21:06:02.123966 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122680 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 21:06:02.123966 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122683 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 21:06:02.124454 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122686 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 21:06:02.124454 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122688 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 21:06:02.124454 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122691 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 21:06:02.124454 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122694 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 21:06:02.124454 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122698 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 21:06:02.124454 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122702 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 21:06:02.124454 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122705 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 21:06:02.124454 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122723 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 21:06:02.124454 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122726 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 21:06:02.124454 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122728 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 21:06:02.124454 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122732 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 21:06:02.124454 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122735 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 21:06:02.124454 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122737 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 21:06:02.124454 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122740 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 21:06:02.124454 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122742 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 21:06:02.124454 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122745 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 21:06:02.124454 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122748 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 21:06:02.124454 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122750 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 21:06:02.124454 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122753 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 21:06:02.124454 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122756 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 21:06:02.124985 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122758 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 21:06:02.124985 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122762 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 21:06:02.124985 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122764 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 21:06:02.124985 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122767 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 21:06:02.124985 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122770 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 21:06:02.124985 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122772 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 21:06:02.124985 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122775 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 21:06:02.124985 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122778 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 21:06:02.124985 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122781 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 21:06:02.124985 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122784 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 21:06:02.124985 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122787 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 21:06:02.124985 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122790 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 21:06:02.124985 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122793 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 21:06:02.124985 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122796 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 21:06:02.124985 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122798 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 21:06:02.124985 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122801 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 21:06:02.124985 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122803 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 21:06:02.124985 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122806 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 21:06:02.124985 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122809 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 21:06:02.124985 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122811 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 21:06:02.125490 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122815 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 21:06:02.125490 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122819 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 21:06:02.125490 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122822 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 21:06:02.125490 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122826 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 21:06:02.125490 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122828 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 21:06:02.125490 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122831 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 21:06:02.125490 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122834 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 21:06:02.125490 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122837 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 21:06:02.125490 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122840 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 21:06:02.125490 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122843 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 21:06:02.125490 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122849 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 21:06:02.125490 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122853 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 21:06:02.125490 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122856 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 21:06:02.125490 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122859 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 21:06:02.125490 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122863 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 21:06:02.125490 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122867 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 21:06:02.125490 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122870 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 21:06:02.125490 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122873 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 21:06:02.125490 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122876 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 21:06:02.125978 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122879 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 03 21:06:02.125978 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122882 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 21:06:02.125978 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122884 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 21:06:02.125978 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122887 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 21:06:02.125978 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122890 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 21:06:02.125978 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122892 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 21:06:02.125978 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122895 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 21:06:02.125978 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122898 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 21:06:02.125978 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122900 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 21:06:02.125978 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122904 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 21:06:02.125978 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122906 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 21:06:02.125978 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122909 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 21:06:02.125978 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122911 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 21:06:02.125978 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122914 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 21:06:02.125978 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122917 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 21:06:02.125978 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122919 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 21:06:02.125978 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122922 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 21:06:02.125978 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122925 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 21:06:02.125978 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122928 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 21:06:02.125978 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122930 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 21:06:02.126505 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122933 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 21:06:02.126505 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122935 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 21:06:02.126505 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122938 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 21:06:02.126505 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122942 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 21:06:02.126505 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122944 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 21:06:02.126505 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122947 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 21:06:02.126505 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122950 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 21:06:02.126505 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122953 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 21:06:02.126505 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122956 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 21:06:02.126505 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122958 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 21:06:02.126505 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.122961 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 21:06:02.126505 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123357 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 21:06:02.126505 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123362 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 21:06:02.126505 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123366 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 21:06:02.126505 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123369 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 21:06:02.126505 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123372 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 21:06:02.126505 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123375 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 21:06:02.126505 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123378 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 21:06:02.126505 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123380 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 21:06:02.126505 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123383 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 21:06:02.127017 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123386 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 21:06:02.127017 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123389 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 21:06:02.127017 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123392 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 21:06:02.127017 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123395 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 21:06:02.127017 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123397 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 21:06:02.127017 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123399 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 21:06:02.127017 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123402 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 21:06:02.127017 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123405 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 21:06:02.127017 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123408 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 21:06:02.127017 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123411 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 21:06:02.127017 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123415 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 21:06:02.127017 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123418 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 21:06:02.127017 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123421 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 21:06:02.127017 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123423 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 21:06:02.127017 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123426 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 21:06:02.127017 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123430 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 21:06:02.127017 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123433 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 21:06:02.127017 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123436 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 21:06:02.127017 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123438 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 21:06:02.127017 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123441 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 21:06:02.127553 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123444 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 21:06:02.127553 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123446 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 21:06:02.127553 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123450 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 21:06:02.127553 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123453 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 21:06:02.127553 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123455 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 21:06:02.127553 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123458 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 21:06:02.127553 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123460 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 21:06:02.127553 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123463 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 21:06:02.127553 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123466 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 21:06:02.127553 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123469 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 21:06:02.127553 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123472 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 21:06:02.127553 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123474 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 21:06:02.127553 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123477 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 21:06:02.127553 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123480 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 21:06:02.127553 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123482 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 21:06:02.127553 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123485 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 21:06:02.127553 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123487 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 21:06:02.127553 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123491 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 21:06:02.127553 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123495 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 21:06:02.127553 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123498 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 21:06:02.128059 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123501 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 21:06:02.128059 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123504 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 21:06:02.128059 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123507 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 21:06:02.128059 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123510 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 21:06:02.128059 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123512 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 21:06:02.128059 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123515 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 21:06:02.128059 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123518 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 21:06:02.128059 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123521 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 21:06:02.128059 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123524 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 21:06:02.128059 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123526 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 21:06:02.128059 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123529 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 21:06:02.128059 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123531 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 21:06:02.128059 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123534 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 21:06:02.128059 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123537 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 21:06:02.128059 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123539 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 21:06:02.128059 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123542 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 21:06:02.128059 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123544 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 21:06:02.128059 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123548 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 21:06:02.128059 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123551 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 21:06:02.128059 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123554 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 21:06:02.128553 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123556 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 21:06:02.128553 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123559 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 21:06:02.128553 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123563 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 21:06:02.128553 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123566 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 21:06:02.128553 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123569 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 21:06:02.128553 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123572 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 21:06:02.128553 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123574 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 21:06:02.128553 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123577 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 21:06:02.128553 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123580 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 21:06:02.128553 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123583 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 21:06:02.128553 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123585 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 21:06:02.128553 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123588 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 21:06:02.128553 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123590 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 21:06:02.128553 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123593 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 21:06:02.128553 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123598 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 21:06:02.128553 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123602 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 21:06:02.128553 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123605 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 21:06:02.128553 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123608 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 21:06:02.128553 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123610 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 21:06:02.129042 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123614 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 21:06:02.129042 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123617 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 21:06:02.129042 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123619 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 21:06:02.129042 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123622 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 03 21:06:02.129042 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123625 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 21:06:02.129042 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123628 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 21:06:02.129042 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123630 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 21:06:02.129042 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123633 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 21:06:02.129042 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123635 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 21:06:02.129042 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.123638 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 21:06:02.129042 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123727 2557 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 21:06:02.129042 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123735 2557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 21:06:02.129042 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123742 2557 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 21:06:02.129042 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123746 2557 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 21:06:02.129042 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123750 2557 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 21:06:02.129042 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123754 2557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 21:06:02.129042 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123762 2557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 21:06:02.129042 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123767 2557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 21:06:02.129042 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123770 2557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 21:06:02.129042 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123773 2557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 21:06:02.129042 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123776 2557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 21:06:02.129564 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123780 2557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 21:06:02.129564 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123783 2557 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 21:06:02.129564 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123786 2557 flags.go:64] FLAG: --cgroup-root="" Jun 03 21:06:02.129564 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123789 2557 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 21:06:02.129564 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123792 2557 flags.go:64] FLAG: --client-ca-file="" Jun 03 21:06:02.129564 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123795 2557 flags.go:64] FLAG: --cloud-provider="external" Jun 03 21:06:02.129564 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123798 2557 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 21:06:02.129564 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123802 2557 flags.go:64] FLAG: --cluster-domain="" Jun 03 21:06:02.129564 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123806 2557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 21:06:02.129564 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123809 2557 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 03 21:06:02.129564 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123812 2557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 21:06:02.129564 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123816 2557 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 21:06:02.129564 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123820 2557 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 21:06:02.129564 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123823 2557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 21:06:02.129564 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123826 2557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 21:06:02.129564 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123830 2557 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 21:06:02.129564 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123833 2557 flags.go:64] FLAG: --contention-profiling="false" Jun 03 21:06:02.129564 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123836 2557 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 21:06:02.129564 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123839 2557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 21:06:02.129564 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123842 2557 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 21:06:02.129564 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123845 2557 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 21:06:02.129564 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123850 2557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 21:06:02.129564 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123853 2557 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 21:06:02.129564 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123856 2557 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 21:06:02.129564 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123859 2557 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 21:06:02.130193 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123862 2557 flags.go:64] FLAG: --enable-server="true" Jun 03 21:06:02.130193 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123865 2557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 21:06:02.130193 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123870 2557 flags.go:64] FLAG: --event-burst="100" Jun 03 21:06:02.130193 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123873 2557 flags.go:64] FLAG: --event-qps="50" Jun 03 21:06:02.130193 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123876 2557 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 21:06:02.130193 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123879 2557 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 21:06:02.130193 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123882 2557 flags.go:64] FLAG: --eviction-hard="" Jun 03 21:06:02.130193 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123886 2557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 21:06:02.130193 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123889 2557 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 21:06:02.130193 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123892 2557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 21:06:02.130193 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123896 2557 flags.go:64] FLAG: --eviction-soft="" Jun 03 21:06:02.130193 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123899 2557 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 21:06:02.130193 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123902 2557 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 21:06:02.130193 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123905 2557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 21:06:02.130193 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123908 2557 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 21:06:02.130193 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123911 2557 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 21:06:02.130193 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123915 2557 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 21:06:02.130193 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123918 2557 flags.go:64] FLAG: --feature-gates="" Jun 03 21:06:02.130193 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123922 2557 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 21:06:02.130193 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123925 2557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 21:06:02.130193 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123928 2557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 21:06:02.130193 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123931 2557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 21:06:02.130193 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123934 2557 flags.go:64] FLAG: --healthz-port="10248" Jun 03 21:06:02.130193 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123937 2557 flags.go:64] FLAG: --help="false" Jun 03 21:06:02.130193 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123940 2557 flags.go:64] FLAG: --hostname-override="ip-10-0-137-203.ec2.internal" Jun 03 21:06:02.130859 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123943 2557 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 21:06:02.130859 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123946 2557 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 21:06:02.130859 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123949 2557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 21:06:02.130859 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123952 2557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 21:06:02.130859 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123955 2557 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 21:06:02.130859 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123958 2557 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 21:06:02.130859 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123961 2557 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 21:06:02.130859 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123964 2557 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 21:06:02.130859 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123967 2557 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 21:06:02.130859 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123971 2557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 21:06:02.130859 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123974 2557 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 21:06:02.130859 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123977 2557 flags.go:64] FLAG: --kube-reserved="" Jun 03 21:06:02.130859 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123980 2557 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 21:06:02.130859 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123983 2557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 21:06:02.130859 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123986 2557 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 21:06:02.130859 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123989 2557 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 21:06:02.130859 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123992 2557 flags.go:64] FLAG: --lock-file="" Jun 03 21:06:02.130859 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123994 2557 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 21:06:02.130859 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.123997 2557 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 21:06:02.130859 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124002 2557 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 21:06:02.130859 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124008 2557 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 21:06:02.130859 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124011 2557 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 21:06:02.130859 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124014 2557 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 21:06:02.130859 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124016 2557 flags.go:64] FLAG: --logging-format="text" Jun 03 21:06:02.131460 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124020 2557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 21:06:02.131460 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124025 2557 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 21:06:02.131460 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124028 2557 flags.go:64] FLAG: --manifest-url="" Jun 03 21:06:02.131460 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124031 2557 flags.go:64] FLAG: --manifest-url-header="" Jun 03 21:06:02.131460 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124035 2557 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 21:06:02.131460 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124038 2557 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 21:06:02.131460 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124042 2557 flags.go:64] FLAG: --max-pods="110" Jun 03 21:06:02.131460 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124045 2557 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 21:06:02.131460 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124048 2557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 21:06:02.131460 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124051 2557 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 21:06:02.131460 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124054 2557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 21:06:02.131460 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124058 2557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 21:06:02.131460 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124061 2557 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 21:06:02.131460 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124064 2557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 21:06:02.131460 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124072 2557 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 21:06:02.131460 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124075 2557 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 21:06:02.131460 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124078 2557 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 21:06:02.131460 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124081 2557 flags.go:64] FLAG: --pod-cidr="" Jun 03 21:06:02.131460 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124084 2557 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 03 21:06:02.131460 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124090 2557 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 21:06:02.131460 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124093 2557 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 21:06:02.131460 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124096 2557 flags.go:64] FLAG: --pods-per-core="0" Jun 03 21:06:02.131460 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124099 2557 flags.go:64] FLAG: --port="10250" Jun 03 21:06:02.131460 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124102 2557 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 21:06:02.132104 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124105 2557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ee8af5eaf274ec1e" Jun 03 21:06:02.132104 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124108 2557 flags.go:64] FLAG: --qos-reserved="" Jun 03 21:06:02.132104 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124111 2557 flags.go:64] FLAG: --read-only-port="10255" Jun 03 21:06:02.132104 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124118 2557 flags.go:64] FLAG: --register-node="true" Jun 03 21:06:02.132104 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124121 2557 flags.go:64] FLAG: --register-with-taints="" Jun 03 21:06:02.132104 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124125 2557 flags.go:64] FLAG: --registry-burst="10" Jun 03 21:06:02.132104 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124128 2557 flags.go:64] FLAG: --registry-qps="5" Jun 03 21:06:02.132104 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124131 2557 flags.go:64] FLAG: --reserved-cpus="" Jun 03 21:06:02.132104 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124134 2557 flags.go:64] FLAG: --reserved-memory="" Jun 03 21:06:02.132104 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124138 2557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 21:06:02.132104 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124143 2557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 21:06:02.132104 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124146 2557 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 21:06:02.132104 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124149 2557 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 21:06:02.132104 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124152 2557 flags.go:64] FLAG: --runonce="false" Jun 03 21:06:02.132104 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124155 2557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 21:06:02.132104 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124158 2557 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 21:06:02.132104 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124161 2557 flags.go:64] FLAG: --seccomp-default="false" Jun 03 21:06:02.132104 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124164 2557 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 21:06:02.132104 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124167 2557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 21:06:02.132104 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124170 2557 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 21:06:02.132104 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124173 2557 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 21:06:02.132104 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124176 2557 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 21:06:02.132104 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124178 2557 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 21:06:02.132104 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124181 2557 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 21:06:02.132104 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124185 2557 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 21:06:02.132719 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124187 2557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 21:06:02.132719 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124191 2557 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 21:06:02.132719 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124194 2557 flags.go:64] FLAG: --system-cgroups="" Jun 03 21:06:02.132719 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124196 2557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 21:06:02.132719 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124202 2557 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 21:06:02.132719 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124205 2557 flags.go:64] FLAG: --tls-cert-file="" Jun 03 21:06:02.132719 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124207 2557 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 21:06:02.132719 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124211 2557 flags.go:64] FLAG: --tls-min-version="" Jun 03 21:06:02.132719 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124214 2557 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 21:06:02.132719 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124217 2557 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 21:06:02.132719 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124222 2557 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 21:06:02.132719 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124224 2557 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 21:06:02.132719 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124227 2557 flags.go:64] FLAG: --v="2" Jun 03 21:06:02.132719 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124231 2557 flags.go:64] FLAG: --version="false" Jun 03 21:06:02.132719 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124235 2557 flags.go:64] FLAG: --vmodule="" Jun 03 21:06:02.132719 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124240 2557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 21:06:02.132719 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.124243 2557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 21:06:02.132719 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124366 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 21:06:02.132719 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124371 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 21:06:02.132719 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124374 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 21:06:02.132719 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124377 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 21:06:02.132719 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124380 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 21:06:02.132719 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124383 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 21:06:02.132719 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124385 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 21:06:02.133362 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124388 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 21:06:02.133362 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124391 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 21:06:02.133362 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124393 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 21:06:02.133362 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124396 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 21:06:02.133362 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124399 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 21:06:02.133362 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124402 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 21:06:02.133362 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124404 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 21:06:02.133362 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124408 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 21:06:02.133362 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124412 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 21:06:02.133362 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124415 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 21:06:02.133362 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124418 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 21:06:02.133362 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124422 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 21:06:02.133362 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124425 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 21:06:02.133362 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124428 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 21:06:02.133362 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124431 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 21:06:02.133362 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124434 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 21:06:02.133362 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124437 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 21:06:02.133362 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124440 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 21:06:02.133828 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124443 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 21:06:02.133828 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124446 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 21:06:02.133828 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124449 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 21:06:02.133828 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124452 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 21:06:02.133828 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124454 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 21:06:02.133828 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124457 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 21:06:02.133828 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124460 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 21:06:02.133828 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124464 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 21:06:02.133828 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124467 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 21:06:02.133828 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124470 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 21:06:02.133828 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124472 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 21:06:02.133828 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124475 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 21:06:02.133828 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124478 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 21:06:02.133828 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124482 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 21:06:02.133828 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124485 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 21:06:02.133828 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124488 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 21:06:02.133828 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124491 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 21:06:02.133828 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124493 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 21:06:02.133828 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124496 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 21:06:02.133828 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124499 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 21:06:02.134326 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124502 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 21:06:02.134326 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124504 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 21:06:02.134326 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124507 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 21:06:02.134326 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124509 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 21:06:02.134326 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124512 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 21:06:02.134326 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124514 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 21:06:02.134326 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124517 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 21:06:02.134326 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124520 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 21:06:02.134326 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124523 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 21:06:02.134326 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124525 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 21:06:02.134326 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124528 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 21:06:02.134326 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124530 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 21:06:02.134326 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124535 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 21:06:02.134326 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124538 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 21:06:02.134326 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124540 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 21:06:02.134326 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124543 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 21:06:02.134326 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124545 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 21:06:02.134326 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124548 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 21:06:02.134326 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124551 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 21:06:02.134326 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124555 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 21:06:02.134830 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124558 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 21:06:02.134830 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124561 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 21:06:02.134830 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124564 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 21:06:02.134830 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124567 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 21:06:02.134830 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124569 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 21:06:02.134830 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124572 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 21:06:02.134830 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124574 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 21:06:02.134830 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124577 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 21:06:02.134830 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124579 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 21:06:02.134830 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124582 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 03 21:06:02.134830 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124585 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 21:06:02.134830 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124587 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 21:06:02.134830 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124590 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 21:06:02.134830 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124592 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 21:06:02.134830 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124595 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 21:06:02.134830 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124597 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 21:06:02.134830 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124600 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 21:06:02.134830 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124602 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 21:06:02.134830 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124605 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 21:06:02.134830 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124608 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 21:06:02.135333 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124611 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 21:06:02.135333 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124613 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 21:06:02.135333 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124616 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 21:06:02.135333 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124618 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 21:06:02.135333 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124622 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 21:06:02.135333 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124625 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 21:06:02.135333 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124627 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 21:06:02.135333 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124630 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 21:06:02.135333 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124634 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 21:06:02.135333 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124637 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 21:06:02.135333 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124642 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 21:06:02.135333 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124647 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 21:06:02.135333 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.124651 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 21:06:02.135333 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.125148 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 21:06:02.135333 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.131751 2557 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 03 21:06:02.135704 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.131767 2557 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 21:06:02.135704 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.131786 2557 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 03 21:06:02.135704 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.131792 2557 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 21:06:02.135704 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.131869 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 21:06:02.135704 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.131874 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 21:06:02.135704 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.131878 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 21:06:02.135704 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.131881 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 21:06:02.135704 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.131884 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 21:06:02.135704 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.131887 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 21:06:02.135704 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.131890 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 21:06:02.135704 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.131894 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 21:06:02.135704 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.131897 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 21:06:02.135704 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.131899 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 21:06:02.135704 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.131902 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 21:06:02.135704 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.131905 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 21:06:02.135704 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.131908 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 21:06:02.135704 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.131910 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 21:06:02.135704 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.131913 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 21:06:02.135704 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.131915 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 21:06:02.136186 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.131918 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 21:06:02.136186 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.131920 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 21:06:02.136186 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.131923 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 21:06:02.136186 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.131928 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 21:06:02.136186 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.131932 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 21:06:02.136186 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.131935 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 21:06:02.136186 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.131938 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 21:06:02.136186 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.131942 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 21:06:02.136186 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.131944 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 21:06:02.136186 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.131948 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 21:06:02.136186 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.131951 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 21:06:02.136186 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.131953 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 21:06:02.136186 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.131963 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 21:06:02.136186 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.131967 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 21:06:02.136186 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.131970 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 21:06:02.136186 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.131973 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 21:06:02.136186 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.131976 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 21:06:02.136186 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.131978 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 21:06:02.136186 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.131981 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 21:06:02.136674 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.131984 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 21:06:02.136674 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.131987 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 21:06:02.136674 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.131990 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 21:06:02.136674 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.131992 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 21:06:02.136674 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.131995 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 21:06:02.136674 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.131998 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 21:06:02.136674 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132001 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 21:06:02.136674 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132003 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 21:06:02.136674 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132006 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 21:06:02.136674 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132008 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 21:06:02.136674 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132011 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 21:06:02.136674 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132015 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 21:06:02.136674 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132018 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 21:06:02.136674 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132021 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 21:06:02.136674 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132024 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 21:06:02.136674 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132027 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 21:06:02.136674 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132029 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 21:06:02.136674 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132032 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 21:06:02.136674 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132035 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 21:06:02.136674 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132037 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 21:06:02.137172 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132040 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 21:06:02.137172 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132043 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 21:06:02.137172 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132045 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 21:06:02.137172 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132048 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 21:06:02.137172 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132050 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 21:06:02.137172 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132053 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 21:06:02.137172 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132061 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 21:06:02.137172 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132064 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 21:06:02.137172 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132067 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 21:06:02.137172 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132070 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 21:06:02.137172 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132072 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 21:06:02.137172 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132075 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 21:06:02.137172 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132077 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 21:06:02.137172 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132080 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 21:06:02.137172 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132083 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 21:06:02.137172 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132086 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 03 21:06:02.137172 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132088 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 21:06:02.137172 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132091 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 21:06:02.137172 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132094 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 21:06:02.137172 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132096 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 21:06:02.137664 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132099 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 21:06:02.137664 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132101 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 21:06:02.137664 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132104 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 21:06:02.137664 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132106 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 21:06:02.137664 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132110 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 21:06:02.137664 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132112 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 21:06:02.137664 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132115 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 21:06:02.137664 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132118 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 21:06:02.137664 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132120 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 21:06:02.137664 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132123 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 21:06:02.137664 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132127 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 21:06:02.137664 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132129 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 21:06:02.137664 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132132 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 21:06:02.137664 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132134 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 21:06:02.137664 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132137 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 21:06:02.137664 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132140 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 21:06:02.137664 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132142 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 21:06:02.137664 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132150 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 21:06:02.137664 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132154 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 21:06:02.137664 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132162 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 21:06:02.138272 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132164 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 21:06:02.138272 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132167 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 21:06:02.138272 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132170 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 21:06:02.138272 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.132175 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 21:06:02.138272 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132321 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 21:06:02.138272 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132325 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 21:06:02.138272 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132328 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 21:06:02.138272 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132330 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 21:06:02.138272 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132333 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 21:06:02.138272 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132336 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 21:06:02.138272 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132338 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 21:06:02.138272 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132341 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 21:06:02.138272 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132344 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 21:06:02.138272 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132347 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 21:06:02.138272 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132349 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 21:06:02.138646 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132352 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 21:06:02.138646 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132354 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 21:06:02.138646 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132357 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 21:06:02.138646 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132360 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 21:06:02.138646 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132362 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 21:06:02.138646 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132365 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 21:06:02.138646 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132368 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 21:06:02.138646 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132370 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 21:06:02.138646 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132373 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 21:06:02.138646 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132376 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 21:06:02.138646 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132378 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 21:06:02.138646 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132381 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 21:06:02.138646 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132383 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 21:06:02.138646 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132386 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 21:06:02.138646 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132388 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 21:06:02.138646 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132391 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 21:06:02.138646 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132394 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 21:06:02.138646 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132403 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 21:06:02.138646 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132406 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 21:06:02.139161 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132413 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 21:06:02.139161 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132416 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 21:06:02.139161 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132418 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 21:06:02.139161 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132421 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 21:06:02.139161 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132424 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 21:06:02.139161 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132426 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 21:06:02.139161 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132429 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 21:06:02.139161 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132431 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 21:06:02.139161 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132434 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 21:06:02.139161 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132437 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 21:06:02.139161 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132439 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 21:06:02.139161 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132442 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 21:06:02.139161 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132445 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 21:06:02.139161 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132447 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 21:06:02.139161 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132450 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 21:06:02.139161 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132452 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 03 21:06:02.139161 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132456 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 21:06:02.139161 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132461 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 21:06:02.139161 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132466 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 21:06:02.139161 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132470 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 21:06:02.139667 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132474 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 21:06:02.139667 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132479 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 21:06:02.139667 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132483 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 21:06:02.139667 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132487 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 21:06:02.139667 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132491 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 21:06:02.139667 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132495 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 21:06:02.139667 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132499 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 21:06:02.139667 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132503 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 21:06:02.139667 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132507 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 21:06:02.139667 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132511 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 21:06:02.139667 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132514 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 21:06:02.139667 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132526 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 21:06:02.139667 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132530 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 21:06:02.139667 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132534 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 21:06:02.139667 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132538 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 21:06:02.139667 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132542 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 21:06:02.139667 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132546 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 21:06:02.139667 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132550 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 21:06:02.139667 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132554 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 21:06:02.139667 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132558 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 21:06:02.140173 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132562 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 21:06:02.140173 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132565 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 21:06:02.140173 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132569 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 21:06:02.140173 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132571 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 21:06:02.140173 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132574 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 21:06:02.140173 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132577 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 21:06:02.140173 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132579 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 21:06:02.140173 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132584 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 21:06:02.140173 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132587 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 21:06:02.140173 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132590 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 21:06:02.140173 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132593 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 21:06:02.140173 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132596 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 21:06:02.140173 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132598 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 21:06:02.140173 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132601 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 21:06:02.140173 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132603 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 21:06:02.140173 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132606 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 21:06:02.140173 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132609 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 21:06:02.140173 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132611 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 21:06:02.140173 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132614 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 21:06:02.140633 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132616 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 21:06:02.140633 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132619 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 21:06:02.140633 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132621 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 21:06:02.140633 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132624 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 21:06:02.140633 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132627 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 21:06:02.140633 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132637 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 21:06:02.140633 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132640 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 21:06:02.140633 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132642 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 21:06:02.140633 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:02.132645 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 21:06:02.140633 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.132650 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 21:06:02.140633 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.132781 2557 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 21:06:02.140633 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.135273 2557 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 21:06:02.140633 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.136372 2557 server.go:1019] "Starting client certificate rotation" Jun 03 21:06:02.140633 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.136478 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 21:06:02.141003 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.136519 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 21:06:02.141003 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.138947 2557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 21:06:02.144436 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.144411 2557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 21:06:02.156591 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.156570 2557 log.go:25] "Validated CRI v1 runtime API" Jun 03 21:06:02.159261 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.159248 2557 log.go:25] "Validated CRI v1 image API" Jun 03 21:06:02.160008 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.159994 2557 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 21:06:02.162372 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.162344 2557 fs.go:135] Filesystem UUIDs: map[30aba584-63bd-471f-8891-0a78726b8712:/dev/nvme0n1p4 55f1ca83-5aa8-4468-af68-9a98e5c50f1a:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jun 03 21:06:02.162372 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.162365 2557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 21:06:02.166465 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.166445 2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 21:06:02.167221 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.167110 2557 manager.go:216] Machine: {Timestamp:2026-06-03 21:06:02.166583183 +0000 UTC m=+0.322761324 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3060613 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25b690bf26b5c7489136021694181c SystemUUID:ec25b690-bf26-b5c7-4891-36021694181c BootID:0b92ce8e-96dc-4028-9606-49a1bf5c82d7 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:42:d9:80:fe:53 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:42:d9:80:fe:53 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:12:2a:8e:66:16:e4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 21:06:02.167221 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.167216 2557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 21:06:02.167355 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.167343 2557 manager.go:232] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 21:06:02.169961 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.169936 2557 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 21:06:02.170113 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.169964 2557 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-203.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 21:06:02.170607 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.170597 2557 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 21:06:02.170638 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.170609 2557 container_manager_linux.go:309] "Creating device plugin manager" Jun 03 21:06:02.170638 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.170618 2557 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 21:06:02.170638 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.170629 2557 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 21:06:02.171412 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.171402 2557 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 03 21:06:02.174745 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.174732 2557 state_mem.go:36] "Initialized new in-memory state store" Jun 03 21:06:02.175055 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.175044 2557 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 03 21:06:02.175086 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.175078 2557 kubelet.go:486] "Attempting to sync node with API server" Jun 03 21:06:02.175113 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.175096 2557 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 21:06:02.175140 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.175127 2557 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 21:06:02.175140 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.175137 2557 kubelet.go:398] "Adding apiserver pod source" Jun 03 21:06:02.175212 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.175152 2557 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 21:06:02.175639 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.175626 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 21:06:02.175680 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.175647 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 21:06:02.178801 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.178778 2557 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 03 21:06:02.180825 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.180811 2557 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 21:06:02.180893 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.180842 2557 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 03 21:06:02.181746 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.181734 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 21:06:02.181790 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.181754 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 21:06:02.181790 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.181761 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 21:06:02.181790 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.181767 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 21:06:02.181790 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.181775 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 21:06:02.181790 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.181780 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 21:06:02.181790 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.181788 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 21:06:02.181935 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.181793 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 21:06:02.181935 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.181800 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 21:06:02.181935 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.181806 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 21:06:02.181935 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.181825 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 21:06:02.181935 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.181830 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 21:06:02.182486 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.182474 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 21:06:02.182486 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.182486 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 21:06:02.185925 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.185849 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hjfsx" Jun 03 21:06:02.185925 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.185857 2557 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-203.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 21:06:02.186406 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:02.186380 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-203.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 21:06:02.186809 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:02.186787 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 21:06:02.187075 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.187060 2557 server.go:1268] "Started kubelet" Jun 03 21:06:02.187233 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.187171 2557 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 21:06:02.187320 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.187202 2557 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 21:06:02.187320 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.187274 2557 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 03 21:06:02.187963 ip-10-0-137-203 systemd[1]: Started Kubernetes Kubelet. Jun 03 21:06:02.189131 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.188984 2557 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 21:06:02.189259 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.189246 2557 server.go:310] "Adding debug handlers to kubelet server" Jun 03 21:06:02.192443 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:02.191596 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-203.ec2.internal.18b5ae33195d8078 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-203.ec2.internal,UID:ip-10-0-137-203.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-203.ec2.internal,},FirstTimestamp:2026-06-03 21:06:02.187022456 +0000 UTC m=+0.343200596,LastTimestamp:2026-06-03 21:06:02.187022456 +0000 UTC m=+0.343200596,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-203.ec2.internal,}" Jun 03 21:06:02.193694 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.193677 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hjfsx" Jun 03 21:06:02.193694 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:02.193680 2557 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 21:06:02.194495 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.194478 2557 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 21:06:02.194577 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.194561 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 21:06:02.194769 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:02.194748 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-203.ec2.internal\" not found" Jun 03 21:06:02.195000 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.194982 2557 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 03 21:06:02.195088 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.195018 2557 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 03 21:06:02.195088 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.194983 2557 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 03 21:06:02.195195 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.195145 2557 reconstruct.go:97] "Volume reconstruction finished" Jun 03 21:06:02.195195 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.195169 2557 reconciler.go:29] "Reconciler: start to sync state" Jun 03 21:06:02.195820 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.195807 2557 factory.go:153] Registering CRI-O factory Jun 03 21:06:02.195820 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.195822 2557 factory.go:223] Registration of the crio container factory successfully Jun 03 21:06:02.195972 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.195901 2557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 21:06:02.195972 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.195909 2557 factory.go:55] Registering systemd factory Jun 03 21:06:02.195972 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.195915 2557 factory.go:223] Registration of the systemd container factory successfully Jun 03 21:06:02.195972 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.195935 2557 factory.go:103] Registering Raw factory Jun 03 21:06:02.195972 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.195949 2557 manager.go:1196] Started watching for new ooms in manager Jun 03 21:06:02.196786 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.196758 2557 manager.go:349] Starting recovery of all containers Jun 03 21:06:02.202750 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.202728 2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 21:06:02.206904 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:02.206879 2557 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-137-203.ec2.internal\" not found" node="ip-10-0-137-203.ec2.internal" Jun 03 21:06:02.207107 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.207094 2557 manager.go:354] Recovery completed Jun 03 21:06:02.213063 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.213049 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 21:06:02.214916 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.214900 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-203.ec2.internal" event="NodeHasSufficientMemory" Jun 03 21:06:02.214982 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.214932 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-203.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 21:06:02.214982 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.214946 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-203.ec2.internal" event="NodeHasSufficientPID" Jun 03 21:06:02.215454 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.215433 2557 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 21:06:02.215454 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.215448 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 21:06:02.215454 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.215452 2557 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 21:06:02.215643 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.215474 2557 state_mem.go:36] "Initialized new in-memory state store" Jun 03 21:06:02.216185 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.216169 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-203.ec2.internal" event="NodeHasSufficientMemory" Jun 03 21:06:02.216255 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.216194 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-203.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 21:06:02.216255 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.216209 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-203.ec2.internal" event="NodeHasSufficientPID" Jun 03 21:06:02.216564 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.216551 2557 policy_none.go:49] "None policy: Start" Jun 03 21:06:02.216621 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.216570 2557 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 03 21:06:02.216621 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.216584 2557 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 03 21:06:02.217631 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.217619 2557 policy_none.go:47] "Start" Jun 03 21:06:02.256065 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.256034 2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 03 21:06:02.258800 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.257458 2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 03 21:06:02.258800 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.257502 2557 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 03 21:06:02.258800 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.257528 2557 kubelet.go:2448] "Starting kubelet main sync loop" Jun 03 21:06:02.258800 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:02.257562 2557 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Jun 03 21:06:02.259989 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.259971 2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 21:06:02.261723 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.261693 2557 manager.go:337] "Starting Device Plugin manager" Jun 03 21:06:02.261864 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:02.261848 2557 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 21:06:02.261933 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.261867 2557 server.go:87] "Starting device plugin registration server" Jun 03 21:06:02.262119 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.262107 2557 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 21:06:02.262159 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.262121 2557 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 21:06:02.262266 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.262237 2557 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 21:06:02.262369 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.262340 2557 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 21:06:02.262369 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.262349 2557 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 21:06:02.263219 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:02.263201 2557 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 21:06:02.263296 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:02.263244 2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-203.ec2.internal\" not found" Jun 03 21:06:02.358459 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.358390 2557 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-203.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-203.ec2.internal"] Jun 03 21:06:02.358676 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.358517 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 21:06:02.360094 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.360078 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-203.ec2.internal" event="NodeHasSufficientMemory" Jun 03 21:06:02.360184 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.360107 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-203.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 21:06:02.360184 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.360117 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-203.ec2.internal" event="NodeHasSufficientPID" Jun 03 21:06:02.361317 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.361302 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 21:06:02.361444 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.361430 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-203.ec2.internal" Jun 03 21:06:02.361505 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.361467 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 21:06:02.362065 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.362049 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-203.ec2.internal" event="NodeHasSufficientMemory" Jun 03 21:06:02.362150 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.362074 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-203.ec2.internal" event="NodeHasSufficientMemory" Jun 03 21:06:02.362150 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.362097 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-203.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 21:06:02.362150 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.362112 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-203.ec2.internal" event="NodeHasSufficientPID" Jun 03 21:06:02.362150 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.362075 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-203.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 21:06:02.362346 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.362155 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-203.ec2.internal" event="NodeHasSufficientPID" Jun 03 21:06:02.362346 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.362229 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 21:06:02.362929 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.362913 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-203.ec2.internal" event="NodeHasSufficientMemory" Jun 03 21:06:02.363011 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.362940 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-203.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 21:06:02.363011 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.362954 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-203.ec2.internal" event="NodeHasSufficientPID" Jun 03 21:06:02.363011 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.362977 2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-203.ec2.internal" Jun 03 21:06:02.363220 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.363206 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-203.ec2.internal" Jun 03 21:06:02.363278 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.363232 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 21:06:02.363913 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.363900 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-203.ec2.internal" event="NodeHasSufficientMemory" Jun 03 21:06:02.363993 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.363927 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-203.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 21:06:02.363993 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.363964 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-203.ec2.internal" event="NodeHasSufficientPID" Jun 03 21:06:02.370702 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.370688 2557 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-203.ec2.internal" Jun 03 21:06:02.370784 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:02.370723 2557 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-203.ec2.internal\": node \"ip-10-0-137-203.ec2.internal\" not found" Jun 03 21:06:02.383788 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:02.383763 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-203.ec2.internal\" not found" Jun 03 21:06:02.394426 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:02.394399 2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-203.ec2.internal\" not found" node="ip-10-0-137-203.ec2.internal" Jun 03 21:06:02.398884 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:02.398864 2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-203.ec2.internal\" not found" node="ip-10-0-137-203.ec2.internal" Jun 03 21:06:02.484271 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:02.484237 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-203.ec2.internal\" not found" Jun 03 21:06:02.496166 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.496135 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e7d009f59f2cabdc00f532f0cd7f53d6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-203.ec2.internal\" (UID: \"e7d009f59f2cabdc00f532f0cd7f53d6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-203.ec2.internal" Jun 03 21:06:02.496297 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.496176 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7d009f59f2cabdc00f532f0cd7f53d6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-203.ec2.internal\" (UID: \"e7d009f59f2cabdc00f532f0cd7f53d6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-203.ec2.internal" Jun 03 21:06:02.496297 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.496202 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/57aa77ddd45f178c820d6322ca613602-config\") pod \"kube-apiserver-proxy-ip-10-0-137-203.ec2.internal\" (UID: \"57aa77ddd45f178c820d6322ca613602\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-203.ec2.internal" Jun 03 21:06:02.585299 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:02.585267 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-203.ec2.internal\" not found" Jun 03 21:06:02.596572 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.596548 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/57aa77ddd45f178c820d6322ca613602-config\") pod \"kube-apiserver-proxy-ip-10-0-137-203.ec2.internal\" (UID: \"57aa77ddd45f178c820d6322ca613602\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-203.ec2.internal" Jun 03 21:06:02.596672 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.596574 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/57aa77ddd45f178c820d6322ca613602-config\") pod \"kube-apiserver-proxy-ip-10-0-137-203.ec2.internal\" (UID: \"57aa77ddd45f178c820d6322ca613602\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-203.ec2.internal" Jun 03 21:06:02.596672 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.596645 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e7d009f59f2cabdc00f532f0cd7f53d6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-203.ec2.internal\" (UID: \"e7d009f59f2cabdc00f532f0cd7f53d6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-203.ec2.internal" Jun 03 21:06:02.596805 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.596686 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7d009f59f2cabdc00f532f0cd7f53d6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-203.ec2.internal\" (UID: \"e7d009f59f2cabdc00f532f0cd7f53d6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-203.ec2.internal" Jun 03 21:06:02.596805 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.596764 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e7d009f59f2cabdc00f532f0cd7f53d6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-203.ec2.internal\" (UID: \"e7d009f59f2cabdc00f532f0cd7f53d6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-203.ec2.internal" Jun 03 21:06:02.596805 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.596766 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7d009f59f2cabdc00f532f0cd7f53d6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-203.ec2.internal\" (UID: \"e7d009f59f2cabdc00f532f0cd7f53d6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-203.ec2.internal" Jun 03 21:06:02.686028 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:02.685950 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-203.ec2.internal\" not found" Jun 03 21:06:02.697267 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.697248 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-203.ec2.internal" Jun 03 21:06:02.702388 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:02.702370 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-203.ec2.internal" Jun 03 21:06:02.787058 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:02.787024 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-203.ec2.internal\" not found" Jun 03 21:06:02.887560 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:02.887513 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-203.ec2.internal\" not found" Jun 03 21:06:02.988065 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:02.987999 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-203.ec2.internal\" not found" Jun 03 21:06:03.007274 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.007245 2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 21:06:03.095220 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.095194 2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-203.ec2.internal" Jun 03 21:06:03.105822 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.105795 2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 21:06:03.107959 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.107939 2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-203.ec2.internal" Jun 03 21:06:03.116342 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.116323 2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 21:06:03.136452 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.136431 2557 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 21:06:03.136579 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.136558 2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 21:06:03.136645 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.136596 2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 21:06:03.136645 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.136607 2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 21:06:03.164747 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:03.164689 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7d009f59f2cabdc00f532f0cd7f53d6.slice/crio-ca106d7bf5b3908dd8558dd61390db151595494600718f409ef557f86110804e WatchSource:0}: Error finding container ca106d7bf5b3908dd8558dd61390db151595494600718f409ef557f86110804e: Status 404 returned error can't find the container with id ca106d7bf5b3908dd8558dd61390db151595494600718f409ef557f86110804e Jun 03 21:06:03.165260 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:03.165236 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57aa77ddd45f178c820d6322ca613602.slice/crio-634667b25e0f1221aee6ba05d61e4a0b23bbd4c6323201297d9883dec928f9f6 WatchSource:0}: Error finding container 634667b25e0f1221aee6ba05d61e4a0b23bbd4c6323201297d9883dec928f9f6: Status 404 returned error can't find the container with id 634667b25e0f1221aee6ba05d61e4a0b23bbd4c6323201297d9883dec928f9f6 Jun 03 21:06:03.169305 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.169290 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 21:06:03.175390 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.175375 2557 apiserver.go:52] "Watching apiserver" Jun 03 21:06:03.186589 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.186548 2557 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 21:06:03.187315 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.187289 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-4s9z9","kube-system/global-pull-secret-syncer-7mnlx","openshift-dns/node-resolver-6kb5w","openshift-image-registry/node-ca-54fxg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-203.ec2.internal","openshift-multus/multus-additional-cni-plugins-rpgl8","openshift-multus/network-metrics-daemon-bpb2j","openshift-network-diagnostics/network-check-target-b64br","openshift-ovn-kubernetes/ovnkube-node-jjpv5","kube-system/konnectivity-agent-ws7rg","kube-system/kube-apiserver-proxy-ip-10-0-137-203.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4xrp","openshift-cluster-node-tuning-operator/tuned-tpfhl","openshift-multus/multus-wtls7"] Jun 03 21:06:03.190785 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.190766 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpb2j" Jun 03 21:06:03.190862 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:03.190837 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpb2j" podUID="fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0" Jun 03 21:06:03.192519 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.192503 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b64br" Jun 03 21:06:03.192595 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:03.192553 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b64br" podUID="c61839be-8301-4c2b-ae73-097623a04e47" Jun 03 21:06:03.194520 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.194509 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6kb5w" Jun 03 21:06:03.194692 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.194673 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 21:06:03.196400 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.196376 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-54fxg" Jun 03 21:06:03.196567 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.196545 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 21:06:03.196667 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.196570 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-z47xq\"" Jun 03 21:06:03.196667 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.196595 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 21:06:03.197828 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.197785 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 21:01:02 +0000 UTC" deadline="2028-01-29 09:27:45.503054507 +0000 UTC" Jun 03 21:06:03.197907 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.197828 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14508h21m42.305230709s" Jun 03 21:06:03.197998 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.197983 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 21:06:03.198060 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.198019 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 21:06:03.198213 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.198195 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 21:06:03.198334 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.198318 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4s9z9" Jun 03 21:06:03.198442 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.198428 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2pd2g\"" Jun 03 21:06:03.199851 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.199828 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 21:06:03.199947 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.199864 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 21:06:03.199947 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.199935 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-gdzpw\"" Jun 03 21:06:03.200065 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.200048 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 21:06:03.200157 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.200137 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/40bf9386-4e9b-4bf1-a193-42924b2ce6b0-hosts-file\") pod \"node-resolver-6kb5w\" (UID: \"40bf9386-4e9b-4bf1-a193-42924b2ce6b0\") " pod="openshift-dns/node-resolver-6kb5w" Jun 03 21:06:03.200267 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.200170 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjn64\" (UniqueName: \"kubernetes.io/projected/40bf9386-4e9b-4bf1-a193-42924b2ce6b0-kube-api-access-rjn64\") pod \"node-resolver-6kb5w\" (UID: \"40bf9386-4e9b-4bf1-a193-42924b2ce6b0\") " pod="openshift-dns/node-resolver-6kb5w" Jun 03 21:06:03.200267 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.200198 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0-metrics-certs\") pod \"network-metrics-daemon-bpb2j\" (UID: \"fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0\") " pod="openshift-multus/network-metrics-daemon-bpb2j" Jun 03 21:06:03.200267 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.200225 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6f4x\" (UniqueName: \"kubernetes.io/projected/fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0-kube-api-access-x6f4x\") pod \"network-metrics-daemon-bpb2j\" (UID: \"fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0\") " pod="openshift-multus/network-metrics-daemon-bpb2j" Jun 03 21:06:03.200267 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.200257 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9rrl\" (UniqueName: \"kubernetes.io/projected/c61839be-8301-4c2b-ae73-097623a04e47-kube-api-access-m9rrl\") pod \"network-check-target-b64br\" (UID: \"c61839be-8301-4c2b-ae73-097623a04e47\") " pod="openshift-network-diagnostics/network-check-target-b64br" Jun 03 21:06:03.200446 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.200301 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40bf9386-4e9b-4bf1-a193-42924b2ce6b0-tmp-dir\") pod \"node-resolver-6kb5w\" (UID: \"40bf9386-4e9b-4bf1-a193-42924b2ce6b0\") " pod="openshift-dns/node-resolver-6kb5w" Jun 03 21:06:03.200446 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.200329 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e6ccb97c-a4b9-402d-9c33-33a1c4bf9041-host\") pod \"node-ca-54fxg\" (UID: \"e6ccb97c-a4b9-402d-9c33-33a1c4bf9041\") " pod="openshift-image-registry/node-ca-54fxg" Jun 03 21:06:03.200446 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.200370 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e6ccb97c-a4b9-402d-9c33-33a1c4bf9041-serviceca\") pod \"node-ca-54fxg\" (UID: \"e6ccb97c-a4b9-402d-9c33-33a1c4bf9041\") " pod="openshift-image-registry/node-ca-54fxg" Jun 03 21:06:03.200446 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.200393 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t85q7\" (UniqueName: \"kubernetes.io/projected/e6ccb97c-a4b9-402d-9c33-33a1c4bf9041-kube-api-access-t85q7\") pod \"node-ca-54fxg\" (UID: \"e6ccb97c-a4b9-402d-9c33-33a1c4bf9041\") " pod="openshift-image-registry/node-ca-54fxg" Jun 03 21:06:03.200637 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.200547 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rpgl8" Jun 03 21:06:03.202273 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.202250 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 21:06:03.202429 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.202413 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 21:06:03.202602 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.202588 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7jvrt\"" Jun 03 21:06:03.202805 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.202760 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.202805 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.202785 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 21:06:03.202943 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.202830 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 21:06:03.202943 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.202867 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 21:06:03.204661 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.204637 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 21:06:03.204661 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.204657 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-k88rb\"" Jun 03 21:06:03.204870 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.204673 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 21:06:03.204870 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.204734 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 21:06:03.204870 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.204739 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 21:06:03.205009 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.204956 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tpfhl" Jun 03 21:06:03.205306 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.205285 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 21:06:03.205399 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.205341 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 21:06:03.206820 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.206801 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 21:06:03.206911 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.206811 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-m96sz\"" Jun 03 21:06:03.206952 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.206910 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 21:06:03.207115 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.207103 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7mnlx" Jun 03 21:06:03.207174 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:03.207156 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7mnlx" podUID="1239087f-2fb2-48c1-a6d6-a77d4c3a8947" Jun 03 21:06:03.207269 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.207252 2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 21:06:03.209337 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.209325 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ws7rg" Jun 03 21:06:03.211025 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.211008 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 21:06:03.211025 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.211018 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-lcmcn\"" Jun 03 21:06:03.211309 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.211292 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 21:06:03.211498 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.211484 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wtls7" Jun 03 21:06:03.213089 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.213073 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 21:06:03.213942 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.213924 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jcjbw\"" Jun 03 21:06:03.214102 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.214088 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4xrp" Jun 03 21:06:03.215618 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.215601 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 21:06:03.215731 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.215603 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 21:06:03.218530 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.216277 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 21:06:03.218530 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.216354 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sz9rd\"" Jun 03 21:06:03.226692 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.226671 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-nwxdt" Jun 03 21:06:03.234833 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.234817 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-nwxdt" Jun 03 21:06:03.260805 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.260751 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-203.ec2.internal" event={"ID":"e7d009f59f2cabdc00f532f0cd7f53d6","Type":"ContainerStarted","Data":"ca106d7bf5b3908dd8558dd61390db151595494600718f409ef557f86110804e"} Jun 03 21:06:03.261856 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.261835 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-203.ec2.internal" event={"ID":"57aa77ddd45f178c820d6322ca613602","Type":"ContainerStarted","Data":"634667b25e0f1221aee6ba05d61e4a0b23bbd4c6323201297d9883dec928f9f6"} Jun 03 21:06:03.295871 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.295842 2557 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 03 21:06:03.301519 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.301498 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/40bf9386-4e9b-4bf1-a193-42924b2ce6b0-hosts-file\") pod \"node-resolver-6kb5w\" (UID: \"40bf9386-4e9b-4bf1-a193-42924b2ce6b0\") " pod="openshift-dns/node-resolver-6kb5w" Jun 03 21:06:03.301584 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.301529 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6f4x\" (UniqueName: \"kubernetes.io/projected/fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0-kube-api-access-x6f4x\") pod \"network-metrics-daemon-bpb2j\" (UID: \"fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0\") " pod="openshift-multus/network-metrics-daemon-bpb2j" Jun 03 21:06:03.301584 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.301551 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8f96219f-677e-46d7-adf9-8a6a44c129a3-os-release\") pod \"multus-wtls7\" (UID: \"8f96219f-677e-46d7-adf9-8a6a44c129a3\") " pod="openshift-multus/multus-wtls7" Jun 03 21:06:03.301584 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.301569 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8f96219f-677e-46d7-adf9-8a6a44c129a3-host-run-netns\") pod \"multus-wtls7\" (UID: \"8f96219f-677e-46d7-adf9-8a6a44c129a3\") " pod="openshift-multus/multus-wtls7" Jun 03 21:06:03.301808 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.301592 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f993f823-6a53-4a65-ba7f-e73ef2c96bd4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b4xrp\" (UID: \"f993f823-6a53-4a65-ba7f-e73ef2c96bd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4xrp" Jun 03 21:06:03.301808 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.301616 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/40bf9386-4e9b-4bf1-a193-42924b2ce6b0-hosts-file\") pod \"node-resolver-6kb5w\" (UID: \"40bf9386-4e9b-4bf1-a193-42924b2ce6b0\") " pod="openshift-dns/node-resolver-6kb5w" Jun 03 21:06:03.301808 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.301618 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c606d039-59f8-4cc1-90d3-6ffdae5639ea-var-lib-openvswitch\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.301808 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.301676 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c606d039-59f8-4cc1-90d3-6ffdae5639ea-ovnkube-script-lib\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.301808 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.301703 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0a81b1c2-565e-4b77-8139-e7f5f4b63f70-etc-modprobe-d\") pod \"tuned-tpfhl\" (UID: \"0a81b1c2-565e-4b77-8139-e7f5f4b63f70\") " pod="openshift-cluster-node-tuning-operator/tuned-tpfhl" Jun 03 21:06:03.301808 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.301752 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8f96219f-677e-46d7-adf9-8a6a44c129a3-host-run-multus-certs\") pod \"multus-wtls7\" (UID: \"8f96219f-677e-46d7-adf9-8a6a44c129a3\") " pod="openshift-multus/multus-wtls7" Jun 03 21:06:03.301808 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.301777 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f172af74-ae3c-447d-bab5-73244d8df822-iptables-alerter-script\") pod \"iptables-alerter-4s9z9\" (UID: \"f172af74-ae3c-447d-bab5-73244d8df822\") " pod="openshift-network-operator/iptables-alerter-4s9z9" Jun 03 21:06:03.301808 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.301802 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bc9138b8-63c1-4840-bf59-bc7dc9dc0e41-os-release\") pod \"multus-additional-cni-plugins-rpgl8\" (UID: \"bc9138b8-63c1-4840-bf59-bc7dc9dc0e41\") " pod="openshift-multus/multus-additional-cni-plugins-rpgl8" Jun 03 21:06:03.302140 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.301826 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1239087f-2fb2-48c1-a6d6-a77d4c3a8947-kubelet-config\") pod \"global-pull-secret-syncer-7mnlx\" (UID: \"1239087f-2fb2-48c1-a6d6-a77d4c3a8947\") " pod="kube-system/global-pull-secret-syncer-7mnlx" Jun 03 21:06:03.302140 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.301850 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1239087f-2fb2-48c1-a6d6-a77d4c3a8947-original-pull-secret\") pod \"global-pull-secret-syncer-7mnlx\" (UID: \"1239087f-2fb2-48c1-a6d6-a77d4c3a8947\") " pod="kube-system/global-pull-secret-syncer-7mnlx" Jun 03 21:06:03.302140 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.301873 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8f96219f-677e-46d7-adf9-8a6a44c129a3-cni-binary-copy\") pod \"multus-wtls7\" (UID: \"8f96219f-677e-46d7-adf9-8a6a44c129a3\") " pod="openshift-multus/multus-wtls7" Jun 03 21:06:03.302140 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.301896 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f96219f-677e-46d7-adf9-8a6a44c129a3-etc-kubernetes\") pod \"multus-wtls7\" (UID: \"8f96219f-677e-46d7-adf9-8a6a44c129a3\") " pod="openshift-multus/multus-wtls7" Jun 03 21:06:03.302140 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.301919 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f993f823-6a53-4a65-ba7f-e73ef2c96bd4-sys-fs\") pod \"aws-ebs-csi-driver-node-b4xrp\" (UID: \"f993f823-6a53-4a65-ba7f-e73ef2c96bd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4xrp" Jun 03 21:06:03.302140 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.301942 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c606d039-59f8-4cc1-90d3-6ffdae5639ea-host-slash\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.302140 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.301973 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c606d039-59f8-4cc1-90d3-6ffdae5639ea-host-cni-netd\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.302140 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.301996 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8f96219f-677e-46d7-adf9-8a6a44c129a3-multus-socket-dir-parent\") pod \"multus-wtls7\" (UID: \"8f96219f-677e-46d7-adf9-8a6a44c129a3\") " pod="openshift-multus/multus-wtls7" Jun 03 21:06:03.302140 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.302015 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bc9138b8-63c1-4840-bf59-bc7dc9dc0e41-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rpgl8\" (UID: \"bc9138b8-63c1-4840-bf59-bc7dc9dc0e41\") " pod="openshift-multus/multus-additional-cni-plugins-rpgl8" Jun 03 21:06:03.302140 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.302034 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0a81b1c2-565e-4b77-8139-e7f5f4b63f70-etc-sysctl-conf\") pod \"tuned-tpfhl\" (UID: \"0a81b1c2-565e-4b77-8139-e7f5f4b63f70\") " pod="openshift-cluster-node-tuning-operator/tuned-tpfhl" Jun 03 21:06:03.302140 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.302048 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0a81b1c2-565e-4b77-8139-e7f5f4b63f70-run\") pod \"tuned-tpfhl\" (UID: \"0a81b1c2-565e-4b77-8139-e7f5f4b63f70\") " pod="openshift-cluster-node-tuning-operator/tuned-tpfhl" Jun 03 21:06:03.302140 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.302062 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0a81b1c2-565e-4b77-8139-e7f5f4b63f70-lib-modules\") pod \"tuned-tpfhl\" (UID: \"0a81b1c2-565e-4b77-8139-e7f5f4b63f70\") " pod="openshift-cluster-node-tuning-operator/tuned-tpfhl" Jun 03 21:06:03.302140 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.302080 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjn64\" (UniqueName: \"kubernetes.io/projected/40bf9386-4e9b-4bf1-a193-42924b2ce6b0-kube-api-access-rjn64\") pod \"node-resolver-6kb5w\" (UID: \"40bf9386-4e9b-4bf1-a193-42924b2ce6b0\") " pod="openshift-dns/node-resolver-6kb5w" Jun 03 21:06:03.302140 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.302100 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0-metrics-certs\") pod \"network-metrics-daemon-bpb2j\" (UID: \"fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0\") " pod="openshift-multus/network-metrics-daemon-bpb2j" Jun 03 21:06:03.302140 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.302118 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8f96219f-677e-46d7-adf9-8a6a44c129a3-multus-daemon-config\") pod \"multus-wtls7\" (UID: \"8f96219f-677e-46d7-adf9-8a6a44c129a3\") " pod="openshift-multus/multus-wtls7" Jun 03 21:06:03.302140 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.302136 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5ckq\" (UniqueName: \"kubernetes.io/projected/bc9138b8-63c1-4840-bf59-bc7dc9dc0e41-kube-api-access-d5ckq\") pod \"multus-additional-cni-plugins-rpgl8\" (UID: \"bc9138b8-63c1-4840-bf59-bc7dc9dc0e41\") " pod="openshift-multus/multus-additional-cni-plugins-rpgl8" Jun 03 21:06:03.302761 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.302152 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0a81b1c2-565e-4b77-8139-e7f5f4b63f70-etc-kubernetes\") pod \"tuned-tpfhl\" (UID: \"0a81b1c2-565e-4b77-8139-e7f5f4b63f70\") " pod="openshift-cluster-node-tuning-operator/tuned-tpfhl" Jun 03 21:06:03.302761 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.302165 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0a81b1c2-565e-4b77-8139-e7f5f4b63f70-etc-sysctl-d\") pod \"tuned-tpfhl\" (UID: \"0a81b1c2-565e-4b77-8139-e7f5f4b63f70\") " pod="openshift-cluster-node-tuning-operator/tuned-tpfhl" Jun 03 21:06:03.302761 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.302187 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f96219f-677e-46d7-adf9-8a6a44c129a3-host-var-lib-kubelet\") pod \"multus-wtls7\" (UID: \"8f96219f-677e-46d7-adf9-8a6a44c129a3\") " pod="openshift-multus/multus-wtls7" Jun 03 21:06:03.302761 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:03.302187 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:06:03.302761 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.302220 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f993f823-6a53-4a65-ba7f-e73ef2c96bd4-socket-dir\") pod \"aws-ebs-csi-driver-node-b4xrp\" (UID: \"f993f823-6a53-4a65-ba7f-e73ef2c96bd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4xrp" Jun 03 21:06:03.302761 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:03.302248 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0-metrics-certs podName:fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0 nodeName:}" failed. No retries permitted until 2026-06-03 21:06:03.802230423 +0000 UTC m=+1.958408549 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0-metrics-certs") pod "network-metrics-daemon-bpb2j" (UID: "fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:06:03.302761 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.302283 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f172af74-ae3c-447d-bab5-73244d8df822-host-slash\") pod \"iptables-alerter-4s9z9\" (UID: \"f172af74-ae3c-447d-bab5-73244d8df822\") " pod="openshift-network-operator/iptables-alerter-4s9z9" Jun 03 21:06:03.302761 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.302300 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bc9138b8-63c1-4840-bf59-bc7dc9dc0e41-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rpgl8\" (UID: \"bc9138b8-63c1-4840-bf59-bc7dc9dc0e41\") " pod="openshift-multus/multus-additional-cni-plugins-rpgl8" Jun 03 21:06:03.302761 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.302314 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c606d039-59f8-4cc1-90d3-6ffdae5639ea-run-openvswitch\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.302761 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.302328 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0a81b1c2-565e-4b77-8139-e7f5f4b63f70-etc-sysconfig\") pod \"tuned-tpfhl\" (UID: \"0a81b1c2-565e-4b77-8139-e7f5f4b63f70\") " pod="openshift-cluster-node-tuning-operator/tuned-tpfhl" Jun 03 21:06:03.302761 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.302366 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0a81b1c2-565e-4b77-8139-e7f5f4b63f70-etc-systemd\") pod \"tuned-tpfhl\" (UID: \"0a81b1c2-565e-4b77-8139-e7f5f4b63f70\") " pod="openshift-cluster-node-tuning-operator/tuned-tpfhl" Jun 03 21:06:03.302761 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.302397 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0a81b1c2-565e-4b77-8139-e7f5f4b63f70-var-lib-kubelet\") pod \"tuned-tpfhl\" (UID: \"0a81b1c2-565e-4b77-8139-e7f5f4b63f70\") " pod="openshift-cluster-node-tuning-operator/tuned-tpfhl" Jun 03 21:06:03.302761 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.302420 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bb7a7428-4273-4603-9894-ca260d699287-agent-certs\") pod \"konnectivity-agent-ws7rg\" (UID: \"bb7a7428-4273-4603-9894-ca260d699287\") " pod="kube-system/konnectivity-agent-ws7rg" Jun 03 21:06:03.302761 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.302435 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8f96219f-677e-46d7-adf9-8a6a44c129a3-host-var-lib-cni-bin\") pod \"multus-wtls7\" (UID: \"8f96219f-677e-46d7-adf9-8a6a44c129a3\") " pod="openshift-multus/multus-wtls7" Jun 03 21:06:03.302761 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.302449 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8f96219f-677e-46d7-adf9-8a6a44c129a3-multus-conf-dir\") pod \"multus-wtls7\" (UID: \"8f96219f-677e-46d7-adf9-8a6a44c129a3\") " pod="openshift-multus/multus-wtls7" Jun 03 21:06:03.302761 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.302463 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0a81b1c2-565e-4b77-8139-e7f5f4b63f70-tmp\") pod \"tuned-tpfhl\" (UID: \"0a81b1c2-565e-4b77-8139-e7f5f4b63f70\") " pod="openshift-cluster-node-tuning-operator/tuned-tpfhl" Jun 03 21:06:03.303444 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.302484 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9rrl\" (UniqueName: \"kubernetes.io/projected/c61839be-8301-4c2b-ae73-097623a04e47-kube-api-access-m9rrl\") pod \"network-check-target-b64br\" (UID: \"c61839be-8301-4c2b-ae73-097623a04e47\") " pod="openshift-network-diagnostics/network-check-target-b64br" Jun 03 21:06:03.303444 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.302509 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40bf9386-4e9b-4bf1-a193-42924b2ce6b0-tmp-dir\") pod \"node-resolver-6kb5w\" (UID: \"40bf9386-4e9b-4bf1-a193-42924b2ce6b0\") " pod="openshift-dns/node-resolver-6kb5w" Jun 03 21:06:03.303444 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.302526 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t85q7\" (UniqueName: \"kubernetes.io/projected/e6ccb97c-a4b9-402d-9c33-33a1c4bf9041-kube-api-access-t85q7\") pod \"node-ca-54fxg\" (UID: \"e6ccb97c-a4b9-402d-9c33-33a1c4bf9041\") " pod="openshift-image-registry/node-ca-54fxg" Jun 03 21:06:03.303444 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.302540 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c606d039-59f8-4cc1-90d3-6ffdae5639ea-etc-openvswitch\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.303444 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.302554 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0a81b1c2-565e-4b77-8139-e7f5f4b63f70-host\") pod \"tuned-tpfhl\" (UID: \"0a81b1c2-565e-4b77-8139-e7f5f4b63f70\") " pod="openshift-cluster-node-tuning-operator/tuned-tpfhl" Jun 03 21:06:03.303444 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.302573 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9g659\" (UniqueName: \"kubernetes.io/projected/f993f823-6a53-4a65-ba7f-e73ef2c96bd4-kube-api-access-9g659\") pod \"aws-ebs-csi-driver-node-b4xrp\" (UID: \"f993f823-6a53-4a65-ba7f-e73ef2c96bd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4xrp" Jun 03 21:06:03.303444 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.302597 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bc9138b8-63c1-4840-bf59-bc7dc9dc0e41-cni-binary-copy\") pod \"multus-additional-cni-plugins-rpgl8\" (UID: \"bc9138b8-63c1-4840-bf59-bc7dc9dc0e41\") " pod="openshift-multus/multus-additional-cni-plugins-rpgl8" Jun 03 21:06:03.303444 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.302694 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c606d039-59f8-4cc1-90d3-6ffdae5639ea-node-log\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.303444 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.302727 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c606d039-59f8-4cc1-90d3-6ffdae5639ea-host-run-ovn-kubernetes\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.303444 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.302746 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e6ccb97c-a4b9-402d-9c33-33a1c4bf9041-host\") pod \"node-ca-54fxg\" (UID: \"e6ccb97c-a4b9-402d-9c33-33a1c4bf9041\") " pod="openshift-image-registry/node-ca-54fxg" Jun 03 21:06:03.303444 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.302761 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8f96219f-677e-46d7-adf9-8a6a44c129a3-host-run-k8s-cni-cncf-io\") pod \"multus-wtls7\" (UID: \"8f96219f-677e-46d7-adf9-8a6a44c129a3\") " pod="openshift-multus/multus-wtls7" Jun 03 21:06:03.303444 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.302782 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8f96219f-677e-46d7-adf9-8a6a44c129a3-host-var-lib-cni-multus\") pod \"multus-wtls7\" (UID: \"8f96219f-677e-46d7-adf9-8a6a44c129a3\") " pod="openshift-multus/multus-wtls7" Jun 03 21:06:03.303444 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.302814 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40bf9386-4e9b-4bf1-a193-42924b2ce6b0-tmp-dir\") pod \"node-resolver-6kb5w\" (UID: \"40bf9386-4e9b-4bf1-a193-42924b2ce6b0\") " pod="openshift-dns/node-resolver-6kb5w" Jun 03 21:06:03.303444 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.302833 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e6ccb97c-a4b9-402d-9c33-33a1c4bf9041-host\") pod \"node-ca-54fxg\" (UID: \"e6ccb97c-a4b9-402d-9c33-33a1c4bf9041\") " pod="openshift-image-registry/node-ca-54fxg" Jun 03 21:06:03.303444 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.302860 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c606d039-59f8-4cc1-90d3-6ffdae5639ea-ovn-node-metrics-cert\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.303444 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.302875 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f96219f-677e-46d7-adf9-8a6a44c129a3-system-cni-dir\") pod \"multus-wtls7\" (UID: \"8f96219f-677e-46d7-adf9-8a6a44c129a3\") " pod="openshift-multus/multus-wtls7" Jun 03 21:06:03.303444 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.302901 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc9138b8-63c1-4840-bf59-bc7dc9dc0e41-system-cni-dir\") pod \"multus-additional-cni-plugins-rpgl8\" (UID: \"bc9138b8-63c1-4840-bf59-bc7dc9dc0e41\") " pod="openshift-multus/multus-additional-cni-plugins-rpgl8" Jun 03 21:06:03.304122 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.302921 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bc9138b8-63c1-4840-bf59-bc7dc9dc0e41-cnibin\") pod \"multus-additional-cni-plugins-rpgl8\" (UID: \"bc9138b8-63c1-4840-bf59-bc7dc9dc0e41\") " pod="openshift-multus/multus-additional-cni-plugins-rpgl8" Jun 03 21:06:03.304122 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.302940 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c606d039-59f8-4cc1-90d3-6ffdae5639ea-run-systemd\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.304122 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.302955 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c606d039-59f8-4cc1-90d3-6ffdae5639ea-env-overrides\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.304122 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.302971 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0a81b1c2-565e-4b77-8139-e7f5f4b63f70-etc-tuned\") pod \"tuned-tpfhl\" (UID: \"0a81b1c2-565e-4b77-8139-e7f5f4b63f70\") " pod="openshift-cluster-node-tuning-operator/tuned-tpfhl" Jun 03 21:06:03.304122 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.302992 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wk7k\" (UniqueName: \"kubernetes.io/projected/0a81b1c2-565e-4b77-8139-e7f5f4b63f70-kube-api-access-9wk7k\") pod \"tuned-tpfhl\" (UID: \"0a81b1c2-565e-4b77-8139-e7f5f4b63f70\") " pod="openshift-cluster-node-tuning-operator/tuned-tpfhl" Jun 03 21:06:03.304122 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.303014 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1239087f-2fb2-48c1-a6d6-a77d4c3a8947-dbus\") pod \"global-pull-secret-syncer-7mnlx\" (UID: \"1239087f-2fb2-48c1-a6d6-a77d4c3a8947\") " pod="kube-system/global-pull-secret-syncer-7mnlx" Jun 03 21:06:03.304122 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.303043 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8f96219f-677e-46d7-adf9-8a6a44c129a3-hostroot\") pod \"multus-wtls7\" (UID: \"8f96219f-677e-46d7-adf9-8a6a44c129a3\") " pod="openshift-multus/multus-wtls7" Jun 03 21:06:03.304122 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.303069 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f993f823-6a53-4a65-ba7f-e73ef2c96bd4-registration-dir\") pod \"aws-ebs-csi-driver-node-b4xrp\" (UID: \"f993f823-6a53-4a65-ba7f-e73ef2c96bd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4xrp" Jun 03 21:06:03.304122 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.303087 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c606d039-59f8-4cc1-90d3-6ffdae5639ea-run-ovn\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.304122 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.303102 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c606d039-59f8-4cc1-90d3-6ffdae5639ea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.304122 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.303117 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bc9138b8-63c1-4840-bf59-bc7dc9dc0e41-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rpgl8\" (UID: \"bc9138b8-63c1-4840-bf59-bc7dc9dc0e41\") " pod="openshift-multus/multus-additional-cni-plugins-rpgl8" Jun 03 21:06:03.304122 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.303131 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c606d039-59f8-4cc1-90d3-6ffdae5639ea-host-kubelet\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.304122 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.303144 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c606d039-59f8-4cc1-90d3-6ffdae5639ea-systemd-units\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.304122 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.303161 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e6ccb97c-a4b9-402d-9c33-33a1c4bf9041-serviceca\") pod \"node-ca-54fxg\" (UID: \"e6ccb97c-a4b9-402d-9c33-33a1c4bf9041\") " pod="openshift-image-registry/node-ca-54fxg" Jun 03 21:06:03.304122 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.303184 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f96219f-677e-46d7-adf9-8a6a44c129a3-multus-cni-dir\") pod \"multus-wtls7\" (UID: \"8f96219f-677e-46d7-adf9-8a6a44c129a3\") " pod="openshift-multus/multus-wtls7" Jun 03 21:06:03.304122 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.303270 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8f96219f-677e-46d7-adf9-8a6a44c129a3-cnibin\") pod \"multus-wtls7\" (UID: \"8f96219f-677e-46d7-adf9-8a6a44c129a3\") " pod="openshift-multus/multus-wtls7" Jun 03 21:06:03.304627 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.303295 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f993f823-6a53-4a65-ba7f-e73ef2c96bd4-etc-selinux\") pod \"aws-ebs-csi-driver-node-b4xrp\" (UID: \"f993f823-6a53-4a65-ba7f-e73ef2c96bd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4xrp" Jun 03 21:06:03.304627 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.303317 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c606d039-59f8-4cc1-90d3-6ffdae5639ea-host-run-netns\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.304627 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.303333 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c606d039-59f8-4cc1-90d3-6ffdae5639ea-log-socket\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.304627 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.303347 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c606d039-59f8-4cc1-90d3-6ffdae5639ea-ovnkube-config\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.304627 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.303367 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0a81b1c2-565e-4b77-8139-e7f5f4b63f70-sys\") pod \"tuned-tpfhl\" (UID: \"0a81b1c2-565e-4b77-8139-e7f5f4b63f70\") " pod="openshift-cluster-node-tuning-operator/tuned-tpfhl" Jun 03 21:06:03.304627 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.303381 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96t8l\" (UniqueName: \"kubernetes.io/projected/8f96219f-677e-46d7-adf9-8a6a44c129a3-kube-api-access-96t8l\") pod \"multus-wtls7\" (UID: \"8f96219f-677e-46d7-adf9-8a6a44c129a3\") " pod="openshift-multus/multus-wtls7" Jun 03 21:06:03.304627 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.303395 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwh44\" (UniqueName: \"kubernetes.io/projected/f172af74-ae3c-447d-bab5-73244d8df822-kube-api-access-wwh44\") pod \"iptables-alerter-4s9z9\" (UID: \"f172af74-ae3c-447d-bab5-73244d8df822\") " pod="openshift-network-operator/iptables-alerter-4s9z9" Jun 03 21:06:03.304627 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.303421 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c606d039-59f8-4cc1-90d3-6ffdae5639ea-host-cni-bin\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.304627 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.303447 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bb7a7428-4273-4603-9894-ca260d699287-konnectivity-ca\") pod \"konnectivity-agent-ws7rg\" (UID: \"bb7a7428-4273-4603-9894-ca260d699287\") " pod="kube-system/konnectivity-agent-ws7rg" Jun 03 21:06:03.304627 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.303463 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f993f823-6a53-4a65-ba7f-e73ef2c96bd4-device-dir\") pod \"aws-ebs-csi-driver-node-b4xrp\" (UID: \"f993f823-6a53-4a65-ba7f-e73ef2c96bd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4xrp" Jun 03 21:06:03.304627 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.303499 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stznq\" (UniqueName: \"kubernetes.io/projected/c606d039-59f8-4cc1-90d3-6ffdae5639ea-kube-api-access-stznq\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.304627 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.304215 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e6ccb97c-a4b9-402d-9c33-33a1c4bf9041-serviceca\") pod \"node-ca-54fxg\" (UID: \"e6ccb97c-a4b9-402d-9c33-33a1c4bf9041\") " pod="openshift-image-registry/node-ca-54fxg" Jun 03 21:06:03.314880 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:03.314849 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 21:06:03.314880 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:03.314875 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 21:06:03.315067 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:03.314888 2557 projected.go:196] Error preparing data for projected volume kube-api-access-m9rrl for pod openshift-network-diagnostics/network-check-target-b64br: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:06:03.315067 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:03.314957 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c61839be-8301-4c2b-ae73-097623a04e47-kube-api-access-m9rrl podName:c61839be-8301-4c2b-ae73-097623a04e47 nodeName:}" failed. No retries permitted until 2026-06-03 21:06:03.814939345 +0000 UTC m=+1.971117471 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-m9rrl" (UniqueName: "kubernetes.io/projected/c61839be-8301-4c2b-ae73-097623a04e47-kube-api-access-m9rrl") pod "network-check-target-b64br" (UID: "c61839be-8301-4c2b-ae73-097623a04e47") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:06:03.318284 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.318241 2557 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 21:06:03.320895 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.320867 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t85q7\" (UniqueName: \"kubernetes.io/projected/e6ccb97c-a4b9-402d-9c33-33a1c4bf9041-kube-api-access-t85q7\") pod \"node-ca-54fxg\" (UID: \"e6ccb97c-a4b9-402d-9c33-33a1c4bf9041\") " pod="openshift-image-registry/node-ca-54fxg" Jun 03 21:06:03.320980 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.320867 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjn64\" (UniqueName: \"kubernetes.io/projected/40bf9386-4e9b-4bf1-a193-42924b2ce6b0-kube-api-access-rjn64\") pod \"node-resolver-6kb5w\" (UID: \"40bf9386-4e9b-4bf1-a193-42924b2ce6b0\") " pod="openshift-dns/node-resolver-6kb5w" Jun 03 21:06:03.320980 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.320867 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6f4x\" (UniqueName: \"kubernetes.io/projected/fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0-kube-api-access-x6f4x\") pod \"network-metrics-daemon-bpb2j\" (UID: \"fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0\") " pod="openshift-multus/network-metrics-daemon-bpb2j" Jun 03 21:06:03.347264 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.345601 2557 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 21:06:03.403811 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.403775 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1239087f-2fb2-48c1-a6d6-a77d4c3a8947-dbus\") pod \"global-pull-secret-syncer-7mnlx\" (UID: \"1239087f-2fb2-48c1-a6d6-a77d4c3a8947\") " pod="kube-system/global-pull-secret-syncer-7mnlx" Jun 03 21:06:03.403811 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.403808 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8f96219f-677e-46d7-adf9-8a6a44c129a3-hostroot\") pod \"multus-wtls7\" (UID: \"8f96219f-677e-46d7-adf9-8a6a44c129a3\") " pod="openshift-multus/multus-wtls7" Jun 03 21:06:03.404043 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.403824 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f993f823-6a53-4a65-ba7f-e73ef2c96bd4-registration-dir\") pod \"aws-ebs-csi-driver-node-b4xrp\" (UID: \"f993f823-6a53-4a65-ba7f-e73ef2c96bd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4xrp" Jun 03 21:06:03.404043 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.403840 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c606d039-59f8-4cc1-90d3-6ffdae5639ea-run-ovn\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.404043 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.403855 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c606d039-59f8-4cc1-90d3-6ffdae5639ea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.404043 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.403897 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c606d039-59f8-4cc1-90d3-6ffdae5639ea-run-ovn\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.404043 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.403902 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8f96219f-677e-46d7-adf9-8a6a44c129a3-hostroot\") pod \"multus-wtls7\" (UID: \"8f96219f-677e-46d7-adf9-8a6a44c129a3\") " pod="openshift-multus/multus-wtls7" Jun 03 21:06:03.404043 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.403924 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bc9138b8-63c1-4840-bf59-bc7dc9dc0e41-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rpgl8\" (UID: \"bc9138b8-63c1-4840-bf59-bc7dc9dc0e41\") " pod="openshift-multus/multus-additional-cni-plugins-rpgl8" Jun 03 21:06:03.404043 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.403944 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c606d039-59f8-4cc1-90d3-6ffdae5639ea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.404043 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.403923 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f993f823-6a53-4a65-ba7f-e73ef2c96bd4-registration-dir\") pod \"aws-ebs-csi-driver-node-b4xrp\" (UID: \"f993f823-6a53-4a65-ba7f-e73ef2c96bd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4xrp" Jun 03 21:06:03.404043 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.403960 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c606d039-59f8-4cc1-90d3-6ffdae5639ea-host-kubelet\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.404043 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.403983 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c606d039-59f8-4cc1-90d3-6ffdae5639ea-systemd-units\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.404043 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.404001 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f96219f-677e-46d7-adf9-8a6a44c129a3-multus-cni-dir\") pod \"multus-wtls7\" (UID: \"8f96219f-677e-46d7-adf9-8a6a44c129a3\") " pod="openshift-multus/multus-wtls7" Jun 03 21:06:03.404043 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.403998 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1239087f-2fb2-48c1-a6d6-a77d4c3a8947-dbus\") pod \"global-pull-secret-syncer-7mnlx\" (UID: \"1239087f-2fb2-48c1-a6d6-a77d4c3a8947\") " pod="kube-system/global-pull-secret-syncer-7mnlx" Jun 03 21:06:03.404043 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.404017 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8f96219f-677e-46d7-adf9-8a6a44c129a3-cnibin\") pod \"multus-wtls7\" (UID: \"8f96219f-677e-46d7-adf9-8a6a44c129a3\") " pod="openshift-multus/multus-wtls7" Jun 03 21:06:03.404043 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.404028 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c606d039-59f8-4cc1-90d3-6ffdae5639ea-host-kubelet\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.404043 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.404040 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f993f823-6a53-4a65-ba7f-e73ef2c96bd4-etc-selinux\") pod \"aws-ebs-csi-driver-node-b4xrp\" (UID: \"f993f823-6a53-4a65-ba7f-e73ef2c96bd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4xrp" Jun 03 21:06:03.404043 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.404041 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c606d039-59f8-4cc1-90d3-6ffdae5639ea-systemd-units\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.404776 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.404074 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f993f823-6a53-4a65-ba7f-e73ef2c96bd4-etc-selinux\") pod \"aws-ebs-csi-driver-node-b4xrp\" (UID: \"f993f823-6a53-4a65-ba7f-e73ef2c96bd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4xrp" Jun 03 21:06:03.404776 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.404079 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f96219f-677e-46d7-adf9-8a6a44c129a3-multus-cni-dir\") pod \"multus-wtls7\" (UID: \"8f96219f-677e-46d7-adf9-8a6a44c129a3\") " pod="openshift-multus/multus-wtls7" Jun 03 21:06:03.404776 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.404080 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bc9138b8-63c1-4840-bf59-bc7dc9dc0e41-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rpgl8\" (UID: \"bc9138b8-63c1-4840-bf59-bc7dc9dc0e41\") " pod="openshift-multus/multus-additional-cni-plugins-rpgl8" Jun 03 21:06:03.404776 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.404089 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c606d039-59f8-4cc1-90d3-6ffdae5639ea-host-run-netns\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.404776 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.404110 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c606d039-59f8-4cc1-90d3-6ffdae5639ea-host-run-netns\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.404776 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.404102 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8f96219f-677e-46d7-adf9-8a6a44c129a3-cnibin\") pod \"multus-wtls7\" (UID: \"8f96219f-677e-46d7-adf9-8a6a44c129a3\") " pod="openshift-multus/multus-wtls7" Jun 03 21:06:03.404776 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.404121 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c606d039-59f8-4cc1-90d3-6ffdae5639ea-log-socket\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.404776 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.404140 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c606d039-59f8-4cc1-90d3-6ffdae5639ea-log-socket\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.404776 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.404145 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c606d039-59f8-4cc1-90d3-6ffdae5639ea-ovnkube-config\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.404776 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.404163 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0a81b1c2-565e-4b77-8139-e7f5f4b63f70-sys\") pod \"tuned-tpfhl\" (UID: \"0a81b1c2-565e-4b77-8139-e7f5f4b63f70\") " pod="openshift-cluster-node-tuning-operator/tuned-tpfhl" Jun 03 21:06:03.404776 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.404194 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0a81b1c2-565e-4b77-8139-e7f5f4b63f70-sys\") pod \"tuned-tpfhl\" (UID: \"0a81b1c2-565e-4b77-8139-e7f5f4b63f70\") " pod="openshift-cluster-node-tuning-operator/tuned-tpfhl" Jun 03 21:06:03.404776 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.404242 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96t8l\" (UniqueName: \"kubernetes.io/projected/8f96219f-677e-46d7-adf9-8a6a44c129a3-kube-api-access-96t8l\") pod \"multus-wtls7\" (UID: \"8f96219f-677e-46d7-adf9-8a6a44c129a3\") " pod="openshift-multus/multus-wtls7" Jun 03 21:06:03.404776 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.404266 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwh44\" (UniqueName: \"kubernetes.io/projected/f172af74-ae3c-447d-bab5-73244d8df822-kube-api-access-wwh44\") pod \"iptables-alerter-4s9z9\" (UID: \"f172af74-ae3c-447d-bab5-73244d8df822\") " pod="openshift-network-operator/iptables-alerter-4s9z9" Jun 03 21:06:03.404776 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.404282 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c606d039-59f8-4cc1-90d3-6ffdae5639ea-host-cni-bin\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.404776 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.404297 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bb7a7428-4273-4603-9894-ca260d699287-konnectivity-ca\") pod \"konnectivity-agent-ws7rg\" (UID: \"bb7a7428-4273-4603-9894-ca260d699287\") " pod="kube-system/konnectivity-agent-ws7rg" Jun 03 21:06:03.404776 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.404311 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f993f823-6a53-4a65-ba7f-e73ef2c96bd4-device-dir\") pod \"aws-ebs-csi-driver-node-b4xrp\" (UID: \"f993f823-6a53-4a65-ba7f-e73ef2c96bd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4xrp" Jun 03 21:06:03.404776 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.404325 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stznq\" (UniqueName: \"kubernetes.io/projected/c606d039-59f8-4cc1-90d3-6ffdae5639ea-kube-api-access-stznq\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.404776 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.404352 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8f96219f-677e-46d7-adf9-8a6a44c129a3-os-release\") pod \"multus-wtls7\" (UID: \"8f96219f-677e-46d7-adf9-8a6a44c129a3\") " pod="openshift-multus/multus-wtls7" Jun 03 21:06:03.405633 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.404376 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8f96219f-677e-46d7-adf9-8a6a44c129a3-host-run-netns\") pod \"multus-wtls7\" (UID: \"8f96219f-677e-46d7-adf9-8a6a44c129a3\") " pod="openshift-multus/multus-wtls7" Jun 03 21:06:03.405633 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.404397 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f993f823-6a53-4a65-ba7f-e73ef2c96bd4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b4xrp\" (UID: \"f993f823-6a53-4a65-ba7f-e73ef2c96bd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4xrp" Jun 03 21:06:03.405633 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.404418 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c606d039-59f8-4cc1-90d3-6ffdae5639ea-var-lib-openvswitch\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.405633 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.404458 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c606d039-59f8-4cc1-90d3-6ffdae5639ea-host-cni-bin\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.405633 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.404461 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c606d039-59f8-4cc1-90d3-6ffdae5639ea-var-lib-openvswitch\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.405633 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.404499 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f993f823-6a53-4a65-ba7f-e73ef2c96bd4-device-dir\") pod \"aws-ebs-csi-driver-node-b4xrp\" (UID: \"f993f823-6a53-4a65-ba7f-e73ef2c96bd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4xrp" Jun 03 21:06:03.405633 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.404504 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c606d039-59f8-4cc1-90d3-6ffdae5639ea-ovnkube-script-lib\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.405633 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.404531 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0a81b1c2-565e-4b77-8139-e7f5f4b63f70-etc-modprobe-d\") pod \"tuned-tpfhl\" (UID: \"0a81b1c2-565e-4b77-8139-e7f5f4b63f70\") " pod="openshift-cluster-node-tuning-operator/tuned-tpfhl" Jun 03 21:06:03.405633 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.404557 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8f96219f-677e-46d7-adf9-8a6a44c129a3-host-run-multus-certs\") pod \"multus-wtls7\" (UID: \"8f96219f-677e-46d7-adf9-8a6a44c129a3\") " pod="openshift-multus/multus-wtls7" Jun 03 21:06:03.405633 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.404581 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f172af74-ae3c-447d-bab5-73244d8df822-iptables-alerter-script\") pod \"iptables-alerter-4s9z9\" (UID: \"f172af74-ae3c-447d-bab5-73244d8df822\") " pod="openshift-network-operator/iptables-alerter-4s9z9" Jun 03 21:06:03.405633 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.404605 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bc9138b8-63c1-4840-bf59-bc7dc9dc0e41-os-release\") pod \"multus-additional-cni-plugins-rpgl8\" (UID: \"bc9138b8-63c1-4840-bf59-bc7dc9dc0e41\") " pod="openshift-multus/multus-additional-cni-plugins-rpgl8" Jun 03 21:06:03.405633 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.404642 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1239087f-2fb2-48c1-a6d6-a77d4c3a8947-kubelet-config\") pod \"global-pull-secret-syncer-7mnlx\" (UID: \"1239087f-2fb2-48c1-a6d6-a77d4c3a8947\") " pod="kube-system/global-pull-secret-syncer-7mnlx" Jun 03 21:06:03.405633 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.404685 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c606d039-59f8-4cc1-90d3-6ffdae5639ea-ovnkube-config\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.405633 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.404734 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0a81b1c2-565e-4b77-8139-e7f5f4b63f70-etc-modprobe-d\") pod \"tuned-tpfhl\" (UID: \"0a81b1c2-565e-4b77-8139-e7f5f4b63f70\") " pod="openshift-cluster-node-tuning-operator/tuned-tpfhl" Jun 03 21:06:03.405633 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.404737 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bc9138b8-63c1-4840-bf59-bc7dc9dc0e41-os-release\") pod \"multus-additional-cni-plugins-rpgl8\" (UID: \"bc9138b8-63c1-4840-bf59-bc7dc9dc0e41\") " pod="openshift-multus/multus-additional-cni-plugins-rpgl8" Jun 03 21:06:03.405633 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.404749 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8f96219f-677e-46d7-adf9-8a6a44c129a3-host-run-multus-certs\") pod \"multus-wtls7\" (UID: \"8f96219f-677e-46d7-adf9-8a6a44c129a3\") " pod="openshift-multus/multus-wtls7" Jun 03 21:06:03.405633 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.404759 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bb7a7428-4273-4603-9894-ca260d699287-konnectivity-ca\") pod \"konnectivity-agent-ws7rg\" (UID: \"bb7a7428-4273-4603-9894-ca260d699287\") " pod="kube-system/konnectivity-agent-ws7rg" Jun 03 21:06:03.405633 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:03.404787 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 21:06:03.406549 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.404684 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1239087f-2fb2-48c1-a6d6-a77d4c3a8947-original-pull-secret\") pod \"global-pull-secret-syncer-7mnlx\" (UID: \"1239087f-2fb2-48c1-a6d6-a77d4c3a8947\") " pod="kube-system/global-pull-secret-syncer-7mnlx" Jun 03 21:06:03.406549 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.404817 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f993f823-6a53-4a65-ba7f-e73ef2c96bd4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b4xrp\" (UID: \"f993f823-6a53-4a65-ba7f-e73ef2c96bd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4xrp" Jun 03 21:06:03.406549 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.404832 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8f96219f-677e-46d7-adf9-8a6a44c129a3-cni-binary-copy\") pod \"multus-wtls7\" (UID: \"8f96219f-677e-46d7-adf9-8a6a44c129a3\") " pod="openshift-multus/multus-wtls7" Jun 03 21:06:03.406549 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:03.404850 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1239087f-2fb2-48c1-a6d6-a77d4c3a8947-original-pull-secret podName:1239087f-2fb2-48c1-a6d6-a77d4c3a8947 nodeName:}" failed. No retries permitted until 2026-06-03 21:06:03.904832991 +0000 UTC m=+2.061011118 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1239087f-2fb2-48c1-a6d6-a77d4c3a8947-original-pull-secret") pod "global-pull-secret-syncer-7mnlx" (UID: "1239087f-2fb2-48c1-a6d6-a77d4c3a8947") : object "kube-system"/"original-pull-secret" not registered Jun 03 21:06:03.406549 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.404891 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1239087f-2fb2-48c1-a6d6-a77d4c3a8947-kubelet-config\") pod \"global-pull-secret-syncer-7mnlx\" (UID: \"1239087f-2fb2-48c1-a6d6-a77d4c3a8947\") " pod="kube-system/global-pull-secret-syncer-7mnlx" Jun 03 21:06:03.406549 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.404788 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8f96219f-677e-46d7-adf9-8a6a44c129a3-host-run-netns\") pod \"multus-wtls7\" (UID: \"8f96219f-677e-46d7-adf9-8a6a44c129a3\") " pod="openshift-multus/multus-wtls7" Jun 03 21:06:03.406549 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.405008 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f96219f-677e-46d7-adf9-8a6a44c129a3-etc-kubernetes\") pod \"multus-wtls7\" (UID: \"8f96219f-677e-46d7-adf9-8a6a44c129a3\") " pod="openshift-multus/multus-wtls7" Jun 03 21:06:03.406549 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.405037 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f993f823-6a53-4a65-ba7f-e73ef2c96bd4-sys-fs\") pod \"aws-ebs-csi-driver-node-b4xrp\" (UID: \"f993f823-6a53-4a65-ba7f-e73ef2c96bd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4xrp" Jun 03 21:06:03.406549 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.405070 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c606d039-59f8-4cc1-90d3-6ffdae5639ea-host-slash\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.406549 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.405093 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c606d039-59f8-4cc1-90d3-6ffdae5639ea-host-cni-netd\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.406549 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.405102 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f96219f-677e-46d7-adf9-8a6a44c129a3-etc-kubernetes\") pod \"multus-wtls7\" (UID: \"8f96219f-677e-46d7-adf9-8a6a44c129a3\") " pod="openshift-multus/multus-wtls7" Jun 03 21:06:03.406549 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.405118 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8f96219f-677e-46d7-adf9-8a6a44c129a3-multus-socket-dir-parent\") pod \"multus-wtls7\" (UID: \"8f96219f-677e-46d7-adf9-8a6a44c129a3\") " pod="openshift-multus/multus-wtls7" Jun 03 21:06:03.406549 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.405147 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c606d039-59f8-4cc1-90d3-6ffdae5639ea-host-slash\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.406549 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.405153 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bc9138b8-63c1-4840-bf59-bc7dc9dc0e41-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rpgl8\" (UID: \"bc9138b8-63c1-4840-bf59-bc7dc9dc0e41\") " pod="openshift-multus/multus-additional-cni-plugins-rpgl8" Jun 03 21:06:03.406549 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.405180 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0a81b1c2-565e-4b77-8139-e7f5f4b63f70-etc-sysctl-conf\") pod \"tuned-tpfhl\" (UID: \"0a81b1c2-565e-4b77-8139-e7f5f4b63f70\") " pod="openshift-cluster-node-tuning-operator/tuned-tpfhl" Jun 03 21:06:03.406549 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.405194 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f993f823-6a53-4a65-ba7f-e73ef2c96bd4-sys-fs\") pod \"aws-ebs-csi-driver-node-b4xrp\" (UID: \"f993f823-6a53-4a65-ba7f-e73ef2c96bd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4xrp" Jun 03 21:06:03.406549 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.405204 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0a81b1c2-565e-4b77-8139-e7f5f4b63f70-run\") pod \"tuned-tpfhl\" (UID: \"0a81b1c2-565e-4b77-8139-e7f5f4b63f70\") " pod="openshift-cluster-node-tuning-operator/tuned-tpfhl" Jun 03 21:06:03.407436 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.405219 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8f96219f-677e-46d7-adf9-8a6a44c129a3-cni-binary-copy\") pod \"multus-wtls7\" (UID: \"8f96219f-677e-46d7-adf9-8a6a44c129a3\") " pod="openshift-multus/multus-wtls7" Jun 03 21:06:03.407436 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.405227 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0a81b1c2-565e-4b77-8139-e7f5f4b63f70-lib-modules\") pod \"tuned-tpfhl\" (UID: \"0a81b1c2-565e-4b77-8139-e7f5f4b63f70\") " pod="openshift-cluster-node-tuning-operator/tuned-tpfhl" Jun 03 21:06:03.407436 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.405244 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8f96219f-677e-46d7-adf9-8a6a44c129a3-multus-socket-dir-parent\") pod \"multus-wtls7\" (UID: \"8f96219f-677e-46d7-adf9-8a6a44c129a3\") " pod="openshift-multus/multus-wtls7" Jun 03 21:06:03.407436 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.405267 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8f96219f-677e-46d7-adf9-8a6a44c129a3-multus-daemon-config\") pod \"multus-wtls7\" (UID: \"8f96219f-677e-46d7-adf9-8a6a44c129a3\") " pod="openshift-multus/multus-wtls7" Jun 03 21:06:03.407436 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.405271 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f172af74-ae3c-447d-bab5-73244d8df822-iptables-alerter-script\") pod \"iptables-alerter-4s9z9\" (UID: \"f172af74-ae3c-447d-bab5-73244d8df822\") " pod="openshift-network-operator/iptables-alerter-4s9z9" Jun 03 21:06:03.407436 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.405288 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c606d039-59f8-4cc1-90d3-6ffdae5639ea-ovnkube-script-lib\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.407436 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.405294 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5ckq\" (UniqueName: \"kubernetes.io/projected/bc9138b8-63c1-4840-bf59-bc7dc9dc0e41-kube-api-access-d5ckq\") pod \"multus-additional-cni-plugins-rpgl8\" (UID: \"bc9138b8-63c1-4840-bf59-bc7dc9dc0e41\") " pod="openshift-multus/multus-additional-cni-plugins-rpgl8" Jun 03 21:06:03.407436 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.405301 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0a81b1c2-565e-4b77-8139-e7f5f4b63f70-run\") pod \"tuned-tpfhl\" (UID: \"0a81b1c2-565e-4b77-8139-e7f5f4b63f70\") " pod="openshift-cluster-node-tuning-operator/tuned-tpfhl" Jun 03 21:06:03.407436 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.405259 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c606d039-59f8-4cc1-90d3-6ffdae5639ea-host-cni-netd\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.407436 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.405316 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0a81b1c2-565e-4b77-8139-e7f5f4b63f70-etc-kubernetes\") pod \"tuned-tpfhl\" (UID: \"0a81b1c2-565e-4b77-8139-e7f5f4b63f70\") " pod="openshift-cluster-node-tuning-operator/tuned-tpfhl" Jun 03 21:06:03.407436 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.405319 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8f96219f-677e-46d7-adf9-8a6a44c129a3-os-release\") pod \"multus-wtls7\" (UID: \"8f96219f-677e-46d7-adf9-8a6a44c129a3\") " pod="openshift-multus/multus-wtls7" Jun 03 21:06:03.407436 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.405364 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0a81b1c2-565e-4b77-8139-e7f5f4b63f70-etc-sysctl-d\") pod \"tuned-tpfhl\" (UID: \"0a81b1c2-565e-4b77-8139-e7f5f4b63f70\") " pod="openshift-cluster-node-tuning-operator/tuned-tpfhl" Jun 03 21:06:03.407436 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.405375 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0a81b1c2-565e-4b77-8139-e7f5f4b63f70-etc-sysctl-conf\") pod \"tuned-tpfhl\" (UID: \"0a81b1c2-565e-4b77-8139-e7f5f4b63f70\") " pod="openshift-cluster-node-tuning-operator/tuned-tpfhl" Jun 03 21:06:03.407436 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.405392 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f96219f-677e-46d7-adf9-8a6a44c129a3-host-var-lib-kubelet\") pod \"multus-wtls7\" (UID: \"8f96219f-677e-46d7-adf9-8a6a44c129a3\") " pod="openshift-multus/multus-wtls7" Jun 03 21:06:03.407436 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.405416 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f993f823-6a53-4a65-ba7f-e73ef2c96bd4-socket-dir\") pod \"aws-ebs-csi-driver-node-b4xrp\" (UID: \"f993f823-6a53-4a65-ba7f-e73ef2c96bd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4xrp" Jun 03 21:06:03.407436 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.405420 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0a81b1c2-565e-4b77-8139-e7f5f4b63f70-lib-modules\") pod \"tuned-tpfhl\" (UID: \"0a81b1c2-565e-4b77-8139-e7f5f4b63f70\") " pod="openshift-cluster-node-tuning-operator/tuned-tpfhl" Jun 03 21:06:03.407436 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.405439 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f172af74-ae3c-447d-bab5-73244d8df822-host-slash\") pod \"iptables-alerter-4s9z9\" (UID: \"f172af74-ae3c-447d-bab5-73244d8df822\") " pod="openshift-network-operator/iptables-alerter-4s9z9" Jun 03 21:06:03.407436 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.405478 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f172af74-ae3c-447d-bab5-73244d8df822-host-slash\") pod \"iptables-alerter-4s9z9\" (UID: \"f172af74-ae3c-447d-bab5-73244d8df822\") " pod="openshift-network-operator/iptables-alerter-4s9z9" Jun 03 21:06:03.408333 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.405483 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0a81b1c2-565e-4b77-8139-e7f5f4b63f70-etc-kubernetes\") pod \"tuned-tpfhl\" (UID: \"0a81b1c2-565e-4b77-8139-e7f5f4b63f70\") " pod="openshift-cluster-node-tuning-operator/tuned-tpfhl" Jun 03 21:06:03.408333 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.405483 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0a81b1c2-565e-4b77-8139-e7f5f4b63f70-etc-sysctl-d\") pod \"tuned-tpfhl\" (UID: \"0a81b1c2-565e-4b77-8139-e7f5f4b63f70\") " pod="openshift-cluster-node-tuning-operator/tuned-tpfhl" Jun 03 21:06:03.408333 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.405514 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bc9138b8-63c1-4840-bf59-bc7dc9dc0e41-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rpgl8\" (UID: \"bc9138b8-63c1-4840-bf59-bc7dc9dc0e41\") " pod="openshift-multus/multus-additional-cni-plugins-rpgl8" Jun 03 21:06:03.408333 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.405552 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c606d039-59f8-4cc1-90d3-6ffdae5639ea-run-openvswitch\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.408333 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.405567 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f993f823-6a53-4a65-ba7f-e73ef2c96bd4-socket-dir\") pod \"aws-ebs-csi-driver-node-b4xrp\" (UID: \"f993f823-6a53-4a65-ba7f-e73ef2c96bd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4xrp" Jun 03 21:06:03.408333 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.405648 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0a81b1c2-565e-4b77-8139-e7f5f4b63f70-etc-sysconfig\") pod \"tuned-tpfhl\" (UID: \"0a81b1c2-565e-4b77-8139-e7f5f4b63f70\") " pod="openshift-cluster-node-tuning-operator/tuned-tpfhl" Jun 03 21:06:03.408333 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.405674 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0a81b1c2-565e-4b77-8139-e7f5f4b63f70-etc-systemd\") pod \"tuned-tpfhl\" (UID: \"0a81b1c2-565e-4b77-8139-e7f5f4b63f70\") " pod="openshift-cluster-node-tuning-operator/tuned-tpfhl" Jun 03 21:06:03.408333 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.405677 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c606d039-59f8-4cc1-90d3-6ffdae5639ea-run-openvswitch\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.408333 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.405732 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f96219f-677e-46d7-adf9-8a6a44c129a3-host-var-lib-kubelet\") pod \"multus-wtls7\" (UID: \"8f96219f-677e-46d7-adf9-8a6a44c129a3\") " pod="openshift-multus/multus-wtls7" Jun 03 21:06:03.408333 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.405738 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0a81b1c2-565e-4b77-8139-e7f5f4b63f70-etc-systemd\") pod \"tuned-tpfhl\" (UID: \"0a81b1c2-565e-4b77-8139-e7f5f4b63f70\") " pod="openshift-cluster-node-tuning-operator/tuned-tpfhl" Jun 03 21:06:03.408333 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.405740 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8f96219f-677e-46d7-adf9-8a6a44c129a3-multus-daemon-config\") pod \"multus-wtls7\" (UID: \"8f96219f-677e-46d7-adf9-8a6a44c129a3\") " pod="openshift-multus/multus-wtls7" Jun 03 21:06:03.408333 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.405769 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0a81b1c2-565e-4b77-8139-e7f5f4b63f70-var-lib-kubelet\") pod \"tuned-tpfhl\" (UID: \"0a81b1c2-565e-4b77-8139-e7f5f4b63f70\") " pod="openshift-cluster-node-tuning-operator/tuned-tpfhl" Jun 03 21:06:03.408333 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.405772 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0a81b1c2-565e-4b77-8139-e7f5f4b63f70-etc-sysconfig\") pod \"tuned-tpfhl\" (UID: \"0a81b1c2-565e-4b77-8139-e7f5f4b63f70\") " pod="openshift-cluster-node-tuning-operator/tuned-tpfhl" Jun 03 21:06:03.408333 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.405802 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bb7a7428-4273-4603-9894-ca260d699287-agent-certs\") pod \"konnectivity-agent-ws7rg\" (UID: \"bb7a7428-4273-4603-9894-ca260d699287\") " pod="kube-system/konnectivity-agent-ws7rg" Jun 03 21:06:03.408333 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.405821 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0a81b1c2-565e-4b77-8139-e7f5f4b63f70-var-lib-kubelet\") pod \"tuned-tpfhl\" (UID: \"0a81b1c2-565e-4b77-8139-e7f5f4b63f70\") " pod="openshift-cluster-node-tuning-operator/tuned-tpfhl" Jun 03 21:06:03.408333 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.405860 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8f96219f-677e-46d7-adf9-8a6a44c129a3-host-var-lib-cni-bin\") pod \"multus-wtls7\" (UID: \"8f96219f-677e-46d7-adf9-8a6a44c129a3\") " pod="openshift-multus/multus-wtls7" Jun 03 21:06:03.408333 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.405898 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bc9138b8-63c1-4840-bf59-bc7dc9dc0e41-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rpgl8\" (UID: \"bc9138b8-63c1-4840-bf59-bc7dc9dc0e41\") " pod="openshift-multus/multus-additional-cni-plugins-rpgl8" Jun 03 21:06:03.408864 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.405930 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8f96219f-677e-46d7-adf9-8a6a44c129a3-multus-conf-dir\") pod \"multus-wtls7\" (UID: \"8f96219f-677e-46d7-adf9-8a6a44c129a3\") " pod="openshift-multus/multus-wtls7" Jun 03 21:06:03.408864 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.405935 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bc9138b8-63c1-4840-bf59-bc7dc9dc0e41-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rpgl8\" (UID: \"bc9138b8-63c1-4840-bf59-bc7dc9dc0e41\") " pod="openshift-multus/multus-additional-cni-plugins-rpgl8" Jun 03 21:06:03.408864 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.405947 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8f96219f-677e-46d7-adf9-8a6a44c129a3-host-var-lib-cni-bin\") pod \"multus-wtls7\" (UID: \"8f96219f-677e-46d7-adf9-8a6a44c129a3\") " pod="openshift-multus/multus-wtls7" Jun 03 21:06:03.408864 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.405960 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8f96219f-677e-46d7-adf9-8a6a44c129a3-multus-conf-dir\") pod \"multus-wtls7\" (UID: \"8f96219f-677e-46d7-adf9-8a6a44c129a3\") " pod="openshift-multus/multus-wtls7" Jun 03 21:06:03.408864 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.405970 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0a81b1c2-565e-4b77-8139-e7f5f4b63f70-tmp\") pod \"tuned-tpfhl\" (UID: \"0a81b1c2-565e-4b77-8139-e7f5f4b63f70\") " pod="openshift-cluster-node-tuning-operator/tuned-tpfhl" Jun 03 21:06:03.408864 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.406010 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c606d039-59f8-4cc1-90d3-6ffdae5639ea-etc-openvswitch\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.408864 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.406032 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0a81b1c2-565e-4b77-8139-e7f5f4b63f70-host\") pod \"tuned-tpfhl\" (UID: \"0a81b1c2-565e-4b77-8139-e7f5f4b63f70\") " pod="openshift-cluster-node-tuning-operator/tuned-tpfhl" Jun 03 21:06:03.408864 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.406056 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9g659\" (UniqueName: \"kubernetes.io/projected/f993f823-6a53-4a65-ba7f-e73ef2c96bd4-kube-api-access-9g659\") pod \"aws-ebs-csi-driver-node-b4xrp\" (UID: \"f993f823-6a53-4a65-ba7f-e73ef2c96bd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4xrp" Jun 03 21:06:03.408864 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.406053 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c606d039-59f8-4cc1-90d3-6ffdae5639ea-etc-openvswitch\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.408864 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.406079 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bc9138b8-63c1-4840-bf59-bc7dc9dc0e41-cni-binary-copy\") pod \"multus-additional-cni-plugins-rpgl8\" (UID: \"bc9138b8-63c1-4840-bf59-bc7dc9dc0e41\") " pod="openshift-multus/multus-additional-cni-plugins-rpgl8" Jun 03 21:06:03.408864 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.406102 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c606d039-59f8-4cc1-90d3-6ffdae5639ea-node-log\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.408864 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.406119 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0a81b1c2-565e-4b77-8139-e7f5f4b63f70-host\") pod \"tuned-tpfhl\" (UID: \"0a81b1c2-565e-4b77-8139-e7f5f4b63f70\") " pod="openshift-cluster-node-tuning-operator/tuned-tpfhl" Jun 03 21:06:03.408864 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.406123 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c606d039-59f8-4cc1-90d3-6ffdae5639ea-host-run-ovn-kubernetes\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.408864 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.406159 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c606d039-59f8-4cc1-90d3-6ffdae5639ea-host-run-ovn-kubernetes\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.408864 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.406179 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8f96219f-677e-46d7-adf9-8a6a44c129a3-host-run-k8s-cni-cncf-io\") pod \"multus-wtls7\" (UID: \"8f96219f-677e-46d7-adf9-8a6a44c129a3\") " pod="openshift-multus/multus-wtls7" Jun 03 21:06:03.408864 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.406194 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c606d039-59f8-4cc1-90d3-6ffdae5639ea-node-log\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.408864 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.406204 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8f96219f-677e-46d7-adf9-8a6a44c129a3-host-var-lib-cni-multus\") pod \"multus-wtls7\" (UID: \"8f96219f-677e-46d7-adf9-8a6a44c129a3\") " pod="openshift-multus/multus-wtls7" Jun 03 21:06:03.409328 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.406225 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8f96219f-677e-46d7-adf9-8a6a44c129a3-host-run-k8s-cni-cncf-io\") pod \"multus-wtls7\" (UID: \"8f96219f-677e-46d7-adf9-8a6a44c129a3\") " pod="openshift-multus/multus-wtls7" Jun 03 21:06:03.409328 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.406240 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c606d039-59f8-4cc1-90d3-6ffdae5639ea-ovn-node-metrics-cert\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.409328 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.406271 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f96219f-677e-46d7-adf9-8a6a44c129a3-system-cni-dir\") pod \"multus-wtls7\" (UID: \"8f96219f-677e-46d7-adf9-8a6a44c129a3\") " pod="openshift-multus/multus-wtls7" Jun 03 21:06:03.409328 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.406267 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8f96219f-677e-46d7-adf9-8a6a44c129a3-host-var-lib-cni-multus\") pod \"multus-wtls7\" (UID: \"8f96219f-677e-46d7-adf9-8a6a44c129a3\") " pod="openshift-multus/multus-wtls7" Jun 03 21:06:03.409328 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.406297 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc9138b8-63c1-4840-bf59-bc7dc9dc0e41-system-cni-dir\") pod \"multus-additional-cni-plugins-rpgl8\" (UID: \"bc9138b8-63c1-4840-bf59-bc7dc9dc0e41\") " pod="openshift-multus/multus-additional-cni-plugins-rpgl8" Jun 03 21:06:03.409328 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.406320 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bc9138b8-63c1-4840-bf59-bc7dc9dc0e41-cnibin\") pod \"multus-additional-cni-plugins-rpgl8\" (UID: \"bc9138b8-63c1-4840-bf59-bc7dc9dc0e41\") " pod="openshift-multus/multus-additional-cni-plugins-rpgl8" Jun 03 21:06:03.409328 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.406346 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c606d039-59f8-4cc1-90d3-6ffdae5639ea-run-systemd\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.409328 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.406353 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc9138b8-63c1-4840-bf59-bc7dc9dc0e41-system-cni-dir\") pod \"multus-additional-cni-plugins-rpgl8\" (UID: \"bc9138b8-63c1-4840-bf59-bc7dc9dc0e41\") " pod="openshift-multus/multus-additional-cni-plugins-rpgl8" Jun 03 21:06:03.409328 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.406323 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f96219f-677e-46d7-adf9-8a6a44c129a3-system-cni-dir\") pod \"multus-wtls7\" (UID: \"8f96219f-677e-46d7-adf9-8a6a44c129a3\") " pod="openshift-multus/multus-wtls7" Jun 03 21:06:03.409328 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.406370 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c606d039-59f8-4cc1-90d3-6ffdae5639ea-env-overrides\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.409328 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.406374 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bc9138b8-63c1-4840-bf59-bc7dc9dc0e41-cnibin\") pod \"multus-additional-cni-plugins-rpgl8\" (UID: \"bc9138b8-63c1-4840-bf59-bc7dc9dc0e41\") " pod="openshift-multus/multus-additional-cni-plugins-rpgl8" Jun 03 21:06:03.409328 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.406394 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0a81b1c2-565e-4b77-8139-e7f5f4b63f70-etc-tuned\") pod \"tuned-tpfhl\" (UID: \"0a81b1c2-565e-4b77-8139-e7f5f4b63f70\") " pod="openshift-cluster-node-tuning-operator/tuned-tpfhl" Jun 03 21:06:03.409328 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.406419 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wk7k\" (UniqueName: \"kubernetes.io/projected/0a81b1c2-565e-4b77-8139-e7f5f4b63f70-kube-api-access-9wk7k\") pod \"tuned-tpfhl\" (UID: \"0a81b1c2-565e-4b77-8139-e7f5f4b63f70\") " pod="openshift-cluster-node-tuning-operator/tuned-tpfhl" Jun 03 21:06:03.409328 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.406560 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bc9138b8-63c1-4840-bf59-bc7dc9dc0e41-cni-binary-copy\") pod \"multus-additional-cni-plugins-rpgl8\" (UID: \"bc9138b8-63c1-4840-bf59-bc7dc9dc0e41\") " pod="openshift-multus/multus-additional-cni-plugins-rpgl8" Jun 03 21:06:03.409328 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.406396 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c606d039-59f8-4cc1-90d3-6ffdae5639ea-run-systemd\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.409328 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.406776 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c606d039-59f8-4cc1-90d3-6ffdae5639ea-env-overrides\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.409328 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.408303 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c606d039-59f8-4cc1-90d3-6ffdae5639ea-ovn-node-metrics-cert\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.409816 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.408340 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0a81b1c2-565e-4b77-8139-e7f5f4b63f70-etc-tuned\") pod \"tuned-tpfhl\" (UID: \"0a81b1c2-565e-4b77-8139-e7f5f4b63f70\") " pod="openshift-cluster-node-tuning-operator/tuned-tpfhl" Jun 03 21:06:03.409816 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.408354 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bb7a7428-4273-4603-9894-ca260d699287-agent-certs\") pod \"konnectivity-agent-ws7rg\" (UID: \"bb7a7428-4273-4603-9894-ca260d699287\") " pod="kube-system/konnectivity-agent-ws7rg" Jun 03 21:06:03.409816 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.408421 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0a81b1c2-565e-4b77-8139-e7f5f4b63f70-tmp\") pod \"tuned-tpfhl\" (UID: \"0a81b1c2-565e-4b77-8139-e7f5f4b63f70\") " pod="openshift-cluster-node-tuning-operator/tuned-tpfhl" Jun 03 21:06:03.412103 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.412076 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96t8l\" (UniqueName: \"kubernetes.io/projected/8f96219f-677e-46d7-adf9-8a6a44c129a3-kube-api-access-96t8l\") pod \"multus-wtls7\" (UID: \"8f96219f-677e-46d7-adf9-8a6a44c129a3\") " pod="openshift-multus/multus-wtls7" Jun 03 21:06:03.413045 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.413019 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwh44\" (UniqueName: \"kubernetes.io/projected/f172af74-ae3c-447d-bab5-73244d8df822-kube-api-access-wwh44\") pod \"iptables-alerter-4s9z9\" (UID: \"f172af74-ae3c-447d-bab5-73244d8df822\") " pod="openshift-network-operator/iptables-alerter-4s9z9" Jun 03 21:06:03.413260 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.413241 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9g659\" (UniqueName: \"kubernetes.io/projected/f993f823-6a53-4a65-ba7f-e73ef2c96bd4-kube-api-access-9g659\") pod \"aws-ebs-csi-driver-node-b4xrp\" (UID: \"f993f823-6a53-4a65-ba7f-e73ef2c96bd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4xrp" Jun 03 21:06:03.413772 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.413750 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stznq\" (UniqueName: \"kubernetes.io/projected/c606d039-59f8-4cc1-90d3-6ffdae5639ea-kube-api-access-stznq\") pod \"ovnkube-node-jjpv5\" (UID: \"c606d039-59f8-4cc1-90d3-6ffdae5639ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.413772 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.413766 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5ckq\" (UniqueName: \"kubernetes.io/projected/bc9138b8-63c1-4840-bf59-bc7dc9dc0e41-kube-api-access-d5ckq\") pod \"multus-additional-cni-plugins-rpgl8\" (UID: \"bc9138b8-63c1-4840-bf59-bc7dc9dc0e41\") " pod="openshift-multus/multus-additional-cni-plugins-rpgl8" Jun 03 21:06:03.413889 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.413863 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wk7k\" (UniqueName: \"kubernetes.io/projected/0a81b1c2-565e-4b77-8139-e7f5f4b63f70-kube-api-access-9wk7k\") pod \"tuned-tpfhl\" (UID: \"0a81b1c2-565e-4b77-8139-e7f5f4b63f70\") " pod="openshift-cluster-node-tuning-operator/tuned-tpfhl" Jun 03 21:06:03.504881 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.504786 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6kb5w" Jun 03 21:06:03.512221 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.512201 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-54fxg" Jun 03 21:06:03.515465 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:03.515438 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40bf9386_4e9b_4bf1_a193_42924b2ce6b0.slice/crio-4435cb4a65dcc9135cd4849c631fd03cd25ed5c845b4b07330b8819266132608 WatchSource:0}: Error finding container 4435cb4a65dcc9135cd4849c631fd03cd25ed5c845b4b07330b8819266132608: Status 404 returned error can't find the container with id 4435cb4a65dcc9135cd4849c631fd03cd25ed5c845b4b07330b8819266132608 Jun 03 21:06:03.521667 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.521646 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4s9z9" Jun 03 21:06:03.521946 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:03.521928 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6ccb97c_a4b9_402d_9c33_33a1c4bf9041.slice/crio-5dcfb590fe2fcadf396f3997c163ed12d775302d5ea01831a85b91eec975f136 WatchSource:0}: Error finding container 5dcfb590fe2fcadf396f3997c163ed12d775302d5ea01831a85b91eec975f136: Status 404 returned error can't find the container with id 5dcfb590fe2fcadf396f3997c163ed12d775302d5ea01831a85b91eec975f136 Jun 03 21:06:03.524579 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.524556 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rpgl8" Jun 03 21:06:03.530047 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.530032 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:03.531354 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:03.531334 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf172af74_ae3c_447d_bab5_73244d8df822.slice/crio-2fe8dc1a2d4571a694b1a6bebba6ad27b8e247520d2ab2dde6de360901909999 WatchSource:0}: Error finding container 2fe8dc1a2d4571a694b1a6bebba6ad27b8e247520d2ab2dde6de360901909999: Status 404 returned error can't find the container with id 2fe8dc1a2d4571a694b1a6bebba6ad27b8e247520d2ab2dde6de360901909999 Jun 03 21:06:03.534469 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:03.534439 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc9138b8_63c1_4840_bf59_bc7dc9dc0e41.slice/crio-3ca4deca4182c1849da9d9a01efc17575cf986cd7362b36d7be780e619a52cc8 WatchSource:0}: Error finding container 3ca4deca4182c1849da9d9a01efc17575cf986cd7362b36d7be780e619a52cc8: Status 404 returned error can't find the container with id 3ca4deca4182c1849da9d9a01efc17575cf986cd7362b36d7be780e619a52cc8 Jun 03 21:06:03.535147 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.535130 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tpfhl" Jun 03 21:06:03.540201 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.540183 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ws7rg" Jun 03 21:06:03.542133 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:03.542114 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc606d039_59f8_4cc1_90d3_6ffdae5639ea.slice/crio-da1dc52045285f41cf8acce516998cee7ce7c1a3660738bad0639a847db62d2f WatchSource:0}: Error finding container da1dc52045285f41cf8acce516998cee7ce7c1a3660738bad0639a847db62d2f: Status 404 returned error can't find the container with id da1dc52045285f41cf8acce516998cee7ce7c1a3660738bad0639a847db62d2f Jun 03 21:06:03.545061 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:03.545037 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a81b1c2_565e_4b77_8139_e7f5f4b63f70.slice/crio-edd5422bbd2bb8d1bfcbcec4c681e4c61d11038361c3d8b669886c643a0591e6 WatchSource:0}: Error finding container edd5422bbd2bb8d1bfcbcec4c681e4c61d11038361c3d8b669886c643a0591e6: Status 404 returned error can't find the container with id edd5422bbd2bb8d1bfcbcec4c681e4c61d11038361c3d8b669886c643a0591e6 Jun 03 21:06:03.545895 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.545878 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wtls7" Jun 03 21:06:03.550042 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.550024 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4xrp" Jun 03 21:06:03.550253 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:03.550228 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb7a7428_4273_4603_9894_ca260d699287.slice/crio-a7d9dfb1c828350ad46ed4adf8a4cd8dc4c47f86ab6b409216483e341d106eda WatchSource:0}: Error finding container a7d9dfb1c828350ad46ed4adf8a4cd8dc4c47f86ab6b409216483e341d106eda: Status 404 returned error can't find the container with id a7d9dfb1c828350ad46ed4adf8a4cd8dc4c47f86ab6b409216483e341d106eda Jun 03 21:06:03.555593 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:03.555569 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f96219f_677e_46d7_adf9_8a6a44c129a3.slice/crio-6e15a561fb2a5ce0bbc87279b0a46666b2e47ebf0ad15df80d58fdf76d6a7794 WatchSource:0}: Error finding container 6e15a561fb2a5ce0bbc87279b0a46666b2e47ebf0ad15df80d58fdf76d6a7794: Status 404 returned error can't find the container with id 6e15a561fb2a5ce0bbc87279b0a46666b2e47ebf0ad15df80d58fdf76d6a7794 Jun 03 21:06:03.559365 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:03.559337 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf993f823_6a53_4a65_ba7f_e73ef2c96bd4.slice/crio-e95abac291638c58777f7668a41eaf215a52a3f0ba45caacb2cedc4f9fc7a044 WatchSource:0}: Error finding container e95abac291638c58777f7668a41eaf215a52a3f0ba45caacb2cedc4f9fc7a044: Status 404 returned error can't find the container with id e95abac291638c58777f7668a41eaf215a52a3f0ba45caacb2cedc4f9fc7a044 Jun 03 21:06:03.810422 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.810338 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0-metrics-certs\") pod \"network-metrics-daemon-bpb2j\" (UID: \"fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0\") " pod="openshift-multus/network-metrics-daemon-bpb2j" Jun 03 21:06:03.810589 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:03.810533 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:06:03.810652 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:03.810612 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0-metrics-certs podName:fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0 nodeName:}" failed. No retries permitted until 2026-06-03 21:06:04.810593764 +0000 UTC m=+2.966771899 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0-metrics-certs") pod "network-metrics-daemon-bpb2j" (UID: "fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:06:03.912003 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.911227 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1239087f-2fb2-48c1-a6d6-a77d4c3a8947-original-pull-secret\") pod \"global-pull-secret-syncer-7mnlx\" (UID: \"1239087f-2fb2-48c1-a6d6-a77d4c3a8947\") " pod="kube-system/global-pull-secret-syncer-7mnlx" Jun 03 21:06:03.912003 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:03.911303 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9rrl\" (UniqueName: \"kubernetes.io/projected/c61839be-8301-4c2b-ae73-097623a04e47-kube-api-access-m9rrl\") pod \"network-check-target-b64br\" (UID: \"c61839be-8301-4c2b-ae73-097623a04e47\") " pod="openshift-network-diagnostics/network-check-target-b64br" Jun 03 21:06:03.912003 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:03.911439 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 21:06:03.912003 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:03.911457 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 21:06:03.912003 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:03.911470 2557 projected.go:196] Error preparing data for projected volume kube-api-access-m9rrl for pod openshift-network-diagnostics/network-check-target-b64br: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:06:03.912003 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:03.911522 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c61839be-8301-4c2b-ae73-097623a04e47-kube-api-access-m9rrl podName:c61839be-8301-4c2b-ae73-097623a04e47 nodeName:}" failed. No retries permitted until 2026-06-03 21:06:04.911504715 +0000 UTC m=+3.067682856 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-m9rrl" (UniqueName: "kubernetes.io/projected/c61839be-8301-4c2b-ae73-097623a04e47-kube-api-access-m9rrl") pod "network-check-target-b64br" (UID: "c61839be-8301-4c2b-ae73-097623a04e47") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:06:03.912003 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:03.911918 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 21:06:03.912003 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:03.911969 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1239087f-2fb2-48c1-a6d6-a77d4c3a8947-original-pull-secret podName:1239087f-2fb2-48c1-a6d6-a77d4c3a8947 nodeName:}" failed. No retries permitted until 2026-06-03 21:06:04.911954461 +0000 UTC m=+3.068132590 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1239087f-2fb2-48c1-a6d6-a77d4c3a8947-original-pull-secret") pod "global-pull-secret-syncer-7mnlx" (UID: "1239087f-2fb2-48c1-a6d6-a77d4c3a8947") : object "kube-system"/"original-pull-secret" not registered Jun 03 21:06:04.238540 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:04.238433 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 21:01:03 +0000 UTC" deadline="2027-11-15 12:27:08.611166021 +0000 UTC" Jun 03 21:06:04.238540 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:04.238472 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12711h21m4.372698652s" Jun 03 21:06:04.286285 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:04.286187 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tpfhl" event={"ID":"0a81b1c2-565e-4b77-8139-e7f5f4b63f70","Type":"ContainerStarted","Data":"edd5422bbd2bb8d1bfcbcec4c681e4c61d11038361c3d8b669886c643a0591e6"} Jun 03 21:06:04.289252 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:04.289145 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rpgl8" event={"ID":"bc9138b8-63c1-4840-bf59-bc7dc9dc0e41","Type":"ContainerStarted","Data":"3ca4deca4182c1849da9d9a01efc17575cf986cd7362b36d7be780e619a52cc8"} Jun 03 21:06:04.295170 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:04.295114 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4s9z9" event={"ID":"f172af74-ae3c-447d-bab5-73244d8df822","Type":"ContainerStarted","Data":"2fe8dc1a2d4571a694b1a6bebba6ad27b8e247520d2ab2dde6de360901909999"} Jun 03 21:06:04.318332 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:04.318120 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6kb5w" event={"ID":"40bf9386-4e9b-4bf1-a193-42924b2ce6b0","Type":"ContainerStarted","Data":"4435cb4a65dcc9135cd4849c631fd03cd25ed5c845b4b07330b8819266132608"} Jun 03 21:06:04.321962 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:04.321931 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4xrp" event={"ID":"f993f823-6a53-4a65-ba7f-e73ef2c96bd4","Type":"ContainerStarted","Data":"e95abac291638c58777f7668a41eaf215a52a3f0ba45caacb2cedc4f9fc7a044"} Jun 03 21:06:04.328047 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:04.328012 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wtls7" event={"ID":"8f96219f-677e-46d7-adf9-8a6a44c129a3","Type":"ContainerStarted","Data":"6e15a561fb2a5ce0bbc87279b0a46666b2e47ebf0ad15df80d58fdf76d6a7794"} Jun 03 21:06:04.343833 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:04.343799 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ws7rg" event={"ID":"bb7a7428-4273-4603-9894-ca260d699287","Type":"ContainerStarted","Data":"a7d9dfb1c828350ad46ed4adf8a4cd8dc4c47f86ab6b409216483e341d106eda"} Jun 03 21:06:04.360737 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:04.360686 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" event={"ID":"c606d039-59f8-4cc1-90d3-6ffdae5639ea","Type":"ContainerStarted","Data":"da1dc52045285f41cf8acce516998cee7ce7c1a3660738bad0639a847db62d2f"} Jun 03 21:06:04.370680 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:04.367563 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-54fxg" event={"ID":"e6ccb97c-a4b9-402d-9c33-33a1c4bf9041","Type":"ContainerStarted","Data":"5dcfb590fe2fcadf396f3997c163ed12d775302d5ea01831a85b91eec975f136"} Jun 03 21:06:04.578061 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:04.577775 2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 21:06:04.581953 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:04.581796 2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 21:06:04.823462 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:04.823420 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0-metrics-certs\") pod \"network-metrics-daemon-bpb2j\" (UID: \"fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0\") " pod="openshift-multus/network-metrics-daemon-bpb2j" Jun 03 21:06:04.823652 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:04.823627 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:06:04.823758 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:04.823692 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0-metrics-certs podName:fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0 nodeName:}" failed. No retries permitted until 2026-06-03 21:06:06.823673834 +0000 UTC m=+4.979851977 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0-metrics-certs") pod "network-metrics-daemon-bpb2j" (UID: "fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:06:04.925127 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:04.924431 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9rrl\" (UniqueName: \"kubernetes.io/projected/c61839be-8301-4c2b-ae73-097623a04e47-kube-api-access-m9rrl\") pod \"network-check-target-b64br\" (UID: \"c61839be-8301-4c2b-ae73-097623a04e47\") " pod="openshift-network-diagnostics/network-check-target-b64br" Jun 03 21:06:04.925127 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:04.924507 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1239087f-2fb2-48c1-a6d6-a77d4c3a8947-original-pull-secret\") pod \"global-pull-secret-syncer-7mnlx\" (UID: \"1239087f-2fb2-48c1-a6d6-a77d4c3a8947\") " pod="kube-system/global-pull-secret-syncer-7mnlx" Jun 03 21:06:04.925127 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:04.924623 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 21:06:04.925127 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:04.924644 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 21:06:04.925127 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:04.924662 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 21:06:04.925127 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:04.924675 2557 projected.go:196] Error preparing data for projected volume kube-api-access-m9rrl for pod openshift-network-diagnostics/network-check-target-b64br: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:06:04.925127 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:04.924686 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1239087f-2fb2-48c1-a6d6-a77d4c3a8947-original-pull-secret podName:1239087f-2fb2-48c1-a6d6-a77d4c3a8947 nodeName:}" failed. No retries permitted until 2026-06-03 21:06:06.924668156 +0000 UTC m=+5.080846295 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1239087f-2fb2-48c1-a6d6-a77d4c3a8947-original-pull-secret") pod "global-pull-secret-syncer-7mnlx" (UID: "1239087f-2fb2-48c1-a6d6-a77d4c3a8947") : object "kube-system"/"original-pull-secret" not registered Jun 03 21:06:04.925127 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:04.924726 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c61839be-8301-4c2b-ae73-097623a04e47-kube-api-access-m9rrl podName:c61839be-8301-4c2b-ae73-097623a04e47 nodeName:}" failed. No retries permitted until 2026-06-03 21:06:06.924700703 +0000 UTC m=+5.080878834 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-m9rrl" (UniqueName: "kubernetes.io/projected/c61839be-8301-4c2b-ae73-097623a04e47-kube-api-access-m9rrl") pod "network-check-target-b64br" (UID: "c61839be-8301-4c2b-ae73-097623a04e47") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:06:05.239369 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:05.239257 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 21:01:03 +0000 UTC" deadline="2027-12-31 16:49:25.568881937 +0000 UTC" Jun 03 21:06:05.239369 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:05.239321 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13819h43m20.329564955s" Jun 03 21:06:05.260460 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:05.258758 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b64br" Jun 03 21:06:05.260460 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:05.259026 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b64br" podUID="c61839be-8301-4c2b-ae73-097623a04e47" Jun 03 21:06:05.260460 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:05.259445 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpb2j" Jun 03 21:06:05.260460 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:05.259542 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpb2j" podUID="fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0" Jun 03 21:06:05.260460 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:05.259553 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7mnlx" Jun 03 21:06:05.260460 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:05.259629 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7mnlx" podUID="1239087f-2fb2-48c1-a6d6-a77d4c3a8947" Jun 03 21:06:05.332076 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:05.332043 2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 21:06:06.841592 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:06.841466 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0-metrics-certs\") pod \"network-metrics-daemon-bpb2j\" (UID: \"fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0\") " pod="openshift-multus/network-metrics-daemon-bpb2j" Jun 03 21:06:06.842134 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:06.841649 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:06:06.842134 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:06.841736 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0-metrics-certs podName:fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0 nodeName:}" failed. No retries permitted until 2026-06-03 21:06:10.841693996 +0000 UTC m=+8.997872125 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0-metrics-certs") pod "network-metrics-daemon-bpb2j" (UID: "fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:06:06.942111 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:06.942070 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1239087f-2fb2-48c1-a6d6-a77d4c3a8947-original-pull-secret\") pod \"global-pull-secret-syncer-7mnlx\" (UID: \"1239087f-2fb2-48c1-a6d6-a77d4c3a8947\") " pod="kube-system/global-pull-secret-syncer-7mnlx" Jun 03 21:06:06.942298 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:06.942161 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9rrl\" (UniqueName: \"kubernetes.io/projected/c61839be-8301-4c2b-ae73-097623a04e47-kube-api-access-m9rrl\") pod \"network-check-target-b64br\" (UID: \"c61839be-8301-4c2b-ae73-097623a04e47\") " pod="openshift-network-diagnostics/network-check-target-b64br" Jun 03 21:06:06.942298 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:06.942249 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 21:06:06.942412 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:06.942324 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 21:06:06.942412 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:06.942335 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1239087f-2fb2-48c1-a6d6-a77d4c3a8947-original-pull-secret podName:1239087f-2fb2-48c1-a6d6-a77d4c3a8947 nodeName:}" failed. No retries permitted until 2026-06-03 21:06:10.942314826 +0000 UTC m=+9.098492963 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1239087f-2fb2-48c1-a6d6-a77d4c3a8947-original-pull-secret") pod "global-pull-secret-syncer-7mnlx" (UID: "1239087f-2fb2-48c1-a6d6-a77d4c3a8947") : object "kube-system"/"original-pull-secret" not registered Jun 03 21:06:06.942412 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:06.942343 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 21:06:06.942412 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:06.942360 2557 projected.go:196] Error preparing data for projected volume kube-api-access-m9rrl for pod openshift-network-diagnostics/network-check-target-b64br: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:06:06.942412 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:06.942410 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c61839be-8301-4c2b-ae73-097623a04e47-kube-api-access-m9rrl podName:c61839be-8301-4c2b-ae73-097623a04e47 nodeName:}" failed. No retries permitted until 2026-06-03 21:06:10.942394232 +0000 UTC m=+9.098572375 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-m9rrl" (UniqueName: "kubernetes.io/projected/c61839be-8301-4c2b-ae73-097623a04e47-kube-api-access-m9rrl") pod "network-check-target-b64br" (UID: "c61839be-8301-4c2b-ae73-097623a04e47") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:06:07.258452 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:07.257774 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7mnlx" Jun 03 21:06:07.258452 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:07.257908 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7mnlx" podUID="1239087f-2fb2-48c1-a6d6-a77d4c3a8947" Jun 03 21:06:07.258452 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:07.258160 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpb2j" Jun 03 21:06:07.258452 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:07.258274 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpb2j" podUID="fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0" Jun 03 21:06:07.258452 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:07.258296 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b64br" Jun 03 21:06:07.258452 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:07.258371 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b64br" podUID="c61839be-8301-4c2b-ae73-097623a04e47" Jun 03 21:06:09.258749 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:09.258673 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7mnlx" Jun 03 21:06:09.258749 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:09.258720 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b64br" Jun 03 21:06:09.259309 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:09.258803 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpb2j" Jun 03 21:06:09.259309 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:09.258823 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7mnlx" podUID="1239087f-2fb2-48c1-a6d6-a77d4c3a8947" Jun 03 21:06:09.259309 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:09.258917 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpb2j" podUID="fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0" Jun 03 21:06:09.259309 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:09.259003 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b64br" podUID="c61839be-8301-4c2b-ae73-097623a04e47" Jun 03 21:06:10.875224 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:10.875183 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0-metrics-certs\") pod \"network-metrics-daemon-bpb2j\" (UID: \"fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0\") " pod="openshift-multus/network-metrics-daemon-bpb2j" Jun 03 21:06:10.875699 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:10.875336 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:06:10.875699 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:10.875401 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0-metrics-certs podName:fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0 nodeName:}" failed. No retries permitted until 2026-06-03 21:06:18.875380614 +0000 UTC m=+17.031558743 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0-metrics-certs") pod "network-metrics-daemon-bpb2j" (UID: "fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:06:10.976056 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:10.976017 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1239087f-2fb2-48c1-a6d6-a77d4c3a8947-original-pull-secret\") pod \"global-pull-secret-syncer-7mnlx\" (UID: \"1239087f-2fb2-48c1-a6d6-a77d4c3a8947\") " pod="kube-system/global-pull-secret-syncer-7mnlx" Jun 03 21:06:10.976237 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:10.976096 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9rrl\" (UniqueName: \"kubernetes.io/projected/c61839be-8301-4c2b-ae73-097623a04e47-kube-api-access-m9rrl\") pod \"network-check-target-b64br\" (UID: \"c61839be-8301-4c2b-ae73-097623a04e47\") " pod="openshift-network-diagnostics/network-check-target-b64br" Jun 03 21:06:10.976296 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:10.976247 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 21:06:10.976296 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:10.976264 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 21:06:10.976296 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:10.976277 2557 projected.go:196] Error preparing data for projected volume kube-api-access-m9rrl for pod openshift-network-diagnostics/network-check-target-b64br: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:06:10.976442 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:10.976365 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c61839be-8301-4c2b-ae73-097623a04e47-kube-api-access-m9rrl podName:c61839be-8301-4c2b-ae73-097623a04e47 nodeName:}" failed. No retries permitted until 2026-06-03 21:06:18.976317397 +0000 UTC m=+17.132495526 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-m9rrl" (UniqueName: "kubernetes.io/projected/c61839be-8301-4c2b-ae73-097623a04e47-kube-api-access-m9rrl") pod "network-check-target-b64br" (UID: "c61839be-8301-4c2b-ae73-097623a04e47") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:06:10.976802 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:10.976776 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 21:06:10.976938 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:10.976829 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1239087f-2fb2-48c1-a6d6-a77d4c3a8947-original-pull-secret podName:1239087f-2fb2-48c1-a6d6-a77d4c3a8947 nodeName:}" failed. No retries permitted until 2026-06-03 21:06:18.976814202 +0000 UTC m=+17.132992329 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1239087f-2fb2-48c1-a6d6-a77d4c3a8947-original-pull-secret") pod "global-pull-secret-syncer-7mnlx" (UID: "1239087f-2fb2-48c1-a6d6-a77d4c3a8947") : object "kube-system"/"original-pull-secret" not registered Jun 03 21:06:11.257979 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:11.257897 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b64br" Jun 03 21:06:11.258137 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:11.258031 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b64br" podUID="c61839be-8301-4c2b-ae73-097623a04e47" Jun 03 21:06:11.258442 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:11.258424 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpb2j" Jun 03 21:06:11.258547 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:11.258531 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpb2j" podUID="fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0" Jun 03 21:06:11.258610 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:11.258596 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7mnlx" Jun 03 21:06:11.258700 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:11.258666 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7mnlx" podUID="1239087f-2fb2-48c1-a6d6-a77d4c3a8947" Jun 03 21:06:13.258149 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:13.258061 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7mnlx" Jun 03 21:06:13.258149 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:13.258106 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b64br" Jun 03 21:06:13.258149 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:13.258110 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpb2j" Jun 03 21:06:13.258664 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:13.258172 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7mnlx" podUID="1239087f-2fb2-48c1-a6d6-a77d4c3a8947" Jun 03 21:06:13.258664 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:13.258327 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpb2j" podUID="fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0" Jun 03 21:06:13.258664 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:13.258422 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b64br" podUID="c61839be-8301-4c2b-ae73-097623a04e47" Jun 03 21:06:15.257977 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:15.257934 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b64br" Jun 03 21:06:15.257977 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:15.257977 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpb2j" Jun 03 21:06:15.258454 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:15.257977 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7mnlx" Jun 03 21:06:15.258454 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:15.258071 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b64br" podUID="c61839be-8301-4c2b-ae73-097623a04e47" Jun 03 21:06:15.258454 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:15.258173 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpb2j" podUID="fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0" Jun 03 21:06:15.258454 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:15.258228 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7mnlx" podUID="1239087f-2fb2-48c1-a6d6-a77d4c3a8947" Jun 03 21:06:17.258334 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:17.258297 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7mnlx" Jun 03 21:06:17.258787 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:17.258345 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b64br" Jun 03 21:06:17.258787 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:17.258424 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpb2j" Jun 03 21:06:17.258787 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:17.258441 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7mnlx" podUID="1239087f-2fb2-48c1-a6d6-a77d4c3a8947" Jun 03 21:06:17.258787 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:17.258569 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpb2j" podUID="fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0" Jun 03 21:06:17.258787 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:17.258654 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b64br" podUID="c61839be-8301-4c2b-ae73-097623a04e47" Jun 03 21:06:18.936314 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:18.936270 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0-metrics-certs\") pod \"network-metrics-daemon-bpb2j\" (UID: \"fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0\") " pod="openshift-multus/network-metrics-daemon-bpb2j" Jun 03 21:06:18.936820 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:18.936439 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:06:18.936820 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:18.936517 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0-metrics-certs podName:fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0 nodeName:}" failed. No retries permitted until 2026-06-03 21:06:34.936496168 +0000 UTC m=+33.092674311 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0-metrics-certs") pod "network-metrics-daemon-bpb2j" (UID: "fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:06:19.036960 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:19.036931 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9rrl\" (UniqueName: \"kubernetes.io/projected/c61839be-8301-4c2b-ae73-097623a04e47-kube-api-access-m9rrl\") pod \"network-check-target-b64br\" (UID: \"c61839be-8301-4c2b-ae73-097623a04e47\") " pod="openshift-network-diagnostics/network-check-target-b64br" Jun 03 21:06:19.037127 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:19.036986 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1239087f-2fb2-48c1-a6d6-a77d4c3a8947-original-pull-secret\") pod \"global-pull-secret-syncer-7mnlx\" (UID: \"1239087f-2fb2-48c1-a6d6-a77d4c3a8947\") " pod="kube-system/global-pull-secret-syncer-7mnlx" Jun 03 21:06:19.037127 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:19.037099 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 21:06:19.037234 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:19.037130 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 21:06:19.037234 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:19.037152 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1239087f-2fb2-48c1-a6d6-a77d4c3a8947-original-pull-secret podName:1239087f-2fb2-48c1-a6d6-a77d4c3a8947 nodeName:}" failed. No retries permitted until 2026-06-03 21:06:35.037136644 +0000 UTC m=+33.193314785 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1239087f-2fb2-48c1-a6d6-a77d4c3a8947-original-pull-secret") pod "global-pull-secret-syncer-7mnlx" (UID: "1239087f-2fb2-48c1-a6d6-a77d4c3a8947") : object "kube-system"/"original-pull-secret" not registered Jun 03 21:06:19.037234 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:19.037157 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 21:06:19.037234 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:19.037173 2557 projected.go:196] Error preparing data for projected volume kube-api-access-m9rrl for pod openshift-network-diagnostics/network-check-target-b64br: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:06:19.037234 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:19.037223 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c61839be-8301-4c2b-ae73-097623a04e47-kube-api-access-m9rrl podName:c61839be-8301-4c2b-ae73-097623a04e47 nodeName:}" failed. No retries permitted until 2026-06-03 21:06:35.037206623 +0000 UTC m=+33.193384761 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-m9rrl" (UniqueName: "kubernetes.io/projected/c61839be-8301-4c2b-ae73-097623a04e47-kube-api-access-m9rrl") pod "network-check-target-b64br" (UID: "c61839be-8301-4c2b-ae73-097623a04e47") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:06:19.258843 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:19.258743 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7mnlx" Jun 03 21:06:19.258843 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:19.258787 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpb2j" Jun 03 21:06:19.259064 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:19.258871 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b64br" Jun 03 21:06:19.259064 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:19.258877 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7mnlx" podUID="1239087f-2fb2-48c1-a6d6-a77d4c3a8947" Jun 03 21:06:19.259064 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:19.259012 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b64br" podUID="c61839be-8301-4c2b-ae73-097623a04e47" Jun 03 21:06:19.259197 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:19.259115 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpb2j" podUID="fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0" Jun 03 21:06:21.257873 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:21.257835 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7mnlx" Jun 03 21:06:21.258424 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:21.257944 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b64br" Jun 03 21:06:21.258424 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:21.257956 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7mnlx" podUID="1239087f-2fb2-48c1-a6d6-a77d4c3a8947" Jun 03 21:06:21.258424 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:21.257977 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpb2j" Jun 03 21:06:21.258424 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:21.258061 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b64br" podUID="c61839be-8301-4c2b-ae73-097623a04e47" Jun 03 21:06:21.258424 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:21.258153 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpb2j" podUID="fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0" Jun 03 21:06:23.259026 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:23.258791 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7mnlx" Jun 03 21:06:23.259370 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:23.258791 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b64br" Jun 03 21:06:23.259370 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:23.259069 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7mnlx" podUID="1239087f-2fb2-48c1-a6d6-a77d4c3a8947" Jun 03 21:06:23.259370 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:23.258810 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpb2j" Jun 03 21:06:23.259370 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:23.259135 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b64br" podUID="c61839be-8301-4c2b-ae73-097623a04e47" Jun 03 21:06:23.259370 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:23.259221 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpb2j" podUID="fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0" Jun 03 21:06:23.418087 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:23.418056 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-203.ec2.internal" event={"ID":"57aa77ddd45f178c820d6322ca613602","Type":"ContainerStarted","Data":"6c5afb832a233034474fb15cf1ee1ebae0a8914da85d0860751f48fb0d196370"} Jun 03 21:06:23.419557 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:23.419528 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tpfhl" event={"ID":"0a81b1c2-565e-4b77-8139-e7f5f4b63f70","Type":"ContainerStarted","Data":"e441779a4d8de10c5cb1218c6bd5d4a2ddee0ca7058807d3219c39d501283991"} Jun 03 21:06:23.420897 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:23.420876 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wtls7" event={"ID":"8f96219f-677e-46d7-adf9-8a6a44c129a3","Type":"ContainerStarted","Data":"190d162043f68e7941013c6f80f0825d0fb7412b2466086c5996fbfbf7f90b9d"} Jun 03 21:06:23.432547 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:23.432497 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-203.ec2.internal" podStartSLOduration=20.432479698 podStartE2EDuration="20.432479698s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:06:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:06:23.432315731 +0000 UTC m=+21.588493880" watchObservedRunningTime="2026-06-03 21:06:23.432479698 +0000 UTC m=+21.588657847" Jun 03 21:06:23.448427 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:23.448384 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wtls7" podStartSLOduration=2.355468529 podStartE2EDuration="21.448369123s" totalImagesPullingTime="19.092900594s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:06:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:06:23.447859291 +0000 UTC m=+21.604037440" watchObservedRunningTime="2026-06-03 21:06:23.448369123 +0000 UTC m=+21.604547268" Jun 03 21:06:23.463987 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:23.463944 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-tpfhl" podStartSLOduration=2.609085113 podStartE2EDuration="21.463929178s" totalImagesPullingTime="18.854844065s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:06:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:06:23.463630877 +0000 UTC m=+21.619809026" watchObservedRunningTime="2026-06-03 21:06:23.463929178 +0000 UTC m=+21.620107325" Jun 03 21:06:24.425196 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:24.424951 2557 generic.go:356] "Generic (PLEG): container finished" podID="bc9138b8-63c1-4840-bf59-bc7dc9dc0e41" containerID="2de13443f628d4e8548ce4a3b31e6186c4de4e0c2a3c1207bf6dccc131a62f84" exitCode=0 Jun 03 21:06:24.425859 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:24.425046 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rpgl8" event={"ID":"bc9138b8-63c1-4840-bf59-bc7dc9dc0e41","Type":"ContainerDied","Data":"2de13443f628d4e8548ce4a3b31e6186c4de4e0c2a3c1207bf6dccc131a62f84"} Jun 03 21:06:24.427363 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:24.427270 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4s9z9" event={"ID":"f172af74-ae3c-447d-bab5-73244d8df822","Type":"ContainerStarted","Data":"a9d1418102d5af977523cf5f08a6c48e5bce5768dc7b4340c7f7ce056b3e974d"} Jun 03 21:06:24.428946 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:24.428921 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6kb5w" event={"ID":"40bf9386-4e9b-4bf1-a193-42924b2ce6b0","Type":"ContainerStarted","Data":"b7783cf9f7270804c4c78b17967620e595f9ddf0d1fd662bf83f950adec18361"} Jun 03 21:06:24.430554 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:24.430532 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4xrp" event={"ID":"f993f823-6a53-4a65-ba7f-e73ef2c96bd4","Type":"ContainerStarted","Data":"fa4d0c2b929fb80a4b9fc151bc46550ba2739b0c735a26ad7a74c6d3b353e007"} Jun 03 21:06:24.432244 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:24.432222 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ws7rg" event={"ID":"bb7a7428-4273-4603-9894-ca260d699287","Type":"ContainerStarted","Data":"566a324c11f2ca973a4c4ca3e4fdf545ddb35c201feaf812f6be45cdfc574eee"} Jun 03 21:06:24.435017 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:24.435001 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjpv5_c606d039-59f8-4cc1-90d3-6ffdae5639ea/ovn-acl-logging/0.log" Jun 03 21:06:24.435366 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:24.435346 2557 generic.go:356] "Generic (PLEG): container finished" podID="c606d039-59f8-4cc1-90d3-6ffdae5639ea" containerID="89cc0e295e8caac2f015ef0c98fbeec352eed119e82d6e9de9dc81fefeb5abbf" exitCode=1 Jun 03 21:06:24.435459 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:24.435425 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" event={"ID":"c606d039-59f8-4cc1-90d3-6ffdae5639ea","Type":"ContainerStarted","Data":"ace90be03e35bd783cf3200cdcea7cc187174ab1e629b3515bbfd540e93a9cea"} Jun 03 21:06:24.435526 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:24.435489 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" event={"ID":"c606d039-59f8-4cc1-90d3-6ffdae5639ea","Type":"ContainerStarted","Data":"444d5b1d4af33f9fd3928b144019901953d8189dc69f5e3e7c85ef45c81d8d13"} Jun 03 21:06:24.435581 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:24.435531 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" event={"ID":"c606d039-59f8-4cc1-90d3-6ffdae5639ea","Type":"ContainerStarted","Data":"062c5aa0a0ca4b41b705d7d04236fbf04c473d69b5bda3cb6adfd3d3ec3a2c01"} Jun 03 21:06:24.435581 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:24.435568 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" event={"ID":"c606d039-59f8-4cc1-90d3-6ffdae5639ea","Type":"ContainerStarted","Data":"b2b1c6dbdbe0836181f74e73c3de1b351d81a9acc57a6e16c577cabb5103dda7"} Jun 03 21:06:24.435678 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:24.435617 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" event={"ID":"c606d039-59f8-4cc1-90d3-6ffdae5639ea","Type":"ContainerDied","Data":"89cc0e295e8caac2f015ef0c98fbeec352eed119e82d6e9de9dc81fefeb5abbf"} Jun 03 21:06:24.435678 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:24.435663 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" event={"ID":"c606d039-59f8-4cc1-90d3-6ffdae5639ea","Type":"ContainerStarted","Data":"ba23eb6c37a39324d0627e6ee280a68b9362152144b2af6a39d892a1a70d062a"} Jun 03 21:06:24.436883 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:24.436857 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-54fxg" event={"ID":"e6ccb97c-a4b9-402d-9c33-33a1c4bf9041","Type":"ContainerStarted","Data":"bb03c2f25e6f86a625f5d35e37b2e0db34a4b04a06466263f7c043d6de46cf94"} Jun 03 21:06:24.438438 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:24.438414 2557 generic.go:356] "Generic (PLEG): container finished" podID="e7d009f59f2cabdc00f532f0cd7f53d6" containerID="5d4f60fc8c119af8f44435e8a64bfc787003674cfaa8bc278039a11755464fe3" exitCode=0 Jun 03 21:06:24.438541 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:24.438502 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-203.ec2.internal" event={"ID":"e7d009f59f2cabdc00f532f0cd7f53d6","Type":"ContainerDied","Data":"5d4f60fc8c119af8f44435e8a64bfc787003674cfaa8bc278039a11755464fe3"} Jun 03 21:06:24.472438 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:24.472383 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-54fxg" podStartSLOduration=3.5956777300000002 podStartE2EDuration="22.472362484s" totalImagesPullingTime="18.876684754s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:06:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:06:24.471981949 +0000 UTC m=+22.628160099" watchObservedRunningTime="2026-06-03 21:06:24.472362484 +0000 UTC m=+22.628540632" Jun 03 21:06:24.486462 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:24.486197 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4s9z9" podStartSLOduration=3.618994344 podStartE2EDuration="22.486176015s" totalImagesPullingTime="18.867181671s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:06:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:06:24.485571525 +0000 UTC m=+22.641749673" watchObservedRunningTime="2026-06-03 21:06:24.486176015 +0000 UTC m=+22.642354163" Jun 03 21:06:24.506099 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:24.506049 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6kb5w" podStartSLOduration=3.644126882 podStartE2EDuration="22.506027542s" totalImagesPullingTime="18.86190066s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:06:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:06:24.505237669 +0000 UTC m=+22.661415816" watchObservedRunningTime="2026-06-03 21:06:24.506027542 +0000 UTC m=+22.662205688" Jun 03 21:06:24.520317 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:24.520269 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ws7rg" podStartSLOduration=3.6695888439999997 podStartE2EDuration="22.520253933s" totalImagesPullingTime="18.850665089s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:06:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:06:24.519870492 +0000 UTC m=+22.676048637" watchObservedRunningTime="2026-06-03 21:06:24.520253933 +0000 UTC m=+22.676432080" Jun 03 21:06:25.054419 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:25.054388 2557 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 21:06:25.257980 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:25.257909 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7mnlx" Jun 03 21:06:25.258163 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:25.258005 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b64br" Jun 03 21:06:25.258163 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:25.258016 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7mnlx" podUID="1239087f-2fb2-48c1-a6d6-a77d4c3a8947" Jun 03 21:06:25.258163 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:25.258034 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpb2j" Jun 03 21:06:25.258163 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:25.258105 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b64br" podUID="c61839be-8301-4c2b-ae73-097623a04e47" Jun 03 21:06:25.258313 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:25.258166 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpb2j" podUID="fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0" Jun 03 21:06:25.273674 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:25.273593 2557 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T21:06:25.054406201Z","UUID":"e5453f67-687d-480e-82e1-00cc72705df1","Handler":null,"Name":"","Endpoint":""} Jun 03 21:06:25.275113 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:25.275092 2557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 21:06:25.275244 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:25.275135 2557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 21:06:25.442805 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:25.442769 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4xrp" event={"ID":"f993f823-6a53-4a65-ba7f-e73ef2c96bd4","Type":"ContainerStarted","Data":"d248d7305871bba713111c5cf66bb78e35c47799b9e7daf47d20e76de57d69fa"} Jun 03 21:06:25.444602 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:25.444562 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-203.ec2.internal" event={"ID":"e7d009f59f2cabdc00f532f0cd7f53d6","Type":"ContainerStarted","Data":"ec14030906871bce46cc670556be3f77e1d4d474158940e70c3bc4c4050afaf2"} Jun 03 21:06:25.458137 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:25.458094 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-203.ec2.internal" podStartSLOduration=22.458078839 podStartE2EDuration="22.458078839s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:06:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:06:25.457990984 +0000 UTC m=+23.614169132" watchObservedRunningTime="2026-06-03 21:06:25.458078839 +0000 UTC m=+23.614256981" Jun 03 21:06:26.448950 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:26.448667 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4xrp" event={"ID":"f993f823-6a53-4a65-ba7f-e73ef2c96bd4","Type":"ContainerStarted","Data":"71f0a23dfb3e764e4c8773f946d0d0542196e91a744c20b3a7325d4950b4ae12"} Jun 03 21:06:26.451603 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:26.451581 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjpv5_c606d039-59f8-4cc1-90d3-6ffdae5639ea/ovn-acl-logging/0.log" Jun 03 21:06:26.452017 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:26.451992 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" event={"ID":"c606d039-59f8-4cc1-90d3-6ffdae5639ea","Type":"ContainerStarted","Data":"6ed6fda65999bbeca8389363d731c6039cfaa42511206be787c51242d490fb8a"} Jun 03 21:06:26.465484 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:26.465442 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4xrp" podStartSLOduration=3.601622918 podStartE2EDuration="24.465425655s" totalImagesPullingTime="20.863802737s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:06:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:06:26.465064862 +0000 UTC m=+24.621243021" watchObservedRunningTime="2026-06-03 21:06:26.465425655 +0000 UTC m=+24.621603803" Jun 03 21:06:27.258523 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:27.258487 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7mnlx" Jun 03 21:06:27.258728 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:27.258553 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpb2j" Jun 03 21:06:27.258728 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:27.258499 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b64br" Jun 03 21:06:27.258728 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:27.258624 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7mnlx" podUID="1239087f-2fb2-48c1-a6d6-a77d4c3a8947" Jun 03 21:06:27.258728 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:27.258719 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b64br" podUID="c61839be-8301-4c2b-ae73-097623a04e47" Jun 03 21:06:27.258927 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:27.258800 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpb2j" podUID="fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0" Jun 03 21:06:28.328393 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:28.328368 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6kb5w_40bf9386-4e9b-4bf1-a193-42924b2ce6b0/dns-node-resolver/0.log" Jun 03 21:06:28.461959 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:28.461887 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjpv5_c606d039-59f8-4cc1-90d3-6ffdae5639ea/ovn-acl-logging/0.log" Jun 03 21:06:28.462325 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:28.462222 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" event={"ID":"c606d039-59f8-4cc1-90d3-6ffdae5639ea","Type":"ContainerStarted","Data":"b7c4271f457ed943bc723886f05659d095cc184c37f73a9817dddda572bc2194"} Jun 03 21:06:28.462600 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:28.462476 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:28.462600 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:28.462539 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:28.462600 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:28.462590 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:28.462933 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:28.462801 2557 scope.go:117] "RemoveContainer" containerID="89cc0e295e8caac2f015ef0c98fbeec352eed119e82d6e9de9dc81fefeb5abbf" Jun 03 21:06:28.479673 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:28.479645 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:28.481331 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:28.481311 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:06:29.162585 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:29.162340 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ws7rg" Jun 03 21:06:29.163231 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:29.163210 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ws7rg" Jun 03 21:06:29.258132 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:29.258097 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b64br" Jun 03 21:06:29.258334 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:29.258144 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7mnlx" Jun 03 21:06:29.258334 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:29.258108 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpb2j" Jun 03 21:06:29.258334 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:29.258223 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b64br" podUID="c61839be-8301-4c2b-ae73-097623a04e47" Jun 03 21:06:29.258334 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:29.258299 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpb2j" podUID="fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0" Jun 03 21:06:29.258520 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:29.258418 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7mnlx" podUID="1239087f-2fb2-48c1-a6d6-a77d4c3a8947" Jun 03 21:06:29.290018 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:29.289986 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-54fxg_e6ccb97c-a4b9-402d-9c33-33a1c4bf9041/node-ca/0.log" Jun 03 21:06:29.468941 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:29.468873 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjpv5_c606d039-59f8-4cc1-90d3-6ffdae5639ea/ovn-acl-logging/0.log" Jun 03 21:06:29.469357 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:29.469301 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" event={"ID":"c606d039-59f8-4cc1-90d3-6ffdae5639ea","Type":"ContainerStarted","Data":"197ddecfb626979ecbfc38a3a602639537f5457239ea4f2bd981ca5ff8162156"} Jun 03 21:06:29.469736 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:29.469655 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ws7rg" Jun 03 21:06:29.470270 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:29.470239 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ws7rg" Jun 03 21:06:29.495576 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:29.495517 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" podStartSLOduration=7.701486104 podStartE2EDuration="27.495502789s" totalImagesPullingTime="19.794016685s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:06:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:06:29.49461564 +0000 UTC m=+27.650793788" watchObservedRunningTime="2026-06-03 21:06:29.495502789 +0000 UTC m=+27.651680936" Jun 03 21:06:30.399088 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:30.399024 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-b64br"] Jun 03 21:06:30.399088 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:30.399097 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bpb2j"] Jun 03 21:06:30.399383 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:30.399198 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpb2j" Jun 03 21:06:30.399383 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:30.399198 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b64br" Jun 03 21:06:30.399383 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:30.399319 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpb2j" podUID="fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0" Jun 03 21:06:30.399383 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:30.399346 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b64br" podUID="c61839be-8301-4c2b-ae73-097623a04e47" Jun 03 21:06:30.399603 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:30.399583 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7mnlx"] Jun 03 21:06:30.399747 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:30.399687 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7mnlx" Jun 03 21:06:30.399814 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:30.399798 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7mnlx" podUID="1239087f-2fb2-48c1-a6d6-a77d4c3a8947" Jun 03 21:06:31.476619 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:31.476400 2557 generic.go:356] "Generic (PLEG): container finished" podID="bc9138b8-63c1-4840-bf59-bc7dc9dc0e41" containerID="9bac5e31b07002281503f95551b9d5aa868ac2f9158dfd8b12771e7553451f08" exitCode=0 Jun 03 21:06:31.477081 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:31.476485 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rpgl8" event={"ID":"bc9138b8-63c1-4840-bf59-bc7dc9dc0e41","Type":"ContainerDied","Data":"9bac5e31b07002281503f95551b9d5aa868ac2f9158dfd8b12771e7553451f08"} Jun 03 21:06:32.259889 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:32.259650 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpb2j" Jun 03 21:06:32.259889 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:32.259672 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7mnlx" Jun 03 21:06:32.259889 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:32.259800 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpb2j" podUID="fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0" Jun 03 21:06:32.260179 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:32.259905 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b64br" Jun 03 21:06:32.260179 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:32.260013 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7mnlx" podUID="1239087f-2fb2-48c1-a6d6-a77d4c3a8947" Jun 03 21:06:32.260179 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:32.260110 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b64br" podUID="c61839be-8301-4c2b-ae73-097623a04e47" Jun 03 21:06:32.481328 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:32.481248 2557 generic.go:356] "Generic (PLEG): container finished" podID="bc9138b8-63c1-4840-bf59-bc7dc9dc0e41" containerID="cff10aa4db7934059e8cdbcc27db3eb70111e1fd0566b3050f313460154bd99b" exitCode=0 Jun 03 21:06:32.481328 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:32.481304 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rpgl8" event={"ID":"bc9138b8-63c1-4840-bf59-bc7dc9dc0e41","Type":"ContainerDied","Data":"cff10aa4db7934059e8cdbcc27db3eb70111e1fd0566b3050f313460154bd99b"} Jun 03 21:06:33.485922 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:33.485844 2557 generic.go:356] "Generic (PLEG): container finished" podID="bc9138b8-63c1-4840-bf59-bc7dc9dc0e41" containerID="7b1a9c68112562ddece3b538cb0d2150ae4d90986c609a36f7405ca4b0bf14e2" exitCode=0 Jun 03 21:06:33.485922 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:33.485877 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rpgl8" event={"ID":"bc9138b8-63c1-4840-bf59-bc7dc9dc0e41","Type":"ContainerDied","Data":"7b1a9c68112562ddece3b538cb0d2150ae4d90986c609a36f7405ca4b0bf14e2"} Jun 03 21:06:34.258594 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:34.258557 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b64br" Jun 03 21:06:34.258781 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:34.258566 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7mnlx" Jun 03 21:06:34.258781 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:34.258682 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b64br" podUID="c61839be-8301-4c2b-ae73-097623a04e47" Jun 03 21:06:34.258892 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:34.258777 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7mnlx" podUID="1239087f-2fb2-48c1-a6d6-a77d4c3a8947" Jun 03 21:06:34.258892 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:34.258568 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpb2j" Jun 03 21:06:34.258892 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:34.258883 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpb2j" podUID="fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0" Jun 03 21:06:34.961111 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:34.961073 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0-metrics-certs\") pod \"network-metrics-daemon-bpb2j\" (UID: \"fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0\") " pod="openshift-multus/network-metrics-daemon-bpb2j" Jun 03 21:06:34.961505 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:34.961254 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:06:34.961505 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:34.961321 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0-metrics-certs podName:fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0 nodeName:}" failed. No retries permitted until 2026-06-03 21:07:06.961304861 +0000 UTC m=+65.117482987 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0-metrics-certs") pod "network-metrics-daemon-bpb2j" (UID: "fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:06:35.061820 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:35.061735 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1239087f-2fb2-48c1-a6d6-a77d4c3a8947-original-pull-secret\") pod \"global-pull-secret-syncer-7mnlx\" (UID: \"1239087f-2fb2-48c1-a6d6-a77d4c3a8947\") " pod="kube-system/global-pull-secret-syncer-7mnlx" Jun 03 21:06:35.061820 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:35.061809 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9rrl\" (UniqueName: \"kubernetes.io/projected/c61839be-8301-4c2b-ae73-097623a04e47-kube-api-access-m9rrl\") pod \"network-check-target-b64br\" (UID: \"c61839be-8301-4c2b-ae73-097623a04e47\") " pod="openshift-network-diagnostics/network-check-target-b64br" Jun 03 21:06:35.062053 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:35.061893 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 21:06:35.062053 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:35.061909 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 21:06:35.062053 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:35.061927 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 21:06:35.062053 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:35.061939 2557 projected.go:196] Error preparing data for projected volume kube-api-access-m9rrl for pod openshift-network-diagnostics/network-check-target-b64br: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:06:35.062053 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:35.061963 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1239087f-2fb2-48c1-a6d6-a77d4c3a8947-original-pull-secret podName:1239087f-2fb2-48c1-a6d6-a77d4c3a8947 nodeName:}" failed. No retries permitted until 2026-06-03 21:07:07.061945458 +0000 UTC m=+65.218123607 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1239087f-2fb2-48c1-a6d6-a77d4c3a8947-original-pull-secret") pod "global-pull-secret-syncer-7mnlx" (UID: "1239087f-2fb2-48c1-a6d6-a77d4c3a8947") : object "kube-system"/"original-pull-secret" not registered Jun 03 21:06:35.062053 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:35.061979 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c61839be-8301-4c2b-ae73-097623a04e47-kube-api-access-m9rrl podName:c61839be-8301-4c2b-ae73-097623a04e47 nodeName:}" failed. No retries permitted until 2026-06-03 21:07:07.061971317 +0000 UTC m=+65.218149443 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-m9rrl" (UniqueName: "kubernetes.io/projected/c61839be-8301-4c2b-ae73-097623a04e47-kube-api-access-m9rrl") pod "network-check-target-b64br" (UID: "c61839be-8301-4c2b-ae73-097623a04e47") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:06:36.259017 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:36.258531 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpb2j" Jun 03 21:06:36.259017 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:36.258548 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b64br" Jun 03 21:06:36.259017 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:36.258539 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7mnlx" Jun 03 21:06:36.259017 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:36.258663 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpb2j" podUID="fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0" Jun 03 21:06:36.259017 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:36.258802 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7mnlx" podUID="1239087f-2fb2-48c1-a6d6-a77d4c3a8947" Jun 03 21:06:36.259017 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:36.258873 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b64br" podUID="c61839be-8301-4c2b-ae73-097623a04e47" Jun 03 21:06:38.262410 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:38.262334 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b64br" Jun 03 21:06:38.262410 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:38.262369 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7mnlx" Jun 03 21:06:38.262410 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:38.262369 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpb2j" Jun 03 21:06:38.262861 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:38.262467 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b64br" podUID="c61839be-8301-4c2b-ae73-097623a04e47" Jun 03 21:06:38.262861 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:38.262516 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7mnlx" podUID="1239087f-2fb2-48c1-a6d6-a77d4c3a8947" Jun 03 21:06:38.262861 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:38.262585 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpb2j" podUID="fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0" Jun 03 21:06:38.500191 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:38.500155 2557 generic.go:356] "Generic (PLEG): container finished" podID="bc9138b8-63c1-4840-bf59-bc7dc9dc0e41" containerID="48d1e7049169cd4548cc92cc827ee4192ed02d837fed2c4099d42176c90e173a" exitCode=0 Jun 03 21:06:38.500365 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:38.500212 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rpgl8" event={"ID":"bc9138b8-63c1-4840-bf59-bc7dc9dc0e41","Type":"ContainerDied","Data":"48d1e7049169cd4548cc92cc827ee4192ed02d837fed2c4099d42176c90e173a"} Jun 03 21:06:39.506413 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:39.506219 2557 generic.go:356] "Generic (PLEG): container finished" podID="bc9138b8-63c1-4840-bf59-bc7dc9dc0e41" containerID="ddf3b0f602bd8203a9781b0b0af40a486600a36964154b89db3213dfe81d2078" exitCode=0 Jun 03 21:06:39.506824 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:39.506295 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rpgl8" event={"ID":"bc9138b8-63c1-4840-bf59-bc7dc9dc0e41","Type":"ContainerDied","Data":"ddf3b0f602bd8203a9781b0b0af40a486600a36964154b89db3213dfe81d2078"} Jun 03 21:06:40.258700 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:40.258616 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpb2j" Jun 03 21:06:40.258700 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:40.258639 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b64br" Jun 03 21:06:40.258700 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:40.258630 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7mnlx" Jun 03 21:06:40.258940 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:40.258764 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpb2j" podUID="fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0" Jun 03 21:06:40.258940 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:40.258891 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7mnlx" podUID="1239087f-2fb2-48c1-a6d6-a77d4c3a8947" Jun 03 21:06:40.259017 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:40.258965 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b64br" podUID="c61839be-8301-4c2b-ae73-097623a04e47" Jun 03 21:06:40.511928 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:40.511838 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rpgl8" event={"ID":"bc9138b8-63c1-4840-bf59-bc7dc9dc0e41","Type":"ContainerStarted","Data":"bc3123bbe3382c4c220e642d74237d2661ab60ee8c0c3ce3ed4ee939145178d6"} Jun 03 21:06:40.533207 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:40.533162 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rpgl8" podStartSLOduration=7.339140153 podStartE2EDuration="38.53314718s" totalImagesPullingTime="31.194007027s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:06:02 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:06:40.532548704 +0000 UTC m=+38.688726852" watchObservedRunningTime="2026-06-03 21:06:40.53314718 +0000 UTC m=+38.689325326" Jun 03 21:06:42.259382 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:42.259340 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b64br" Jun 03 21:06:42.259824 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:42.259422 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpb2j" Jun 03 21:06:42.259824 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:42.259429 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b64br" podUID="c61839be-8301-4c2b-ae73-097623a04e47" Jun 03 21:06:42.259824 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:42.259557 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpb2j" podUID="fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0" Jun 03 21:06:42.259824 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:42.259579 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7mnlx" Jun 03 21:06:42.259824 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:42.259633 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7mnlx" podUID="1239087f-2fb2-48c1-a6d6-a77d4c3a8947" Jun 03 21:06:44.257822 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:44.257785 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b64br" Jun 03 21:06:44.257822 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:44.257815 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7mnlx" Jun 03 21:06:44.258382 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:44.257792 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpb2j" Jun 03 21:06:44.258382 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:44.257887 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b64br" podUID="c61839be-8301-4c2b-ae73-097623a04e47" Jun 03 21:06:44.258382 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:44.257974 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpb2j" podUID="fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0" Jun 03 21:06:44.258382 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:44.258030 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7mnlx" podUID="1239087f-2fb2-48c1-a6d6-a77d4c3a8947" Jun 03 21:06:46.258038 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:46.258004 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpb2j" Jun 03 21:06:46.258436 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:46.258005 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b64br" Jun 03 21:06:46.258436 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:46.258120 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpb2j" podUID="fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0" Jun 03 21:06:46.258436 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:46.258215 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b64br" podUID="c61839be-8301-4c2b-ae73-097623a04e47" Jun 03 21:06:46.258436 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:46.258005 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7mnlx" Jun 03 21:06:46.258436 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:46.258332 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7mnlx" podUID="1239087f-2fb2-48c1-a6d6-a77d4c3a8947" Jun 03 21:06:48.258498 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:48.258456 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b64br" Jun 03 21:06:48.258498 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:48.258488 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7mnlx" Jun 03 21:06:48.258976 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:48.258465 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpb2j" Jun 03 21:06:48.258976 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:48.258571 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b64br" podUID="c61839be-8301-4c2b-ae73-097623a04e47" Jun 03 21:06:48.258976 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:48.258653 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpb2j" podUID="fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0" Jun 03 21:06:48.258976 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:48.258760 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7mnlx" podUID="1239087f-2fb2-48c1-a6d6-a77d4c3a8947" Jun 03 21:06:50.258032 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:50.258004 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b64br" Jun 03 21:06:50.258408 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:50.258008 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpb2j" Jun 03 21:06:50.258408 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:50.258129 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7mnlx" Jun 03 21:06:50.258408 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:50.258121 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b64br" podUID="c61839be-8301-4c2b-ae73-097623a04e47" Jun 03 21:06:50.258408 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:50.258254 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpb2j" podUID="fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0" Jun 03 21:06:50.258408 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:06:50.258346 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7mnlx" podUID="1239087f-2fb2-48c1-a6d6-a77d4c3a8947" Jun 03 21:06:50.724401 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:50.724377 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-203.ec2.internal" event="NodeReady" Jun 03 21:06:50.724558 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:50.724512 2557 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 03 21:06:50.772649 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:50.772609 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xxkll"] Jun 03 21:06:50.796791 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:50.796759 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zztxm"] Jun 03 21:06:50.796939 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:50.796891 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xxkll" Jun 03 21:06:50.799602 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:50.799579 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-twp4v\"" Jun 03 21:06:50.799818 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:50.799803 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 21:06:50.800211 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:50.800196 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 21:06:50.800319 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:50.800305 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 21:06:50.800382 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:50.800323 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 21:06:50.820808 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:50.820781 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zztxm"] Jun 03 21:06:50.820808 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:50.820816 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xxkll"] Jun 03 21:06:50.820982 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:50.820891 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zztxm" Jun 03 21:06:50.822998 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:50.822976 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 21:06:50.823264 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:50.823248 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 21:06:50.823350 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:50.823306 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 21:06:50.823411 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:50.823350 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zthwz\"" Jun 03 21:06:50.879168 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:50.879139 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mw8f6"] Jun 03 21:06:50.879357 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:50.879339 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc62x\" (UniqueName: \"kubernetes.io/projected/0d459700-3a74-4042-92c7-8e8c6d127b81-kube-api-access-kc62x\") pod \"ingress-canary-zztxm\" (UID: \"0d459700-3a74-4042-92c7-8e8c6d127b81\") " pod="openshift-ingress-canary/ingress-canary-zztxm" Jun 03 21:06:50.879426 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:50.879404 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5f451f0c-1985-41d0-9a5c-f54fd7c2549a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xxkll\" (UID: \"5f451f0c-1985-41d0-9a5c-f54fd7c2549a\") " pod="openshift-insights/insights-runtime-extractor-xxkll" Jun 03 21:06:50.879479 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:50.879447 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5f451f0c-1985-41d0-9a5c-f54fd7c2549a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xxkll\" (UID: \"5f451f0c-1985-41d0-9a5c-f54fd7c2549a\") " pod="openshift-insights/insights-runtime-extractor-xxkll" Jun 03 21:06:50.879534 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:50.879486 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4r46q\" (UniqueName: \"kubernetes.io/projected/5f451f0c-1985-41d0-9a5c-f54fd7c2549a-kube-api-access-4r46q\") pod \"insights-runtime-extractor-xxkll\" (UID: \"5f451f0c-1985-41d0-9a5c-f54fd7c2549a\") " pod="openshift-insights/insights-runtime-extractor-xxkll" Jun 03 21:06:50.879534 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:50.879508 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d459700-3a74-4042-92c7-8e8c6d127b81-cert\") pod \"ingress-canary-zztxm\" (UID: \"0d459700-3a74-4042-92c7-8e8c6d127b81\") " pod="openshift-ingress-canary/ingress-canary-zztxm" Jun 03 21:06:50.879694 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:50.879569 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5f451f0c-1985-41d0-9a5c-f54fd7c2549a-crio-socket\") pod \"insights-runtime-extractor-xxkll\" (UID: \"5f451f0c-1985-41d0-9a5c-f54fd7c2549a\") " pod="openshift-insights/insights-runtime-extractor-xxkll" Jun 03 21:06:50.879694 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:50.879592 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5f451f0c-1985-41d0-9a5c-f54fd7c2549a-data-volume\") pod \"insights-runtime-extractor-xxkll\" (UID: \"5f451f0c-1985-41d0-9a5c-f54fd7c2549a\") " pod="openshift-insights/insights-runtime-extractor-xxkll" Jun 03 21:06:50.904756 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:50.904722 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mw8f6"] Jun 03 21:06:50.904883 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:50.904803 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mw8f6" Jun 03 21:06:50.907000 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:50.906977 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-45h6c\"" Jun 03 21:06:50.907000 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:50.906999 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 21:06:50.907215 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:50.907200 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 21:06:50.980318 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:50.980222 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/df3f961e-9c1b-4b9e-a7e3-ba97f25c4359-config-volume\") pod \"dns-default-mw8f6\" (UID: \"df3f961e-9c1b-4b9e-a7e3-ba97f25c4359\") " pod="openshift-dns/dns-default-mw8f6" Jun 03 21:06:50.980318 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:50.980280 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5f451f0c-1985-41d0-9a5c-f54fd7c2549a-crio-socket\") pod \"insights-runtime-extractor-xxkll\" (UID: \"5f451f0c-1985-41d0-9a5c-f54fd7c2549a\") " pod="openshift-insights/insights-runtime-extractor-xxkll" Jun 03 21:06:50.980544 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:50.980341 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5f451f0c-1985-41d0-9a5c-f54fd7c2549a-data-volume\") pod \"insights-runtime-extractor-xxkll\" (UID: \"5f451f0c-1985-41d0-9a5c-f54fd7c2549a\") " pod="openshift-insights/insights-runtime-extractor-xxkll" Jun 03 21:06:50.980544 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:50.980417 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kc62x\" (UniqueName: \"kubernetes.io/projected/0d459700-3a74-4042-92c7-8e8c6d127b81-kube-api-access-kc62x\") pod \"ingress-canary-zztxm\" (UID: \"0d459700-3a74-4042-92c7-8e8c6d127b81\") " pod="openshift-ingress-canary/ingress-canary-zztxm" Jun 03 21:06:50.980544 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:50.980442 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4djx\" (UniqueName: \"kubernetes.io/projected/df3f961e-9c1b-4b9e-a7e3-ba97f25c4359-kube-api-access-r4djx\") pod \"dns-default-mw8f6\" (UID: \"df3f961e-9c1b-4b9e-a7e3-ba97f25c4359\") " pod="openshift-dns/dns-default-mw8f6" Jun 03 21:06:50.980544 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:50.980469 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df3f961e-9c1b-4b9e-a7e3-ba97f25c4359-tmp-dir\") pod \"dns-default-mw8f6\" (UID: \"df3f961e-9c1b-4b9e-a7e3-ba97f25c4359\") " pod="openshift-dns/dns-default-mw8f6" Jun 03 21:06:50.980544 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:50.980491 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5f451f0c-1985-41d0-9a5c-f54fd7c2549a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xxkll\" (UID: \"5f451f0c-1985-41d0-9a5c-f54fd7c2549a\") " pod="openshift-insights/insights-runtime-extractor-xxkll" Jun 03 21:06:50.980544 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:50.980495 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5f451f0c-1985-41d0-9a5c-f54fd7c2549a-crio-socket\") pod \"insights-runtime-extractor-xxkll\" (UID: \"5f451f0c-1985-41d0-9a5c-f54fd7c2549a\") " pod="openshift-insights/insights-runtime-extractor-xxkll" Jun 03 21:06:50.980544 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:50.980512 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5f451f0c-1985-41d0-9a5c-f54fd7c2549a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xxkll\" (UID: \"5f451f0c-1985-41d0-9a5c-f54fd7c2549a\") " pod="openshift-insights/insights-runtime-extractor-xxkll" Jun 03 21:06:50.980856 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:50.980596 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4r46q\" (UniqueName: \"kubernetes.io/projected/5f451f0c-1985-41d0-9a5c-f54fd7c2549a-kube-api-access-4r46q\") pod \"insights-runtime-extractor-xxkll\" (UID: \"5f451f0c-1985-41d0-9a5c-f54fd7c2549a\") " pod="openshift-insights/insights-runtime-extractor-xxkll" Jun 03 21:06:50.980856 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:50.980626 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d459700-3a74-4042-92c7-8e8c6d127b81-cert\") pod \"ingress-canary-zztxm\" (UID: \"0d459700-3a74-4042-92c7-8e8c6d127b81\") " pod="openshift-ingress-canary/ingress-canary-zztxm" Jun 03 21:06:50.980856 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:50.980641 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5f451f0c-1985-41d0-9a5c-f54fd7c2549a-data-volume\") pod \"insights-runtime-extractor-xxkll\" (UID: \"5f451f0c-1985-41d0-9a5c-f54fd7c2549a\") " pod="openshift-insights/insights-runtime-extractor-xxkll" Jun 03 21:06:50.980856 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:50.980656 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/df3f961e-9c1b-4b9e-a7e3-ba97f25c4359-metrics-tls\") pod \"dns-default-mw8f6\" (UID: \"df3f961e-9c1b-4b9e-a7e3-ba97f25c4359\") " pod="openshift-dns/dns-default-mw8f6" Jun 03 21:06:50.981078 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:50.981059 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5f451f0c-1985-41d0-9a5c-f54fd7c2549a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xxkll\" (UID: \"5f451f0c-1985-41d0-9a5c-f54fd7c2549a\") " pod="openshift-insights/insights-runtime-extractor-xxkll" Jun 03 21:06:50.984520 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:50.984488 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5f451f0c-1985-41d0-9a5c-f54fd7c2549a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xxkll\" (UID: \"5f451f0c-1985-41d0-9a5c-f54fd7c2549a\") " pod="openshift-insights/insights-runtime-extractor-xxkll" Jun 03 21:06:50.984630 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:50.984545 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d459700-3a74-4042-92c7-8e8c6d127b81-cert\") pod \"ingress-canary-zztxm\" (UID: \"0d459700-3a74-4042-92c7-8e8c6d127b81\") " pod="openshift-ingress-canary/ingress-canary-zztxm" Jun 03 21:06:50.988289 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:50.988254 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4r46q\" (UniqueName: \"kubernetes.io/projected/5f451f0c-1985-41d0-9a5c-f54fd7c2549a-kube-api-access-4r46q\") pod \"insights-runtime-extractor-xxkll\" (UID: \"5f451f0c-1985-41d0-9a5c-f54fd7c2549a\") " pod="openshift-insights/insights-runtime-extractor-xxkll" Jun 03 21:06:50.988548 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:50.988528 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc62x\" (UniqueName: \"kubernetes.io/projected/0d459700-3a74-4042-92c7-8e8c6d127b81-kube-api-access-kc62x\") pod \"ingress-canary-zztxm\" (UID: \"0d459700-3a74-4042-92c7-8e8c6d127b81\") " pod="openshift-ingress-canary/ingress-canary-zztxm" Jun 03 21:06:51.081561 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:51.081526 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4djx\" (UniqueName: \"kubernetes.io/projected/df3f961e-9c1b-4b9e-a7e3-ba97f25c4359-kube-api-access-r4djx\") pod \"dns-default-mw8f6\" (UID: \"df3f961e-9c1b-4b9e-a7e3-ba97f25c4359\") " pod="openshift-dns/dns-default-mw8f6" Jun 03 21:06:51.081741 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:51.081570 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df3f961e-9c1b-4b9e-a7e3-ba97f25c4359-tmp-dir\") pod \"dns-default-mw8f6\" (UID: \"df3f961e-9c1b-4b9e-a7e3-ba97f25c4359\") " pod="openshift-dns/dns-default-mw8f6" Jun 03 21:06:51.081741 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:51.081726 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/df3f961e-9c1b-4b9e-a7e3-ba97f25c4359-metrics-tls\") pod \"dns-default-mw8f6\" (UID: \"df3f961e-9c1b-4b9e-a7e3-ba97f25c4359\") " pod="openshift-dns/dns-default-mw8f6" Jun 03 21:06:51.081827 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:51.081780 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/df3f961e-9c1b-4b9e-a7e3-ba97f25c4359-config-volume\") pod \"dns-default-mw8f6\" (UID: \"df3f961e-9c1b-4b9e-a7e3-ba97f25c4359\") " pod="openshift-dns/dns-default-mw8f6" Jun 03 21:06:51.081942 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:51.081924 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df3f961e-9c1b-4b9e-a7e3-ba97f25c4359-tmp-dir\") pod \"dns-default-mw8f6\" (UID: \"df3f961e-9c1b-4b9e-a7e3-ba97f25c4359\") " pod="openshift-dns/dns-default-mw8f6" Jun 03 21:06:51.082378 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:51.082362 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/df3f961e-9c1b-4b9e-a7e3-ba97f25c4359-config-volume\") pod \"dns-default-mw8f6\" (UID: \"df3f961e-9c1b-4b9e-a7e3-ba97f25c4359\") " pod="openshift-dns/dns-default-mw8f6" Jun 03 21:06:51.083999 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:51.083970 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/df3f961e-9c1b-4b9e-a7e3-ba97f25c4359-metrics-tls\") pod \"dns-default-mw8f6\" (UID: \"df3f961e-9c1b-4b9e-a7e3-ba97f25c4359\") " pod="openshift-dns/dns-default-mw8f6" Jun 03 21:06:51.089483 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:51.089459 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4djx\" (UniqueName: \"kubernetes.io/projected/df3f961e-9c1b-4b9e-a7e3-ba97f25c4359-kube-api-access-r4djx\") pod \"dns-default-mw8f6\" (UID: \"df3f961e-9c1b-4b9e-a7e3-ba97f25c4359\") " pod="openshift-dns/dns-default-mw8f6" Jun 03 21:06:51.105393 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:51.105366 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xxkll" Jun 03 21:06:51.129504 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:51.129468 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zztxm" Jun 03 21:06:51.213924 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:51.213604 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mw8f6" Jun 03 21:06:51.308263 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:51.308234 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xxkll"] Jun 03 21:06:51.310976 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:51.310895 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zztxm"] Jun 03 21:06:51.321356 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:51.321327 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d459700_3a74_4042_92c7_8e8c6d127b81.slice/crio-8fa549da3da39035f98832c11c2cd2b8a7a1826f84f8f872c6dc6f957aa48616 WatchSource:0}: Error finding container 8fa549da3da39035f98832c11c2cd2b8a7a1826f84f8f872c6dc6f957aa48616: Status 404 returned error can't find the container with id 8fa549da3da39035f98832c11c2cd2b8a7a1826f84f8f872c6dc6f957aa48616 Jun 03 21:06:51.363035 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:51.363006 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mw8f6"] Jun 03 21:06:51.365847 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:51.365821 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf3f961e_9c1b_4b9e_a7e3_ba97f25c4359.slice/crio-6c6d116bd79095b562dc02e67296d4e094a6ef3a13054ec6f8a150cb87a3b2ed WatchSource:0}: Error finding container 6c6d116bd79095b562dc02e67296d4e094a6ef3a13054ec6f8a150cb87a3b2ed: Status 404 returned error can't find the container with id 6c6d116bd79095b562dc02e67296d4e094a6ef3a13054ec6f8a150cb87a3b2ed Jun 03 21:06:51.538916 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:51.538813 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xxkll" event={"ID":"5f451f0c-1985-41d0-9a5c-f54fd7c2549a","Type":"ContainerStarted","Data":"e21b50048bc703529ffaa589ba17fd321e75967ebbe20448abcd47e34889bd08"} Jun 03 21:06:51.538916 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:51.538878 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xxkll" event={"ID":"5f451f0c-1985-41d0-9a5c-f54fd7c2549a","Type":"ContainerStarted","Data":"e971465cc3085339fed85b806097f96d46067d8ebf72a88067b8f82c9393616a"} Jun 03 21:06:51.539881 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:51.539858 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mw8f6" event={"ID":"df3f961e-9c1b-4b9e-a7e3-ba97f25c4359","Type":"ContainerStarted","Data":"6c6d116bd79095b562dc02e67296d4e094a6ef3a13054ec6f8a150cb87a3b2ed"} Jun 03 21:06:51.540958 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:51.540937 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zztxm" event={"ID":"0d459700-3a74-4042-92c7-8e8c6d127b81","Type":"ContainerStarted","Data":"8fa549da3da39035f98832c11c2cd2b8a7a1826f84f8f872c6dc6f957aa48616"} Jun 03 21:06:52.259990 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:52.259954 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7mnlx" Jun 03 21:06:52.260177 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:52.260049 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b64br" Jun 03 21:06:52.260177 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:52.260093 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpb2j" Jun 03 21:06:52.263868 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:52.263286 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jgdk8\"" Jun 03 21:06:52.263868 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:52.263311 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 21:06:52.263868 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:52.263528 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 21:06:52.263868 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:52.263557 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 21:06:52.263868 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:52.263692 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 21:06:52.263868 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:52.263819 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-c4n2g\"" Jun 03 21:06:54.552225 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:54.552180 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mw8f6" event={"ID":"df3f961e-9c1b-4b9e-a7e3-ba97f25c4359","Type":"ContainerStarted","Data":"b644da30c21ef889a5b66d7b2effe68e708960843cdcd22783c5a70e17cef2e0"} Jun 03 21:06:54.552745 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:54.552314 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mw8f6" Jun 03 21:06:54.552745 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:54.552341 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mw8f6" event={"ID":"df3f961e-9c1b-4b9e-a7e3-ba97f25c4359","Type":"ContainerStarted","Data":"764b72024b29a5d8dc16a7df1dc3804146f227200eccbe3dff407a741c601291"} Jun 03 21:06:54.553976 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:54.553946 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zztxm" event={"ID":"0d459700-3a74-4042-92c7-8e8c6d127b81","Type":"ContainerStarted","Data":"fa37ceea71549bd5b10c7b20090dadba03e594e3f8446daa9000cb4ad1035f0e"} Jun 03 21:06:54.555946 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:54.555923 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xxkll" event={"ID":"5f451f0c-1985-41d0-9a5c-f54fd7c2549a","Type":"ContainerStarted","Data":"63f3c092f134395416935be07e23f40393a13da5ffdf036ab5bdc23a1bab2484"} Jun 03 21:06:54.568345 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:54.568292 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-mw8f6" podStartSLOduration=1.993108315 podStartE2EDuration="4.568274913s" totalImagesPullingTime="2.575166598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:06:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:06:54.56685027 +0000 UTC m=+52.723028418" watchObservedRunningTime="2026-06-03 21:06:54.568274913 +0000 UTC m=+52.724453039" Jun 03 21:06:54.581105 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:54.581031 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zztxm" podStartSLOduration=1.9569483540000001 podStartE2EDuration="4.58101126s" totalImagesPullingTime="2.624062906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:06:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:06:54.580636659 +0000 UTC m=+52.736814808" watchObservedRunningTime="2026-06-03 21:06:54.58101126 +0000 UTC m=+52.737189410" Jun 03 21:06:56.564269 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:56.564233 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xxkll" event={"ID":"5f451f0c-1985-41d0-9a5c-f54fd7c2549a","Type":"ContainerStarted","Data":"c13217c127a572cbf5fb4ff393a28c0c62bc48bec18f5d13190fc20732e13ab3"} Jun 03 21:06:56.581022 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:56.580971 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xxkll" podStartSLOduration=2.609702392 podStartE2EDuration="6.580954399s" totalImagesPullingTime="3.971252007s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:06:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:06:56.579501607 +0000 UTC m=+54.735679768" watchObservedRunningTime="2026-06-03 21:06:56.580954399 +0000 UTC m=+54.737132547" Jun 03 21:06:58.686343 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:58.686310 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-2ftfv"] Jun 03 21:06:58.688185 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:58.688168 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-2ftfv" Jun 03 21:06:58.690163 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:58.690136 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 03 21:06:58.690287 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:58.690169 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-l7w5w\"" Jun 03 21:06:58.703050 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:58.703021 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-2ftfv"] Jun 03 21:06:58.738298 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:58.738262 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/aab22389-d525-40b4-9b57-bc40f3fb94c8-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-2ftfv\" (UID: \"aab22389-d525-40b4-9b57-bc40f3fb94c8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-2ftfv" Jun 03 21:06:58.839535 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:58.839493 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/aab22389-d525-40b4-9b57-bc40f3fb94c8-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-2ftfv\" (UID: \"aab22389-d525-40b4-9b57-bc40f3fb94c8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-2ftfv" Jun 03 21:06:58.841963 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:58.841938 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/aab22389-d525-40b4-9b57-bc40f3fb94c8-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-2ftfv\" (UID: \"aab22389-d525-40b4-9b57-bc40f3fb94c8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-2ftfv" Jun 03 21:06:58.996694 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:58.996605 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-2ftfv" Jun 03 21:06:59.118588 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:59.118555 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-2ftfv"] Jun 03 21:06:59.121694 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:06:59.121658 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaab22389_d525_40b4_9b57_bc40f3fb94c8.slice/crio-6af6231d148749185925d3a8f471dd3d6db36646acd9b1f40ca5d1b2e80d6055 WatchSource:0}: Error finding container 6af6231d148749185925d3a8f471dd3d6db36646acd9b1f40ca5d1b2e80d6055: Status 404 returned error can't find the container with id 6af6231d148749185925d3a8f471dd3d6db36646acd9b1f40ca5d1b2e80d6055 Jun 03 21:06:59.574642 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:59.574609 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-2ftfv" event={"ID":"aab22389-d525-40b4-9b57-bc40f3fb94c8","Type":"ContainerStarted","Data":"6af6231d148749185925d3a8f471dd3d6db36646acd9b1f40ca5d1b2e80d6055"} Jun 03 21:06:59.683837 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:59.683798 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-56b467f5ff-wrbnh"] Jun 03 21:06:59.685947 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:59.685931 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-56b467f5ff-wrbnh" Jun 03 21:06:59.688197 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:59.688177 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 03 21:06:59.688559 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:59.688237 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 03 21:06:59.688559 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:59.688252 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-fj5c9\"" Jun 03 21:06:59.696640 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:59.696616 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-56b467f5ff-wrbnh"] Jun 03 21:06:59.744895 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:59.744861 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqf64\" (UniqueName: \"kubernetes.io/projected/98f567b5-9549-413d-b661-dfd2a4dc1dc5-kube-api-access-lqf64\") pod \"downloads-56b467f5ff-wrbnh\" (UID: \"98f567b5-9549-413d-b661-dfd2a4dc1dc5\") " pod="openshift-console/downloads-56b467f5ff-wrbnh" Jun 03 21:06:59.845761 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:59.845661 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqf64\" (UniqueName: \"kubernetes.io/projected/98f567b5-9549-413d-b661-dfd2a4dc1dc5-kube-api-access-lqf64\") pod \"downloads-56b467f5ff-wrbnh\" (UID: \"98f567b5-9549-413d-b661-dfd2a4dc1dc5\") " pod="openshift-console/downloads-56b467f5ff-wrbnh" Jun 03 21:06:59.854743 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:59.854692 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqf64\" (UniqueName: \"kubernetes.io/projected/98f567b5-9549-413d-b661-dfd2a4dc1dc5-kube-api-access-lqf64\") pod \"downloads-56b467f5ff-wrbnh\" (UID: \"98f567b5-9549-413d-b661-dfd2a4dc1dc5\") " pod="openshift-console/downloads-56b467f5ff-wrbnh" Jun 03 21:06:59.995254 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:06:59.995216 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-56b467f5ff-wrbnh" Jun 03 21:07:00.304410 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:00.304384 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-56b467f5ff-wrbnh"] Jun 03 21:07:00.307242 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:07:00.307213 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98f567b5_9549_413d_b661_dfd2a4dc1dc5.slice/crio-d6b2171443a4980f020de1b360c8d14f89e7441baf48e96de3f2e6cac832fd1a WatchSource:0}: Error finding container d6b2171443a4980f020de1b360c8d14f89e7441baf48e96de3f2e6cac832fd1a: Status 404 returned error can't find the container with id d6b2171443a4980f020de1b360c8d14f89e7441baf48e96de3f2e6cac832fd1a Jun 03 21:07:00.483018 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:00.482950 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jjpv5" Jun 03 21:07:00.579620 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:00.579586 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-2ftfv" event={"ID":"aab22389-d525-40b4-9b57-bc40f3fb94c8","Type":"ContainerStarted","Data":"1644cd1525fd1bcb34f9fa68efd49726cd0142106aeabec82263af75a2fa342e"} Jun 03 21:07:00.579838 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:00.579814 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-2ftfv" Jun 03 21:07:00.580882 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:00.580855 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-56b467f5ff-wrbnh" event={"ID":"98f567b5-9549-413d-b661-dfd2a4dc1dc5","Type":"ContainerStarted","Data":"d6b2171443a4980f020de1b360c8d14f89e7441baf48e96de3f2e6cac832fd1a"} Jun 03 21:07:00.585041 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:00.585022 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-2ftfv" Jun 03 21:07:00.595980 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:00.595504 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-2ftfv" podStartSLOduration=1.413976559 podStartE2EDuration="2.595484717s" totalImagesPullingTime="1.181508158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:06:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:07:00.595380686 +0000 UTC m=+58.751558835" watchObservedRunningTime="2026-06-03 21:07:00.595484717 +0000 UTC m=+58.751662865" Jun 03 21:07:00.742541 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:00.742464 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-pjz2k"] Jun 03 21:07:00.758435 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:00.758406 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-pjz2k"] Jun 03 21:07:00.758591 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:00.758515 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-pjz2k" Jun 03 21:07:00.761035 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:00.760991 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 03 21:07:00.761159 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:00.761071 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 03 21:07:00.761159 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:00.761099 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 21:07:00.761159 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:00.761143 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 21:07:00.761345 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:00.761226 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-hml7b\"" Jun 03 21:07:00.761447 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:00.761430 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 21:07:00.854406 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:00.854369 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/98c89919-7f9d-409d-81d6-f883029a7174-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-pjz2k\" (UID: \"98c89919-7f9d-409d-81d6-f883029a7174\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-pjz2k" Jun 03 21:07:00.854406 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:00.854406 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9pm2\" (UniqueName: \"kubernetes.io/projected/98c89919-7f9d-409d-81d6-f883029a7174-kube-api-access-w9pm2\") pod \"prometheus-operator-7f7d445d84-pjz2k\" (UID: \"98c89919-7f9d-409d-81d6-f883029a7174\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-pjz2k" Jun 03 21:07:00.854610 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:00.854430 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/98c89919-7f9d-409d-81d6-f883029a7174-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-pjz2k\" (UID: \"98c89919-7f9d-409d-81d6-f883029a7174\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-pjz2k" Jun 03 21:07:00.854610 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:00.854525 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98c89919-7f9d-409d-81d6-f883029a7174-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-pjz2k\" (UID: \"98c89919-7f9d-409d-81d6-f883029a7174\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-pjz2k" Jun 03 21:07:00.955697 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:00.955658 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/98c89919-7f9d-409d-81d6-f883029a7174-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-pjz2k\" (UID: \"98c89919-7f9d-409d-81d6-f883029a7174\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-pjz2k" Jun 03 21:07:00.955878 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:07:00.955823 2557 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 03 21:07:00.955878 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:00.955863 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98c89919-7f9d-409d-81d6-f883029a7174-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-pjz2k\" (UID: \"98c89919-7f9d-409d-81d6-f883029a7174\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-pjz2k" Jun 03 21:07:00.955957 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:07:00.955897 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98c89919-7f9d-409d-81d6-f883029a7174-prometheus-operator-tls podName:98c89919-7f9d-409d-81d6-f883029a7174 nodeName:}" failed. No retries permitted until 2026-06-03 21:07:01.455881477 +0000 UTC m=+59.612059607 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/98c89919-7f9d-409d-81d6-f883029a7174-prometheus-operator-tls") pod "prometheus-operator-7f7d445d84-pjz2k" (UID: "98c89919-7f9d-409d-81d6-f883029a7174") : secret "prometheus-operator-tls" not found Jun 03 21:07:00.955957 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:00.955928 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/98c89919-7f9d-409d-81d6-f883029a7174-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-pjz2k\" (UID: \"98c89919-7f9d-409d-81d6-f883029a7174\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-pjz2k" Jun 03 21:07:00.955957 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:00.955949 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9pm2\" (UniqueName: \"kubernetes.io/projected/98c89919-7f9d-409d-81d6-f883029a7174-kube-api-access-w9pm2\") pod \"prometheus-operator-7f7d445d84-pjz2k\" (UID: \"98c89919-7f9d-409d-81d6-f883029a7174\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-pjz2k" Jun 03 21:07:00.956631 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:00.956606 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98c89919-7f9d-409d-81d6-f883029a7174-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-pjz2k\" (UID: \"98c89919-7f9d-409d-81d6-f883029a7174\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-pjz2k" Jun 03 21:07:00.958409 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:00.958391 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/98c89919-7f9d-409d-81d6-f883029a7174-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-pjz2k\" (UID: \"98c89919-7f9d-409d-81d6-f883029a7174\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-pjz2k" Jun 03 21:07:00.964195 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:00.964169 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9pm2\" (UniqueName: \"kubernetes.io/projected/98c89919-7f9d-409d-81d6-f883029a7174-kube-api-access-w9pm2\") pod \"prometheus-operator-7f7d445d84-pjz2k\" (UID: \"98c89919-7f9d-409d-81d6-f883029a7174\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-pjz2k" Jun 03 21:07:01.458920 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:01.458878 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/98c89919-7f9d-409d-81d6-f883029a7174-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-pjz2k\" (UID: \"98c89919-7f9d-409d-81d6-f883029a7174\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-pjz2k" Jun 03 21:07:01.461739 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:01.461702 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/98c89919-7f9d-409d-81d6-f883029a7174-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-pjz2k\" (UID: \"98c89919-7f9d-409d-81d6-f883029a7174\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-pjz2k" Jun 03 21:07:01.667351 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:01.667316 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-pjz2k" Jun 03 21:07:01.828454 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:01.828420 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-pjz2k"] Jun 03 21:07:01.831879 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:07:01.831846 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98c89919_7f9d_409d_81d6_f883029a7174.slice/crio-80a0a055f4ee1c460622861b9b8d3c19b0c8d1ee53944d78142fecda2b579b8a WatchSource:0}: Error finding container 80a0a055f4ee1c460622861b9b8d3c19b0c8d1ee53944d78142fecda2b579b8a: Status 404 returned error can't find the container with id 80a0a055f4ee1c460622861b9b8d3c19b0c8d1ee53944d78142fecda2b579b8a Jun 03 21:07:02.591103 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:02.591054 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-pjz2k" event={"ID":"98c89919-7f9d-409d-81d6-f883029a7174","Type":"ContainerStarted","Data":"80a0a055f4ee1c460622861b9b8d3c19b0c8d1ee53944d78142fecda2b579b8a"} Jun 03 21:07:03.597255 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:03.597210 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-pjz2k" event={"ID":"98c89919-7f9d-409d-81d6-f883029a7174","Type":"ContainerStarted","Data":"cd5f8f02c9283991e660b97b86f6795700a63a7fab6e5f6aa75c62e384f683de"} Jun 03 21:07:03.597746 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:03.597367 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-pjz2k" event={"ID":"98c89919-7f9d-409d-81d6-f883029a7174","Type":"ContainerStarted","Data":"93a7313c498c241291fde4d289d3a30ef2e2af2d67ee2be133109a1dcfd8f9a3"} Jun 03 21:07:03.615810 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:03.615749 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-pjz2k" podStartSLOduration=2.051123244 podStartE2EDuration="3.615726252s" totalImagesPullingTime="1.564603008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:07:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:07:03.614135962 +0000 UTC m=+61.770314110" watchObservedRunningTime="2026-06-03 21:07:03.615726252 +0000 UTC m=+61.771904402" Jun 03 21:07:04.561265 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:04.561230 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mw8f6" Jun 03 21:07:05.119976 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.119941 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-tknds"] Jun 03 21:07:05.122239 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.122213 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tknds" Jun 03 21:07:05.124968 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.124932 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 03 21:07:05.124968 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.124955 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 03 21:07:05.125170 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.124956 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-vvskt\"" Jun 03 21:07:05.137321 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.137295 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-tknds"] Jun 03 21:07:05.164958 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.164925 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-79fb7d47d4-jthps"] Jun 03 21:07:05.167244 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.167223 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jthps" Jun 03 21:07:05.171421 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.171380 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-dnw4w\"" Jun 03 21:07:05.172395 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.172294 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 03 21:07:05.172543 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.172522 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 03 21:07:05.176454 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.176431 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 03 21:07:05.182902 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.182875 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-79fb7d47d4-jthps"] Jun 03 21:07:05.186335 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.186310 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2wrhs"] Jun 03 21:07:05.188580 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.188559 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2wrhs" Jun 03 21:07:05.190943 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.190811 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 21:07:05.190943 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.190859 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 21:07:05.190943 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.190874 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 21:07:05.191162 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.191004 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7tcbp\"" Jun 03 21:07:05.191330 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.191310 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fdc0db97-8099-4bd7-a458-2edacf4a2696-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-tknds\" (UID: \"fdc0db97-8099-4bd7-a458-2edacf4a2696\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tknds" Jun 03 21:07:05.191483 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.191463 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fdc0db97-8099-4bd7-a458-2edacf4a2696-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-tknds\" (UID: \"fdc0db97-8099-4bd7-a458-2edacf4a2696\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tknds" Jun 03 21:07:05.191563 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.191499 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fdc0db97-8099-4bd7-a458-2edacf4a2696-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-tknds\" (UID: \"fdc0db97-8099-4bd7-a458-2edacf4a2696\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tknds" Jun 03 21:07:05.191563 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.191528 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5d6wh\" (UniqueName: \"kubernetes.io/projected/fdc0db97-8099-4bd7-a458-2edacf4a2696-kube-api-access-5d6wh\") pod \"openshift-state-metrics-65f78d5c66-tknds\" (UID: \"fdc0db97-8099-4bd7-a458-2edacf4a2696\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tknds" Jun 03 21:07:05.292515 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.292477 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fdc0db97-8099-4bd7-a458-2edacf4a2696-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-tknds\" (UID: \"fdc0db97-8099-4bd7-a458-2edacf4a2696\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tknds" Jun 03 21:07:05.292515 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.292518 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2wrhs\" (UID: \"2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b\") " pod="openshift-monitoring/node-exporter-2wrhs" Jun 03 21:07:05.292784 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.292538 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c4f38a31-9f9c-408b-a1a7-4262ba1c1119-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-79fb7d47d4-jthps\" (UID: \"c4f38a31-9f9c-408b-a1a7-4262ba1c1119\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jthps" Jun 03 21:07:05.292784 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.292591 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c4f38a31-9f9c-408b-a1a7-4262ba1c1119-kube-state-metrics-tls\") pod \"kube-state-metrics-79fb7d47d4-jthps\" (UID: \"c4f38a31-9f9c-408b-a1a7-4262ba1c1119\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jthps" Jun 03 21:07:05.292784 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.292631 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c4f38a31-9f9c-408b-a1a7-4262ba1c1119-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-79fb7d47d4-jthps\" (UID: \"c4f38a31-9f9c-408b-a1a7-4262ba1c1119\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jthps" Jun 03 21:07:05.292784 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.292695 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fdc0db97-8099-4bd7-a458-2edacf4a2696-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-tknds\" (UID: \"fdc0db97-8099-4bd7-a458-2edacf4a2696\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tknds" Jun 03 21:07:05.292784 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.292737 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5d6wh\" (UniqueName: \"kubernetes.io/projected/fdc0db97-8099-4bd7-a458-2edacf4a2696-kube-api-access-5d6wh\") pod \"openshift-state-metrics-65f78d5c66-tknds\" (UID: \"fdc0db97-8099-4bd7-a458-2edacf4a2696\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tknds" Jun 03 21:07:05.292784 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.292759 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b-node-exporter-textfile\") pod \"node-exporter-2wrhs\" (UID: \"2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b\") " pod="openshift-monitoring/node-exporter-2wrhs" Jun 03 21:07:05.292784 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.292774 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qk7d\" (UniqueName: \"kubernetes.io/projected/c4f38a31-9f9c-408b-a1a7-4262ba1c1119-kube-api-access-9qk7d\") pod \"kube-state-metrics-79fb7d47d4-jthps\" (UID: \"c4f38a31-9f9c-408b-a1a7-4262ba1c1119\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jthps" Jun 03 21:07:05.293119 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.292798 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b-sys\") pod \"node-exporter-2wrhs\" (UID: \"2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b\") " pod="openshift-monitoring/node-exporter-2wrhs" Jun 03 21:07:05.293119 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.292824 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b-node-exporter-wtmp\") pod \"node-exporter-2wrhs\" (UID: \"2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b\") " pod="openshift-monitoring/node-exporter-2wrhs" Jun 03 21:07:05.293119 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:07:05.292822 2557 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 03 21:07:05.293119 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.292848 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dl4j8\" (UniqueName: \"kubernetes.io/projected/2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b-kube-api-access-dl4j8\") pod \"node-exporter-2wrhs\" (UID: \"2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b\") " pod="openshift-monitoring/node-exporter-2wrhs" Jun 03 21:07:05.293119 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:07:05.292914 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdc0db97-8099-4bd7-a458-2edacf4a2696-openshift-state-metrics-tls podName:fdc0db97-8099-4bd7-a458-2edacf4a2696 nodeName:}" failed. No retries permitted until 2026-06-03 21:07:05.792893562 +0000 UTC m=+63.949071705 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/fdc0db97-8099-4bd7-a458-2edacf4a2696-openshift-state-metrics-tls") pod "openshift-state-metrics-65f78d5c66-tknds" (UID: "fdc0db97-8099-4bd7-a458-2edacf4a2696") : secret "openshift-state-metrics-tls" not found Jun 03 21:07:05.293427 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.293173 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c4f38a31-9f9c-408b-a1a7-4262ba1c1119-volume-directive-shadow\") pod \"kube-state-metrics-79fb7d47d4-jthps\" (UID: \"c4f38a31-9f9c-408b-a1a7-4262ba1c1119\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jthps" Jun 03 21:07:05.293521 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.293497 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4f38a31-9f9c-408b-a1a7-4262ba1c1119-metrics-client-ca\") pod \"kube-state-metrics-79fb7d47d4-jthps\" (UID: \"c4f38a31-9f9c-408b-a1a7-4262ba1c1119\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jthps" Jun 03 21:07:05.293623 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.293580 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b-metrics-client-ca\") pod \"node-exporter-2wrhs\" (UID: \"2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b\") " pod="openshift-monitoring/node-exporter-2wrhs" Jun 03 21:07:05.293623 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.293614 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fdc0db97-8099-4bd7-a458-2edacf4a2696-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-tknds\" (UID: \"fdc0db97-8099-4bd7-a458-2edacf4a2696\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tknds" Jun 03 21:07:05.293746 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.293636 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fdc0db97-8099-4bd7-a458-2edacf4a2696-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-tknds\" (UID: \"fdc0db97-8099-4bd7-a458-2edacf4a2696\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tknds" Jun 03 21:07:05.293746 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.293655 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b-node-exporter-accelerators-collector-config\") pod \"node-exporter-2wrhs\" (UID: \"2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b\") " pod="openshift-monitoring/node-exporter-2wrhs" Jun 03 21:07:05.293849 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.293809 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b-root\") pod \"node-exporter-2wrhs\" (UID: \"2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b\") " pod="openshift-monitoring/node-exporter-2wrhs" Jun 03 21:07:05.293901 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.293854 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b-node-exporter-tls\") pod \"node-exporter-2wrhs\" (UID: \"2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b\") " pod="openshift-monitoring/node-exporter-2wrhs" Jun 03 21:07:05.298662 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.298633 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fdc0db97-8099-4bd7-a458-2edacf4a2696-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-tknds\" (UID: \"fdc0db97-8099-4bd7-a458-2edacf4a2696\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tknds" Jun 03 21:07:05.304288 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.304256 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5d6wh\" (UniqueName: \"kubernetes.io/projected/fdc0db97-8099-4bd7-a458-2edacf4a2696-kube-api-access-5d6wh\") pod \"openshift-state-metrics-65f78d5c66-tknds\" (UID: \"fdc0db97-8099-4bd7-a458-2edacf4a2696\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tknds" Jun 03 21:07:05.395071 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.394892 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4f38a31-9f9c-408b-a1a7-4262ba1c1119-metrics-client-ca\") pod \"kube-state-metrics-79fb7d47d4-jthps\" (UID: \"c4f38a31-9f9c-408b-a1a7-4262ba1c1119\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jthps" Jun 03 21:07:05.395071 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.394957 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b-metrics-client-ca\") pod \"node-exporter-2wrhs\" (UID: \"2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b\") " pod="openshift-monitoring/node-exporter-2wrhs" Jun 03 21:07:05.395071 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.394986 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b-node-exporter-accelerators-collector-config\") pod \"node-exporter-2wrhs\" (UID: \"2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b\") " pod="openshift-monitoring/node-exporter-2wrhs" Jun 03 21:07:05.395071 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.395020 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b-root\") pod \"node-exporter-2wrhs\" (UID: \"2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b\") " pod="openshift-monitoring/node-exporter-2wrhs" Jun 03 21:07:05.395071 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.395044 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b-node-exporter-tls\") pod \"node-exporter-2wrhs\" (UID: \"2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b\") " pod="openshift-monitoring/node-exporter-2wrhs" Jun 03 21:07:05.395071 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.395073 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2wrhs\" (UID: \"2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b\") " pod="openshift-monitoring/node-exporter-2wrhs" Jun 03 21:07:05.395519 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.395129 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c4f38a31-9f9c-408b-a1a7-4262ba1c1119-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-79fb7d47d4-jthps\" (UID: \"c4f38a31-9f9c-408b-a1a7-4262ba1c1119\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jthps" Jun 03 21:07:05.395519 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.395194 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c4f38a31-9f9c-408b-a1a7-4262ba1c1119-kube-state-metrics-tls\") pod \"kube-state-metrics-79fb7d47d4-jthps\" (UID: \"c4f38a31-9f9c-408b-a1a7-4262ba1c1119\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jthps" Jun 03 21:07:05.395519 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.395224 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c4f38a31-9f9c-408b-a1a7-4262ba1c1119-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-79fb7d47d4-jthps\" (UID: \"c4f38a31-9f9c-408b-a1a7-4262ba1c1119\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jthps" Jun 03 21:07:05.395519 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.395285 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b-node-exporter-textfile\") pod \"node-exporter-2wrhs\" (UID: \"2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b\") " pod="openshift-monitoring/node-exporter-2wrhs" Jun 03 21:07:05.395519 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.395311 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qk7d\" (UniqueName: \"kubernetes.io/projected/c4f38a31-9f9c-408b-a1a7-4262ba1c1119-kube-api-access-9qk7d\") pod \"kube-state-metrics-79fb7d47d4-jthps\" (UID: \"c4f38a31-9f9c-408b-a1a7-4262ba1c1119\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jthps" Jun 03 21:07:05.395519 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.395336 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b-sys\") pod \"node-exporter-2wrhs\" (UID: \"2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b\") " pod="openshift-monitoring/node-exporter-2wrhs" Jun 03 21:07:05.395519 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.395362 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b-node-exporter-wtmp\") pod \"node-exporter-2wrhs\" (UID: \"2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b\") " pod="openshift-monitoring/node-exporter-2wrhs" Jun 03 21:07:05.395519 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.395387 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dl4j8\" (UniqueName: \"kubernetes.io/projected/2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b-kube-api-access-dl4j8\") pod \"node-exporter-2wrhs\" (UID: \"2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b\") " pod="openshift-monitoring/node-exporter-2wrhs" Jun 03 21:07:05.395519 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.395411 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c4f38a31-9f9c-408b-a1a7-4262ba1c1119-volume-directive-shadow\") pod \"kube-state-metrics-79fb7d47d4-jthps\" (UID: \"c4f38a31-9f9c-408b-a1a7-4262ba1c1119\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jthps" Jun 03 21:07:05.396017 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.395747 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4f38a31-9f9c-408b-a1a7-4262ba1c1119-metrics-client-ca\") pod \"kube-state-metrics-79fb7d47d4-jthps\" (UID: \"c4f38a31-9f9c-408b-a1a7-4262ba1c1119\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jthps" Jun 03 21:07:05.396017 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.395747 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b-metrics-client-ca\") pod \"node-exporter-2wrhs\" (UID: \"2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b\") " pod="openshift-monitoring/node-exporter-2wrhs" Jun 03 21:07:05.396017 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.395783 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b-node-exporter-accelerators-collector-config\") pod \"node-exporter-2wrhs\" (UID: \"2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b\") " pod="openshift-monitoring/node-exporter-2wrhs" Jun 03 21:07:05.396017 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.395808 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c4f38a31-9f9c-408b-a1a7-4262ba1c1119-volume-directive-shadow\") pod \"kube-state-metrics-79fb7d47d4-jthps\" (UID: \"c4f38a31-9f9c-408b-a1a7-4262ba1c1119\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jthps" Jun 03 21:07:05.396017 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.395833 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b-root\") pod \"node-exporter-2wrhs\" (UID: \"2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b\") " pod="openshift-monitoring/node-exporter-2wrhs" Jun 03 21:07:05.396017 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.395874 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b-sys\") pod \"node-exporter-2wrhs\" (UID: \"2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b\") " pod="openshift-monitoring/node-exporter-2wrhs" Jun 03 21:07:05.396017 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.395990 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b-node-exporter-wtmp\") pod \"node-exporter-2wrhs\" (UID: \"2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b\") " pod="openshift-monitoring/node-exporter-2wrhs" Jun 03 21:07:05.396477 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.396245 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b-node-exporter-textfile\") pod \"node-exporter-2wrhs\" (UID: \"2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b\") " pod="openshift-monitoring/node-exporter-2wrhs" Jun 03 21:07:05.396477 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.396274 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c4f38a31-9f9c-408b-a1a7-4262ba1c1119-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-79fb7d47d4-jthps\" (UID: \"c4f38a31-9f9c-408b-a1a7-4262ba1c1119\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jthps" Jun 03 21:07:05.398159 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.398123 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c4f38a31-9f9c-408b-a1a7-4262ba1c1119-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-79fb7d47d4-jthps\" (UID: \"c4f38a31-9f9c-408b-a1a7-4262ba1c1119\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jthps" Jun 03 21:07:05.398500 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.398454 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c4f38a31-9f9c-408b-a1a7-4262ba1c1119-kube-state-metrics-tls\") pod \"kube-state-metrics-79fb7d47d4-jthps\" (UID: \"c4f38a31-9f9c-408b-a1a7-4262ba1c1119\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jthps" Jun 03 21:07:05.398613 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.398572 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2wrhs\" (UID: \"2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b\") " pod="openshift-monitoring/node-exporter-2wrhs" Jun 03 21:07:05.398927 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.398904 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b-node-exporter-tls\") pod \"node-exporter-2wrhs\" (UID: \"2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b\") " pod="openshift-monitoring/node-exporter-2wrhs" Jun 03 21:07:05.404154 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.404129 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qk7d\" (UniqueName: \"kubernetes.io/projected/c4f38a31-9f9c-408b-a1a7-4262ba1c1119-kube-api-access-9qk7d\") pod \"kube-state-metrics-79fb7d47d4-jthps\" (UID: \"c4f38a31-9f9c-408b-a1a7-4262ba1c1119\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jthps" Jun 03 21:07:05.404408 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.404386 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dl4j8\" (UniqueName: \"kubernetes.io/projected/2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b-kube-api-access-dl4j8\") pod \"node-exporter-2wrhs\" (UID: \"2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b\") " pod="openshift-monitoring/node-exporter-2wrhs" Jun 03 21:07:05.479238 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.479200 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jthps" Jun 03 21:07:05.499671 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.499633 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2wrhs" Jun 03 21:07:05.510730 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:07:05.510674 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d0d74a9_35f9_4f5f_905c_1afd7cbaac4b.slice/crio-692dc312376f46df18401dce7a0eddb85b8ecaa4d42fcee4f714c636dd21498b WatchSource:0}: Error finding container 692dc312376f46df18401dce7a0eddb85b8ecaa4d42fcee4f714c636dd21498b: Status 404 returned error can't find the container with id 692dc312376f46df18401dce7a0eddb85b8ecaa4d42fcee4f714c636dd21498b Jun 03 21:07:05.605798 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.605673 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2wrhs" event={"ID":"2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b","Type":"ContainerStarted","Data":"692dc312376f46df18401dce7a0eddb85b8ecaa4d42fcee4f714c636dd21498b"} Jun 03 21:07:05.636045 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.636004 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-79fb7d47d4-jthps"] Jun 03 21:07:05.642076 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:07:05.642048 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4f38a31_9f9c_408b_a1a7_4262ba1c1119.slice/crio-f9e346c283140dac487a69117f689000ddddea381437ae9fc0899183fc361511 WatchSource:0}: Error finding container f9e346c283140dac487a69117f689000ddddea381437ae9fc0899183fc361511: Status 404 returned error can't find the container with id f9e346c283140dac487a69117f689000ddddea381437ae9fc0899183fc361511 Jun 03 21:07:05.800280 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.800240 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fdc0db97-8099-4bd7-a458-2edacf4a2696-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-tknds\" (UID: \"fdc0db97-8099-4bd7-a458-2edacf4a2696\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tknds" Jun 03 21:07:05.802852 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:05.802826 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fdc0db97-8099-4bd7-a458-2edacf4a2696-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-tknds\" (UID: \"fdc0db97-8099-4bd7-a458-2edacf4a2696\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tknds" Jun 03 21:07:06.034370 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.034333 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tknds" Jun 03 21:07:06.183210 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.183173 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-tknds"] Jun 03 21:07:06.186486 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:07:06.186456 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdc0db97_8099_4bd7_a458_2edacf4a2696.slice/crio-3bfcb10b2f987923fe56e00df8ec57030c48ffcebf03dd276e034da57e59dbca WatchSource:0}: Error finding container 3bfcb10b2f987923fe56e00df8ec57030c48ffcebf03dd276e034da57e59dbca: Status 404 returned error can't find the container with id 3bfcb10b2f987923fe56e00df8ec57030c48ffcebf03dd276e034da57e59dbca Jun 03 21:07:06.189774 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.188989 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 21:07:06.193159 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.193137 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:07:06.195612 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.195586 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-mjw9t\"" Jun 03 21:07:06.196353 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.195843 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 03 21:07:06.196353 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.195932 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 03 21:07:06.196353 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.196008 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 03 21:07:06.196353 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.196094 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 03 21:07:06.196353 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.196105 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 03 21:07:06.196353 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.196124 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 03 21:07:06.196353 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.196176 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 03 21:07:06.196353 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.196226 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 03 21:07:06.196353 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.196260 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 03 21:07:06.213126 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.213090 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 21:07:06.303641 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.303603 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/678f0d30-436d-4e13-bdaf-9543f9437a9f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"678f0d30-436d-4e13-bdaf-9543f9437a9f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:07:06.303816 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.303704 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glwcx\" (UniqueName: \"kubernetes.io/projected/678f0d30-436d-4e13-bdaf-9543f9437a9f-kube-api-access-glwcx\") pod \"alertmanager-main-0\" (UID: \"678f0d30-436d-4e13-bdaf-9543f9437a9f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:07:06.303816 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.303773 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/678f0d30-436d-4e13-bdaf-9543f9437a9f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"678f0d30-436d-4e13-bdaf-9543f9437a9f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:07:06.303816 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.303800 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/678f0d30-436d-4e13-bdaf-9543f9437a9f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"678f0d30-436d-4e13-bdaf-9543f9437a9f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:07:06.303984 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.303829 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/678f0d30-436d-4e13-bdaf-9543f9437a9f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"678f0d30-436d-4e13-bdaf-9543f9437a9f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:07:06.303984 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.303856 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/678f0d30-436d-4e13-bdaf-9543f9437a9f-config-out\") pod \"alertmanager-main-0\" (UID: \"678f0d30-436d-4e13-bdaf-9543f9437a9f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:07:06.303984 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.303881 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/678f0d30-436d-4e13-bdaf-9543f9437a9f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"678f0d30-436d-4e13-bdaf-9543f9437a9f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:07:06.303984 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.303907 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/678f0d30-436d-4e13-bdaf-9543f9437a9f-web-config\") pod \"alertmanager-main-0\" (UID: \"678f0d30-436d-4e13-bdaf-9543f9437a9f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:07:06.303984 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.303946 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/678f0d30-436d-4e13-bdaf-9543f9437a9f-config-volume\") pod \"alertmanager-main-0\" (UID: \"678f0d30-436d-4e13-bdaf-9543f9437a9f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:07:06.304226 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.303990 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/678f0d30-436d-4e13-bdaf-9543f9437a9f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"678f0d30-436d-4e13-bdaf-9543f9437a9f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:07:06.304226 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.304013 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/678f0d30-436d-4e13-bdaf-9543f9437a9f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"678f0d30-436d-4e13-bdaf-9543f9437a9f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:07:06.304226 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.304038 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/678f0d30-436d-4e13-bdaf-9543f9437a9f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"678f0d30-436d-4e13-bdaf-9543f9437a9f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:07:06.304226 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.304073 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/678f0d30-436d-4e13-bdaf-9543f9437a9f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"678f0d30-436d-4e13-bdaf-9543f9437a9f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:07:06.406187 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.405268 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/678f0d30-436d-4e13-bdaf-9543f9437a9f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"678f0d30-436d-4e13-bdaf-9543f9437a9f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:07:06.406187 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.405317 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/678f0d30-436d-4e13-bdaf-9543f9437a9f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"678f0d30-436d-4e13-bdaf-9543f9437a9f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:07:06.406187 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.405356 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/678f0d30-436d-4e13-bdaf-9543f9437a9f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"678f0d30-436d-4e13-bdaf-9543f9437a9f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:07:06.406187 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.405385 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/678f0d30-436d-4e13-bdaf-9543f9437a9f-config-out\") pod \"alertmanager-main-0\" (UID: \"678f0d30-436d-4e13-bdaf-9543f9437a9f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:07:06.406187 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.405409 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/678f0d30-436d-4e13-bdaf-9543f9437a9f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"678f0d30-436d-4e13-bdaf-9543f9437a9f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:07:06.406187 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.405432 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/678f0d30-436d-4e13-bdaf-9543f9437a9f-web-config\") pod \"alertmanager-main-0\" (UID: \"678f0d30-436d-4e13-bdaf-9543f9437a9f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:07:06.406187 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.405482 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/678f0d30-436d-4e13-bdaf-9543f9437a9f-config-volume\") pod \"alertmanager-main-0\" (UID: \"678f0d30-436d-4e13-bdaf-9543f9437a9f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:07:06.406187 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.405529 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/678f0d30-436d-4e13-bdaf-9543f9437a9f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"678f0d30-436d-4e13-bdaf-9543f9437a9f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:07:06.406187 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.405553 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/678f0d30-436d-4e13-bdaf-9543f9437a9f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"678f0d30-436d-4e13-bdaf-9543f9437a9f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:07:06.406187 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.405580 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/678f0d30-436d-4e13-bdaf-9543f9437a9f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"678f0d30-436d-4e13-bdaf-9543f9437a9f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:07:06.406187 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.405624 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/678f0d30-436d-4e13-bdaf-9543f9437a9f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"678f0d30-436d-4e13-bdaf-9543f9437a9f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:07:06.406187 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.405655 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/678f0d30-436d-4e13-bdaf-9543f9437a9f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"678f0d30-436d-4e13-bdaf-9543f9437a9f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:07:06.406187 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.405761 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glwcx\" (UniqueName: \"kubernetes.io/projected/678f0d30-436d-4e13-bdaf-9543f9437a9f-kube-api-access-glwcx\") pod \"alertmanager-main-0\" (UID: \"678f0d30-436d-4e13-bdaf-9543f9437a9f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:07:06.406973 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.406776 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/678f0d30-436d-4e13-bdaf-9543f9437a9f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"678f0d30-436d-4e13-bdaf-9543f9437a9f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:07:06.408984 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.407772 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/678f0d30-436d-4e13-bdaf-9543f9437a9f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"678f0d30-436d-4e13-bdaf-9543f9437a9f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:07:06.408984 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:07:06.407886 2557 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 03 21:07:06.408984 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:07:06.407949 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/678f0d30-436d-4e13-bdaf-9543f9437a9f-secret-alertmanager-main-tls podName:678f0d30-436d-4e13-bdaf-9543f9437a9f nodeName:}" failed. No retries permitted until 2026-06-03 21:07:06.907927345 +0000 UTC m=+65.064105491 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/678f0d30-436d-4e13-bdaf-9543f9437a9f-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "678f0d30-436d-4e13-bdaf-9543f9437a9f") : secret "alertmanager-main-tls" not found Jun 03 21:07:06.408984 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.408937 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/678f0d30-436d-4e13-bdaf-9543f9437a9f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"678f0d30-436d-4e13-bdaf-9543f9437a9f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:07:06.411205 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.410954 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/678f0d30-436d-4e13-bdaf-9543f9437a9f-config-out\") pod \"alertmanager-main-0\" (UID: \"678f0d30-436d-4e13-bdaf-9543f9437a9f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:07:06.411205 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.411122 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/678f0d30-436d-4e13-bdaf-9543f9437a9f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"678f0d30-436d-4e13-bdaf-9543f9437a9f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:07:06.411733 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.411596 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/678f0d30-436d-4e13-bdaf-9543f9437a9f-config-volume\") pod \"alertmanager-main-0\" (UID: \"678f0d30-436d-4e13-bdaf-9543f9437a9f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:07:06.411733 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.411693 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/678f0d30-436d-4e13-bdaf-9543f9437a9f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"678f0d30-436d-4e13-bdaf-9543f9437a9f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:07:06.412419 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.412377 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/678f0d30-436d-4e13-bdaf-9543f9437a9f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"678f0d30-436d-4e13-bdaf-9543f9437a9f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:07:06.412568 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.412545 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/678f0d30-436d-4e13-bdaf-9543f9437a9f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"678f0d30-436d-4e13-bdaf-9543f9437a9f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:07:06.413017 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.412962 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/678f0d30-436d-4e13-bdaf-9543f9437a9f-web-config\") pod \"alertmanager-main-0\" (UID: \"678f0d30-436d-4e13-bdaf-9543f9437a9f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:07:06.415931 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.415895 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-glwcx\" (UniqueName: \"kubernetes.io/projected/678f0d30-436d-4e13-bdaf-9543f9437a9f-kube-api-access-glwcx\") pod \"alertmanager-main-0\" (UID: \"678f0d30-436d-4e13-bdaf-9543f9437a9f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:07:06.416128 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.416042 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/678f0d30-436d-4e13-bdaf-9543f9437a9f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"678f0d30-436d-4e13-bdaf-9543f9437a9f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:07:06.612979 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.612862 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jthps" event={"ID":"c4f38a31-9f9c-408b-a1a7-4262ba1c1119","Type":"ContainerStarted","Data":"f9e346c283140dac487a69117f689000ddddea381437ae9fc0899183fc361511"} Jun 03 21:07:06.615449 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.615415 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tknds" event={"ID":"fdc0db97-8099-4bd7-a458-2edacf4a2696","Type":"ContainerStarted","Data":"a17df4e6ac95fc62440165fd5d266a65ddd48b2296732d93cf62a68d3b5eda46"} Jun 03 21:07:06.615598 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.615470 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tknds" event={"ID":"fdc0db97-8099-4bd7-a458-2edacf4a2696","Type":"ContainerStarted","Data":"7207696d8cf832e6cc638cd1b192840319af62690a448afedbc09771e1cf746e"} Jun 03 21:07:06.615598 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.615490 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tknds" event={"ID":"fdc0db97-8099-4bd7-a458-2edacf4a2696","Type":"ContainerStarted","Data":"3bfcb10b2f987923fe56e00df8ec57030c48ffcebf03dd276e034da57e59dbca"} Jun 03 21:07:06.910688 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.910491 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/678f0d30-436d-4e13-bdaf-9543f9437a9f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"678f0d30-436d-4e13-bdaf-9543f9437a9f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:07:06.913798 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:06.913736 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/678f0d30-436d-4e13-bdaf-9543f9437a9f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"678f0d30-436d-4e13-bdaf-9543f9437a9f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:07:07.011381 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.011331 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0-metrics-certs\") pod \"network-metrics-daemon-bpb2j\" (UID: \"fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0\") " pod="openshift-multus/network-metrics-daemon-bpb2j" Jun 03 21:07:07.013604 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.013399 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 21:07:07.025626 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.025594 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0-metrics-certs\") pod \"network-metrics-daemon-bpb2j\" (UID: \"fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0\") " pod="openshift-multus/network-metrics-daemon-bpb2j" Jun 03 21:07:07.076073 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.076032 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6dbbfcb4bd-d9dvl"] Jun 03 21:07:07.083049 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.082999 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6dbbfcb4bd-d9dvl" Jun 03 21:07:07.085519 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.085371 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 03 21:07:07.085519 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.085392 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 03 21:07:07.085519 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.085482 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-84pc2\"" Jun 03 21:07:07.085836 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.085772 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 03 21:07:07.086079 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.085892 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 03 21:07:07.086193 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.086177 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 03 21:07:07.086274 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.086240 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2uup1r7elvuac\"" Jun 03 21:07:07.094631 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.094598 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6dbbfcb4bd-d9dvl"] Jun 03 21:07:07.107184 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.107155 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:07:07.112167 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.112144 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1239087f-2fb2-48c1-a6d6-a77d4c3a8947-original-pull-secret\") pod \"global-pull-secret-syncer-7mnlx\" (UID: \"1239087f-2fb2-48c1-a6d6-a77d4c3a8947\") " pod="kube-system/global-pull-secret-syncer-7mnlx" Jun 03 21:07:07.112300 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.112265 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9rrl\" (UniqueName: \"kubernetes.io/projected/c61839be-8301-4c2b-ae73-097623a04e47-kube-api-access-m9rrl\") pod \"network-check-target-b64br\" (UID: \"c61839be-8301-4c2b-ae73-097623a04e47\") " pod="openshift-network-diagnostics/network-check-target-b64br" Jun 03 21:07:07.114539 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.114513 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 21:07:07.114827 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.114804 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 21:07:07.124856 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.124834 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 21:07:07.124977 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.124954 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1239087f-2fb2-48c1-a6d6-a77d4c3a8947-original-pull-secret\") pod \"global-pull-secret-syncer-7mnlx\" (UID: \"1239087f-2fb2-48c1-a6d6-a77d4c3a8947\") " pod="kube-system/global-pull-secret-syncer-7mnlx" Jun 03 21:07:07.135523 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.135495 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9rrl\" (UniqueName: \"kubernetes.io/projected/c61839be-8301-4c2b-ae73-097623a04e47-kube-api-access-m9rrl\") pod \"network-check-target-b64br\" (UID: \"c61839be-8301-4c2b-ae73-097623a04e47\") " pod="openshift-network-diagnostics/network-check-target-b64br" Jun 03 21:07:07.213779 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.213736 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tds4\" (UniqueName: \"kubernetes.io/projected/ac093228-c4a1-4c8e-8ea5-1c25e5959fed-kube-api-access-8tds4\") pod \"thanos-querier-6dbbfcb4bd-d9dvl\" (UID: \"ac093228-c4a1-4c8e-8ea5-1c25e5959fed\") " pod="openshift-monitoring/thanos-querier-6dbbfcb4bd-d9dvl" Jun 03 21:07:07.214263 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.213793 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ac093228-c4a1-4c8e-8ea5-1c25e5959fed-secret-grpc-tls\") pod \"thanos-querier-6dbbfcb4bd-d9dvl\" (UID: \"ac093228-c4a1-4c8e-8ea5-1c25e5959fed\") " pod="openshift-monitoring/thanos-querier-6dbbfcb4bd-d9dvl" Jun 03 21:07:07.214263 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.213822 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ac093228-c4a1-4c8e-8ea5-1c25e5959fed-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6dbbfcb4bd-d9dvl\" (UID: \"ac093228-c4a1-4c8e-8ea5-1c25e5959fed\") " pod="openshift-monitoring/thanos-querier-6dbbfcb4bd-d9dvl" Jun 03 21:07:07.214263 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.213850 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ac093228-c4a1-4c8e-8ea5-1c25e5959fed-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6dbbfcb4bd-d9dvl\" (UID: \"ac093228-c4a1-4c8e-8ea5-1c25e5959fed\") " pod="openshift-monitoring/thanos-querier-6dbbfcb4bd-d9dvl" Jun 03 21:07:07.214263 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.213926 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ac093228-c4a1-4c8e-8ea5-1c25e5959fed-secret-thanos-querier-tls\") pod \"thanos-querier-6dbbfcb4bd-d9dvl\" (UID: \"ac093228-c4a1-4c8e-8ea5-1c25e5959fed\") " pod="openshift-monitoring/thanos-querier-6dbbfcb4bd-d9dvl" Jun 03 21:07:07.214263 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.213994 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ac093228-c4a1-4c8e-8ea5-1c25e5959fed-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6dbbfcb4bd-d9dvl\" (UID: \"ac093228-c4a1-4c8e-8ea5-1c25e5959fed\") " pod="openshift-monitoring/thanos-querier-6dbbfcb4bd-d9dvl" Jun 03 21:07:07.214263 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.214032 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ac093228-c4a1-4c8e-8ea5-1c25e5959fed-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6dbbfcb4bd-d9dvl\" (UID: \"ac093228-c4a1-4c8e-8ea5-1c25e5959fed\") " pod="openshift-monitoring/thanos-querier-6dbbfcb4bd-d9dvl" Jun 03 21:07:07.214263 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.214069 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac093228-c4a1-4c8e-8ea5-1c25e5959fed-metrics-client-ca\") pod \"thanos-querier-6dbbfcb4bd-d9dvl\" (UID: \"ac093228-c4a1-4c8e-8ea5-1c25e5959fed\") " pod="openshift-monitoring/thanos-querier-6dbbfcb4bd-d9dvl" Jun 03 21:07:07.276776 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.276751 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jgdk8\"" Jun 03 21:07:07.284443 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.284409 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpb2j" Jun 03 21:07:07.284885 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.284819 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-c4n2g\"" Jun 03 21:07:07.289791 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.289772 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7mnlx" Jun 03 21:07:07.292865 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.292842 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b64br" Jun 03 21:07:07.315182 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.315145 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tds4\" (UniqueName: \"kubernetes.io/projected/ac093228-c4a1-4c8e-8ea5-1c25e5959fed-kube-api-access-8tds4\") pod \"thanos-querier-6dbbfcb4bd-d9dvl\" (UID: \"ac093228-c4a1-4c8e-8ea5-1c25e5959fed\") " pod="openshift-monitoring/thanos-querier-6dbbfcb4bd-d9dvl" Jun 03 21:07:07.315341 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.315200 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ac093228-c4a1-4c8e-8ea5-1c25e5959fed-secret-grpc-tls\") pod \"thanos-querier-6dbbfcb4bd-d9dvl\" (UID: \"ac093228-c4a1-4c8e-8ea5-1c25e5959fed\") " pod="openshift-monitoring/thanos-querier-6dbbfcb4bd-d9dvl" Jun 03 21:07:07.315341 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.315251 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ac093228-c4a1-4c8e-8ea5-1c25e5959fed-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6dbbfcb4bd-d9dvl\" (UID: \"ac093228-c4a1-4c8e-8ea5-1c25e5959fed\") " pod="openshift-monitoring/thanos-querier-6dbbfcb4bd-d9dvl" Jun 03 21:07:07.315341 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.315281 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ac093228-c4a1-4c8e-8ea5-1c25e5959fed-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6dbbfcb4bd-d9dvl\" (UID: \"ac093228-c4a1-4c8e-8ea5-1c25e5959fed\") " pod="openshift-monitoring/thanos-querier-6dbbfcb4bd-d9dvl" Jun 03 21:07:07.315341 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.315323 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ac093228-c4a1-4c8e-8ea5-1c25e5959fed-secret-thanos-querier-tls\") pod \"thanos-querier-6dbbfcb4bd-d9dvl\" (UID: \"ac093228-c4a1-4c8e-8ea5-1c25e5959fed\") " pod="openshift-monitoring/thanos-querier-6dbbfcb4bd-d9dvl" Jun 03 21:07:07.315534 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.315365 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ac093228-c4a1-4c8e-8ea5-1c25e5959fed-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6dbbfcb4bd-d9dvl\" (UID: \"ac093228-c4a1-4c8e-8ea5-1c25e5959fed\") " pod="openshift-monitoring/thanos-querier-6dbbfcb4bd-d9dvl" Jun 03 21:07:07.315534 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.315393 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ac093228-c4a1-4c8e-8ea5-1c25e5959fed-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6dbbfcb4bd-d9dvl\" (UID: \"ac093228-c4a1-4c8e-8ea5-1c25e5959fed\") " pod="openshift-monitoring/thanos-querier-6dbbfcb4bd-d9dvl" Jun 03 21:07:07.315534 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.315425 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac093228-c4a1-4c8e-8ea5-1c25e5959fed-metrics-client-ca\") pod \"thanos-querier-6dbbfcb4bd-d9dvl\" (UID: \"ac093228-c4a1-4c8e-8ea5-1c25e5959fed\") " pod="openshift-monitoring/thanos-querier-6dbbfcb4bd-d9dvl" Jun 03 21:07:07.316262 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.316170 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac093228-c4a1-4c8e-8ea5-1c25e5959fed-metrics-client-ca\") pod \"thanos-querier-6dbbfcb4bd-d9dvl\" (UID: \"ac093228-c4a1-4c8e-8ea5-1c25e5959fed\") " pod="openshift-monitoring/thanos-querier-6dbbfcb4bd-d9dvl" Jun 03 21:07:07.318467 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.318439 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ac093228-c4a1-4c8e-8ea5-1c25e5959fed-secret-grpc-tls\") pod \"thanos-querier-6dbbfcb4bd-d9dvl\" (UID: \"ac093228-c4a1-4c8e-8ea5-1c25e5959fed\") " pod="openshift-monitoring/thanos-querier-6dbbfcb4bd-d9dvl" Jun 03 21:07:07.318590 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.318438 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ac093228-c4a1-4c8e-8ea5-1c25e5959fed-secret-thanos-querier-tls\") pod \"thanos-querier-6dbbfcb4bd-d9dvl\" (UID: \"ac093228-c4a1-4c8e-8ea5-1c25e5959fed\") " pod="openshift-monitoring/thanos-querier-6dbbfcb4bd-d9dvl" Jun 03 21:07:07.318590 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.318483 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ac093228-c4a1-4c8e-8ea5-1c25e5959fed-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6dbbfcb4bd-d9dvl\" (UID: \"ac093228-c4a1-4c8e-8ea5-1c25e5959fed\") " pod="openshift-monitoring/thanos-querier-6dbbfcb4bd-d9dvl" Jun 03 21:07:07.318676 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.318646 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ac093228-c4a1-4c8e-8ea5-1c25e5959fed-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6dbbfcb4bd-d9dvl\" (UID: \"ac093228-c4a1-4c8e-8ea5-1c25e5959fed\") " pod="openshift-monitoring/thanos-querier-6dbbfcb4bd-d9dvl" Jun 03 21:07:07.318967 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.318945 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ac093228-c4a1-4c8e-8ea5-1c25e5959fed-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6dbbfcb4bd-d9dvl\" (UID: \"ac093228-c4a1-4c8e-8ea5-1c25e5959fed\") " pod="openshift-monitoring/thanos-querier-6dbbfcb4bd-d9dvl" Jun 03 21:07:07.320445 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.320422 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ac093228-c4a1-4c8e-8ea5-1c25e5959fed-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6dbbfcb4bd-d9dvl\" (UID: \"ac093228-c4a1-4c8e-8ea5-1c25e5959fed\") " pod="openshift-monitoring/thanos-querier-6dbbfcb4bd-d9dvl" Jun 03 21:07:07.324637 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.324614 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tds4\" (UniqueName: \"kubernetes.io/projected/ac093228-c4a1-4c8e-8ea5-1c25e5959fed-kube-api-access-8tds4\") pod \"thanos-querier-6dbbfcb4bd-d9dvl\" (UID: \"ac093228-c4a1-4c8e-8ea5-1c25e5959fed\") " pod="openshift-monitoring/thanos-querier-6dbbfcb4bd-d9dvl" Jun 03 21:07:07.397278 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.397239 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6dbbfcb4bd-d9dvl" Jun 03 21:07:07.648920 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.647478 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jthps" event={"ID":"c4f38a31-9f9c-408b-a1a7-4262ba1c1119","Type":"ContainerStarted","Data":"a315135ef40dd3d75204e4333de74d556bfb6a22a26afccb01a51e5eda045e96"} Jun 03 21:07:07.657463 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.654664 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2wrhs" event={"ID":"2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b","Type":"ContainerStarted","Data":"2503baffd49f4b44f65b1f2d496fbe6feb7f49f79167c4a5cc63e21905cc5225"} Jun 03 21:07:07.657463 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.657069 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 21:07:07.671820 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:07:07.671287 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod678f0d30_436d_4e13_bdaf_9543f9437a9f.slice/crio-cdd07ae7adf7e1e3e7a17fada3e6d8468ad68f6763117b67e9b86d98368db447 WatchSource:0}: Error finding container cdd07ae7adf7e1e3e7a17fada3e6d8468ad68f6763117b67e9b86d98368db447: Status 404 returned error can't find the container with id cdd07ae7adf7e1e3e7a17fada3e6d8468ad68f6763117b67e9b86d98368db447 Jun 03 21:07:07.708372 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.707922 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7mnlx"] Jun 03 21:07:07.730155 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.726518 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bpb2j"] Jun 03 21:07:07.737083 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.732396 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-b64br"] Jun 03 21:07:07.754173 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:07.754056 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6dbbfcb4bd-d9dvl"] Jun 03 21:07:07.785255 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:07:07.785206 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd08c5ed_fd66_4062_bbe5_bb9b55b20bc0.slice/crio-2a6d778442b496c5abe8aeaacb2f6709dc125b6f7621136d263603a84c5d794f WatchSource:0}: Error finding container 2a6d778442b496c5abe8aeaacb2f6709dc125b6f7621136d263603a84c5d794f: Status 404 returned error can't find the container with id 2a6d778442b496c5abe8aeaacb2f6709dc125b6f7621136d263603a84c5d794f Jun 03 21:07:08.662134 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:08.662099 2557 generic.go:356] "Generic (PLEG): container finished" podID="2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b" containerID="2503baffd49f4b44f65b1f2d496fbe6feb7f49f79167c4a5cc63e21905cc5225" exitCode=0 Jun 03 21:07:08.662616 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:08.662193 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2wrhs" event={"ID":"2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b","Type":"ContainerDied","Data":"2503baffd49f4b44f65b1f2d496fbe6feb7f49f79167c4a5cc63e21905cc5225"} Jun 03 21:07:08.670910 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:08.667089 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tknds" event={"ID":"fdc0db97-8099-4bd7-a458-2edacf4a2696","Type":"ContainerStarted","Data":"c651dc973ab6ee9fb1719f9c617444aacc0708bb58ae3df333dadd4346d3d23a"} Jun 03 21:07:08.673058 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:08.673008 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-b64br" event={"ID":"c61839be-8301-4c2b-ae73-097623a04e47","Type":"ContainerStarted","Data":"a99c177ed620fdd7f626a7ce1199de3d5b2f60fc3e74eae9c21890be71ede95a"} Jun 03 21:07:08.678664 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:08.678626 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jthps" event={"ID":"c4f38a31-9f9c-408b-a1a7-4262ba1c1119","Type":"ContainerStarted","Data":"8235642e257bd731f1804f692d3313793a36b2644b1053597f94ba4f644e14f8"} Jun 03 21:07:08.678819 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:08.678691 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jthps" event={"ID":"c4f38a31-9f9c-408b-a1a7-4262ba1c1119","Type":"ContainerStarted","Data":"953cb936b41111634ae87be8caabe18c83b7ddbd2fd82ddaee737343a196bc17"} Jun 03 21:07:08.682767 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:08.682670 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bpb2j" event={"ID":"fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0","Type":"ContainerStarted","Data":"2a6d778442b496c5abe8aeaacb2f6709dc125b6f7621136d263603a84c5d794f"} Jun 03 21:07:08.684518 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:08.684472 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6dbbfcb4bd-d9dvl" event={"ID":"ac093228-c4a1-4c8e-8ea5-1c25e5959fed","Type":"ContainerStarted","Data":"736b8f015c0bb1a1a07a7c4d7e276611da3c65eef6e8c37953160c63c00e5a4f"} Jun 03 21:07:08.686076 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:08.686051 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7mnlx" event={"ID":"1239087f-2fb2-48c1-a6d6-a77d4c3a8947","Type":"ContainerStarted","Data":"fb3dd1d5bb4ccff97aba4b8ff320fdd06180e3a29c26fa3fa8b1f9a425283730"} Jun 03 21:07:08.688379 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:08.688355 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"678f0d30-436d-4e13-bdaf-9543f9437a9f","Type":"ContainerStarted","Data":"cdd07ae7adf7e1e3e7a17fada3e6d8468ad68f6763117b67e9b86d98368db447"} Jun 03 21:07:08.707599 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:08.706850 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-tknds" podStartSLOduration=2.428683069 podStartE2EDuration="3.706828479s" totalImagesPullingTime="1.27814541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:07:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:07:08.705783318 +0000 UTC m=+66.861961469" watchObservedRunningTime="2026-06-03 21:07:08.706828479 +0000 UTC m=+66.863006630" Jun 03 21:07:09.418369 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:09.417988 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jthps" podStartSLOduration=2.650549184 podStartE2EDuration="4.417956041s" totalImagesPullingTime="1.767406857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:07:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:07:08.730234202 +0000 UTC m=+66.886412350" watchObservedRunningTime="2026-06-03 21:07:09.417956041 +0000 UTC m=+67.574134183" Jun 03 21:07:09.420582 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:09.419158 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-68c789f4b4-xgmvd"] Jun 03 21:07:09.421732 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:09.421688 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-68c789f4b4-xgmvd" Jun 03 21:07:09.426361 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:09.426077 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 03 21:07:09.426361 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:09.426325 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 03 21:07:09.426547 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:09.426523 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 03 21:07:09.426760 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:09.426744 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-q8jn4\"" Jun 03 21:07:09.427112 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:09.427095 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 03 21:07:09.427499 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:09.427482 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-1nk5kmt8bptn4\"" Jun 03 21:07:09.437518 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:09.437494 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-68c789f4b4-xgmvd"] Jun 03 21:07:09.538754 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:09.538695 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8bc8bac3-062f-473f-a131-7a25f51972f6-audit-log\") pod \"metrics-server-68c789f4b4-xgmvd\" (UID: \"8bc8bac3-062f-473f-a131-7a25f51972f6\") " pod="openshift-monitoring/metrics-server-68c789f4b4-xgmvd" Jun 03 21:07:09.539012 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:09.538772 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8bc8bac3-062f-473f-a131-7a25f51972f6-client-ca-bundle\") pod \"metrics-server-68c789f4b4-xgmvd\" (UID: \"8bc8bac3-062f-473f-a131-7a25f51972f6\") " pod="openshift-monitoring/metrics-server-68c789f4b4-xgmvd" Jun 03 21:07:09.539012 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:09.538815 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bc8bac3-062f-473f-a131-7a25f51972f6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-68c789f4b4-xgmvd\" (UID: \"8bc8bac3-062f-473f-a131-7a25f51972f6\") " pod="openshift-monitoring/metrics-server-68c789f4b4-xgmvd" Jun 03 21:07:09.539012 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:09.538847 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8bc8bac3-062f-473f-a131-7a25f51972f6-secret-metrics-server-tls\") pod \"metrics-server-68c789f4b4-xgmvd\" (UID: \"8bc8bac3-062f-473f-a131-7a25f51972f6\") " pod="openshift-monitoring/metrics-server-68c789f4b4-xgmvd" Jun 03 21:07:09.539012 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:09.538881 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8bc8bac3-062f-473f-a131-7a25f51972f6-secret-metrics-server-client-certs\") pod \"metrics-server-68c789f4b4-xgmvd\" (UID: \"8bc8bac3-062f-473f-a131-7a25f51972f6\") " pod="openshift-monitoring/metrics-server-68c789f4b4-xgmvd" Jun 03 21:07:09.539012 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:09.538962 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvdf7\" (UniqueName: \"kubernetes.io/projected/8bc8bac3-062f-473f-a131-7a25f51972f6-kube-api-access-lvdf7\") pod \"metrics-server-68c789f4b4-xgmvd\" (UID: \"8bc8bac3-062f-473f-a131-7a25f51972f6\") " pod="openshift-monitoring/metrics-server-68c789f4b4-xgmvd" Jun 03 21:07:09.539012 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:09.538999 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8bc8bac3-062f-473f-a131-7a25f51972f6-metrics-server-audit-profiles\") pod \"metrics-server-68c789f4b4-xgmvd\" (UID: \"8bc8bac3-062f-473f-a131-7a25f51972f6\") " pod="openshift-monitoring/metrics-server-68c789f4b4-xgmvd" Jun 03 21:07:09.643037 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:09.640099 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8bc8bac3-062f-473f-a131-7a25f51972f6-metrics-server-audit-profiles\") pod \"metrics-server-68c789f4b4-xgmvd\" (UID: \"8bc8bac3-062f-473f-a131-7a25f51972f6\") " pod="openshift-monitoring/metrics-server-68c789f4b4-xgmvd" Jun 03 21:07:09.643037 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:09.640158 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8bc8bac3-062f-473f-a131-7a25f51972f6-audit-log\") pod \"metrics-server-68c789f4b4-xgmvd\" (UID: \"8bc8bac3-062f-473f-a131-7a25f51972f6\") " pod="openshift-monitoring/metrics-server-68c789f4b4-xgmvd" Jun 03 21:07:09.643037 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:09.640185 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8bc8bac3-062f-473f-a131-7a25f51972f6-client-ca-bundle\") pod \"metrics-server-68c789f4b4-xgmvd\" (UID: \"8bc8bac3-062f-473f-a131-7a25f51972f6\") " pod="openshift-monitoring/metrics-server-68c789f4b4-xgmvd" Jun 03 21:07:09.643037 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:09.640226 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bc8bac3-062f-473f-a131-7a25f51972f6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-68c789f4b4-xgmvd\" (UID: \"8bc8bac3-062f-473f-a131-7a25f51972f6\") " pod="openshift-monitoring/metrics-server-68c789f4b4-xgmvd" Jun 03 21:07:09.643037 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:09.640253 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8bc8bac3-062f-473f-a131-7a25f51972f6-secret-metrics-server-tls\") pod \"metrics-server-68c789f4b4-xgmvd\" (UID: \"8bc8bac3-062f-473f-a131-7a25f51972f6\") " pod="openshift-monitoring/metrics-server-68c789f4b4-xgmvd" Jun 03 21:07:09.643037 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:09.640282 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8bc8bac3-062f-473f-a131-7a25f51972f6-secret-metrics-server-client-certs\") pod \"metrics-server-68c789f4b4-xgmvd\" (UID: \"8bc8bac3-062f-473f-a131-7a25f51972f6\") " pod="openshift-monitoring/metrics-server-68c789f4b4-xgmvd" Jun 03 21:07:09.643037 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:09.640349 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvdf7\" (UniqueName: \"kubernetes.io/projected/8bc8bac3-062f-473f-a131-7a25f51972f6-kube-api-access-lvdf7\") pod \"metrics-server-68c789f4b4-xgmvd\" (UID: \"8bc8bac3-062f-473f-a131-7a25f51972f6\") " pod="openshift-monitoring/metrics-server-68c789f4b4-xgmvd" Jun 03 21:07:09.643037 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:09.642056 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8bc8bac3-062f-473f-a131-7a25f51972f6-metrics-server-audit-profiles\") pod \"metrics-server-68c789f4b4-xgmvd\" (UID: \"8bc8bac3-062f-473f-a131-7a25f51972f6\") " pod="openshift-monitoring/metrics-server-68c789f4b4-xgmvd" Jun 03 21:07:09.643037 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:09.642350 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8bc8bac3-062f-473f-a131-7a25f51972f6-audit-log\") pod \"metrics-server-68c789f4b4-xgmvd\" (UID: \"8bc8bac3-062f-473f-a131-7a25f51972f6\") " pod="openshift-monitoring/metrics-server-68c789f4b4-xgmvd" Jun 03 21:07:09.643610 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:09.643333 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bc8bac3-062f-473f-a131-7a25f51972f6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-68c789f4b4-xgmvd\" (UID: \"8bc8bac3-062f-473f-a131-7a25f51972f6\") " pod="openshift-monitoring/metrics-server-68c789f4b4-xgmvd" Jun 03 21:07:09.662899 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:09.662370 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8bc8bac3-062f-473f-a131-7a25f51972f6-secret-metrics-server-client-certs\") pod \"metrics-server-68c789f4b4-xgmvd\" (UID: \"8bc8bac3-062f-473f-a131-7a25f51972f6\") " pod="openshift-monitoring/metrics-server-68c789f4b4-xgmvd" Jun 03 21:07:09.662899 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:09.662389 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8bc8bac3-062f-473f-a131-7a25f51972f6-secret-metrics-server-tls\") pod \"metrics-server-68c789f4b4-xgmvd\" (UID: \"8bc8bac3-062f-473f-a131-7a25f51972f6\") " pod="openshift-monitoring/metrics-server-68c789f4b4-xgmvd" Jun 03 21:07:09.664549 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:09.664498 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8bc8bac3-062f-473f-a131-7a25f51972f6-client-ca-bundle\") pod \"metrics-server-68c789f4b4-xgmvd\" (UID: \"8bc8bac3-062f-473f-a131-7a25f51972f6\") " pod="openshift-monitoring/metrics-server-68c789f4b4-xgmvd" Jun 03 21:07:09.669814 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:09.669744 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvdf7\" (UniqueName: \"kubernetes.io/projected/8bc8bac3-062f-473f-a131-7a25f51972f6-kube-api-access-lvdf7\") pod \"metrics-server-68c789f4b4-xgmvd\" (UID: \"8bc8bac3-062f-473f-a131-7a25f51972f6\") " pod="openshift-monitoring/metrics-server-68c789f4b4-xgmvd" Jun 03 21:07:09.739524 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:09.739486 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-68c789f4b4-xgmvd" Jun 03 21:07:09.895740 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:09.894577 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-9b9fc658-6dsg4"] Jun 03 21:07:09.897914 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:09.897219 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-9b9fc658-6dsg4" Jun 03 21:07:09.900065 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:09.900041 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 03 21:07:09.900453 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:09.900435 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-wxzsr\"" Jun 03 21:07:09.910656 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:09.910586 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-9b9fc658-6dsg4"] Jun 03 21:07:09.942697 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:09.942659 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/341ebaee-23b7-4b2d-bfe8-76cde68cf60b-monitoring-plugin-cert\") pod \"monitoring-plugin-9b9fc658-6dsg4\" (UID: \"341ebaee-23b7-4b2d-bfe8-76cde68cf60b\") " pod="openshift-monitoring/monitoring-plugin-9b9fc658-6dsg4" Jun 03 21:07:09.942885 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:09.942790 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jss7\" (UniqueName: \"kubernetes.io/projected/341ebaee-23b7-4b2d-bfe8-76cde68cf60b-kube-api-access-6jss7\") pod \"monitoring-plugin-9b9fc658-6dsg4\" (UID: \"341ebaee-23b7-4b2d-bfe8-76cde68cf60b\") " pod="openshift-monitoring/monitoring-plugin-9b9fc658-6dsg4" Jun 03 21:07:09.985592 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:09.985465 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-68c789f4b4-xgmvd"] Jun 03 21:07:10.044651 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:10.044212 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jss7\" (UniqueName: \"kubernetes.io/projected/341ebaee-23b7-4b2d-bfe8-76cde68cf60b-kube-api-access-6jss7\") pod \"monitoring-plugin-9b9fc658-6dsg4\" (UID: \"341ebaee-23b7-4b2d-bfe8-76cde68cf60b\") " pod="openshift-monitoring/monitoring-plugin-9b9fc658-6dsg4" Jun 03 21:07:10.044651 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:10.044314 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/341ebaee-23b7-4b2d-bfe8-76cde68cf60b-monitoring-plugin-cert\") pod \"monitoring-plugin-9b9fc658-6dsg4\" (UID: \"341ebaee-23b7-4b2d-bfe8-76cde68cf60b\") " pod="openshift-monitoring/monitoring-plugin-9b9fc658-6dsg4" Jun 03 21:07:10.044651 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:07:10.044465 2557 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 03 21:07:10.044651 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:07:10.044533 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/341ebaee-23b7-4b2d-bfe8-76cde68cf60b-monitoring-plugin-cert podName:341ebaee-23b7-4b2d-bfe8-76cde68cf60b nodeName:}" failed. No retries permitted until 2026-06-03 21:07:10.544510562 +0000 UTC m=+68.700688713 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/341ebaee-23b7-4b2d-bfe8-76cde68cf60b-monitoring-plugin-cert") pod "monitoring-plugin-9b9fc658-6dsg4" (UID: "341ebaee-23b7-4b2d-bfe8-76cde68cf60b") : secret "monitoring-plugin-cert" not found Jun 03 21:07:10.059559 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:10.059472 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jss7\" (UniqueName: \"kubernetes.io/projected/341ebaee-23b7-4b2d-bfe8-76cde68cf60b-kube-api-access-6jss7\") pod \"monitoring-plugin-9b9fc658-6dsg4\" (UID: \"341ebaee-23b7-4b2d-bfe8-76cde68cf60b\") " pod="openshift-monitoring/monitoring-plugin-9b9fc658-6dsg4" Jun 03 21:07:10.548571 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:10.548532 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/341ebaee-23b7-4b2d-bfe8-76cde68cf60b-monitoring-plugin-cert\") pod \"monitoring-plugin-9b9fc658-6dsg4\" (UID: \"341ebaee-23b7-4b2d-bfe8-76cde68cf60b\") " pod="openshift-monitoring/monitoring-plugin-9b9fc658-6dsg4" Jun 03 21:07:10.552368 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:10.552311 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/341ebaee-23b7-4b2d-bfe8-76cde68cf60b-monitoring-plugin-cert\") pod \"monitoring-plugin-9b9fc658-6dsg4\" (UID: \"341ebaee-23b7-4b2d-bfe8-76cde68cf60b\") " pod="openshift-monitoring/monitoring-plugin-9b9fc658-6dsg4" Jun 03 21:07:10.704120 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:10.704025 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2wrhs" event={"ID":"2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b","Type":"ContainerStarted","Data":"e7f5803202ec32bc7bd37b5516acc4a1ab00056f268d19734dc2a1025b82c602"} Jun 03 21:07:10.752796 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:07:10.746156 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bc8bac3_062f_473f_a131_7a25f51972f6.slice/crio-3e7a93eecf7104a3297155d4d3829c3cee693cdea6f08b65267b19d10295e2bb WatchSource:0}: Error finding container 3e7a93eecf7104a3297155d4d3829c3cee693cdea6f08b65267b19d10295e2bb: Status 404 returned error can't find the container with id 3e7a93eecf7104a3297155d4d3829c3cee693cdea6f08b65267b19d10295e2bb Jun 03 21:07:10.815669 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:10.815461 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-9b9fc658-6dsg4" Jun 03 21:07:11.021907 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.021867 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-9b9fc658-6dsg4"] Jun 03 21:07:11.406458 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.406280 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8cf9996db-96czm"] Jun 03 21:07:11.411894 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.411861 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8cf9996db-96czm" Jun 03 21:07:11.414329 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.414281 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 03 21:07:11.414897 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.414878 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4nqlz\"" Jun 03 21:07:11.415920 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.414915 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 03 21:07:11.415920 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.415089 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 03 21:07:11.416088 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.415134 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 03 21:07:11.416088 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.415153 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 03 21:07:11.420528 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.420459 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8cf9996db-96czm"] Jun 03 21:07:11.460593 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.460269 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9133bd70-86bf-4e4e-834f-74d9b3a6b693-service-ca\") pod \"console-8cf9996db-96czm\" (UID: \"9133bd70-86bf-4e4e-834f-74d9b3a6b693\") " pod="openshift-console/console-8cf9996db-96czm" Jun 03 21:07:11.460593 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.460321 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qvgs\" (UniqueName: \"kubernetes.io/projected/9133bd70-86bf-4e4e-834f-74d9b3a6b693-kube-api-access-2qvgs\") pod \"console-8cf9996db-96czm\" (UID: \"9133bd70-86bf-4e4e-834f-74d9b3a6b693\") " pod="openshift-console/console-8cf9996db-96czm" Jun 03 21:07:11.460593 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.460381 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9133bd70-86bf-4e4e-834f-74d9b3a6b693-oauth-serving-cert\") pod \"console-8cf9996db-96czm\" (UID: \"9133bd70-86bf-4e4e-834f-74d9b3a6b693\") " pod="openshift-console/console-8cf9996db-96czm" Jun 03 21:07:11.460593 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.460425 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9133bd70-86bf-4e4e-834f-74d9b3a6b693-console-serving-cert\") pod \"console-8cf9996db-96czm\" (UID: \"9133bd70-86bf-4e4e-834f-74d9b3a6b693\") " pod="openshift-console/console-8cf9996db-96czm" Jun 03 21:07:11.460593 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.460466 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9133bd70-86bf-4e4e-834f-74d9b3a6b693-console-config\") pod \"console-8cf9996db-96czm\" (UID: \"9133bd70-86bf-4e4e-834f-74d9b3a6b693\") " pod="openshift-console/console-8cf9996db-96czm" Jun 03 21:07:11.460593 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.460493 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9133bd70-86bf-4e4e-834f-74d9b3a6b693-console-oauth-config\") pod \"console-8cf9996db-96czm\" (UID: \"9133bd70-86bf-4e4e-834f-74d9b3a6b693\") " pod="openshift-console/console-8cf9996db-96czm" Jun 03 21:07:11.485911 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.483678 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 21:07:11.489376 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.489346 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.491938 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.491773 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 03 21:07:11.492173 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.492076 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 03 21:07:11.492287 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.492270 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 03 21:07:11.492730 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.492683 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 03 21:07:11.492937 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.492915 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 03 21:07:11.493005 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.492967 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 03 21:07:11.493216 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.493164 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 03 21:07:11.493216 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.493186 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 03 21:07:11.493451 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.493398 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 03 21:07:11.493451 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.493440 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 03 21:07:11.493746 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.493679 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 03 21:07:11.493812 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.493774 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-v484b\"" Jun 03 21:07:11.493925 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.493907 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 03 21:07:11.493995 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.493964 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-o9porrjiu3lu\"" Jun 03 21:07:11.495658 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.495639 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 03 21:07:11.497247 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.497074 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 03 21:07:11.511344 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.511313 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 21:07:11.561470 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.561433 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a0a9ce13-0d44-473d-94f6-2542dd4501e0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.561661 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.561482 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0a9ce13-0d44-473d-94f6-2542dd4501e0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.561661 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.561552 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a0a9ce13-0d44-473d-94f6-2542dd4501e0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.561661 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.561588 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0a9ce13-0d44-473d-94f6-2542dd4501e0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.561661 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.561622 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a0a9ce13-0d44-473d-94f6-2542dd4501e0-config-out\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.561661 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.561646 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a0a9ce13-0d44-473d-94f6-2542dd4501e0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.561990 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.561690 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9133bd70-86bf-4e4e-834f-74d9b3a6b693-oauth-serving-cert\") pod \"console-8cf9996db-96czm\" (UID: \"9133bd70-86bf-4e4e-834f-74d9b3a6b693\") " pod="openshift-console/console-8cf9996db-96czm" Jun 03 21:07:11.561990 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.561746 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a0a9ce13-0d44-473d-94f6-2542dd4501e0-web-config\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.561990 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.561773 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a0a9ce13-0d44-473d-94f6-2542dd4501e0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.561990 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.561808 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9133bd70-86bf-4e4e-834f-74d9b3a6b693-console-serving-cert\") pod \"console-8cf9996db-96czm\" (UID: \"9133bd70-86bf-4e4e-834f-74d9b3a6b693\") " pod="openshift-console/console-8cf9996db-96czm" Jun 03 21:07:11.561990 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.561836 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0a9ce13-0d44-473d-94f6-2542dd4501e0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.561990 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.561868 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a0a9ce13-0d44-473d-94f6-2542dd4501e0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.561990 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.561904 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a0a9ce13-0d44-473d-94f6-2542dd4501e0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.561990 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.561928 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0a9ce13-0d44-473d-94f6-2542dd4501e0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.561990 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.561954 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmjvw\" (UniqueName: \"kubernetes.io/projected/a0a9ce13-0d44-473d-94f6-2542dd4501e0-kube-api-access-lmjvw\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.562416 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.562011 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a0a9ce13-0d44-473d-94f6-2542dd4501e0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.562416 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.562044 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9133bd70-86bf-4e4e-834f-74d9b3a6b693-console-config\") pod \"console-8cf9996db-96czm\" (UID: \"9133bd70-86bf-4e4e-834f-74d9b3a6b693\") " pod="openshift-console/console-8cf9996db-96czm" Jun 03 21:07:11.562416 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.562073 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9133bd70-86bf-4e4e-834f-74d9b3a6b693-console-oauth-config\") pod \"console-8cf9996db-96czm\" (UID: \"9133bd70-86bf-4e4e-834f-74d9b3a6b693\") " pod="openshift-console/console-8cf9996db-96czm" Jun 03 21:07:11.562416 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.562100 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a0a9ce13-0d44-473d-94f6-2542dd4501e0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.562416 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.562127 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a0a9ce13-0d44-473d-94f6-2542dd4501e0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.562416 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.562158 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a0a9ce13-0d44-473d-94f6-2542dd4501e0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.562416 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.562198 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9133bd70-86bf-4e4e-834f-74d9b3a6b693-service-ca\") pod \"console-8cf9996db-96czm\" (UID: \"9133bd70-86bf-4e4e-834f-74d9b3a6b693\") " pod="openshift-console/console-8cf9996db-96czm" Jun 03 21:07:11.562416 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.562224 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a0a9ce13-0d44-473d-94f6-2542dd4501e0-config\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.563142 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.563054 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9133bd70-86bf-4e4e-834f-74d9b3a6b693-console-config\") pod \"console-8cf9996db-96czm\" (UID: \"9133bd70-86bf-4e4e-834f-74d9b3a6b693\") " pod="openshift-console/console-8cf9996db-96czm" Jun 03 21:07:11.563142 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.563087 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9133bd70-86bf-4e4e-834f-74d9b3a6b693-oauth-serving-cert\") pod \"console-8cf9996db-96czm\" (UID: \"9133bd70-86bf-4e4e-834f-74d9b3a6b693\") " pod="openshift-console/console-8cf9996db-96czm" Jun 03 21:07:11.563142 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.563133 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qvgs\" (UniqueName: \"kubernetes.io/projected/9133bd70-86bf-4e4e-834f-74d9b3a6b693-kube-api-access-2qvgs\") pod \"console-8cf9996db-96czm\" (UID: \"9133bd70-86bf-4e4e-834f-74d9b3a6b693\") " pod="openshift-console/console-8cf9996db-96czm" Jun 03 21:07:11.563367 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.563167 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a0a9ce13-0d44-473d-94f6-2542dd4501e0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.563367 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.563199 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a0a9ce13-0d44-473d-94f6-2542dd4501e0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.563638 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.563579 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9133bd70-86bf-4e4e-834f-74d9b3a6b693-service-ca\") pod \"console-8cf9996db-96czm\" (UID: \"9133bd70-86bf-4e4e-834f-74d9b3a6b693\") " pod="openshift-console/console-8cf9996db-96czm" Jun 03 21:07:11.567328 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.567286 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9133bd70-86bf-4e4e-834f-74d9b3a6b693-console-oauth-config\") pod \"console-8cf9996db-96czm\" (UID: \"9133bd70-86bf-4e4e-834f-74d9b3a6b693\") " pod="openshift-console/console-8cf9996db-96czm" Jun 03 21:07:11.567443 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.567400 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9133bd70-86bf-4e4e-834f-74d9b3a6b693-console-serving-cert\") pod \"console-8cf9996db-96czm\" (UID: \"9133bd70-86bf-4e4e-834f-74d9b3a6b693\") " pod="openshift-console/console-8cf9996db-96czm" Jun 03 21:07:11.572245 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.572202 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qvgs\" (UniqueName: \"kubernetes.io/projected/9133bd70-86bf-4e4e-834f-74d9b3a6b693-kube-api-access-2qvgs\") pod \"console-8cf9996db-96czm\" (UID: \"9133bd70-86bf-4e4e-834f-74d9b3a6b693\") " pod="openshift-console/console-8cf9996db-96czm" Jun 03 21:07:11.665079 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.664498 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a0a9ce13-0d44-473d-94f6-2542dd4501e0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.665079 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.664549 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a0a9ce13-0d44-473d-94f6-2542dd4501e0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.665079 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.664578 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a0a9ce13-0d44-473d-94f6-2542dd4501e0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.665079 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.664610 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a0a9ce13-0d44-473d-94f6-2542dd4501e0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.665079 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.664642 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a0a9ce13-0d44-473d-94f6-2542dd4501e0-config\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.665079 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.664675 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a0a9ce13-0d44-473d-94f6-2542dd4501e0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.665079 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.664969 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a0a9ce13-0d44-473d-94f6-2542dd4501e0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.665079 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.665015 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a0a9ce13-0d44-473d-94f6-2542dd4501e0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.665079 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.665049 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0a9ce13-0d44-473d-94f6-2542dd4501e0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.665079 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.665076 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a0a9ce13-0d44-473d-94f6-2542dd4501e0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.665664 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.665101 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0a9ce13-0d44-473d-94f6-2542dd4501e0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.665664 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.665131 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a0a9ce13-0d44-473d-94f6-2542dd4501e0-config-out\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.665664 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.665153 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a0a9ce13-0d44-473d-94f6-2542dd4501e0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.665664 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.665205 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a0a9ce13-0d44-473d-94f6-2542dd4501e0-web-config\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.665664 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.665228 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a0a9ce13-0d44-473d-94f6-2542dd4501e0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.665664 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.665281 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0a9ce13-0d44-473d-94f6-2542dd4501e0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.665664 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.665309 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a0a9ce13-0d44-473d-94f6-2542dd4501e0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.665664 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.665349 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a0a9ce13-0d44-473d-94f6-2542dd4501e0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.665664 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.665376 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0a9ce13-0d44-473d-94f6-2542dd4501e0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.665664 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.665400 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmjvw\" (UniqueName: \"kubernetes.io/projected/a0a9ce13-0d44-473d-94f6-2542dd4501e0-kube-api-access-lmjvw\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.666517 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.665887 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a0a9ce13-0d44-473d-94f6-2542dd4501e0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.666517 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.666487 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0a9ce13-0d44-473d-94f6-2542dd4501e0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.667433 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.667107 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0a9ce13-0d44-473d-94f6-2542dd4501e0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.667433 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.667206 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0a9ce13-0d44-473d-94f6-2542dd4501e0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.669553 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.669065 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a0a9ce13-0d44-473d-94f6-2542dd4501e0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.669723 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.669684 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a0a9ce13-0d44-473d-94f6-2542dd4501e0-config-out\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.672766 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.670104 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a0a9ce13-0d44-473d-94f6-2542dd4501e0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.672766 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.670307 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a0a9ce13-0d44-473d-94f6-2542dd4501e0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.672766 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.670739 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0a9ce13-0d44-473d-94f6-2542dd4501e0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.672766 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.671213 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a0a9ce13-0d44-473d-94f6-2542dd4501e0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.673864 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.673430 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a0a9ce13-0d44-473d-94f6-2542dd4501e0-config\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.673864 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.673672 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a0a9ce13-0d44-473d-94f6-2542dd4501e0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.673864 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.673804 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a0a9ce13-0d44-473d-94f6-2542dd4501e0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.674084 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.672700 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a0a9ce13-0d44-473d-94f6-2542dd4501e0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.674084 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.674058 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a0a9ce13-0d44-473d-94f6-2542dd4501e0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.674197 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.674129 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a0a9ce13-0d44-473d-94f6-2542dd4501e0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.675074 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.675051 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a0a9ce13-0d44-473d-94f6-2542dd4501e0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.675283 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.675260 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a0a9ce13-0d44-473d-94f6-2542dd4501e0-web-config\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.678490 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.678452 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a0a9ce13-0d44-473d-94f6-2542dd4501e0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.679180 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.679143 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmjvw\" (UniqueName: \"kubernetes.io/projected/a0a9ce13-0d44-473d-94f6-2542dd4501e0-kube-api-access-lmjvw\") pod \"prometheus-k8s-0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:11.710832 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.710737 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-68c789f4b4-xgmvd" event={"ID":"8bc8bac3-062f-473f-a131-7a25f51972f6","Type":"ContainerStarted","Data":"3e7a93eecf7104a3297155d4d3829c3cee693cdea6f08b65267b19d10295e2bb"} Jun 03 21:07:11.713882 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.713851 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bpb2j" event={"ID":"fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0","Type":"ContainerStarted","Data":"b3f33661523f824e59b75fba95703cac080f8e041034cab88ad8250d6c751ce4"} Jun 03 21:07:11.716268 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.716203 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6dbbfcb4bd-d9dvl" event={"ID":"ac093228-c4a1-4c8e-8ea5-1c25e5959fed","Type":"ContainerStarted","Data":"d22a8e3f6dd9cc0b32ff3047a714afe6d49cdb9f0c03ebad6179fa62b27edf72"} Jun 03 21:07:11.716372 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.716285 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6dbbfcb4bd-d9dvl" event={"ID":"ac093228-c4a1-4c8e-8ea5-1c25e5959fed","Type":"ContainerStarted","Data":"2a5cc2972cdedf7e1984f0a493168edad3c9e34898e5a9a747ea45dbf72cdf78"} Jun 03 21:07:11.718990 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.718961 2557 generic.go:356] "Generic (PLEG): container finished" podID="678f0d30-436d-4e13-bdaf-9543f9437a9f" containerID="fea82663f22d6dbe8f327d478b2a1d35ace32f9841a6ad9d1862ad825aa7ce0f" exitCode=0 Jun 03 21:07:11.719096 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.719042 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"678f0d30-436d-4e13-bdaf-9543f9437a9f","Type":"ContainerDied","Data":"fea82663f22d6dbe8f327d478b2a1d35ace32f9841a6ad9d1862ad825aa7ce0f"} Jun 03 21:07:11.724170 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.724144 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2wrhs" event={"ID":"2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b","Type":"ContainerStarted","Data":"053007efafe761b72c7ac8d90cd8cb1c3af89b077572a55137738e344f9eecc0"} Jun 03 21:07:11.725973 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.725953 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8cf9996db-96czm" Jun 03 21:07:11.801554 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:11.801505 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:12.730522 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:12.730481 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-9b9fc658-6dsg4" event={"ID":"341ebaee-23b7-4b2d-bfe8-76cde68cf60b","Type":"ContainerStarted","Data":"f5e220be5dc2f1aed234af998cde6d5b9a5cf3799bb4cb135ff92ead907b3cf0"} Jun 03 21:07:22.027881 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:22.026266 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2wrhs" podStartSLOduration=14.97692681 podStartE2EDuration="17.026250918s" totalImagesPullingTime="1.902255906s" totalInitContainerRuntime="147.068202ms" isStatefulPod=true podCreationTimestamp="2026-06-03 21:07:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:07:11.778869735 +0000 UTC m=+69.935047883" watchObservedRunningTime="2026-06-03 21:07:22.026250918 +0000 UTC m=+80.182429066" Jun 03 21:07:22.027881 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:22.027161 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8cf9996db-96czm"] Jun 03 21:07:22.063600 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:22.063570 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 21:07:22.349428 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:07:22.349390 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0a9ce13_0d44_473d_94f6_2542dd4501e0.slice/crio-95415ac02a2b9a57d37ab366a5db9ed23c57a055ed175a52cb5375975f8cdabf WatchSource:0}: Error finding container 95415ac02a2b9a57d37ab366a5db9ed23c57a055ed175a52cb5375975f8cdabf: Status 404 returned error can't find the container with id 95415ac02a2b9a57d37ab366a5db9ed23c57a055ed175a52cb5375975f8cdabf Jun 03 21:07:22.351214 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:07:22.351124 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9133bd70_86bf_4e4e_834f_74d9b3a6b693.slice/crio-9d9335d400116020c70a165d7697863330a21f118012be343bf5daedec3f6654 WatchSource:0}: Error finding container 9d9335d400116020c70a165d7697863330a21f118012be343bf5daedec3f6654: Status 404 returned error can't find the container with id 9d9335d400116020c70a165d7697863330a21f118012be343bf5daedec3f6654 Jun 03 21:07:22.773845 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:22.773654 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a0a9ce13-0d44-473d-94f6-2542dd4501e0","Type":"ContainerStarted","Data":"95415ac02a2b9a57d37ab366a5db9ed23c57a055ed175a52cb5375975f8cdabf"} Jun 03 21:07:22.776952 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:22.776926 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6dbbfcb4bd-d9dvl" event={"ID":"ac093228-c4a1-4c8e-8ea5-1c25e5959fed","Type":"ContainerStarted","Data":"efd44785f661ba01ab3ed0b09c3f32cd4cbf748b48accaa242dfa07c89b03744"} Jun 03 21:07:22.778395 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:22.778370 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8cf9996db-96czm" event={"ID":"9133bd70-86bf-4e4e-834f-74d9b3a6b693","Type":"ContainerStarted","Data":"9d9335d400116020c70a165d7697863330a21f118012be343bf5daedec3f6654"} Jun 03 21:07:22.780530 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:22.780503 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bpb2j" event={"ID":"fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0","Type":"ContainerStarted","Data":"c4b1ae100f57b0ba59e5f9057a8f1a78d07e6e6ef76fe46ccadf837323ae5580"} Jun 03 21:07:22.798128 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:22.798069 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bpb2j" podStartSLOduration=78.790386143 podStartE2EDuration="1m20.798052266s" totalImagesPullingTime="2.007666123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:06:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:07:22.797426598 +0000 UTC m=+80.953604747" watchObservedRunningTime="2026-06-03 21:07:22.798052266 +0000 UTC m=+80.954230414" Jun 03 21:07:23.794788 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:23.794499 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"678f0d30-436d-4e13-bdaf-9543f9437a9f","Type":"ContainerStarted","Data":"1bc5b191b66b9903243cc7b4c935d513ee211032f3b7eac0856fec83583d1954"} Jun 03 21:07:23.794788 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:23.794627 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"678f0d30-436d-4e13-bdaf-9543f9437a9f","Type":"ContainerStarted","Data":"6a036281b09a22a4de0be01aefb943f546be74e716c24bfba7900b33c4053a50"} Jun 03 21:07:23.794788 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:23.794677 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"678f0d30-436d-4e13-bdaf-9543f9437a9f","Type":"ContainerStarted","Data":"d751dbee66fe6ae4a164893e16161da4512e640613ca6c049e218e9b87b01749"} Jun 03 21:07:23.794788 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:23.794741 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"678f0d30-436d-4e13-bdaf-9543f9437a9f","Type":"ContainerStarted","Data":"584df876307944dce29fad526e3790d586c9ef608532010d95da3bc6fcf2d96b"} Jun 03 21:07:23.795497 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:23.795466 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"678f0d30-436d-4e13-bdaf-9543f9437a9f","Type":"ContainerStarted","Data":"d9bbcfcb1b32f151000e7c763f03cc7b0cf39018b79d2e75ab15982475fa4edc"} Jun 03 21:07:23.800746 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:23.800623 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-9b9fc658-6dsg4" event={"ID":"341ebaee-23b7-4b2d-bfe8-76cde68cf60b","Type":"ContainerStarted","Data":"6b308fe6a9e12dc13fdef4e8a111ac9ef7e4d14c643f1d7e335dceb5ac97d5bd"} Jun 03 21:07:23.801003 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:23.800932 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-9b9fc658-6dsg4" Jun 03 21:07:23.805128 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:23.805081 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-b64br" event={"ID":"c61839be-8301-4c2b-ae73-097623a04e47","Type":"ContainerStarted","Data":"0a8e34e2ce133e8ced48122e04dbc6c0834eefdc601a8613dbe25e55d3698aa2"} Jun 03 21:07:23.805385 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:23.805330 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-b64br" Jun 03 21:07:23.808771 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:23.808746 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-68c789f4b4-xgmvd" event={"ID":"8bc8bac3-062f-473f-a131-7a25f51972f6","Type":"ContainerStarted","Data":"35d85dd6b1610b8a0bccdc905845d6683a5e6cd201ac4b7b9066d1785e575a31"} Jun 03 21:07:23.809579 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:23.809558 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-9b9fc658-6dsg4" Jun 03 21:07:23.811411 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:23.811386 2557 generic.go:356] "Generic (PLEG): container finished" podID="a0a9ce13-0d44-473d-94f6-2542dd4501e0" containerID="edbac0d9d411d1a685c5d5ee9cb48ddebc8ab11e233926a475ce9b2923c1738e" exitCode=0 Jun 03 21:07:23.811761 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:23.811664 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a0a9ce13-0d44-473d-94f6-2542dd4501e0","Type":"ContainerDied","Data":"edbac0d9d411d1a685c5d5ee9cb48ddebc8ab11e233926a475ce9b2923c1738e"} Jun 03 21:07:23.835671 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:23.818946 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-9b9fc658-6dsg4" podStartSLOduration=4.24120105 podStartE2EDuration="14.818927383s" totalImagesPullingTime="10.577726333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:07:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:07:23.816615515 +0000 UTC m=+81.972793665" watchObservedRunningTime="2026-06-03 21:07:23.818927383 +0000 UTC m=+81.975105533" Jun 03 21:07:23.835671 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:23.827165 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7mnlx" event={"ID":"1239087f-2fb2-48c1-a6d6-a77d4c3a8947","Type":"ContainerStarted","Data":"9514e50cc9f4311db19c08a0f33d496520cceca88886be427d0ca8f0513866d5"} Jun 03 21:07:23.835671 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:23.835453 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-56b467f5ff-wrbnh" event={"ID":"98f567b5-9549-413d-b661-dfd2a4dc1dc5","Type":"ContainerStarted","Data":"f5d214c2542c83fd5a0ae68f817e807d94212102bc894502cdbb8dd741c37492"} Jun 03 21:07:23.835671 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:23.835514 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-56b467f5ff-wrbnh" Jun 03 21:07:23.841253 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:23.841204 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-56b467f5ff-wrbnh" Jun 03 21:07:23.867288 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:23.867226 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-68c789f4b4-xgmvd" podStartSLOduration=2.519968776 podStartE2EDuration="14.867202339s" totalImagesPullingTime="12.347233563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:07:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:07:23.865843031 +0000 UTC m=+82.022021181" watchObservedRunningTime="2026-06-03 21:07:23.867202339 +0000 UTC m=+82.023380488" Jun 03 21:07:23.907314 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:23.907241 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-b64br" podStartSLOduration=67.824191763 podStartE2EDuration="1m21.907219869s" totalImagesPullingTime="14.083028106s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:06:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:07:23.905478129 +0000 UTC m=+82.061656277" watchObservedRunningTime="2026-06-03 21:07:23.907219869 +0000 UTC m=+82.063398017" Jun 03 21:07:23.944862 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:23.942420 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-56b467f5ff-wrbnh" podStartSLOduration=2.184744734 podStartE2EDuration="24.942394799s" totalImagesPullingTime="22.757650065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:06:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:07:23.924413369 +0000 UTC m=+82.080591518" watchObservedRunningTime="2026-06-03 21:07:23.942394799 +0000 UTC m=+82.098572948" Jun 03 21:07:24.847123 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:24.847074 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"678f0d30-436d-4e13-bdaf-9543f9437a9f","Type":"ContainerStarted","Data":"f9a7ecbd898326a3f98e140577daa9da4f7a507dd58306a14dc61d75fe74defe"} Jun 03 21:07:24.857265 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:24.857232 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6dbbfcb4bd-d9dvl" event={"ID":"ac093228-c4a1-4c8e-8ea5-1c25e5959fed","Type":"ContainerStarted","Data":"28ed6317cf21ac85c724bebb1eacca2d7ed9bf3bf7b27dc52c25e3a6dfff9db1"} Jun 03 21:07:24.858243 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:24.858074 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6dbbfcb4bd-d9dvl" Jun 03 21:07:24.858243 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:24.858141 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6dbbfcb4bd-d9dvl" event={"ID":"ac093228-c4a1-4c8e-8ea5-1c25e5959fed","Type":"ContainerStarted","Data":"1fa78ad65a183824337e35eca6e8f3149769b4d0a777b5782b5bad6ccc24c6c2"} Jun 03 21:07:24.858243 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:24.858185 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6dbbfcb4bd-d9dvl" event={"ID":"ac093228-c4a1-4c8e-8ea5-1c25e5959fed","Type":"ContainerStarted","Data":"2b51b61a32a52a4201172279e959f2aaeda4d14873bdd248a25b1c7e86b64862"} Jun 03 21:07:24.866677 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:24.866593 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6dbbfcb4bd-d9dvl" Jun 03 21:07:24.874616 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:24.873956 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.754742781 podStartE2EDuration="18.873935415s" totalImagesPullingTime="14.095207081s" totalInitContainerRuntime="23.985553ms" isStatefulPod=false podCreationTimestamp="2026-06-03 21:07:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:07:24.87348424 +0000 UTC m=+83.029662392" watchObservedRunningTime="2026-06-03 21:07:24.873935415 +0000 UTC m=+83.030113566" Jun 03 21:07:24.874804 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:24.874705 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7mnlx" podStartSLOduration=67.897198012 podStartE2EDuration="1m22.874689731s" totalImagesPullingTime="14.977491719s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:06:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:07:23.945274686 +0000 UTC m=+82.101452835" watchObservedRunningTime="2026-06-03 21:07:24.874689731 +0000 UTC m=+83.030867880" Jun 03 21:07:24.899703 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:24.899228 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6dbbfcb4bd-d9dvl" podStartSLOduration=13.425302121 podStartE2EDuration="17.899204793s" totalImagesPullingTime="4.473902672s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:07:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:07:24.897853078 +0000 UTC m=+83.054031229" watchObservedRunningTime="2026-06-03 21:07:24.899204793 +0000 UTC m=+83.055382941" Jun 03 21:07:29.740628 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:29.740594 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-68c789f4b4-xgmvd" Jun 03 21:07:29.741096 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:29.740659 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-68c789f4b4-xgmvd" Jun 03 21:07:29.888853 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:29.888807 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a0a9ce13-0d44-473d-94f6-2542dd4501e0","Type":"ContainerStarted","Data":"c25f41489a71ad819109e05a131268f88b5c3dd7549b7f7c31ca7a89d602480f"} Jun 03 21:07:29.889038 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:29.888889 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a0a9ce13-0d44-473d-94f6-2542dd4501e0","Type":"ContainerStarted","Data":"62a52fcbb0b3a401d2502f40cb67b5b160f1c235cea54d86b7de4261af2650f2"} Jun 03 21:07:29.889038 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:29.888931 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a0a9ce13-0d44-473d-94f6-2542dd4501e0","Type":"ContainerStarted","Data":"28107fe7ad238a82675d65984f46772e82a4a99c047698e69be34c2ab5469e8f"} Jun 03 21:07:29.889038 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:29.888974 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a0a9ce13-0d44-473d-94f6-2542dd4501e0","Type":"ContainerStarted","Data":"d1946e3f4fee294199c2aed8fc1efb73e1627906c0cc3ce540ab349e1a666cf0"} Jun 03 21:07:29.889038 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:29.889014 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a0a9ce13-0d44-473d-94f6-2542dd4501e0","Type":"ContainerStarted","Data":"83f3117a83bf6aeb8baea04a7f7526d020512fe229bcb8ed1ef8882a74685db4"} Jun 03 21:07:29.889246 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:29.889052 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a0a9ce13-0d44-473d-94f6-2542dd4501e0","Type":"ContainerStarted","Data":"6c3b3ee5e754d1d44b1b2ea29e333d7009ed26cc8216d60937f68d37de3897ae"} Jun 03 21:07:29.890751 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:29.890697 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8cf9996db-96czm" event={"ID":"9133bd70-86bf-4e4e-834f-74d9b3a6b693","Type":"ContainerStarted","Data":"f6f69179f98e61ccf5067ba20910c9b92f74ff5ddac34e261c4e9f15c94d4f3e"} Jun 03 21:07:29.918768 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:29.918629 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=13.661044054 podStartE2EDuration="18.918608255s" totalImagesPullingTime="5.230771885s" totalInitContainerRuntime="26.792316ms" isStatefulPod=false podCreationTimestamp="2026-06-03 21:07:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:07:29.917516879 +0000 UTC m=+88.073695065" watchObservedRunningTime="2026-06-03 21:07:29.918608255 +0000 UTC m=+88.074786404" Jun 03 21:07:29.934398 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:29.934332 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8cf9996db-96czm" podStartSLOduration=12.250105278 podStartE2EDuration="18.9343031s" totalImagesPullingTime="6.684197822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:07:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:07:29.933562511 +0000 UTC m=+88.089740674" watchObservedRunningTime="2026-06-03 21:07:29.9343031 +0000 UTC m=+88.090481249" Jun 03 21:07:31.726902 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:31.726862 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8cf9996db-96czm" Jun 03 21:07:31.727323 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:31.726963 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8cf9996db-96czm" Jun 03 21:07:31.732771 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:31.732745 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8cf9996db-96czm" Jun 03 21:07:31.801909 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:31.801860 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:07:31.903789 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:31.903759 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8cf9996db-96czm" Jun 03 21:07:33.343343 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:33.343307 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8cf9996db-96czm"] Jun 03 21:07:49.746111 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:49.746080 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-68c789f4b4-xgmvd" Jun 03 21:07:49.750067 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:49.750040 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-68c789f4b4-xgmvd" Jun 03 21:07:54.859925 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:54.859878 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-b64br" Jun 03 21:07:59.932248 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:07:59.932183 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-8cf9996db-96czm" podUID="9133bd70-86bf-4e4e-834f-74d9b3a6b693" containerName="console" containerID="cri-o://f6f69179f98e61ccf5067ba20910c9b92f74ff5ddac34e261c4e9f15c94d4f3e" gracePeriod=15 Jun 03 21:08:00.214861 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:00.214827 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8cf9996db-96czm" Jun 03 21:08:00.343056 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:00.343019 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2qvgs\" (UniqueName: \"kubernetes.io/projected/9133bd70-86bf-4e4e-834f-74d9b3a6b693-kube-api-access-2qvgs\") pod \"9133bd70-86bf-4e4e-834f-74d9b3a6b693\" (UID: \"9133bd70-86bf-4e4e-834f-74d9b3a6b693\") " Jun 03 21:08:00.343056 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:00.343066 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9133bd70-86bf-4e4e-834f-74d9b3a6b693-console-config\") pod \"9133bd70-86bf-4e4e-834f-74d9b3a6b693\" (UID: \"9133bd70-86bf-4e4e-834f-74d9b3a6b693\") " Jun 03 21:08:00.343303 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:00.343106 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9133bd70-86bf-4e4e-834f-74d9b3a6b693-console-oauth-config\") pod \"9133bd70-86bf-4e4e-834f-74d9b3a6b693\" (UID: \"9133bd70-86bf-4e4e-834f-74d9b3a6b693\") " Jun 03 21:08:00.343303 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:00.343155 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9133bd70-86bf-4e4e-834f-74d9b3a6b693-oauth-serving-cert\") pod \"9133bd70-86bf-4e4e-834f-74d9b3a6b693\" (UID: \"9133bd70-86bf-4e4e-834f-74d9b3a6b693\") " Jun 03 21:08:00.343303 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:00.343202 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9133bd70-86bf-4e4e-834f-74d9b3a6b693-service-ca\") pod \"9133bd70-86bf-4e4e-834f-74d9b3a6b693\" (UID: \"9133bd70-86bf-4e4e-834f-74d9b3a6b693\") " Jun 03 21:08:00.343303 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:00.343260 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9133bd70-86bf-4e4e-834f-74d9b3a6b693-console-serving-cert\") pod \"9133bd70-86bf-4e4e-834f-74d9b3a6b693\" (UID: \"9133bd70-86bf-4e4e-834f-74d9b3a6b693\") " Jun 03 21:08:00.343627 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:00.343595 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9133bd70-86bf-4e4e-834f-74d9b3a6b693-console-config" (OuterVolumeSpecName: "console-config") pod "9133bd70-86bf-4e4e-834f-74d9b3a6b693" (UID: "9133bd70-86bf-4e4e-834f-74d9b3a6b693"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 21:08:00.343775 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:00.343626 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9133bd70-86bf-4e4e-834f-74d9b3a6b693-service-ca" (OuterVolumeSpecName: "service-ca") pod "9133bd70-86bf-4e4e-834f-74d9b3a6b693" (UID: "9133bd70-86bf-4e4e-834f-74d9b3a6b693"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 21:08:00.343775 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:00.343623 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9133bd70-86bf-4e4e-834f-74d9b3a6b693-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9133bd70-86bf-4e4e-834f-74d9b3a6b693" (UID: "9133bd70-86bf-4e4e-834f-74d9b3a6b693"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 21:08:00.345470 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:00.345449 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9133bd70-86bf-4e4e-834f-74d9b3a6b693-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9133bd70-86bf-4e4e-834f-74d9b3a6b693" (UID: "9133bd70-86bf-4e4e-834f-74d9b3a6b693"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 21:08:00.345562 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:00.345530 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9133bd70-86bf-4e4e-834f-74d9b3a6b693-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9133bd70-86bf-4e4e-834f-74d9b3a6b693" (UID: "9133bd70-86bf-4e4e-834f-74d9b3a6b693"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 21:08:00.345598 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:00.345560 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9133bd70-86bf-4e4e-834f-74d9b3a6b693-kube-api-access-2qvgs" (OuterVolumeSpecName: "kube-api-access-2qvgs") pod "9133bd70-86bf-4e4e-834f-74d9b3a6b693" (UID: "9133bd70-86bf-4e4e-834f-74d9b3a6b693"). InnerVolumeSpecName "kube-api-access-2qvgs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:08:00.444260 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:00.444161 2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9133bd70-86bf-4e4e-834f-74d9b3a6b693-oauth-serving-cert\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jun 03 21:08:00.444260 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:00.444194 2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9133bd70-86bf-4e4e-834f-74d9b3a6b693-service-ca\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jun 03 21:08:00.444260 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:00.444209 2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9133bd70-86bf-4e4e-834f-74d9b3a6b693-console-serving-cert\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jun 03 21:08:00.444260 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:00.444221 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qvgs\" (UniqueName: \"kubernetes.io/projected/9133bd70-86bf-4e4e-834f-74d9b3a6b693-kube-api-access-2qvgs\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jun 03 21:08:00.444260 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:00.444232 2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9133bd70-86bf-4e4e-834f-74d9b3a6b693-console-config\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jun 03 21:08:00.444260 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:00.444244 2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9133bd70-86bf-4e4e-834f-74d9b3a6b693-console-oauth-config\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jun 03 21:08:01.033643 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:01.033608 2557 generic.go:356] "Generic (PLEG): container finished" podID="9133bd70-86bf-4e4e-834f-74d9b3a6b693" containerID="f6f69179f98e61ccf5067ba20910c9b92f74ff5ddac34e261c4e9f15c94d4f3e" exitCode=0 Jun 03 21:08:01.034140 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:01.033653 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8cf9996db-96czm" Jun 03 21:08:01.034140 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:01.033661 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8cf9996db-96czm" event={"ID":"9133bd70-86bf-4e4e-834f-74d9b3a6b693","Type":"ContainerDied","Data":"f6f69179f98e61ccf5067ba20910c9b92f74ff5ddac34e261c4e9f15c94d4f3e"} Jun 03 21:08:01.034140 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:01.033729 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8cf9996db-96czm" event={"ID":"9133bd70-86bf-4e4e-834f-74d9b3a6b693","Type":"ContainerDied","Data":"9d9335d400116020c70a165d7697863330a21f118012be343bf5daedec3f6654"} Jun 03 21:08:01.034140 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:01.033733 2557 scope.go:117] "RemoveContainer" containerID="f6f69179f98e61ccf5067ba20910c9b92f74ff5ddac34e261c4e9f15c94d4f3e" Jun 03 21:08:01.053799 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:01.053766 2557 scope.go:117] "RemoveContainer" containerID="f6f69179f98e61ccf5067ba20910c9b92f74ff5ddac34e261c4e9f15c94d4f3e" Jun 03 21:08:01.054143 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:08:01.054117 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6f69179f98e61ccf5067ba20910c9b92f74ff5ddac34e261c4e9f15c94d4f3e\": container with ID starting with f6f69179f98e61ccf5067ba20910c9b92f74ff5ddac34e261c4e9f15c94d4f3e not found: ID does not exist" containerID="f6f69179f98e61ccf5067ba20910c9b92f74ff5ddac34e261c4e9f15c94d4f3e" Jun 03 21:08:01.054203 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:01.054157 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6f69179f98e61ccf5067ba20910c9b92f74ff5ddac34e261c4e9f15c94d4f3e"} err="failed to get container status \"f6f69179f98e61ccf5067ba20910c9b92f74ff5ddac34e261c4e9f15c94d4f3e\": rpc error: code = NotFound desc = could not find container \"f6f69179f98e61ccf5067ba20910c9b92f74ff5ddac34e261c4e9f15c94d4f3e\": container with ID starting with f6f69179f98e61ccf5067ba20910c9b92f74ff5ddac34e261c4e9f15c94d4f3e not found: ID does not exist" Jun 03 21:08:01.054807 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:01.054783 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8cf9996db-96czm"] Jun 03 21:08:01.057943 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:01.057920 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8cf9996db-96czm"] Jun 03 21:08:02.263808 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:02.263779 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9133bd70-86bf-4e4e-834f-74d9b3a6b693" path="/var/lib/kubelet/pods/9133bd70-86bf-4e4e-834f-74d9b3a6b693/volumes" Jun 03 21:08:11.802112 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:11.802071 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:11.875754 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:11.875702 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:12.094773 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:12.094695 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:25.466002 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:25.465965 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 21:08:25.466617 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:25.466335 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="678f0d30-436d-4e13-bdaf-9543f9437a9f" containerName="alertmanager" containerID="cri-o://d9bbcfcb1b32f151000e7c763f03cc7b0cf39018b79d2e75ab15982475fa4edc" gracePeriod=120 Jun 03 21:08:25.466617 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:25.466402 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="678f0d30-436d-4e13-bdaf-9543f9437a9f" containerName="kube-rbac-proxy-web" containerID="cri-o://d751dbee66fe6ae4a164893e16161da4512e640613ca6c049e218e9b87b01749" gracePeriod=120 Jun 03 21:08:25.466617 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:25.466432 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="678f0d30-436d-4e13-bdaf-9543f9437a9f" containerName="kube-rbac-proxy-metric" containerID="cri-o://1bc5b191b66b9903243cc7b4c935d513ee211032f3b7eac0856fec83583d1954" gracePeriod=120 Jun 03 21:08:25.466617 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:25.466463 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="678f0d30-436d-4e13-bdaf-9543f9437a9f" containerName="config-reloader" containerID="cri-o://584df876307944dce29fad526e3790d586c9ef608532010d95da3bc6fcf2d96b" gracePeriod=120 Jun 03 21:08:25.466617 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:25.466442 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="678f0d30-436d-4e13-bdaf-9543f9437a9f" containerName="kube-rbac-proxy" containerID="cri-o://6a036281b09a22a4de0be01aefb943f546be74e716c24bfba7900b33c4053a50" gracePeriod=120 Jun 03 21:08:25.466617 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:25.466502 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="678f0d30-436d-4e13-bdaf-9543f9437a9f" containerName="prom-label-proxy" containerID="cri-o://f9a7ecbd898326a3f98e140577daa9da4f7a507dd58306a14dc61d75fe74defe" gracePeriod=120 Jun 03 21:08:26.139427 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:26.139395 2557 generic.go:356] "Generic (PLEG): container finished" podID="678f0d30-436d-4e13-bdaf-9543f9437a9f" containerID="f9a7ecbd898326a3f98e140577daa9da4f7a507dd58306a14dc61d75fe74defe" exitCode=0 Jun 03 21:08:26.139427 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:26.139420 2557 generic.go:356] "Generic (PLEG): container finished" podID="678f0d30-436d-4e13-bdaf-9543f9437a9f" containerID="6a036281b09a22a4de0be01aefb943f546be74e716c24bfba7900b33c4053a50" exitCode=0 Jun 03 21:08:26.139427 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:26.139426 2557 generic.go:356] "Generic (PLEG): container finished" podID="678f0d30-436d-4e13-bdaf-9543f9437a9f" containerID="584df876307944dce29fad526e3790d586c9ef608532010d95da3bc6fcf2d96b" exitCode=0 Jun 03 21:08:26.139427 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:26.139432 2557 generic.go:356] "Generic (PLEG): container finished" podID="678f0d30-436d-4e13-bdaf-9543f9437a9f" containerID="d9bbcfcb1b32f151000e7c763f03cc7b0cf39018b79d2e75ab15982475fa4edc" exitCode=0 Jun 03 21:08:26.139686 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:26.139469 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"678f0d30-436d-4e13-bdaf-9543f9437a9f","Type":"ContainerDied","Data":"f9a7ecbd898326a3f98e140577daa9da4f7a507dd58306a14dc61d75fe74defe"} Jun 03 21:08:26.139686 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:26.139537 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"678f0d30-436d-4e13-bdaf-9543f9437a9f","Type":"ContainerDied","Data":"6a036281b09a22a4de0be01aefb943f546be74e716c24bfba7900b33c4053a50"} Jun 03 21:08:26.139686 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:26.139567 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"678f0d30-436d-4e13-bdaf-9543f9437a9f","Type":"ContainerDied","Data":"584df876307944dce29fad526e3790d586c9ef608532010d95da3bc6fcf2d96b"} Jun 03 21:08:26.139686 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:26.139593 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"678f0d30-436d-4e13-bdaf-9543f9437a9f","Type":"ContainerDied","Data":"d9bbcfcb1b32f151000e7c763f03cc7b0cf39018b79d2e75ab15982475fa4edc"} Jun 03 21:08:26.717077 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:26.717050 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:08:26.775762 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:26.775652 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-glwcx\" (UniqueName: \"kubernetes.io/projected/678f0d30-436d-4e13-bdaf-9543f9437a9f-kube-api-access-glwcx\") pod \"678f0d30-436d-4e13-bdaf-9543f9437a9f\" (UID: \"678f0d30-436d-4e13-bdaf-9543f9437a9f\") " Jun 03 21:08:26.775762 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:26.775721 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/678f0d30-436d-4e13-bdaf-9543f9437a9f-config-out\") pod \"678f0d30-436d-4e13-bdaf-9543f9437a9f\" (UID: \"678f0d30-436d-4e13-bdaf-9543f9437a9f\") " Jun 03 21:08:26.775762 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:26.775750 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/678f0d30-436d-4e13-bdaf-9543f9437a9f-web-config\") pod \"678f0d30-436d-4e13-bdaf-9543f9437a9f\" (UID: \"678f0d30-436d-4e13-bdaf-9543f9437a9f\") " Jun 03 21:08:26.776022 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:26.775769 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/678f0d30-436d-4e13-bdaf-9543f9437a9f-alertmanager-main-db\") pod \"678f0d30-436d-4e13-bdaf-9543f9437a9f\" (UID: \"678f0d30-436d-4e13-bdaf-9543f9437a9f\") " Jun 03 21:08:26.776022 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:26.775847 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/678f0d30-436d-4e13-bdaf-9543f9437a9f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"678f0d30-436d-4e13-bdaf-9543f9437a9f\" (UID: \"678f0d30-436d-4e13-bdaf-9543f9437a9f\") " Jun 03 21:08:26.776022 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:26.775875 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/678f0d30-436d-4e13-bdaf-9543f9437a9f-metrics-client-ca\") pod \"678f0d30-436d-4e13-bdaf-9543f9437a9f\" (UID: \"678f0d30-436d-4e13-bdaf-9543f9437a9f\") " Jun 03 21:08:26.776022 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:26.775901 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/678f0d30-436d-4e13-bdaf-9543f9437a9f-tls-assets\") pod \"678f0d30-436d-4e13-bdaf-9543f9437a9f\" (UID: \"678f0d30-436d-4e13-bdaf-9543f9437a9f\") " Jun 03 21:08:26.776022 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:26.775937 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/678f0d30-436d-4e13-bdaf-9543f9437a9f-secret-alertmanager-kube-rbac-proxy-web\") pod \"678f0d30-436d-4e13-bdaf-9543f9437a9f\" (UID: \"678f0d30-436d-4e13-bdaf-9543f9437a9f\") " Jun 03 21:08:26.776022 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:26.775972 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/678f0d30-436d-4e13-bdaf-9543f9437a9f-secret-alertmanager-main-tls\") pod \"678f0d30-436d-4e13-bdaf-9543f9437a9f\" (UID: \"678f0d30-436d-4e13-bdaf-9543f9437a9f\") " Jun 03 21:08:26.776022 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:26.776000 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/678f0d30-436d-4e13-bdaf-9543f9437a9f-cluster-tls-config\") pod \"678f0d30-436d-4e13-bdaf-9543f9437a9f\" (UID: \"678f0d30-436d-4e13-bdaf-9543f9437a9f\") " Jun 03 21:08:26.776492 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:26.776046 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/678f0d30-436d-4e13-bdaf-9543f9437a9f-secret-alertmanager-kube-rbac-proxy\") pod \"678f0d30-436d-4e13-bdaf-9543f9437a9f\" (UID: \"678f0d30-436d-4e13-bdaf-9543f9437a9f\") " Jun 03 21:08:26.776492 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:26.776097 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/678f0d30-436d-4e13-bdaf-9543f9437a9f-alertmanager-trusted-ca-bundle\") pod \"678f0d30-436d-4e13-bdaf-9543f9437a9f\" (UID: \"678f0d30-436d-4e13-bdaf-9543f9437a9f\") " Jun 03 21:08:26.776492 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:26.776136 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/678f0d30-436d-4e13-bdaf-9543f9437a9f-config-volume\") pod \"678f0d30-436d-4e13-bdaf-9543f9437a9f\" (UID: \"678f0d30-436d-4e13-bdaf-9543f9437a9f\") " Jun 03 21:08:26.777219 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:26.776752 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/678f0d30-436d-4e13-bdaf-9543f9437a9f-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "678f0d30-436d-4e13-bdaf-9543f9437a9f" (UID: "678f0d30-436d-4e13-bdaf-9543f9437a9f"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 21:08:26.777219 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:26.777176 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/678f0d30-436d-4e13-bdaf-9543f9437a9f-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "678f0d30-436d-4e13-bdaf-9543f9437a9f" (UID: "678f0d30-436d-4e13-bdaf-9543f9437a9f"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 21:08:26.777390 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:26.777360 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/678f0d30-436d-4e13-bdaf-9543f9437a9f-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "678f0d30-436d-4e13-bdaf-9543f9437a9f" (UID: "678f0d30-436d-4e13-bdaf-9543f9437a9f"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 21:08:26.780256 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:26.780225 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/678f0d30-436d-4e13-bdaf-9543f9437a9f-kube-api-access-glwcx" (OuterVolumeSpecName: "kube-api-access-glwcx") pod "678f0d30-436d-4e13-bdaf-9543f9437a9f" (UID: "678f0d30-436d-4e13-bdaf-9543f9437a9f"). InnerVolumeSpecName "kube-api-access-glwcx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:08:26.780660 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:26.780619 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/678f0d30-436d-4e13-bdaf-9543f9437a9f-config-volume" (OuterVolumeSpecName: "config-volume") pod "678f0d30-436d-4e13-bdaf-9543f9437a9f" (UID: "678f0d30-436d-4e13-bdaf-9543f9437a9f"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 21:08:26.780796 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:26.780659 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/678f0d30-436d-4e13-bdaf-9543f9437a9f-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "678f0d30-436d-4e13-bdaf-9543f9437a9f" (UID: "678f0d30-436d-4e13-bdaf-9543f9437a9f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:08:26.780887 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:26.780854 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/678f0d30-436d-4e13-bdaf-9543f9437a9f-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "678f0d30-436d-4e13-bdaf-9543f9437a9f" (UID: "678f0d30-436d-4e13-bdaf-9543f9437a9f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 21:08:26.780887 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:26.780800 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/678f0d30-436d-4e13-bdaf-9543f9437a9f-config-out" (OuterVolumeSpecName: "config-out") pod "678f0d30-436d-4e13-bdaf-9543f9437a9f" (UID: "678f0d30-436d-4e13-bdaf-9543f9437a9f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 21:08:26.781048 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:26.780956 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/678f0d30-436d-4e13-bdaf-9543f9437a9f-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "678f0d30-436d-4e13-bdaf-9543f9437a9f" (UID: "678f0d30-436d-4e13-bdaf-9543f9437a9f"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 21:08:26.781114 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:26.781071 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/678f0d30-436d-4e13-bdaf-9543f9437a9f-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "678f0d30-436d-4e13-bdaf-9543f9437a9f" (UID: "678f0d30-436d-4e13-bdaf-9543f9437a9f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 21:08:26.781217 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:26.781197 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/678f0d30-436d-4e13-bdaf-9543f9437a9f-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "678f0d30-436d-4e13-bdaf-9543f9437a9f" (UID: "678f0d30-436d-4e13-bdaf-9543f9437a9f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 21:08:26.786091 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:26.785958 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/678f0d30-436d-4e13-bdaf-9543f9437a9f-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "678f0d30-436d-4e13-bdaf-9543f9437a9f" (UID: "678f0d30-436d-4e13-bdaf-9543f9437a9f"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 21:08:26.793724 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:26.793676 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/678f0d30-436d-4e13-bdaf-9543f9437a9f-web-config" (OuterVolumeSpecName: "web-config") pod "678f0d30-436d-4e13-bdaf-9543f9437a9f" (UID: "678f0d30-436d-4e13-bdaf-9543f9437a9f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 21:08:26.877634 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:26.877593 2557 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/678f0d30-436d-4e13-bdaf-9543f9437a9f-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jun 03 21:08:26.877634 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:26.877626 2557 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/678f0d30-436d-4e13-bdaf-9543f9437a9f-metrics-client-ca\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jun 03 21:08:26.877634 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:26.877636 2557 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/678f0d30-436d-4e13-bdaf-9543f9437a9f-tls-assets\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jun 03 21:08:26.877923 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:26.877647 2557 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/678f0d30-436d-4e13-bdaf-9543f9437a9f-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jun 03 21:08:26.877923 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:26.877658 2557 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/678f0d30-436d-4e13-bdaf-9543f9437a9f-secret-alertmanager-main-tls\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jun 03 21:08:26.877923 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:26.877668 2557 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/678f0d30-436d-4e13-bdaf-9543f9437a9f-cluster-tls-config\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jun 03 21:08:26.877923 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:26.877676 2557 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/678f0d30-436d-4e13-bdaf-9543f9437a9f-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jun 03 21:08:26.877923 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:26.877687 2557 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/678f0d30-436d-4e13-bdaf-9543f9437a9f-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jun 03 21:08:26.877923 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:26.877695 2557 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/678f0d30-436d-4e13-bdaf-9543f9437a9f-config-volume\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jun 03 21:08:26.877923 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:26.877705 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-glwcx\" (UniqueName: \"kubernetes.io/projected/678f0d30-436d-4e13-bdaf-9543f9437a9f-kube-api-access-glwcx\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jun 03 21:08:26.877923 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:26.877735 2557 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/678f0d30-436d-4e13-bdaf-9543f9437a9f-config-out\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jun 03 21:08:26.877923 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:26.877746 2557 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/678f0d30-436d-4e13-bdaf-9543f9437a9f-web-config\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jun 03 21:08:26.877923 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:26.877755 2557 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/678f0d30-436d-4e13-bdaf-9543f9437a9f-alertmanager-main-db\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jun 03 21:08:27.151046 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.150940 2557 generic.go:356] "Generic (PLEG): container finished" podID="678f0d30-436d-4e13-bdaf-9543f9437a9f" containerID="1bc5b191b66b9903243cc7b4c935d513ee211032f3b7eac0856fec83583d1954" exitCode=0 Jun 03 21:08:27.151046 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.150971 2557 generic.go:356] "Generic (PLEG): container finished" podID="678f0d30-436d-4e13-bdaf-9543f9437a9f" containerID="d751dbee66fe6ae4a164893e16161da4512e640613ca6c049e218e9b87b01749" exitCode=0 Jun 03 21:08:27.151046 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.151020 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:08:27.151268 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.151013 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"678f0d30-436d-4e13-bdaf-9543f9437a9f","Type":"ContainerDied","Data":"1bc5b191b66b9903243cc7b4c935d513ee211032f3b7eac0856fec83583d1954"} Jun 03 21:08:27.151268 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.151172 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"678f0d30-436d-4e13-bdaf-9543f9437a9f","Type":"ContainerDied","Data":"d751dbee66fe6ae4a164893e16161da4512e640613ca6c049e218e9b87b01749"} Jun 03 21:08:27.151268 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.151200 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"678f0d30-436d-4e13-bdaf-9543f9437a9f","Type":"ContainerDied","Data":"cdd07ae7adf7e1e3e7a17fada3e6d8468ad68f6763117b67e9b86d98368db447"} Jun 03 21:08:27.151268 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.151232 2557 scope.go:117] "RemoveContainer" containerID="f9a7ecbd898326a3f98e140577daa9da4f7a507dd58306a14dc61d75fe74defe" Jun 03 21:08:27.159738 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.159694 2557 scope.go:117] "RemoveContainer" containerID="1bc5b191b66b9903243cc7b4c935d513ee211032f3b7eac0856fec83583d1954" Jun 03 21:08:27.167083 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.167061 2557 scope.go:117] "RemoveContainer" containerID="6a036281b09a22a4de0be01aefb943f546be74e716c24bfba7900b33c4053a50" Jun 03 21:08:27.174497 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.174475 2557 scope.go:117] "RemoveContainer" containerID="d751dbee66fe6ae4a164893e16161da4512e640613ca6c049e218e9b87b01749" Jun 03 21:08:27.175698 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.175673 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 21:08:27.179992 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.179968 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 21:08:27.182813 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.182791 2557 scope.go:117] "RemoveContainer" containerID="584df876307944dce29fad526e3790d586c9ef608532010d95da3bc6fcf2d96b" Jun 03 21:08:27.191568 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.191544 2557 scope.go:117] "RemoveContainer" containerID="d9bbcfcb1b32f151000e7c763f03cc7b0cf39018b79d2e75ab15982475fa4edc" Jun 03 21:08:27.199622 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.199598 2557 scope.go:117] "RemoveContainer" containerID="fea82663f22d6dbe8f327d478b2a1d35ace32f9841a6ad9d1862ad825aa7ce0f" Jun 03 21:08:27.207495 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.207475 2557 scope.go:117] "RemoveContainer" containerID="f9a7ecbd898326a3f98e140577daa9da4f7a507dd58306a14dc61d75fe74defe" Jun 03 21:08:27.207579 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.207553 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 21:08:27.207858 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:08:27.207837 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9a7ecbd898326a3f98e140577daa9da4f7a507dd58306a14dc61d75fe74defe\": container with ID starting with f9a7ecbd898326a3f98e140577daa9da4f7a507dd58306a14dc61d75fe74defe not found: ID does not exist" containerID="f9a7ecbd898326a3f98e140577daa9da4f7a507dd58306a14dc61d75fe74defe" Jun 03 21:08:27.207924 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.207870 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9a7ecbd898326a3f98e140577daa9da4f7a507dd58306a14dc61d75fe74defe"} err="failed to get container status \"f9a7ecbd898326a3f98e140577daa9da4f7a507dd58306a14dc61d75fe74defe\": rpc error: code = NotFound desc = could not find container \"f9a7ecbd898326a3f98e140577daa9da4f7a507dd58306a14dc61d75fe74defe\": container with ID starting with f9a7ecbd898326a3f98e140577daa9da4f7a507dd58306a14dc61d75fe74defe not found: ID does not exist" Jun 03 21:08:27.207924 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.207889 2557 scope.go:117] "RemoveContainer" containerID="1bc5b191b66b9903243cc7b4c935d513ee211032f3b7eac0856fec83583d1954" Jun 03 21:08:27.208009 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.207932 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="678f0d30-436d-4e13-bdaf-9543f9437a9f" containerName="kube-rbac-proxy-web" Jun 03 21:08:27.208009 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.207946 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="678f0d30-436d-4e13-bdaf-9543f9437a9f" containerName="kube-rbac-proxy-web" Jun 03 21:08:27.208009 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.207955 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="678f0d30-436d-4e13-bdaf-9543f9437a9f" containerName="init-config-reloader" Jun 03 21:08:27.208009 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.207961 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="678f0d30-436d-4e13-bdaf-9543f9437a9f" containerName="init-config-reloader" Jun 03 21:08:27.208009 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.207968 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="678f0d30-436d-4e13-bdaf-9543f9437a9f" containerName="alertmanager" Jun 03 21:08:27.208009 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.207974 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="678f0d30-436d-4e13-bdaf-9543f9437a9f" containerName="alertmanager" Jun 03 21:08:27.208009 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.207980 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="678f0d30-436d-4e13-bdaf-9543f9437a9f" containerName="kube-rbac-proxy" Jun 03 21:08:27.208009 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.207986 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="678f0d30-436d-4e13-bdaf-9543f9437a9f" containerName="kube-rbac-proxy" Jun 03 21:08:27.208009 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.207995 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="678f0d30-436d-4e13-bdaf-9543f9437a9f" containerName="config-reloader" Jun 03 21:08:27.208009 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.208003 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="678f0d30-436d-4e13-bdaf-9543f9437a9f" containerName="config-reloader" Jun 03 21:08:27.208385 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.208014 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="678f0d30-436d-4e13-bdaf-9543f9437a9f" containerName="prom-label-proxy" Jun 03 21:08:27.208385 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.208022 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="678f0d30-436d-4e13-bdaf-9543f9437a9f" containerName="prom-label-proxy" Jun 03 21:08:27.208385 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.208032 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="678f0d30-436d-4e13-bdaf-9543f9437a9f" containerName="kube-rbac-proxy-metric" Jun 03 21:08:27.208385 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.208039 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="678f0d30-436d-4e13-bdaf-9543f9437a9f" containerName="kube-rbac-proxy-metric" Jun 03 21:08:27.208385 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.208049 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9133bd70-86bf-4e4e-834f-74d9b3a6b693" containerName="console" Jun 03 21:08:27.208385 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.208057 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="9133bd70-86bf-4e4e-834f-74d9b3a6b693" containerName="console" Jun 03 21:08:27.208385 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.208113 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="9133bd70-86bf-4e4e-834f-74d9b3a6b693" containerName="console" Jun 03 21:08:27.208385 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.208123 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="678f0d30-436d-4e13-bdaf-9543f9437a9f" containerName="kube-rbac-proxy-web" Jun 03 21:08:27.208385 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.208129 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="678f0d30-436d-4e13-bdaf-9543f9437a9f" containerName="kube-rbac-proxy" Jun 03 21:08:27.208385 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.208136 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="678f0d30-436d-4e13-bdaf-9543f9437a9f" containerName="kube-rbac-proxy-metric" Jun 03 21:08:27.208385 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.208143 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="678f0d30-436d-4e13-bdaf-9543f9437a9f" containerName="prom-label-proxy" Jun 03 21:08:27.208385 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.208148 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="678f0d30-436d-4e13-bdaf-9543f9437a9f" containerName="alertmanager" Jun 03 21:08:27.208385 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:08:27.208144 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bc5b191b66b9903243cc7b4c935d513ee211032f3b7eac0856fec83583d1954\": container with ID starting with 1bc5b191b66b9903243cc7b4c935d513ee211032f3b7eac0856fec83583d1954 not found: ID does not exist" containerID="1bc5b191b66b9903243cc7b4c935d513ee211032f3b7eac0856fec83583d1954" Jun 03 21:08:27.208385 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.208166 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bc5b191b66b9903243cc7b4c935d513ee211032f3b7eac0856fec83583d1954"} err="failed to get container status \"1bc5b191b66b9903243cc7b4c935d513ee211032f3b7eac0856fec83583d1954\": rpc error: code = NotFound desc = could not find container \"1bc5b191b66b9903243cc7b4c935d513ee211032f3b7eac0856fec83583d1954\": container with ID starting with 1bc5b191b66b9903243cc7b4c935d513ee211032f3b7eac0856fec83583d1954 not found: ID does not exist" Jun 03 21:08:27.208385 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.208183 2557 scope.go:117] "RemoveContainer" containerID="6a036281b09a22a4de0be01aefb943f546be74e716c24bfba7900b33c4053a50" Jun 03 21:08:27.208385 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.208153 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="678f0d30-436d-4e13-bdaf-9543f9437a9f" containerName="config-reloader" Jun 03 21:08:27.209053 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:08:27.208463 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a036281b09a22a4de0be01aefb943f546be74e716c24bfba7900b33c4053a50\": container with ID starting with 6a036281b09a22a4de0be01aefb943f546be74e716c24bfba7900b33c4053a50 not found: ID does not exist" containerID="6a036281b09a22a4de0be01aefb943f546be74e716c24bfba7900b33c4053a50" Jun 03 21:08:27.209053 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.208492 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a036281b09a22a4de0be01aefb943f546be74e716c24bfba7900b33c4053a50"} err="failed to get container status \"6a036281b09a22a4de0be01aefb943f546be74e716c24bfba7900b33c4053a50\": rpc error: code = NotFound desc = could not find container \"6a036281b09a22a4de0be01aefb943f546be74e716c24bfba7900b33c4053a50\": container with ID starting with 6a036281b09a22a4de0be01aefb943f546be74e716c24bfba7900b33c4053a50 not found: ID does not exist" Jun 03 21:08:27.209053 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.208516 2557 scope.go:117] "RemoveContainer" containerID="d751dbee66fe6ae4a164893e16161da4512e640613ca6c049e218e9b87b01749" Jun 03 21:08:27.209053 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:08:27.208871 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d751dbee66fe6ae4a164893e16161da4512e640613ca6c049e218e9b87b01749\": container with ID starting with d751dbee66fe6ae4a164893e16161da4512e640613ca6c049e218e9b87b01749 not found: ID does not exist" containerID="d751dbee66fe6ae4a164893e16161da4512e640613ca6c049e218e9b87b01749" Jun 03 21:08:27.209053 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.208889 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d751dbee66fe6ae4a164893e16161da4512e640613ca6c049e218e9b87b01749"} err="failed to get container status \"d751dbee66fe6ae4a164893e16161da4512e640613ca6c049e218e9b87b01749\": rpc error: code = NotFound desc = could not find container \"d751dbee66fe6ae4a164893e16161da4512e640613ca6c049e218e9b87b01749\": container with ID starting with d751dbee66fe6ae4a164893e16161da4512e640613ca6c049e218e9b87b01749 not found: ID does not exist" Jun 03 21:08:27.209053 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.208902 2557 scope.go:117] "RemoveContainer" containerID="584df876307944dce29fad526e3790d586c9ef608532010d95da3bc6fcf2d96b" Jun 03 21:08:27.209346 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:08:27.209117 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"584df876307944dce29fad526e3790d586c9ef608532010d95da3bc6fcf2d96b\": container with ID starting with 584df876307944dce29fad526e3790d586c9ef608532010d95da3bc6fcf2d96b not found: ID does not exist" containerID="584df876307944dce29fad526e3790d586c9ef608532010d95da3bc6fcf2d96b" Jun 03 21:08:27.209346 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.209142 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"584df876307944dce29fad526e3790d586c9ef608532010d95da3bc6fcf2d96b"} err="failed to get container status \"584df876307944dce29fad526e3790d586c9ef608532010d95da3bc6fcf2d96b\": rpc error: code = NotFound desc = could not find container \"584df876307944dce29fad526e3790d586c9ef608532010d95da3bc6fcf2d96b\": container with ID starting with 584df876307944dce29fad526e3790d586c9ef608532010d95da3bc6fcf2d96b not found: ID does not exist" Jun 03 21:08:27.209346 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.209156 2557 scope.go:117] "RemoveContainer" containerID="d9bbcfcb1b32f151000e7c763f03cc7b0cf39018b79d2e75ab15982475fa4edc" Jun 03 21:08:27.209453 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:08:27.209375 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9bbcfcb1b32f151000e7c763f03cc7b0cf39018b79d2e75ab15982475fa4edc\": container with ID starting with d9bbcfcb1b32f151000e7c763f03cc7b0cf39018b79d2e75ab15982475fa4edc not found: ID does not exist" containerID="d9bbcfcb1b32f151000e7c763f03cc7b0cf39018b79d2e75ab15982475fa4edc" Jun 03 21:08:27.209453 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.209393 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9bbcfcb1b32f151000e7c763f03cc7b0cf39018b79d2e75ab15982475fa4edc"} err="failed to get container status \"d9bbcfcb1b32f151000e7c763f03cc7b0cf39018b79d2e75ab15982475fa4edc\": rpc error: code = NotFound desc = could not find container \"d9bbcfcb1b32f151000e7c763f03cc7b0cf39018b79d2e75ab15982475fa4edc\": container with ID starting with d9bbcfcb1b32f151000e7c763f03cc7b0cf39018b79d2e75ab15982475fa4edc not found: ID does not exist" Jun 03 21:08:27.209453 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.209406 2557 scope.go:117] "RemoveContainer" containerID="fea82663f22d6dbe8f327d478b2a1d35ace32f9841a6ad9d1862ad825aa7ce0f" Jun 03 21:08:27.209636 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:08:27.209615 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fea82663f22d6dbe8f327d478b2a1d35ace32f9841a6ad9d1862ad825aa7ce0f\": container with ID starting with fea82663f22d6dbe8f327d478b2a1d35ace32f9841a6ad9d1862ad825aa7ce0f not found: ID does not exist" containerID="fea82663f22d6dbe8f327d478b2a1d35ace32f9841a6ad9d1862ad825aa7ce0f" Jun 03 21:08:27.209675 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.209641 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fea82663f22d6dbe8f327d478b2a1d35ace32f9841a6ad9d1862ad825aa7ce0f"} err="failed to get container status \"fea82663f22d6dbe8f327d478b2a1d35ace32f9841a6ad9d1862ad825aa7ce0f\": rpc error: code = NotFound desc = could not find container \"fea82663f22d6dbe8f327d478b2a1d35ace32f9841a6ad9d1862ad825aa7ce0f\": container with ID starting with fea82663f22d6dbe8f327d478b2a1d35ace32f9841a6ad9d1862ad825aa7ce0f not found: ID does not exist" Jun 03 21:08:27.209675 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.209656 2557 scope.go:117] "RemoveContainer" containerID="f9a7ecbd898326a3f98e140577daa9da4f7a507dd58306a14dc61d75fe74defe" Jun 03 21:08:27.209929 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.209906 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9a7ecbd898326a3f98e140577daa9da4f7a507dd58306a14dc61d75fe74defe"} err="failed to get container status \"f9a7ecbd898326a3f98e140577daa9da4f7a507dd58306a14dc61d75fe74defe\": rpc error: code = NotFound desc = could not find container \"f9a7ecbd898326a3f98e140577daa9da4f7a507dd58306a14dc61d75fe74defe\": container with ID starting with f9a7ecbd898326a3f98e140577daa9da4f7a507dd58306a14dc61d75fe74defe not found: ID does not exist" Jun 03 21:08:27.209983 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.209931 2557 scope.go:117] "RemoveContainer" containerID="1bc5b191b66b9903243cc7b4c935d513ee211032f3b7eac0856fec83583d1954" Jun 03 21:08:27.210212 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.210188 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bc5b191b66b9903243cc7b4c935d513ee211032f3b7eac0856fec83583d1954"} err="failed to get container status \"1bc5b191b66b9903243cc7b4c935d513ee211032f3b7eac0856fec83583d1954\": rpc error: code = NotFound desc = could not find container \"1bc5b191b66b9903243cc7b4c935d513ee211032f3b7eac0856fec83583d1954\": container with ID starting with 1bc5b191b66b9903243cc7b4c935d513ee211032f3b7eac0856fec83583d1954 not found: ID does not exist" Jun 03 21:08:27.210266 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.210213 2557 scope.go:117] "RemoveContainer" containerID="6a036281b09a22a4de0be01aefb943f546be74e716c24bfba7900b33c4053a50" Jun 03 21:08:27.210500 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.210475 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a036281b09a22a4de0be01aefb943f546be74e716c24bfba7900b33c4053a50"} err="failed to get container status \"6a036281b09a22a4de0be01aefb943f546be74e716c24bfba7900b33c4053a50\": rpc error: code = NotFound desc = could not find container \"6a036281b09a22a4de0be01aefb943f546be74e716c24bfba7900b33c4053a50\": container with ID starting with 6a036281b09a22a4de0be01aefb943f546be74e716c24bfba7900b33c4053a50 not found: ID does not exist" Jun 03 21:08:27.210500 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.210497 2557 scope.go:117] "RemoveContainer" containerID="d751dbee66fe6ae4a164893e16161da4512e640613ca6c049e218e9b87b01749" Jun 03 21:08:27.212416 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.212391 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d751dbee66fe6ae4a164893e16161da4512e640613ca6c049e218e9b87b01749"} err="failed to get container status \"d751dbee66fe6ae4a164893e16161da4512e640613ca6c049e218e9b87b01749\": rpc error: code = NotFound desc = could not find container \"d751dbee66fe6ae4a164893e16161da4512e640613ca6c049e218e9b87b01749\": container with ID starting with d751dbee66fe6ae4a164893e16161da4512e640613ca6c049e218e9b87b01749 not found: ID does not exist" Jun 03 21:08:27.212416 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.212414 2557 scope.go:117] "RemoveContainer" containerID="584df876307944dce29fad526e3790d586c9ef608532010d95da3bc6fcf2d96b" Jun 03 21:08:27.212644 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.212627 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"584df876307944dce29fad526e3790d586c9ef608532010d95da3bc6fcf2d96b"} err="failed to get container status \"584df876307944dce29fad526e3790d586c9ef608532010d95da3bc6fcf2d96b\": rpc error: code = NotFound desc = could not find container \"584df876307944dce29fad526e3790d586c9ef608532010d95da3bc6fcf2d96b\": container with ID starting with 584df876307944dce29fad526e3790d586c9ef608532010d95da3bc6fcf2d96b not found: ID does not exist" Jun 03 21:08:27.212691 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.212645 2557 scope.go:117] "RemoveContainer" containerID="d9bbcfcb1b32f151000e7c763f03cc7b0cf39018b79d2e75ab15982475fa4edc" Jun 03 21:08:27.212885 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.212866 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9bbcfcb1b32f151000e7c763f03cc7b0cf39018b79d2e75ab15982475fa4edc"} err="failed to get container status \"d9bbcfcb1b32f151000e7c763f03cc7b0cf39018b79d2e75ab15982475fa4edc\": rpc error: code = NotFound desc = could not find container \"d9bbcfcb1b32f151000e7c763f03cc7b0cf39018b79d2e75ab15982475fa4edc\": container with ID starting with d9bbcfcb1b32f151000e7c763f03cc7b0cf39018b79d2e75ab15982475fa4edc not found: ID does not exist" Jun 03 21:08:27.212962 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.212888 2557 scope.go:117] "RemoveContainer" containerID="fea82663f22d6dbe8f327d478b2a1d35ace32f9841a6ad9d1862ad825aa7ce0f" Jun 03 21:08:27.213183 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.213165 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fea82663f22d6dbe8f327d478b2a1d35ace32f9841a6ad9d1862ad825aa7ce0f"} err="failed to get container status \"fea82663f22d6dbe8f327d478b2a1d35ace32f9841a6ad9d1862ad825aa7ce0f\": rpc error: code = NotFound desc = could not find container \"fea82663f22d6dbe8f327d478b2a1d35ace32f9841a6ad9d1862ad825aa7ce0f\": container with ID starting with fea82663f22d6dbe8f327d478b2a1d35ace32f9841a6ad9d1862ad825aa7ce0f not found: ID does not exist" Jun 03 21:08:27.213376 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.213362 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:08:27.215544 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.215494 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 03 21:08:27.215820 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.215798 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 03 21:08:27.215910 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.215884 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 03 21:08:27.215910 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.215903 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-mjw9t\"" Jun 03 21:08:27.216139 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.216121 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 03 21:08:27.216215 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.216168 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 03 21:08:27.216367 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.216343 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 03 21:08:27.216367 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.216362 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 03 21:08:27.216522 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.216396 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 03 21:08:27.221349 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.221329 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 03 21:08:27.226308 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.226282 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 21:08:27.280314 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.280271 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/66cab92f-9aea-45cb-ab37-c63260a5b994-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"66cab92f-9aea-45cb-ab37-c63260a5b994\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:08:27.280314 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.280322 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/66cab92f-9aea-45cb-ab37-c63260a5b994-config-out\") pod \"alertmanager-main-0\" (UID: \"66cab92f-9aea-45cb-ab37-c63260a5b994\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:08:27.280549 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.280354 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/66cab92f-9aea-45cb-ab37-c63260a5b994-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"66cab92f-9aea-45cb-ab37-c63260a5b994\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:08:27.280549 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.280406 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v8wq\" (UniqueName: \"kubernetes.io/projected/66cab92f-9aea-45cb-ab37-c63260a5b994-kube-api-access-4v8wq\") pod \"alertmanager-main-0\" (UID: \"66cab92f-9aea-45cb-ab37-c63260a5b994\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:08:27.280549 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.280451 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/66cab92f-9aea-45cb-ab37-c63260a5b994-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"66cab92f-9aea-45cb-ab37-c63260a5b994\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:08:27.280549 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.280509 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66cab92f-9aea-45cb-ab37-c63260a5b994-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"66cab92f-9aea-45cb-ab37-c63260a5b994\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:08:27.280835 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.280551 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66cab92f-9aea-45cb-ab37-c63260a5b994-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"66cab92f-9aea-45cb-ab37-c63260a5b994\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:08:27.280835 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.280571 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/66cab92f-9aea-45cb-ab37-c63260a5b994-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"66cab92f-9aea-45cb-ab37-c63260a5b994\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:08:27.280835 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.280665 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/66cab92f-9aea-45cb-ab37-c63260a5b994-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"66cab92f-9aea-45cb-ab37-c63260a5b994\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:08:27.280835 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.280705 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/66cab92f-9aea-45cb-ab37-c63260a5b994-tls-assets\") pod \"alertmanager-main-0\" (UID: \"66cab92f-9aea-45cb-ab37-c63260a5b994\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:08:27.280835 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.280755 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/66cab92f-9aea-45cb-ab37-c63260a5b994-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"66cab92f-9aea-45cb-ab37-c63260a5b994\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:08:27.280835 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.280811 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/66cab92f-9aea-45cb-ab37-c63260a5b994-config-volume\") pod \"alertmanager-main-0\" (UID: \"66cab92f-9aea-45cb-ab37-c63260a5b994\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:08:27.281039 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.280839 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/66cab92f-9aea-45cb-ab37-c63260a5b994-web-config\") pod \"alertmanager-main-0\" (UID: \"66cab92f-9aea-45cb-ab37-c63260a5b994\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:08:27.381693 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.381655 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/66cab92f-9aea-45cb-ab37-c63260a5b994-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"66cab92f-9aea-45cb-ab37-c63260a5b994\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:08:27.381693 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.381697 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/66cab92f-9aea-45cb-ab37-c63260a5b994-config-out\") pod \"alertmanager-main-0\" (UID: \"66cab92f-9aea-45cb-ab37-c63260a5b994\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:08:27.381693 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.381735 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/66cab92f-9aea-45cb-ab37-c63260a5b994-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"66cab92f-9aea-45cb-ab37-c63260a5b994\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:08:27.382023 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.381758 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4v8wq\" (UniqueName: \"kubernetes.io/projected/66cab92f-9aea-45cb-ab37-c63260a5b994-kube-api-access-4v8wq\") pod \"alertmanager-main-0\" (UID: \"66cab92f-9aea-45cb-ab37-c63260a5b994\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:08:27.382023 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.381782 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/66cab92f-9aea-45cb-ab37-c63260a5b994-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"66cab92f-9aea-45cb-ab37-c63260a5b994\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:08:27.382023 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.381803 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66cab92f-9aea-45cb-ab37-c63260a5b994-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"66cab92f-9aea-45cb-ab37-c63260a5b994\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:08:27.382023 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.381826 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66cab92f-9aea-45cb-ab37-c63260a5b994-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"66cab92f-9aea-45cb-ab37-c63260a5b994\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:08:27.382023 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.381844 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/66cab92f-9aea-45cb-ab37-c63260a5b994-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"66cab92f-9aea-45cb-ab37-c63260a5b994\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:08:27.382023 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.381900 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/66cab92f-9aea-45cb-ab37-c63260a5b994-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"66cab92f-9aea-45cb-ab37-c63260a5b994\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:08:27.382023 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.381928 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/66cab92f-9aea-45cb-ab37-c63260a5b994-tls-assets\") pod \"alertmanager-main-0\" (UID: \"66cab92f-9aea-45cb-ab37-c63260a5b994\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:08:27.382023 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.381956 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/66cab92f-9aea-45cb-ab37-c63260a5b994-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"66cab92f-9aea-45cb-ab37-c63260a5b994\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:08:27.382023 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.381990 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/66cab92f-9aea-45cb-ab37-c63260a5b994-config-volume\") pod \"alertmanager-main-0\" (UID: \"66cab92f-9aea-45cb-ab37-c63260a5b994\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:08:27.382023 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.382016 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/66cab92f-9aea-45cb-ab37-c63260a5b994-web-config\") pod \"alertmanager-main-0\" (UID: \"66cab92f-9aea-45cb-ab37-c63260a5b994\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:08:27.383312 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.382991 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66cab92f-9aea-45cb-ab37-c63260a5b994-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"66cab92f-9aea-45cb-ab37-c63260a5b994\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:08:27.383621 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.383595 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66cab92f-9aea-45cb-ab37-c63260a5b994-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"66cab92f-9aea-45cb-ab37-c63260a5b994\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:08:27.384590 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.384557 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/66cab92f-9aea-45cb-ab37-c63260a5b994-config-out\") pod \"alertmanager-main-0\" (UID: \"66cab92f-9aea-45cb-ab37-c63260a5b994\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:08:27.385027 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.384742 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/66cab92f-9aea-45cb-ab37-c63260a5b994-web-config\") pod \"alertmanager-main-0\" (UID: \"66cab92f-9aea-45cb-ab37-c63260a5b994\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:08:27.385027 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.384783 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/66cab92f-9aea-45cb-ab37-c63260a5b994-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"66cab92f-9aea-45cb-ab37-c63260a5b994\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:08:27.385027 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.384876 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/66cab92f-9aea-45cb-ab37-c63260a5b994-tls-assets\") pod \"alertmanager-main-0\" (UID: \"66cab92f-9aea-45cb-ab37-c63260a5b994\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:08:27.385027 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.384975 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/66cab92f-9aea-45cb-ab37-c63260a5b994-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"66cab92f-9aea-45cb-ab37-c63260a5b994\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:08:27.385027 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.384985 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/66cab92f-9aea-45cb-ab37-c63260a5b994-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"66cab92f-9aea-45cb-ab37-c63260a5b994\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:08:27.385027 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.385027 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/66cab92f-9aea-45cb-ab37-c63260a5b994-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"66cab92f-9aea-45cb-ab37-c63260a5b994\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:08:27.385739 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.385699 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/66cab92f-9aea-45cb-ab37-c63260a5b994-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"66cab92f-9aea-45cb-ab37-c63260a5b994\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:08:27.386024 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.386007 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/66cab92f-9aea-45cb-ab37-c63260a5b994-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"66cab92f-9aea-45cb-ab37-c63260a5b994\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:08:27.386600 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.386586 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/66cab92f-9aea-45cb-ab37-c63260a5b994-config-volume\") pod \"alertmanager-main-0\" (UID: \"66cab92f-9aea-45cb-ab37-c63260a5b994\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:08:27.389074 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.389056 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v8wq\" (UniqueName: \"kubernetes.io/projected/66cab92f-9aea-45cb-ab37-c63260a5b994-kube-api-access-4v8wq\") pod \"alertmanager-main-0\" (UID: \"66cab92f-9aea-45cb-ab37-c63260a5b994\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:08:27.523885 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.523855 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 21:08:27.665313 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:27.665290 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 21:08:27.667541 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:08:27.667500 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66cab92f_9aea_45cb_ab37_c63260a5b994.slice/crio-c3f96e808618fbb9b4f68dc37540c14ab1fa9c29bc11a45c0d8d23a4ea3b93a9 WatchSource:0}: Error finding container c3f96e808618fbb9b4f68dc37540c14ab1fa9c29bc11a45c0d8d23a4ea3b93a9: Status 404 returned error can't find the container with id c3f96e808618fbb9b4f68dc37540c14ab1fa9c29bc11a45c0d8d23a4ea3b93a9 Jun 03 21:08:28.157123 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:28.157089 2557 generic.go:356] "Generic (PLEG): container finished" podID="66cab92f-9aea-45cb-ab37-c63260a5b994" containerID="20d72618c9217c72c28c9dfcdc108fc8e542a8f6e4d9bef4291552964ad83210" exitCode=0 Jun 03 21:08:28.157586 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:28.157183 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"66cab92f-9aea-45cb-ab37-c63260a5b994","Type":"ContainerDied","Data":"20d72618c9217c72c28c9dfcdc108fc8e542a8f6e4d9bef4291552964ad83210"} Jun 03 21:08:28.157586 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:28.157249 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"66cab92f-9aea-45cb-ab37-c63260a5b994","Type":"ContainerStarted","Data":"c3f96e808618fbb9b4f68dc37540c14ab1fa9c29bc11a45c0d8d23a4ea3b93a9"} Jun 03 21:08:28.264981 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:28.264953 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="678f0d30-436d-4e13-bdaf-9543f9437a9f" path="/var/lib/kubelet/pods/678f0d30-436d-4e13-bdaf-9543f9437a9f/volumes" Jun 03 21:08:29.165160 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:29.165119 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"66cab92f-9aea-45cb-ab37-c63260a5b994","Type":"ContainerStarted","Data":"d8d966ec75e55a36342aec5ed22eea100472ba76931733f069a76c1fcec30a1d"} Jun 03 21:08:29.165546 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:29.165213 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"66cab92f-9aea-45cb-ab37-c63260a5b994","Type":"ContainerStarted","Data":"81b91cdd7d9aaa77e966dd933ed90702ea15f3c77b7ebd2f3e2c3e12f8093afd"} Jun 03 21:08:29.165546 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:29.165245 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"66cab92f-9aea-45cb-ab37-c63260a5b994","Type":"ContainerStarted","Data":"0739f4ee9d9dc1e55a8781f97bd2442e284ba72307c6377bf0d7b66388df13b2"} Jun 03 21:08:29.165546 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:29.165272 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"66cab92f-9aea-45cb-ab37-c63260a5b994","Type":"ContainerStarted","Data":"77e8a5362fe722e9eb34c8df0cd0b28c34c8296262db81c785ce8e80dc984141"} Jun 03 21:08:29.165546 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:29.165295 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"66cab92f-9aea-45cb-ab37-c63260a5b994","Type":"ContainerStarted","Data":"109c1586cc7c10d496c85e4e4c476581c2e0fdc050707a4bc2ada2574398c296"} Jun 03 21:08:29.165546 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:29.165321 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"66cab92f-9aea-45cb-ab37-c63260a5b994","Type":"ContainerStarted","Data":"788ef4b2f22d215653228a94ca0f5a6f2cca3d0237a5f3e4146ee5212af954de"} Jun 03 21:08:29.189326 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:29.189260 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.173576714 podStartE2EDuration="2.189240306s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.663592ms" isStatefulPod=false podCreationTimestamp="2026-06-03 21:08:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:08:29.188039782 +0000 UTC m=+147.344217940" watchObservedRunningTime="2026-06-03 21:08:29.189240306 +0000 UTC m=+147.345418453" Jun 03 21:08:29.471080 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:29.471039 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5b574787c-j86r4"] Jun 03 21:08:29.473967 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:29.473943 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5b574787c-j86r4" Jun 03 21:08:29.476283 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:29.476250 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 03 21:08:29.476424 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:29.476378 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 03 21:08:29.476528 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:29.476510 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-fjtdt\"" Jun 03 21:08:29.476810 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:29.476638 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 03 21:08:29.476810 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:29.476668 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 03 21:08:29.477001 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:29.476963 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 03 21:08:29.481904 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:29.481878 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 03 21:08:29.489966 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:29.489938 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5b574787c-j86r4"] Jun 03 21:08:29.603428 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:29.603391 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/25abc8cb-486f-43ca-9217-e129dc4f8e4f-federate-client-tls\") pod \"telemeter-client-5b574787c-j86r4\" (UID: \"25abc8cb-486f-43ca-9217-e129dc4f8e4f\") " pod="openshift-monitoring/telemeter-client-5b574787c-j86r4" Jun 03 21:08:29.603614 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:29.603461 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4t8h\" (UniqueName: \"kubernetes.io/projected/25abc8cb-486f-43ca-9217-e129dc4f8e4f-kube-api-access-k4t8h\") pod \"telemeter-client-5b574787c-j86r4\" (UID: \"25abc8cb-486f-43ca-9217-e129dc4f8e4f\") " pod="openshift-monitoring/telemeter-client-5b574787c-j86r4" Jun 03 21:08:29.603614 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:29.603499 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25abc8cb-486f-43ca-9217-e129dc4f8e4f-serving-certs-ca-bundle\") pod \"telemeter-client-5b574787c-j86r4\" (UID: \"25abc8cb-486f-43ca-9217-e129dc4f8e4f\") " pod="openshift-monitoring/telemeter-client-5b574787c-j86r4" Jun 03 21:08:29.603614 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:29.603524 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/25abc8cb-486f-43ca-9217-e129dc4f8e4f-secret-telemeter-client\") pod \"telemeter-client-5b574787c-j86r4\" (UID: \"25abc8cb-486f-43ca-9217-e129dc4f8e4f\") " pod="openshift-monitoring/telemeter-client-5b574787c-j86r4" Jun 03 21:08:29.603614 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:29.603607 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25abc8cb-486f-43ca-9217-e129dc4f8e4f-metrics-client-ca\") pod \"telemeter-client-5b574787c-j86r4\" (UID: \"25abc8cb-486f-43ca-9217-e129dc4f8e4f\") " pod="openshift-monitoring/telemeter-client-5b574787c-j86r4" Jun 03 21:08:29.603811 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:29.603637 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/25abc8cb-486f-43ca-9217-e129dc4f8e4f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b574787c-j86r4\" (UID: \"25abc8cb-486f-43ca-9217-e129dc4f8e4f\") " pod="openshift-monitoring/telemeter-client-5b574787c-j86r4" Jun 03 21:08:29.603811 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:29.603677 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25abc8cb-486f-43ca-9217-e129dc4f8e4f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b574787c-j86r4\" (UID: \"25abc8cb-486f-43ca-9217-e129dc4f8e4f\") " pod="openshift-monitoring/telemeter-client-5b574787c-j86r4" Jun 03 21:08:29.603811 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:29.603775 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/25abc8cb-486f-43ca-9217-e129dc4f8e4f-telemeter-client-tls\") pod \"telemeter-client-5b574787c-j86r4\" (UID: \"25abc8cb-486f-43ca-9217-e129dc4f8e4f\") " pod="openshift-monitoring/telemeter-client-5b574787c-j86r4" Jun 03 21:08:29.705234 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:29.705189 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25abc8cb-486f-43ca-9217-e129dc4f8e4f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b574787c-j86r4\" (UID: \"25abc8cb-486f-43ca-9217-e129dc4f8e4f\") " pod="openshift-monitoring/telemeter-client-5b574787c-j86r4" Jun 03 21:08:29.705430 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:29.705406 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/25abc8cb-486f-43ca-9217-e129dc4f8e4f-telemeter-client-tls\") pod \"telemeter-client-5b574787c-j86r4\" (UID: \"25abc8cb-486f-43ca-9217-e129dc4f8e4f\") " pod="openshift-monitoring/telemeter-client-5b574787c-j86r4" Jun 03 21:08:29.705500 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:29.705458 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/25abc8cb-486f-43ca-9217-e129dc4f8e4f-federate-client-tls\") pod \"telemeter-client-5b574787c-j86r4\" (UID: \"25abc8cb-486f-43ca-9217-e129dc4f8e4f\") " pod="openshift-monitoring/telemeter-client-5b574787c-j86r4" Jun 03 21:08:29.705555 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:29.705520 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4t8h\" (UniqueName: \"kubernetes.io/projected/25abc8cb-486f-43ca-9217-e129dc4f8e4f-kube-api-access-k4t8h\") pod \"telemeter-client-5b574787c-j86r4\" (UID: \"25abc8cb-486f-43ca-9217-e129dc4f8e4f\") " pod="openshift-monitoring/telemeter-client-5b574787c-j86r4" Jun 03 21:08:29.705614 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:29.705562 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25abc8cb-486f-43ca-9217-e129dc4f8e4f-serving-certs-ca-bundle\") pod \"telemeter-client-5b574787c-j86r4\" (UID: \"25abc8cb-486f-43ca-9217-e129dc4f8e4f\") " pod="openshift-monitoring/telemeter-client-5b574787c-j86r4" Jun 03 21:08:29.705614 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:29.705586 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/25abc8cb-486f-43ca-9217-e129dc4f8e4f-secret-telemeter-client\") pod \"telemeter-client-5b574787c-j86r4\" (UID: \"25abc8cb-486f-43ca-9217-e129dc4f8e4f\") " pod="openshift-monitoring/telemeter-client-5b574787c-j86r4" Jun 03 21:08:29.705731 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:29.705667 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25abc8cb-486f-43ca-9217-e129dc4f8e4f-metrics-client-ca\") pod \"telemeter-client-5b574787c-j86r4\" (UID: \"25abc8cb-486f-43ca-9217-e129dc4f8e4f\") " pod="openshift-monitoring/telemeter-client-5b574787c-j86r4" Jun 03 21:08:29.705731 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:29.705697 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/25abc8cb-486f-43ca-9217-e129dc4f8e4f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b574787c-j86r4\" (UID: \"25abc8cb-486f-43ca-9217-e129dc4f8e4f\") " pod="openshift-monitoring/telemeter-client-5b574787c-j86r4" Jun 03 21:08:29.706561 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:29.706273 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25abc8cb-486f-43ca-9217-e129dc4f8e4f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b574787c-j86r4\" (UID: \"25abc8cb-486f-43ca-9217-e129dc4f8e4f\") " pod="openshift-monitoring/telemeter-client-5b574787c-j86r4" Jun 03 21:08:29.706561 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:29.706515 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25abc8cb-486f-43ca-9217-e129dc4f8e4f-serving-certs-ca-bundle\") pod \"telemeter-client-5b574787c-j86r4\" (UID: \"25abc8cb-486f-43ca-9217-e129dc4f8e4f\") " pod="openshift-monitoring/telemeter-client-5b574787c-j86r4" Jun 03 21:08:29.706561 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:29.706552 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25abc8cb-486f-43ca-9217-e129dc4f8e4f-metrics-client-ca\") pod \"telemeter-client-5b574787c-j86r4\" (UID: \"25abc8cb-486f-43ca-9217-e129dc4f8e4f\") " pod="openshift-monitoring/telemeter-client-5b574787c-j86r4" Jun 03 21:08:29.708148 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:29.708121 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/25abc8cb-486f-43ca-9217-e129dc4f8e4f-telemeter-client-tls\") pod \"telemeter-client-5b574787c-j86r4\" (UID: \"25abc8cb-486f-43ca-9217-e129dc4f8e4f\") " pod="openshift-monitoring/telemeter-client-5b574787c-j86r4" Jun 03 21:08:29.708283 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:29.708264 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/25abc8cb-486f-43ca-9217-e129dc4f8e4f-secret-telemeter-client\") pod \"telemeter-client-5b574787c-j86r4\" (UID: \"25abc8cb-486f-43ca-9217-e129dc4f8e4f\") " pod="openshift-monitoring/telemeter-client-5b574787c-j86r4" Jun 03 21:08:29.708445 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:29.708426 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/25abc8cb-486f-43ca-9217-e129dc4f8e4f-federate-client-tls\") pod \"telemeter-client-5b574787c-j86r4\" (UID: \"25abc8cb-486f-43ca-9217-e129dc4f8e4f\") " pod="openshift-monitoring/telemeter-client-5b574787c-j86r4" Jun 03 21:08:29.708618 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:29.708597 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/25abc8cb-486f-43ca-9217-e129dc4f8e4f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b574787c-j86r4\" (UID: \"25abc8cb-486f-43ca-9217-e129dc4f8e4f\") " pod="openshift-monitoring/telemeter-client-5b574787c-j86r4" Jun 03 21:08:29.713766 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:29.713695 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4t8h\" (UniqueName: \"kubernetes.io/projected/25abc8cb-486f-43ca-9217-e129dc4f8e4f-kube-api-access-k4t8h\") pod \"telemeter-client-5b574787c-j86r4\" (UID: \"25abc8cb-486f-43ca-9217-e129dc4f8e4f\") " pod="openshift-monitoring/telemeter-client-5b574787c-j86r4" Jun 03 21:08:29.784702 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:29.784608 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 21:08:29.785019 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:29.784990 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a0a9ce13-0d44-473d-94f6-2542dd4501e0" containerName="prometheus" containerID="cri-o://6c3b3ee5e754d1d44b1b2ea29e333d7009ed26cc8216d60937f68d37de3897ae" gracePeriod=600 Jun 03 21:08:29.785110 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:29.785025 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a0a9ce13-0d44-473d-94f6-2542dd4501e0" containerName="kube-rbac-proxy" containerID="cri-o://62a52fcbb0b3a401d2502f40cb67b5b160f1c235cea54d86b7de4261af2650f2" gracePeriod=600 Jun 03 21:08:29.785188 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:29.785169 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a0a9ce13-0d44-473d-94f6-2542dd4501e0" containerName="kube-rbac-proxy-web" containerID="cri-o://28107fe7ad238a82675d65984f46772e82a4a99c047698e69be34c2ab5469e8f" gracePeriod=600 Jun 03 21:08:29.785242 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:29.785213 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a0a9ce13-0d44-473d-94f6-2542dd4501e0" containerName="config-reloader" containerID="cri-o://83f3117a83bf6aeb8baea04a7f7526d020512fe229bcb8ed1ef8882a74685db4" gracePeriod=600 Jun 03 21:08:29.785308 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:29.785291 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a0a9ce13-0d44-473d-94f6-2542dd4501e0" containerName="thanos-sidecar" containerID="cri-o://d1946e3f4fee294199c2aed8fc1efb73e1627906c0cc3ce540ab349e1a666cf0" gracePeriod=600 Jun 03 21:08:29.785384 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:29.785176 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a0a9ce13-0d44-473d-94f6-2542dd4501e0" containerName="kube-rbac-proxy-thanos" containerID="cri-o://c25f41489a71ad819109e05a131268f88b5c3dd7549b7f7c31ca7a89d602480f" gracePeriod=600 Jun 03 21:08:29.786822 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:29.786276 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5b574787c-j86r4" Jun 03 21:08:29.960433 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:29.960410 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5b574787c-j86r4"] Jun 03 21:08:29.962816 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:08:29.962784 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25abc8cb_486f_43ca_9217_e129dc4f8e4f.slice/crio-8f435c71ee22b0893a1351be732097d813e98683667adfc9d435f865d3776ccd WatchSource:0}: Error finding container 8f435c71ee22b0893a1351be732097d813e98683667adfc9d435f865d3776ccd: Status 404 returned error can't find the container with id 8f435c71ee22b0893a1351be732097d813e98683667adfc9d435f865d3776ccd Jun 03 21:08:30.046763 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.046670 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.111493 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.111457 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a0a9ce13-0d44-473d-94f6-2542dd4501e0-secret-prometheus-k8s-tls\") pod \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " Jun 03 21:08:30.111663 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.111518 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0a9ce13-0d44-473d-94f6-2542dd4501e0-configmap-serving-certs-ca-bundle\") pod \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " Jun 03 21:08:30.111663 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.111551 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a0a9ce13-0d44-473d-94f6-2542dd4501e0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " Jun 03 21:08:30.111663 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.111582 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a0a9ce13-0d44-473d-94f6-2542dd4501e0-web-config\") pod \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " Jun 03 21:08:30.111663 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.111605 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0a9ce13-0d44-473d-94f6-2542dd4501e0-prometheus-trusted-ca-bundle\") pod \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " Jun 03 21:08:30.111663 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.111648 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a0a9ce13-0d44-473d-94f6-2542dd4501e0-prometheus-k8s-rulefiles-0\") pod \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " Jun 03 21:08:30.111977 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.111675 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a0a9ce13-0d44-473d-94f6-2542dd4501e0-secret-metrics-client-certs\") pod \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " Jun 03 21:08:30.111977 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.111736 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a0a9ce13-0d44-473d-94f6-2542dd4501e0-config\") pod \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " Jun 03 21:08:30.111977 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.111778 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a0a9ce13-0d44-473d-94f6-2542dd4501e0-thanos-prometheus-http-client-file\") pod \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " Jun 03 21:08:30.111977 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.111805 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a0a9ce13-0d44-473d-94f6-2542dd4501e0-prometheus-k8s-rulefiles-2\") pod \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " Jun 03 21:08:30.111977 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.111838 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmjvw\" (UniqueName: \"kubernetes.io/projected/a0a9ce13-0d44-473d-94f6-2542dd4501e0-kube-api-access-lmjvw\") pod \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " Jun 03 21:08:30.111977 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.111865 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a0a9ce13-0d44-473d-94f6-2542dd4501e0-tls-assets\") pod \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " Jun 03 21:08:30.111977 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.111898 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a0a9ce13-0d44-473d-94f6-2542dd4501e0-secret-kube-rbac-proxy\") pod \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " Jun 03 21:08:30.111977 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.111943 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a0a9ce13-0d44-473d-94f6-2542dd4501e0-config-out\") pod \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " Jun 03 21:08:30.111977 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.111950 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0a9ce13-0d44-473d-94f6-2542dd4501e0-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "a0a9ce13-0d44-473d-94f6-2542dd4501e0" (UID: "a0a9ce13-0d44-473d-94f6-2542dd4501e0"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 21:08:30.112431 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.111964 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a0a9ce13-0d44-473d-94f6-2542dd4501e0-prometheus-k8s-rulefiles-1\") pod \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " Jun 03 21:08:30.112431 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.112022 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a0a9ce13-0d44-473d-94f6-2542dd4501e0-secret-grpc-tls\") pod \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " Jun 03 21:08:30.112431 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.112077 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0a9ce13-0d44-473d-94f6-2542dd4501e0-configmap-metrics-client-ca\") pod \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " Jun 03 21:08:30.112431 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.112110 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a0a9ce13-0d44-473d-94f6-2542dd4501e0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " Jun 03 21:08:30.112431 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.112150 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a0a9ce13-0d44-473d-94f6-2542dd4501e0-prometheus-k8s-db\") pod \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " Jun 03 21:08:30.112431 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.112179 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0a9ce13-0d44-473d-94f6-2542dd4501e0-configmap-kubelet-serving-ca-bundle\") pod \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\" (UID: \"a0a9ce13-0d44-473d-94f6-2542dd4501e0\") " Jun 03 21:08:30.112431 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.112265 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0a9ce13-0d44-473d-94f6-2542dd4501e0-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "a0a9ce13-0d44-473d-94f6-2542dd4501e0" (UID: "a0a9ce13-0d44-473d-94f6-2542dd4501e0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 21:08:30.112792 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.112498 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0a9ce13-0d44-473d-94f6-2542dd4501e0-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "a0a9ce13-0d44-473d-94f6-2542dd4501e0" (UID: "a0a9ce13-0d44-473d-94f6-2542dd4501e0"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 21:08:30.112792 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.112548 2557 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a0a9ce13-0d44-473d-94f6-2542dd4501e0-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jun 03 21:08:30.112792 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.112571 2557 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0a9ce13-0d44-473d-94f6-2542dd4501e0-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jun 03 21:08:30.112792 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.112737 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0a9ce13-0d44-473d-94f6-2542dd4501e0-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "a0a9ce13-0d44-473d-94f6-2542dd4501e0" (UID: "a0a9ce13-0d44-473d-94f6-2542dd4501e0"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 21:08:30.114191 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.113933 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0a9ce13-0d44-473d-94f6-2542dd4501e0-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "a0a9ce13-0d44-473d-94f6-2542dd4501e0" (UID: "a0a9ce13-0d44-473d-94f6-2542dd4501e0"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 21:08:30.115424 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.115172 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0a9ce13-0d44-473d-94f6-2542dd4501e0-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "a0a9ce13-0d44-473d-94f6-2542dd4501e0" (UID: "a0a9ce13-0d44-473d-94f6-2542dd4501e0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 21:08:30.116653 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.116567 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0a9ce13-0d44-473d-94f6-2542dd4501e0-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "a0a9ce13-0d44-473d-94f6-2542dd4501e0" (UID: "a0a9ce13-0d44-473d-94f6-2542dd4501e0"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 21:08:30.117020 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.116804 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0a9ce13-0d44-473d-94f6-2542dd4501e0-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "a0a9ce13-0d44-473d-94f6-2542dd4501e0" (UID: "a0a9ce13-0d44-473d-94f6-2542dd4501e0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 21:08:30.119129 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.117100 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0a9ce13-0d44-473d-94f6-2542dd4501e0-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "a0a9ce13-0d44-473d-94f6-2542dd4501e0" (UID: "a0a9ce13-0d44-473d-94f6-2542dd4501e0"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 21:08:30.119129 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.117519 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0a9ce13-0d44-473d-94f6-2542dd4501e0-config-out" (OuterVolumeSpecName: "config-out") pod "a0a9ce13-0d44-473d-94f6-2542dd4501e0" (UID: "a0a9ce13-0d44-473d-94f6-2542dd4501e0"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 21:08:30.119129 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.117880 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0a9ce13-0d44-473d-94f6-2542dd4501e0-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "a0a9ce13-0d44-473d-94f6-2542dd4501e0" (UID: "a0a9ce13-0d44-473d-94f6-2542dd4501e0"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 21:08:30.119129 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.118061 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0a9ce13-0d44-473d-94f6-2542dd4501e0-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "a0a9ce13-0d44-473d-94f6-2542dd4501e0" (UID: "a0a9ce13-0d44-473d-94f6-2542dd4501e0"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 21:08:30.119129 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.118769 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0a9ce13-0d44-473d-94f6-2542dd4501e0-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "a0a9ce13-0d44-473d-94f6-2542dd4501e0" (UID: "a0a9ce13-0d44-473d-94f6-2542dd4501e0"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:08:30.120146 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.119960 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0a9ce13-0d44-473d-94f6-2542dd4501e0-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "a0a9ce13-0d44-473d-94f6-2542dd4501e0" (UID: "a0a9ce13-0d44-473d-94f6-2542dd4501e0"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 21:08:30.120146 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.120095 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0a9ce13-0d44-473d-94f6-2542dd4501e0-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "a0a9ce13-0d44-473d-94f6-2542dd4501e0" (UID: "a0a9ce13-0d44-473d-94f6-2542dd4501e0"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 21:08:30.120146 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.120125 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0a9ce13-0d44-473d-94f6-2542dd4501e0-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "a0a9ce13-0d44-473d-94f6-2542dd4501e0" (UID: "a0a9ce13-0d44-473d-94f6-2542dd4501e0"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 21:08:30.121133 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.121105 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0a9ce13-0d44-473d-94f6-2542dd4501e0-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "a0a9ce13-0d44-473d-94f6-2542dd4501e0" (UID: "a0a9ce13-0d44-473d-94f6-2542dd4501e0"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 21:08:30.121219 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.121160 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0a9ce13-0d44-473d-94f6-2542dd4501e0-kube-api-access-lmjvw" (OuterVolumeSpecName: "kube-api-access-lmjvw") pod "a0a9ce13-0d44-473d-94f6-2542dd4501e0" (UID: "a0a9ce13-0d44-473d-94f6-2542dd4501e0"). InnerVolumeSpecName "kube-api-access-lmjvw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:08:30.121267 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.121221 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0a9ce13-0d44-473d-94f6-2542dd4501e0-config" (OuterVolumeSpecName: "config") pod "a0a9ce13-0d44-473d-94f6-2542dd4501e0" (UID: "a0a9ce13-0d44-473d-94f6-2542dd4501e0"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 21:08:30.132249 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.132216 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0a9ce13-0d44-473d-94f6-2542dd4501e0-web-config" (OuterVolumeSpecName: "web-config") pod "a0a9ce13-0d44-473d-94f6-2542dd4501e0" (UID: "a0a9ce13-0d44-473d-94f6-2542dd4501e0"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 21:08:30.172117 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.172079 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b574787c-j86r4" event={"ID":"25abc8cb-486f-43ca-9217-e129dc4f8e4f","Type":"ContainerStarted","Data":"8f435c71ee22b0893a1351be732097d813e98683667adfc9d435f865d3776ccd"} Jun 03 21:08:30.175398 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.175369 2557 generic.go:356] "Generic (PLEG): container finished" podID="a0a9ce13-0d44-473d-94f6-2542dd4501e0" containerID="c25f41489a71ad819109e05a131268f88b5c3dd7549b7f7c31ca7a89d602480f" exitCode=0 Jun 03 21:08:30.175398 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.175394 2557 generic.go:356] "Generic (PLEG): container finished" podID="a0a9ce13-0d44-473d-94f6-2542dd4501e0" containerID="62a52fcbb0b3a401d2502f40cb67b5b160f1c235cea54d86b7de4261af2650f2" exitCode=0 Jun 03 21:08:30.175398 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.175401 2557 generic.go:356] "Generic (PLEG): container finished" podID="a0a9ce13-0d44-473d-94f6-2542dd4501e0" containerID="28107fe7ad238a82675d65984f46772e82a4a99c047698e69be34c2ab5469e8f" exitCode=0 Jun 03 21:08:30.175398 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.175406 2557 generic.go:356] "Generic (PLEG): container finished" podID="a0a9ce13-0d44-473d-94f6-2542dd4501e0" containerID="d1946e3f4fee294199c2aed8fc1efb73e1627906c0cc3ce540ab349e1a666cf0" exitCode=0 Jun 03 21:08:30.175629 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.175412 2557 generic.go:356] "Generic (PLEG): container finished" podID="a0a9ce13-0d44-473d-94f6-2542dd4501e0" containerID="83f3117a83bf6aeb8baea04a7f7526d020512fe229bcb8ed1ef8882a74685db4" exitCode=0 Jun 03 21:08:30.175629 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.175417 2557 generic.go:356] "Generic (PLEG): container finished" podID="a0a9ce13-0d44-473d-94f6-2542dd4501e0" containerID="6c3b3ee5e754d1d44b1b2ea29e333d7009ed26cc8216d60937f68d37de3897ae" exitCode=0 Jun 03 21:08:30.175629 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.175452 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.175629 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.175451 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a0a9ce13-0d44-473d-94f6-2542dd4501e0","Type":"ContainerDied","Data":"c25f41489a71ad819109e05a131268f88b5c3dd7549b7f7c31ca7a89d602480f"} Jun 03 21:08:30.175765 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.175643 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a0a9ce13-0d44-473d-94f6-2542dd4501e0","Type":"ContainerDied","Data":"62a52fcbb0b3a401d2502f40cb67b5b160f1c235cea54d86b7de4261af2650f2"} Jun 03 21:08:30.175765 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.175680 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a0a9ce13-0d44-473d-94f6-2542dd4501e0","Type":"ContainerDied","Data":"28107fe7ad238a82675d65984f46772e82a4a99c047698e69be34c2ab5469e8f"} Jun 03 21:08:30.175765 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.175730 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a0a9ce13-0d44-473d-94f6-2542dd4501e0","Type":"ContainerDied","Data":"d1946e3f4fee294199c2aed8fc1efb73e1627906c0cc3ce540ab349e1a666cf0"} Jun 03 21:08:30.175765 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.175738 2557 scope.go:117] "RemoveContainer" containerID="c25f41489a71ad819109e05a131268f88b5c3dd7549b7f7c31ca7a89d602480f" Jun 03 21:08:30.175896 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.175771 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a0a9ce13-0d44-473d-94f6-2542dd4501e0","Type":"ContainerDied","Data":"83f3117a83bf6aeb8baea04a7f7526d020512fe229bcb8ed1ef8882a74685db4"} Jun 03 21:08:30.175896 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.175801 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a0a9ce13-0d44-473d-94f6-2542dd4501e0","Type":"ContainerDied","Data":"6c3b3ee5e754d1d44b1b2ea29e333d7009ed26cc8216d60937f68d37de3897ae"} Jun 03 21:08:30.175896 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.175827 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a0a9ce13-0d44-473d-94f6-2542dd4501e0","Type":"ContainerDied","Data":"95415ac02a2b9a57d37ab366a5db9ed23c57a055ed175a52cb5375975f8cdabf"} Jun 03 21:08:30.184094 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.184071 2557 scope.go:117] "RemoveContainer" containerID="62a52fcbb0b3a401d2502f40cb67b5b160f1c235cea54d86b7de4261af2650f2" Jun 03 21:08:30.196566 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.196534 2557 scope.go:117] "RemoveContainer" containerID="28107fe7ad238a82675d65984f46772e82a4a99c047698e69be34c2ab5469e8f" Jun 03 21:08:30.200581 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.200556 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 21:08:30.204950 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.204929 2557 scope.go:117] "RemoveContainer" containerID="d1946e3f4fee294199c2aed8fc1efb73e1627906c0cc3ce540ab349e1a666cf0" Jun 03 21:08:30.206928 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.206903 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 21:08:30.212599 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.212581 2557 scope.go:117] "RemoveContainer" containerID="83f3117a83bf6aeb8baea04a7f7526d020512fe229bcb8ed1ef8882a74685db4" Jun 03 21:08:30.212962 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.212939 2557 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a0a9ce13-0d44-473d-94f6-2542dd4501e0-secret-kube-rbac-proxy\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jun 03 21:08:30.213021 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.212966 2557 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a0a9ce13-0d44-473d-94f6-2542dd4501e0-config-out\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jun 03 21:08:30.213021 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.212978 2557 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a0a9ce13-0d44-473d-94f6-2542dd4501e0-secret-grpc-tls\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jun 03 21:08:30.213021 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.212985 2557 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0a9ce13-0d44-473d-94f6-2542dd4501e0-configmap-metrics-client-ca\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jun 03 21:08:30.213180 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.213023 2557 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a0a9ce13-0d44-473d-94f6-2542dd4501e0-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jun 03 21:08:30.213180 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.213037 2557 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a0a9ce13-0d44-473d-94f6-2542dd4501e0-prometheus-k8s-db\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jun 03 21:08:30.213180 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.213045 2557 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0a9ce13-0d44-473d-94f6-2542dd4501e0-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jun 03 21:08:30.213180 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.213054 2557 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a0a9ce13-0d44-473d-94f6-2542dd4501e0-secret-prometheus-k8s-tls\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jun 03 21:08:30.213180 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.213062 2557 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a0a9ce13-0d44-473d-94f6-2542dd4501e0-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jun 03 21:08:30.213180 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.213071 2557 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a0a9ce13-0d44-473d-94f6-2542dd4501e0-web-config\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jun 03 21:08:30.213180 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.213079 2557 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0a9ce13-0d44-473d-94f6-2542dd4501e0-prometheus-trusted-ca-bundle\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jun 03 21:08:30.213180 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.213088 2557 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a0a9ce13-0d44-473d-94f6-2542dd4501e0-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jun 03 21:08:30.213180 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.213098 2557 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a0a9ce13-0d44-473d-94f6-2542dd4501e0-secret-metrics-client-certs\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jun 03 21:08:30.213180 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.213110 2557 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/a0a9ce13-0d44-473d-94f6-2542dd4501e0-config\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jun 03 21:08:30.213180 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.213119 2557 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a0a9ce13-0d44-473d-94f6-2542dd4501e0-thanos-prometheus-http-client-file\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jun 03 21:08:30.213180 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.213129 2557 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a0a9ce13-0d44-473d-94f6-2542dd4501e0-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jun 03 21:08:30.213180 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.213137 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmjvw\" (UniqueName: \"kubernetes.io/projected/a0a9ce13-0d44-473d-94f6-2542dd4501e0-kube-api-access-lmjvw\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jun 03 21:08:30.213180 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.213145 2557 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a0a9ce13-0d44-473d-94f6-2542dd4501e0-tls-assets\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jun 03 21:08:30.219647 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.219626 2557 scope.go:117] "RemoveContainer" containerID="6c3b3ee5e754d1d44b1b2ea29e333d7009ed26cc8216d60937f68d37de3897ae" Jun 03 21:08:30.227436 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.227414 2557 scope.go:117] "RemoveContainer" containerID="edbac0d9d411d1a685c5d5ee9cb48ddebc8ab11e233926a475ce9b2923c1738e" Jun 03 21:08:30.230537 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.230513 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 21:08:30.230892 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.230878 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0a9ce13-0d44-473d-94f6-2542dd4501e0" containerName="thanos-sidecar" Jun 03 21:08:30.230953 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.230893 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0a9ce13-0d44-473d-94f6-2542dd4501e0" containerName="thanos-sidecar" Jun 03 21:08:30.230953 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.230910 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0a9ce13-0d44-473d-94f6-2542dd4501e0" containerName="init-config-reloader" Jun 03 21:08:30.230953 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.230916 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0a9ce13-0d44-473d-94f6-2542dd4501e0" containerName="init-config-reloader" Jun 03 21:08:30.230953 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.230923 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0a9ce13-0d44-473d-94f6-2542dd4501e0" containerName="kube-rbac-proxy-thanos" Jun 03 21:08:30.230953 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.230930 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0a9ce13-0d44-473d-94f6-2542dd4501e0" containerName="kube-rbac-proxy-thanos" Jun 03 21:08:30.230953 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.230938 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0a9ce13-0d44-473d-94f6-2542dd4501e0" containerName="kube-rbac-proxy-web" Jun 03 21:08:30.230953 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.230942 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0a9ce13-0d44-473d-94f6-2542dd4501e0" containerName="kube-rbac-proxy-web" Jun 03 21:08:30.230953 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.230952 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0a9ce13-0d44-473d-94f6-2542dd4501e0" containerName="config-reloader" Jun 03 21:08:30.230953 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.230957 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0a9ce13-0d44-473d-94f6-2542dd4501e0" containerName="config-reloader" Jun 03 21:08:30.231219 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.230966 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0a9ce13-0d44-473d-94f6-2542dd4501e0" containerName="kube-rbac-proxy" Jun 03 21:08:30.231219 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.230971 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0a9ce13-0d44-473d-94f6-2542dd4501e0" containerName="kube-rbac-proxy" Jun 03 21:08:30.231219 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.230979 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0a9ce13-0d44-473d-94f6-2542dd4501e0" containerName="prometheus" Jun 03 21:08:30.231219 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.230986 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0a9ce13-0d44-473d-94f6-2542dd4501e0" containerName="prometheus" Jun 03 21:08:30.231219 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.231053 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0a9ce13-0d44-473d-94f6-2542dd4501e0" containerName="kube-rbac-proxy" Jun 03 21:08:30.231219 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.231065 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0a9ce13-0d44-473d-94f6-2542dd4501e0" containerName="kube-rbac-proxy-thanos" Jun 03 21:08:30.231219 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.231074 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0a9ce13-0d44-473d-94f6-2542dd4501e0" containerName="prometheus" Jun 03 21:08:30.231219 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.231084 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0a9ce13-0d44-473d-94f6-2542dd4501e0" containerName="config-reloader" Jun 03 21:08:30.231219 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.231096 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0a9ce13-0d44-473d-94f6-2542dd4501e0" containerName="thanos-sidecar" Jun 03 21:08:30.231219 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.231105 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0a9ce13-0d44-473d-94f6-2542dd4501e0" containerName="kube-rbac-proxy-web" Jun 03 21:08:30.235337 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.235318 2557 scope.go:117] "RemoveContainer" containerID="c25f41489a71ad819109e05a131268f88b5c3dd7549b7f7c31ca7a89d602480f" Jun 03 21:08:30.235408 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.235340 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.235786 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:08:30.235650 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c25f41489a71ad819109e05a131268f88b5c3dd7549b7f7c31ca7a89d602480f\": container with ID starting with c25f41489a71ad819109e05a131268f88b5c3dd7549b7f7c31ca7a89d602480f not found: ID does not exist" containerID="c25f41489a71ad819109e05a131268f88b5c3dd7549b7f7c31ca7a89d602480f" Jun 03 21:08:30.235786 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.235693 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c25f41489a71ad819109e05a131268f88b5c3dd7549b7f7c31ca7a89d602480f"} err="failed to get container status \"c25f41489a71ad819109e05a131268f88b5c3dd7549b7f7c31ca7a89d602480f\": rpc error: code = NotFound desc = could not find container \"c25f41489a71ad819109e05a131268f88b5c3dd7549b7f7c31ca7a89d602480f\": container with ID starting with c25f41489a71ad819109e05a131268f88b5c3dd7549b7f7c31ca7a89d602480f not found: ID does not exist" Jun 03 21:08:30.235786 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.235734 2557 scope.go:117] "RemoveContainer" containerID="62a52fcbb0b3a401d2502f40cb67b5b160f1c235cea54d86b7de4261af2650f2" Jun 03 21:08:30.236054 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:08:30.236032 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62a52fcbb0b3a401d2502f40cb67b5b160f1c235cea54d86b7de4261af2650f2\": container with ID starting with 62a52fcbb0b3a401d2502f40cb67b5b160f1c235cea54d86b7de4261af2650f2 not found: ID does not exist" containerID="62a52fcbb0b3a401d2502f40cb67b5b160f1c235cea54d86b7de4261af2650f2" Jun 03 21:08:30.236095 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.236064 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62a52fcbb0b3a401d2502f40cb67b5b160f1c235cea54d86b7de4261af2650f2"} err="failed to get container status \"62a52fcbb0b3a401d2502f40cb67b5b160f1c235cea54d86b7de4261af2650f2\": rpc error: code = NotFound desc = could not find container \"62a52fcbb0b3a401d2502f40cb67b5b160f1c235cea54d86b7de4261af2650f2\": container with ID starting with 62a52fcbb0b3a401d2502f40cb67b5b160f1c235cea54d86b7de4261af2650f2 not found: ID does not exist" Jun 03 21:08:30.236095 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.236087 2557 scope.go:117] "RemoveContainer" containerID="28107fe7ad238a82675d65984f46772e82a4a99c047698e69be34c2ab5469e8f" Jun 03 21:08:30.236342 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:08:30.236319 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28107fe7ad238a82675d65984f46772e82a4a99c047698e69be34c2ab5469e8f\": container with ID starting with 28107fe7ad238a82675d65984f46772e82a4a99c047698e69be34c2ab5469e8f not found: ID does not exist" containerID="28107fe7ad238a82675d65984f46772e82a4a99c047698e69be34c2ab5469e8f" Jun 03 21:08:30.236388 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.236352 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28107fe7ad238a82675d65984f46772e82a4a99c047698e69be34c2ab5469e8f"} err="failed to get container status \"28107fe7ad238a82675d65984f46772e82a4a99c047698e69be34c2ab5469e8f\": rpc error: code = NotFound desc = could not find container \"28107fe7ad238a82675d65984f46772e82a4a99c047698e69be34c2ab5469e8f\": container with ID starting with 28107fe7ad238a82675d65984f46772e82a4a99c047698e69be34c2ab5469e8f not found: ID does not exist" Jun 03 21:08:30.236388 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.236375 2557 scope.go:117] "RemoveContainer" containerID="d1946e3f4fee294199c2aed8fc1efb73e1627906c0cc3ce540ab349e1a666cf0" Jun 03 21:08:30.236582 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:08:30.236566 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1946e3f4fee294199c2aed8fc1efb73e1627906c0cc3ce540ab349e1a666cf0\": container with ID starting with d1946e3f4fee294199c2aed8fc1efb73e1627906c0cc3ce540ab349e1a666cf0 not found: ID does not exist" containerID="d1946e3f4fee294199c2aed8fc1efb73e1627906c0cc3ce540ab349e1a666cf0" Jun 03 21:08:30.236623 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.236586 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1946e3f4fee294199c2aed8fc1efb73e1627906c0cc3ce540ab349e1a666cf0"} err="failed to get container status \"d1946e3f4fee294199c2aed8fc1efb73e1627906c0cc3ce540ab349e1a666cf0\": rpc error: code = NotFound desc = could not find container \"d1946e3f4fee294199c2aed8fc1efb73e1627906c0cc3ce540ab349e1a666cf0\": container with ID starting with d1946e3f4fee294199c2aed8fc1efb73e1627906c0cc3ce540ab349e1a666cf0 not found: ID does not exist" Jun 03 21:08:30.236623 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.236600 2557 scope.go:117] "RemoveContainer" containerID="83f3117a83bf6aeb8baea04a7f7526d020512fe229bcb8ed1ef8882a74685db4" Jun 03 21:08:30.236946 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:08:30.236922 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83f3117a83bf6aeb8baea04a7f7526d020512fe229bcb8ed1ef8882a74685db4\": container with ID starting with 83f3117a83bf6aeb8baea04a7f7526d020512fe229bcb8ed1ef8882a74685db4 not found: ID does not exist" containerID="83f3117a83bf6aeb8baea04a7f7526d020512fe229bcb8ed1ef8882a74685db4" Jun 03 21:08:30.236990 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.236953 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83f3117a83bf6aeb8baea04a7f7526d020512fe229bcb8ed1ef8882a74685db4"} err="failed to get container status \"83f3117a83bf6aeb8baea04a7f7526d020512fe229bcb8ed1ef8882a74685db4\": rpc error: code = NotFound desc = could not find container \"83f3117a83bf6aeb8baea04a7f7526d020512fe229bcb8ed1ef8882a74685db4\": container with ID starting with 83f3117a83bf6aeb8baea04a7f7526d020512fe229bcb8ed1ef8882a74685db4 not found: ID does not exist" Jun 03 21:08:30.236990 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.236973 2557 scope.go:117] "RemoveContainer" containerID="6c3b3ee5e754d1d44b1b2ea29e333d7009ed26cc8216d60937f68d37de3897ae" Jun 03 21:08:30.237253 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:08:30.237232 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c3b3ee5e754d1d44b1b2ea29e333d7009ed26cc8216d60937f68d37de3897ae\": container with ID starting with 6c3b3ee5e754d1d44b1b2ea29e333d7009ed26cc8216d60937f68d37de3897ae not found: ID does not exist" containerID="6c3b3ee5e754d1d44b1b2ea29e333d7009ed26cc8216d60937f68d37de3897ae" Jun 03 21:08:30.237316 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.237261 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c3b3ee5e754d1d44b1b2ea29e333d7009ed26cc8216d60937f68d37de3897ae"} err="failed to get container status \"6c3b3ee5e754d1d44b1b2ea29e333d7009ed26cc8216d60937f68d37de3897ae\": rpc error: code = NotFound desc = could not find container \"6c3b3ee5e754d1d44b1b2ea29e333d7009ed26cc8216d60937f68d37de3897ae\": container with ID starting with 6c3b3ee5e754d1d44b1b2ea29e333d7009ed26cc8216d60937f68d37de3897ae not found: ID does not exist" Jun 03 21:08:30.237316 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.237283 2557 scope.go:117] "RemoveContainer" containerID="edbac0d9d411d1a685c5d5ee9cb48ddebc8ab11e233926a475ce9b2923c1738e" Jun 03 21:08:30.237535 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:08:30.237518 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"edbac0d9d411d1a685c5d5ee9cb48ddebc8ab11e233926a475ce9b2923c1738e\": container with ID starting with edbac0d9d411d1a685c5d5ee9cb48ddebc8ab11e233926a475ce9b2923c1738e not found: ID does not exist" containerID="edbac0d9d411d1a685c5d5ee9cb48ddebc8ab11e233926a475ce9b2923c1738e" Jun 03 21:08:30.237609 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.237541 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edbac0d9d411d1a685c5d5ee9cb48ddebc8ab11e233926a475ce9b2923c1738e"} err="failed to get container status \"edbac0d9d411d1a685c5d5ee9cb48ddebc8ab11e233926a475ce9b2923c1738e\": rpc error: code = NotFound desc = could not find container \"edbac0d9d411d1a685c5d5ee9cb48ddebc8ab11e233926a475ce9b2923c1738e\": container with ID starting with edbac0d9d411d1a685c5d5ee9cb48ddebc8ab11e233926a475ce9b2923c1738e not found: ID does not exist" Jun 03 21:08:30.237609 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.237559 2557 scope.go:117] "RemoveContainer" containerID="c25f41489a71ad819109e05a131268f88b5c3dd7549b7f7c31ca7a89d602480f" Jun 03 21:08:30.237828 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.237805 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 03 21:08:30.237828 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.237818 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 03 21:08:30.237977 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.237855 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c25f41489a71ad819109e05a131268f88b5c3dd7549b7f7c31ca7a89d602480f"} err="failed to get container status \"c25f41489a71ad819109e05a131268f88b5c3dd7549b7f7c31ca7a89d602480f\": rpc error: code = NotFound desc = could not find container \"c25f41489a71ad819109e05a131268f88b5c3dd7549b7f7c31ca7a89d602480f\": container with ID starting with c25f41489a71ad819109e05a131268f88b5c3dd7549b7f7c31ca7a89d602480f not found: ID does not exist" Jun 03 21:08:30.237977 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.237869 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 03 21:08:30.237977 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.237876 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 03 21:08:30.237977 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.237878 2557 scope.go:117] "RemoveContainer" containerID="62a52fcbb0b3a401d2502f40cb67b5b160f1c235cea54d86b7de4261af2650f2" Jun 03 21:08:30.238245 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.238161 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 03 21:08:30.238245 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.238174 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 03 21:08:30.238245 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.238218 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62a52fcbb0b3a401d2502f40cb67b5b160f1c235cea54d86b7de4261af2650f2"} err="failed to get container status \"62a52fcbb0b3a401d2502f40cb67b5b160f1c235cea54d86b7de4261af2650f2\": rpc error: code = NotFound desc = could not find container \"62a52fcbb0b3a401d2502f40cb67b5b160f1c235cea54d86b7de4261af2650f2\": container with ID starting with 62a52fcbb0b3a401d2502f40cb67b5b160f1c235cea54d86b7de4261af2650f2 not found: ID does not exist" Jun 03 21:08:30.238245 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.238235 2557 scope.go:117] "RemoveContainer" containerID="28107fe7ad238a82675d65984f46772e82a4a99c047698e69be34c2ab5469e8f" Jun 03 21:08:30.238506 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.238361 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 03 21:08:30.238556 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.238513 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28107fe7ad238a82675d65984f46772e82a4a99c047698e69be34c2ab5469e8f"} err="failed to get container status \"28107fe7ad238a82675d65984f46772e82a4a99c047698e69be34c2ab5469e8f\": rpc error: code = NotFound desc = could not find container \"28107fe7ad238a82675d65984f46772e82a4a99c047698e69be34c2ab5469e8f\": container with ID starting with 28107fe7ad238a82675d65984f46772e82a4a99c047698e69be34c2ab5469e8f not found: ID does not exist" Jun 03 21:08:30.238556 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.238531 2557 scope.go:117] "RemoveContainer" containerID="d1946e3f4fee294199c2aed8fc1efb73e1627906c0cc3ce540ab349e1a666cf0" Jun 03 21:08:30.238556 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.238545 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 03 21:08:30.238794 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.238602 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 03 21:08:30.238794 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.238769 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1946e3f4fee294199c2aed8fc1efb73e1627906c0cc3ce540ab349e1a666cf0"} err="failed to get container status \"d1946e3f4fee294199c2aed8fc1efb73e1627906c0cc3ce540ab349e1a666cf0\": rpc error: code = NotFound desc = could not find container \"d1946e3f4fee294199c2aed8fc1efb73e1627906c0cc3ce540ab349e1a666cf0\": container with ID starting with d1946e3f4fee294199c2aed8fc1efb73e1627906c0cc3ce540ab349e1a666cf0 not found: ID does not exist" Jun 03 21:08:30.238794 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.238793 2557 scope.go:117] "RemoveContainer" containerID="83f3117a83bf6aeb8baea04a7f7526d020512fe229bcb8ed1ef8882a74685db4" Jun 03 21:08:30.238990 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.238944 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-v484b\"" Jun 03 21:08:30.239077 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.239027 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 03 21:08:30.239129 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.239098 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83f3117a83bf6aeb8baea04a7f7526d020512fe229bcb8ed1ef8882a74685db4"} err="failed to get container status \"83f3117a83bf6aeb8baea04a7f7526d020512fe229bcb8ed1ef8882a74685db4\": rpc error: code = NotFound desc = could not find container \"83f3117a83bf6aeb8baea04a7f7526d020512fe229bcb8ed1ef8882a74685db4\": container with ID starting with 83f3117a83bf6aeb8baea04a7f7526d020512fe229bcb8ed1ef8882a74685db4 not found: ID does not exist" Jun 03 21:08:30.239129 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.239121 2557 scope.go:117] "RemoveContainer" containerID="6c3b3ee5e754d1d44b1b2ea29e333d7009ed26cc8216d60937f68d37de3897ae" Jun 03 21:08:30.239504 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.239466 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c3b3ee5e754d1d44b1b2ea29e333d7009ed26cc8216d60937f68d37de3897ae"} err="failed to get container status \"6c3b3ee5e754d1d44b1b2ea29e333d7009ed26cc8216d60937f68d37de3897ae\": rpc error: code = NotFound desc = could not find container \"6c3b3ee5e754d1d44b1b2ea29e333d7009ed26cc8216d60937f68d37de3897ae\": container with ID starting with 6c3b3ee5e754d1d44b1b2ea29e333d7009ed26cc8216d60937f68d37de3897ae not found: ID does not exist" Jun 03 21:08:30.239504 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.239513 2557 scope.go:117] "RemoveContainer" containerID="edbac0d9d411d1a685c5d5ee9cb48ddebc8ab11e233926a475ce9b2923c1738e" Jun 03 21:08:30.240237 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.239674 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 03 21:08:30.240237 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.240022 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 03 21:08:30.240481 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.240419 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-o9porrjiu3lu\"" Jun 03 21:08:30.240904 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.240815 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edbac0d9d411d1a685c5d5ee9cb48ddebc8ab11e233926a475ce9b2923c1738e"} err="failed to get container status \"edbac0d9d411d1a685c5d5ee9cb48ddebc8ab11e233926a475ce9b2923c1738e\": rpc error: code = NotFound desc = could not find container \"edbac0d9d411d1a685c5d5ee9cb48ddebc8ab11e233926a475ce9b2923c1738e\": container with ID starting with edbac0d9d411d1a685c5d5ee9cb48ddebc8ab11e233926a475ce9b2923c1738e not found: ID does not exist" Jun 03 21:08:30.240904 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.240840 2557 scope.go:117] "RemoveContainer" containerID="c25f41489a71ad819109e05a131268f88b5c3dd7549b7f7c31ca7a89d602480f" Jun 03 21:08:30.241287 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.241263 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c25f41489a71ad819109e05a131268f88b5c3dd7549b7f7c31ca7a89d602480f"} err="failed to get container status \"c25f41489a71ad819109e05a131268f88b5c3dd7549b7f7c31ca7a89d602480f\": rpc error: code = NotFound desc = could not find container \"c25f41489a71ad819109e05a131268f88b5c3dd7549b7f7c31ca7a89d602480f\": container with ID starting with c25f41489a71ad819109e05a131268f88b5c3dd7549b7f7c31ca7a89d602480f not found: ID does not exist" Jun 03 21:08:30.241434 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.241420 2557 scope.go:117] "RemoveContainer" containerID="62a52fcbb0b3a401d2502f40cb67b5b160f1c235cea54d86b7de4261af2650f2" Jun 03 21:08:30.241838 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.241791 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62a52fcbb0b3a401d2502f40cb67b5b160f1c235cea54d86b7de4261af2650f2"} err="failed to get container status \"62a52fcbb0b3a401d2502f40cb67b5b160f1c235cea54d86b7de4261af2650f2\": rpc error: code = NotFound desc = could not find container \"62a52fcbb0b3a401d2502f40cb67b5b160f1c235cea54d86b7de4261af2650f2\": container with ID starting with 62a52fcbb0b3a401d2502f40cb67b5b160f1c235cea54d86b7de4261af2650f2 not found: ID does not exist" Jun 03 21:08:30.241958 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.241946 2557 scope.go:117] "RemoveContainer" containerID="28107fe7ad238a82675d65984f46772e82a4a99c047698e69be34c2ab5469e8f" Jun 03 21:08:30.242105 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.242006 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 03 21:08:30.242356 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.242307 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28107fe7ad238a82675d65984f46772e82a4a99c047698e69be34c2ab5469e8f"} err="failed to get container status \"28107fe7ad238a82675d65984f46772e82a4a99c047698e69be34c2ab5469e8f\": rpc error: code = NotFound desc = could not find container \"28107fe7ad238a82675d65984f46772e82a4a99c047698e69be34c2ab5469e8f\": container with ID starting with 28107fe7ad238a82675d65984f46772e82a4a99c047698e69be34c2ab5469e8f not found: ID does not exist" Jun 03 21:08:30.242356 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.242330 2557 scope.go:117] "RemoveContainer" containerID="d1946e3f4fee294199c2aed8fc1efb73e1627906c0cc3ce540ab349e1a666cf0" Jun 03 21:08:30.242736 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.242623 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1946e3f4fee294199c2aed8fc1efb73e1627906c0cc3ce540ab349e1a666cf0"} err="failed to get container status \"d1946e3f4fee294199c2aed8fc1efb73e1627906c0cc3ce540ab349e1a666cf0\": rpc error: code = NotFound desc = could not find container \"d1946e3f4fee294199c2aed8fc1efb73e1627906c0cc3ce540ab349e1a666cf0\": container with ID starting with d1946e3f4fee294199c2aed8fc1efb73e1627906c0cc3ce540ab349e1a666cf0 not found: ID does not exist" Jun 03 21:08:30.242736 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.242663 2557 scope.go:117] "RemoveContainer" containerID="83f3117a83bf6aeb8baea04a7f7526d020512fe229bcb8ed1ef8882a74685db4" Jun 03 21:08:30.243093 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.243053 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83f3117a83bf6aeb8baea04a7f7526d020512fe229bcb8ed1ef8882a74685db4"} err="failed to get container status \"83f3117a83bf6aeb8baea04a7f7526d020512fe229bcb8ed1ef8882a74685db4\": rpc error: code = NotFound desc = could not find container \"83f3117a83bf6aeb8baea04a7f7526d020512fe229bcb8ed1ef8882a74685db4\": container with ID starting with 83f3117a83bf6aeb8baea04a7f7526d020512fe229bcb8ed1ef8882a74685db4 not found: ID does not exist" Jun 03 21:08:30.243093 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.243087 2557 scope.go:117] "RemoveContainer" containerID="6c3b3ee5e754d1d44b1b2ea29e333d7009ed26cc8216d60937f68d37de3897ae" Jun 03 21:08:30.243361 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.243332 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c3b3ee5e754d1d44b1b2ea29e333d7009ed26cc8216d60937f68d37de3897ae"} err="failed to get container status \"6c3b3ee5e754d1d44b1b2ea29e333d7009ed26cc8216d60937f68d37de3897ae\": rpc error: code = NotFound desc = could not find container \"6c3b3ee5e754d1d44b1b2ea29e333d7009ed26cc8216d60937f68d37de3897ae\": container with ID starting with 6c3b3ee5e754d1d44b1b2ea29e333d7009ed26cc8216d60937f68d37de3897ae not found: ID does not exist" Jun 03 21:08:30.243457 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.243362 2557 scope.go:117] "RemoveContainer" containerID="edbac0d9d411d1a685c5d5ee9cb48ddebc8ab11e233926a475ce9b2923c1738e" Jun 03 21:08:30.243648 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.243630 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edbac0d9d411d1a685c5d5ee9cb48ddebc8ab11e233926a475ce9b2923c1738e"} err="failed to get container status \"edbac0d9d411d1a685c5d5ee9cb48ddebc8ab11e233926a475ce9b2923c1738e\": rpc error: code = NotFound desc = could not find container \"edbac0d9d411d1a685c5d5ee9cb48ddebc8ab11e233926a475ce9b2923c1738e\": container with ID starting with edbac0d9d411d1a685c5d5ee9cb48ddebc8ab11e233926a475ce9b2923c1738e not found: ID does not exist" Jun 03 21:08:30.243773 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.243666 2557 scope.go:117] "RemoveContainer" containerID="c25f41489a71ad819109e05a131268f88b5c3dd7549b7f7c31ca7a89d602480f" Jun 03 21:08:30.244019 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.243995 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c25f41489a71ad819109e05a131268f88b5c3dd7549b7f7c31ca7a89d602480f"} err="failed to get container status \"c25f41489a71ad819109e05a131268f88b5c3dd7549b7f7c31ca7a89d602480f\": rpc error: code = NotFound desc = could not find container \"c25f41489a71ad819109e05a131268f88b5c3dd7549b7f7c31ca7a89d602480f\": container with ID starting with c25f41489a71ad819109e05a131268f88b5c3dd7549b7f7c31ca7a89d602480f not found: ID does not exist" Jun 03 21:08:30.244019 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.244020 2557 scope.go:117] "RemoveContainer" containerID="62a52fcbb0b3a401d2502f40cb67b5b160f1c235cea54d86b7de4261af2650f2" Jun 03 21:08:30.244293 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.244267 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62a52fcbb0b3a401d2502f40cb67b5b160f1c235cea54d86b7de4261af2650f2"} err="failed to get container status \"62a52fcbb0b3a401d2502f40cb67b5b160f1c235cea54d86b7de4261af2650f2\": rpc error: code = NotFound desc = could not find container \"62a52fcbb0b3a401d2502f40cb67b5b160f1c235cea54d86b7de4261af2650f2\": container with ID starting with 62a52fcbb0b3a401d2502f40cb67b5b160f1c235cea54d86b7de4261af2650f2 not found: ID does not exist" Jun 03 21:08:30.244390 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.244294 2557 scope.go:117] "RemoveContainer" containerID="28107fe7ad238a82675d65984f46772e82a4a99c047698e69be34c2ab5469e8f" Jun 03 21:08:30.244675 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.244584 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28107fe7ad238a82675d65984f46772e82a4a99c047698e69be34c2ab5469e8f"} err="failed to get container status \"28107fe7ad238a82675d65984f46772e82a4a99c047698e69be34c2ab5469e8f\": rpc error: code = NotFound desc = could not find container \"28107fe7ad238a82675d65984f46772e82a4a99c047698e69be34c2ab5469e8f\": container with ID starting with 28107fe7ad238a82675d65984f46772e82a4a99c047698e69be34c2ab5469e8f not found: ID does not exist" Jun 03 21:08:30.244835 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.244758 2557 scope.go:117] "RemoveContainer" containerID="d1946e3f4fee294199c2aed8fc1efb73e1627906c0cc3ce540ab349e1a666cf0" Jun 03 21:08:30.245061 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.245042 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 03 21:08:30.245325 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.245302 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1946e3f4fee294199c2aed8fc1efb73e1627906c0cc3ce540ab349e1a666cf0"} err="failed to get container status \"d1946e3f4fee294199c2aed8fc1efb73e1627906c0cc3ce540ab349e1a666cf0\": rpc error: code = NotFound desc = could not find container \"d1946e3f4fee294199c2aed8fc1efb73e1627906c0cc3ce540ab349e1a666cf0\": container with ID starting with d1946e3f4fee294199c2aed8fc1efb73e1627906c0cc3ce540ab349e1a666cf0 not found: ID does not exist" Jun 03 21:08:30.245380 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.245329 2557 scope.go:117] "RemoveContainer" containerID="83f3117a83bf6aeb8baea04a7f7526d020512fe229bcb8ed1ef8882a74685db4" Jun 03 21:08:30.245577 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.245558 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83f3117a83bf6aeb8baea04a7f7526d020512fe229bcb8ed1ef8882a74685db4"} err="failed to get container status \"83f3117a83bf6aeb8baea04a7f7526d020512fe229bcb8ed1ef8882a74685db4\": rpc error: code = NotFound desc = could not find container \"83f3117a83bf6aeb8baea04a7f7526d020512fe229bcb8ed1ef8882a74685db4\": container with ID starting with 83f3117a83bf6aeb8baea04a7f7526d020512fe229bcb8ed1ef8882a74685db4 not found: ID does not exist" Jun 03 21:08:30.245629 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.245577 2557 scope.go:117] "RemoveContainer" containerID="6c3b3ee5e754d1d44b1b2ea29e333d7009ed26cc8216d60937f68d37de3897ae" Jun 03 21:08:30.245842 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.245825 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c3b3ee5e754d1d44b1b2ea29e333d7009ed26cc8216d60937f68d37de3897ae"} err="failed to get container status \"6c3b3ee5e754d1d44b1b2ea29e333d7009ed26cc8216d60937f68d37de3897ae\": rpc error: code = NotFound desc = could not find container \"6c3b3ee5e754d1d44b1b2ea29e333d7009ed26cc8216d60937f68d37de3897ae\": container with ID starting with 6c3b3ee5e754d1d44b1b2ea29e333d7009ed26cc8216d60937f68d37de3897ae not found: ID does not exist" Jun 03 21:08:30.245903 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.245842 2557 scope.go:117] "RemoveContainer" containerID="edbac0d9d411d1a685c5d5ee9cb48ddebc8ab11e233926a475ce9b2923c1738e" Jun 03 21:08:30.246070 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.246054 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edbac0d9d411d1a685c5d5ee9cb48ddebc8ab11e233926a475ce9b2923c1738e"} err="failed to get container status \"edbac0d9d411d1a685c5d5ee9cb48ddebc8ab11e233926a475ce9b2923c1738e\": rpc error: code = NotFound desc = could not find container \"edbac0d9d411d1a685c5d5ee9cb48ddebc8ab11e233926a475ce9b2923c1738e\": container with ID starting with edbac0d9d411d1a685c5d5ee9cb48ddebc8ab11e233926a475ce9b2923c1738e not found: ID does not exist" Jun 03 21:08:30.246115 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.246071 2557 scope.go:117] "RemoveContainer" containerID="c25f41489a71ad819109e05a131268f88b5c3dd7549b7f7c31ca7a89d602480f" Jun 03 21:08:30.246284 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.246269 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c25f41489a71ad819109e05a131268f88b5c3dd7549b7f7c31ca7a89d602480f"} err="failed to get container status \"c25f41489a71ad819109e05a131268f88b5c3dd7549b7f7c31ca7a89d602480f\": rpc error: code = NotFound desc = could not find container \"c25f41489a71ad819109e05a131268f88b5c3dd7549b7f7c31ca7a89d602480f\": container with ID starting with c25f41489a71ad819109e05a131268f88b5c3dd7549b7f7c31ca7a89d602480f not found: ID does not exist" Jun 03 21:08:30.246324 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.246284 2557 scope.go:117] "RemoveContainer" containerID="62a52fcbb0b3a401d2502f40cb67b5b160f1c235cea54d86b7de4261af2650f2" Jun 03 21:08:30.246486 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.246472 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62a52fcbb0b3a401d2502f40cb67b5b160f1c235cea54d86b7de4261af2650f2"} err="failed to get container status \"62a52fcbb0b3a401d2502f40cb67b5b160f1c235cea54d86b7de4261af2650f2\": rpc error: code = NotFound desc = could not find container \"62a52fcbb0b3a401d2502f40cb67b5b160f1c235cea54d86b7de4261af2650f2\": container with ID starting with 62a52fcbb0b3a401d2502f40cb67b5b160f1c235cea54d86b7de4261af2650f2 not found: ID does not exist" Jun 03 21:08:30.246537 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.246486 2557 scope.go:117] "RemoveContainer" containerID="28107fe7ad238a82675d65984f46772e82a4a99c047698e69be34c2ab5469e8f" Jun 03 21:08:30.246705 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.246686 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28107fe7ad238a82675d65984f46772e82a4a99c047698e69be34c2ab5469e8f"} err="failed to get container status \"28107fe7ad238a82675d65984f46772e82a4a99c047698e69be34c2ab5469e8f\": rpc error: code = NotFound desc = could not find container \"28107fe7ad238a82675d65984f46772e82a4a99c047698e69be34c2ab5469e8f\": container with ID starting with 28107fe7ad238a82675d65984f46772e82a4a99c047698e69be34c2ab5469e8f not found: ID does not exist" Jun 03 21:08:30.246705 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.246719 2557 scope.go:117] "RemoveContainer" containerID="d1946e3f4fee294199c2aed8fc1efb73e1627906c0cc3ce540ab349e1a666cf0" Jun 03 21:08:30.246963 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.246944 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1946e3f4fee294199c2aed8fc1efb73e1627906c0cc3ce540ab349e1a666cf0"} err="failed to get container status \"d1946e3f4fee294199c2aed8fc1efb73e1627906c0cc3ce540ab349e1a666cf0\": rpc error: code = NotFound desc = could not find container \"d1946e3f4fee294199c2aed8fc1efb73e1627906c0cc3ce540ab349e1a666cf0\": container with ID starting with d1946e3f4fee294199c2aed8fc1efb73e1627906c0cc3ce540ab349e1a666cf0 not found: ID does not exist" Jun 03 21:08:30.246963 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.246962 2557 scope.go:117] "RemoveContainer" containerID="83f3117a83bf6aeb8baea04a7f7526d020512fe229bcb8ed1ef8882a74685db4" Jun 03 21:08:30.247194 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.247178 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83f3117a83bf6aeb8baea04a7f7526d020512fe229bcb8ed1ef8882a74685db4"} err="failed to get container status \"83f3117a83bf6aeb8baea04a7f7526d020512fe229bcb8ed1ef8882a74685db4\": rpc error: code = NotFound desc = could not find container \"83f3117a83bf6aeb8baea04a7f7526d020512fe229bcb8ed1ef8882a74685db4\": container with ID starting with 83f3117a83bf6aeb8baea04a7f7526d020512fe229bcb8ed1ef8882a74685db4 not found: ID does not exist" Jun 03 21:08:30.247194 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.247193 2557 scope.go:117] "RemoveContainer" containerID="6c3b3ee5e754d1d44b1b2ea29e333d7009ed26cc8216d60937f68d37de3897ae" Jun 03 21:08:30.247393 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.247377 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c3b3ee5e754d1d44b1b2ea29e333d7009ed26cc8216d60937f68d37de3897ae"} err="failed to get container status \"6c3b3ee5e754d1d44b1b2ea29e333d7009ed26cc8216d60937f68d37de3897ae\": rpc error: code = NotFound desc = could not find container \"6c3b3ee5e754d1d44b1b2ea29e333d7009ed26cc8216d60937f68d37de3897ae\": container with ID starting with 6c3b3ee5e754d1d44b1b2ea29e333d7009ed26cc8216d60937f68d37de3897ae not found: ID does not exist" Jun 03 21:08:30.247449 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.247393 2557 scope.go:117] "RemoveContainer" containerID="edbac0d9d411d1a685c5d5ee9cb48ddebc8ab11e233926a475ce9b2923c1738e" Jun 03 21:08:30.247601 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.247583 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edbac0d9d411d1a685c5d5ee9cb48ddebc8ab11e233926a475ce9b2923c1738e"} err="failed to get container status \"edbac0d9d411d1a685c5d5ee9cb48ddebc8ab11e233926a475ce9b2923c1738e\": rpc error: code = NotFound desc = could not find container \"edbac0d9d411d1a685c5d5ee9cb48ddebc8ab11e233926a475ce9b2923c1738e\": container with ID starting with edbac0d9d411d1a685c5d5ee9cb48ddebc8ab11e233926a475ce9b2923c1738e not found: ID does not exist" Jun 03 21:08:30.247679 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.247601 2557 scope.go:117] "RemoveContainer" containerID="c25f41489a71ad819109e05a131268f88b5c3dd7549b7f7c31ca7a89d602480f" Jun 03 21:08:30.247800 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.247783 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c25f41489a71ad819109e05a131268f88b5c3dd7549b7f7c31ca7a89d602480f"} err="failed to get container status \"c25f41489a71ad819109e05a131268f88b5c3dd7549b7f7c31ca7a89d602480f\": rpc error: code = NotFound desc = could not find container \"c25f41489a71ad819109e05a131268f88b5c3dd7549b7f7c31ca7a89d602480f\": container with ID starting with c25f41489a71ad819109e05a131268f88b5c3dd7549b7f7c31ca7a89d602480f not found: ID does not exist" Jun 03 21:08:30.247896 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.247802 2557 scope.go:117] "RemoveContainer" containerID="62a52fcbb0b3a401d2502f40cb67b5b160f1c235cea54d86b7de4261af2650f2" Jun 03 21:08:30.248027 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.248008 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62a52fcbb0b3a401d2502f40cb67b5b160f1c235cea54d86b7de4261af2650f2"} err="failed to get container status \"62a52fcbb0b3a401d2502f40cb67b5b160f1c235cea54d86b7de4261af2650f2\": rpc error: code = NotFound desc = could not find container \"62a52fcbb0b3a401d2502f40cb67b5b160f1c235cea54d86b7de4261af2650f2\": container with ID starting with 62a52fcbb0b3a401d2502f40cb67b5b160f1c235cea54d86b7de4261af2650f2 not found: ID does not exist" Jun 03 21:08:30.248082 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.248029 2557 scope.go:117] "RemoveContainer" containerID="28107fe7ad238a82675d65984f46772e82a4a99c047698e69be34c2ab5469e8f" Jun 03 21:08:30.248300 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.248279 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28107fe7ad238a82675d65984f46772e82a4a99c047698e69be34c2ab5469e8f"} err="failed to get container status \"28107fe7ad238a82675d65984f46772e82a4a99c047698e69be34c2ab5469e8f\": rpc error: code = NotFound desc = could not find container \"28107fe7ad238a82675d65984f46772e82a4a99c047698e69be34c2ab5469e8f\": container with ID starting with 28107fe7ad238a82675d65984f46772e82a4a99c047698e69be34c2ab5469e8f not found: ID does not exist" Jun 03 21:08:30.248359 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.248301 2557 scope.go:117] "RemoveContainer" containerID="d1946e3f4fee294199c2aed8fc1efb73e1627906c0cc3ce540ab349e1a666cf0" Jun 03 21:08:30.248510 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.248495 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1946e3f4fee294199c2aed8fc1efb73e1627906c0cc3ce540ab349e1a666cf0"} err="failed to get container status \"d1946e3f4fee294199c2aed8fc1efb73e1627906c0cc3ce540ab349e1a666cf0\": rpc error: code = NotFound desc = could not find container \"d1946e3f4fee294199c2aed8fc1efb73e1627906c0cc3ce540ab349e1a666cf0\": container with ID starting with d1946e3f4fee294199c2aed8fc1efb73e1627906c0cc3ce540ab349e1a666cf0 not found: ID does not exist" Jun 03 21:08:30.248510 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.248509 2557 scope.go:117] "RemoveContainer" containerID="83f3117a83bf6aeb8baea04a7f7526d020512fe229bcb8ed1ef8882a74685db4" Jun 03 21:08:30.248774 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.248755 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83f3117a83bf6aeb8baea04a7f7526d020512fe229bcb8ed1ef8882a74685db4"} err="failed to get container status \"83f3117a83bf6aeb8baea04a7f7526d020512fe229bcb8ed1ef8882a74685db4\": rpc error: code = NotFound desc = could not find container \"83f3117a83bf6aeb8baea04a7f7526d020512fe229bcb8ed1ef8882a74685db4\": container with ID starting with 83f3117a83bf6aeb8baea04a7f7526d020512fe229bcb8ed1ef8882a74685db4 not found: ID does not exist" Jun 03 21:08:30.248831 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.248775 2557 scope.go:117] "RemoveContainer" containerID="6c3b3ee5e754d1d44b1b2ea29e333d7009ed26cc8216d60937f68d37de3897ae" Jun 03 21:08:30.248998 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.248979 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c3b3ee5e754d1d44b1b2ea29e333d7009ed26cc8216d60937f68d37de3897ae"} err="failed to get container status \"6c3b3ee5e754d1d44b1b2ea29e333d7009ed26cc8216d60937f68d37de3897ae\": rpc error: code = NotFound desc = could not find container \"6c3b3ee5e754d1d44b1b2ea29e333d7009ed26cc8216d60937f68d37de3897ae\": container with ID starting with 6c3b3ee5e754d1d44b1b2ea29e333d7009ed26cc8216d60937f68d37de3897ae not found: ID does not exist" Jun 03 21:08:30.249044 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.248998 2557 scope.go:117] "RemoveContainer" containerID="edbac0d9d411d1a685c5d5ee9cb48ddebc8ab11e233926a475ce9b2923c1738e" Jun 03 21:08:30.249210 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.249195 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edbac0d9d411d1a685c5d5ee9cb48ddebc8ab11e233926a475ce9b2923c1738e"} err="failed to get container status \"edbac0d9d411d1a685c5d5ee9cb48ddebc8ab11e233926a475ce9b2923c1738e\": rpc error: code = NotFound desc = could not find container \"edbac0d9d411d1a685c5d5ee9cb48ddebc8ab11e233926a475ce9b2923c1738e\": container with ID starting with edbac0d9d411d1a685c5d5ee9cb48ddebc8ab11e233926a475ce9b2923c1738e not found: ID does not exist" Jun 03 21:08:30.254835 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.254809 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 21:08:30.264680 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.264653 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0a9ce13-0d44-473d-94f6-2542dd4501e0" path="/var/lib/kubelet/pods/a0a9ce13-0d44-473d-94f6-2542dd4501e0/volumes" Jun 03 21:08:30.314049 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.313943 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c8ce378c-453d-4cbf-a0fa-ca393dee609b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.314228 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.314204 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c8ce378c-453d-4cbf-a0fa-ca393dee609b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.314303 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.314252 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c8ce378c-453d-4cbf-a0fa-ca393dee609b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.314303 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.314276 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c8ce378c-453d-4cbf-a0fa-ca393dee609b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.314422 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.314308 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c8ce378c-453d-4cbf-a0fa-ca393dee609b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.314422 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.314375 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c8ce378c-453d-4cbf-a0fa-ca393dee609b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.314522 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.314480 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c8ce378c-453d-4cbf-a0fa-ca393dee609b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.314522 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.314508 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5vwp\" (UniqueName: \"kubernetes.io/projected/c8ce378c-453d-4cbf-a0fa-ca393dee609b-kube-api-access-z5vwp\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.314762 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.314699 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c8ce378c-453d-4cbf-a0fa-ca393dee609b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.314895 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.314841 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8ce378c-453d-4cbf-a0fa-ca393dee609b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.314958 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.314903 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c8ce378c-453d-4cbf-a0fa-ca393dee609b-config-out\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.314958 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.314936 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c8ce378c-453d-4cbf-a0fa-ca393dee609b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.315057 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.314964 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c8ce378c-453d-4cbf-a0fa-ca393dee609b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.315057 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.315048 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c8ce378c-453d-4cbf-a0fa-ca393dee609b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.315163 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.315131 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8ce378c-453d-4cbf-a0fa-ca393dee609b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.315163 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.315160 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c8ce378c-453d-4cbf-a0fa-ca393dee609b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.315269 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.315253 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8ce378c-453d-4cbf-a0fa-ca393dee609b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.315302 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.315276 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c8ce378c-453d-4cbf-a0fa-ca393dee609b-web-config\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.315346 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.315302 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c8ce378c-453d-4cbf-a0fa-ca393dee609b-config\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.315346 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.315319 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8ce378c-453d-4cbf-a0fa-ca393dee609b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.416049 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.416019 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c8ce378c-453d-4cbf-a0fa-ca393dee609b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.416049 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.416053 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8ce378c-453d-4cbf-a0fa-ca393dee609b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.416270 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.416074 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c8ce378c-453d-4cbf-a0fa-ca393dee609b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.416270 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.416099 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8ce378c-453d-4cbf-a0fa-ca393dee609b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.416270 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.416127 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c8ce378c-453d-4cbf-a0fa-ca393dee609b-web-config\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.416270 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.416153 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c8ce378c-453d-4cbf-a0fa-ca393dee609b-config\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.416270 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.416175 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8ce378c-453d-4cbf-a0fa-ca393dee609b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.416270 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.416220 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c8ce378c-453d-4cbf-a0fa-ca393dee609b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.416270 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.416251 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c8ce378c-453d-4cbf-a0fa-ca393dee609b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.416760 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.416283 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c8ce378c-453d-4cbf-a0fa-ca393dee609b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.416760 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.416306 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c8ce378c-453d-4cbf-a0fa-ca393dee609b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.416760 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.416331 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c8ce378c-453d-4cbf-a0fa-ca393dee609b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.416760 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.416366 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c8ce378c-453d-4cbf-a0fa-ca393dee609b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.416760 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.416399 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c8ce378c-453d-4cbf-a0fa-ca393dee609b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.416760 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.416427 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5vwp\" (UniqueName: \"kubernetes.io/projected/c8ce378c-453d-4cbf-a0fa-ca393dee609b-kube-api-access-z5vwp\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.416760 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.416475 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c8ce378c-453d-4cbf-a0fa-ca393dee609b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.416760 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.416499 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8ce378c-453d-4cbf-a0fa-ca393dee609b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.416760 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.416524 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c8ce378c-453d-4cbf-a0fa-ca393dee609b-config-out\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.416760 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.416549 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c8ce378c-453d-4cbf-a0fa-ca393dee609b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.416760 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.416575 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c8ce378c-453d-4cbf-a0fa-ca393dee609b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.417287 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.416950 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8ce378c-453d-4cbf-a0fa-ca393dee609b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.417287 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.417087 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c8ce378c-453d-4cbf-a0fa-ca393dee609b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.417287 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.417177 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8ce378c-453d-4cbf-a0fa-ca393dee609b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.417287 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.417282 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c8ce378c-453d-4cbf-a0fa-ca393dee609b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.417622 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.417594 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8ce378c-453d-4cbf-a0fa-ca393dee609b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.417949 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.417851 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8ce378c-453d-4cbf-a0fa-ca393dee609b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.419320 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.419288 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c8ce378c-453d-4cbf-a0fa-ca393dee609b-web-config\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.419428 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.419321 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c8ce378c-453d-4cbf-a0fa-ca393dee609b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.419486 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.419449 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c8ce378c-453d-4cbf-a0fa-ca393dee609b-config\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.419835 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.419809 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c8ce378c-453d-4cbf-a0fa-ca393dee609b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.419929 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.419869 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c8ce378c-453d-4cbf-a0fa-ca393dee609b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.419929 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.419879 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c8ce378c-453d-4cbf-a0fa-ca393dee609b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.420050 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.419943 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c8ce378c-453d-4cbf-a0fa-ca393dee609b-config-out\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.420914 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.420885 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c8ce378c-453d-4cbf-a0fa-ca393dee609b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.421017 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.420994 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c8ce378c-453d-4cbf-a0fa-ca393dee609b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.421681 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.421660 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c8ce378c-453d-4cbf-a0fa-ca393dee609b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.421946 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.421927 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c8ce378c-453d-4cbf-a0fa-ca393dee609b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.422447 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.422430 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c8ce378c-453d-4cbf-a0fa-ca393dee609b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.422720 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.422688 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c8ce378c-453d-4cbf-a0fa-ca393dee609b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.425984 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.425966 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5vwp\" (UniqueName: \"kubernetes.io/projected/c8ce378c-453d-4cbf-a0fa-ca393dee609b-kube-api-access-z5vwp\") pod \"prometheus-k8s-0\" (UID: \"c8ce378c-453d-4cbf-a0fa-ca393dee609b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.548041 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.547990 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:08:30.703124 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:30.703097 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 21:08:30.704832 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:08:30.704803 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8ce378c_453d_4cbf_a0fa_ca393dee609b.slice/crio-3fe938cdc11bcd79d73f9c23f46da25b1e758ca60e51d5411d10f445f29f89e0 WatchSource:0}: Error finding container 3fe938cdc11bcd79d73f9c23f46da25b1e758ca60e51d5411d10f445f29f89e0: Status 404 returned error can't find the container with id 3fe938cdc11bcd79d73f9c23f46da25b1e758ca60e51d5411d10f445f29f89e0 Jun 03 21:08:31.183373 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:31.183333 2557 generic.go:356] "Generic (PLEG): container finished" podID="c8ce378c-453d-4cbf-a0fa-ca393dee609b" containerID="687659de7ef5d6e71ddde3001851f1fad260220c726710ddaa5f9d273516edb6" exitCode=0 Jun 03 21:08:31.183912 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:31.183387 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c8ce378c-453d-4cbf-a0fa-ca393dee609b","Type":"ContainerDied","Data":"687659de7ef5d6e71ddde3001851f1fad260220c726710ddaa5f9d273516edb6"} Jun 03 21:08:31.183912 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:31.183467 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c8ce378c-453d-4cbf-a0fa-ca393dee609b","Type":"ContainerStarted","Data":"3fe938cdc11bcd79d73f9c23f46da25b1e758ca60e51d5411d10f445f29f89e0"} Jun 03 21:08:32.189787 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:32.189743 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b574787c-j86r4" event={"ID":"25abc8cb-486f-43ca-9217-e129dc4f8e4f","Type":"ContainerStarted","Data":"76ef17bda90a16a8c45525651254bdf0eec1a7cbd839ff209fff48cbf42ec659"} Jun 03 21:08:32.190270 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:32.189814 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b574787c-j86r4" event={"ID":"25abc8cb-486f-43ca-9217-e129dc4f8e4f","Type":"ContainerStarted","Data":"4783437da7207791eb2eff85a63faebed0d44c08d490e010214e89df3d68957d"} Jun 03 21:08:32.190270 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:32.189843 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b574787c-j86r4" event={"ID":"25abc8cb-486f-43ca-9217-e129dc4f8e4f","Type":"ContainerStarted","Data":"7568bfd6e160d8124491a5b3bd47995cf7550ae2bec3571bbb274c59730c8da6"} Jun 03 21:08:32.192996 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:32.192972 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c8ce378c-453d-4cbf-a0fa-ca393dee609b","Type":"ContainerStarted","Data":"d9c6e8a39bb797e9570cb7ee000e9f49416d1d419eb3bf883af1282e15582638"} Jun 03 21:08:32.193099 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:32.193028 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c8ce378c-453d-4cbf-a0fa-ca393dee609b","Type":"ContainerStarted","Data":"c837b13d259131ea1d90a2ae9738ab4c6c819b9e8e2a823de6ebb0b40353a979"} Jun 03 21:08:32.193099 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:32.193055 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c8ce378c-453d-4cbf-a0fa-ca393dee609b","Type":"ContainerStarted","Data":"0eb8a2119546f938892fe721f1a737423735a618387ba693ddb41078b0540a31"} Jun 03 21:08:32.193099 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:32.193083 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c8ce378c-453d-4cbf-a0fa-ca393dee609b","Type":"ContainerStarted","Data":"a9acadd7b8741da43bcebe16dc953f94f1bd98dfbd58c6cd3eba37d4bf9b0087"} Jun 03 21:08:32.193215 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:32.193106 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c8ce378c-453d-4cbf-a0fa-ca393dee609b","Type":"ContainerStarted","Data":"4b3c194dec2c93be0383fff96b253c2ccd75eb2c7394549d224d459d439ec76b"} Jun 03 21:08:32.193215 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:32.193131 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c8ce378c-453d-4cbf-a0fa-ca393dee609b","Type":"ContainerStarted","Data":"b1e9ecbedf00611a51fb0ec1eaab753049108b687882720be27cd79e366ecd58"} Jun 03 21:08:32.212000 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:32.211946 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5b574787c-j86r4" podStartSLOduration=1.303775927 podStartE2EDuration="3.211927258s" totalImagesPullingTime="1.908151331s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:08:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:08:32.210012557 +0000 UTC m=+150.366190704" watchObservedRunningTime="2026-06-03 21:08:32.211927258 +0000 UTC m=+150.368105405" Jun 03 21:08:32.250191 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:32.250143 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.228081629 podStartE2EDuration="2.250126946s" totalImagesPullingTime="0s" totalInitContainerRuntime="22.045317ms" isStatefulPod=false podCreationTimestamp="2026-06-03 21:08:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:08:32.249882445 +0000 UTC m=+150.406060594" watchObservedRunningTime="2026-06-03 21:08:32.250126946 +0000 UTC m=+150.406305093" Jun 03 21:08:35.549036 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:08:35.548982 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:09:30.549000 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:09:30.548952 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:09:30.564870 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:09:30.564844 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:09:31.456031 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:09:31.456001 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 21:11:02.217022 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:02.216988 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjpv5_c606d039-59f8-4cc1-90d3-6ffdae5639ea/ovn-acl-logging/0.log" Jun 03 21:11:02.219367 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:02.219342 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjpv5_c606d039-59f8-4cc1-90d3-6ffdae5639ea/ovn-acl-logging/0.log" Jun 03 21:11:02.222869 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:02.222848 2557 kubelet.go:1648] "Image garbage collection succeeded" Jun 03 21:11:16.849452 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:16.849416 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-cqvdq"] Jun 03 21:11:16.851430 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:16.851414 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-cqvdq" Jun 03 21:11:16.853620 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:16.853594 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 03 21:11:16.853759 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:16.853634 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 03 21:11:16.853759 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:16.853644 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-zxxj7\"" Jun 03 21:11:16.862348 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:16.862300 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-cqvdq"] Jun 03 21:11:16.967105 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:16.967066 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e2944277-de02-47c3-954b-38ed3d7531bb-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-cqvdq\" (UID: \"e2944277-de02-47c3-954b-38ed3d7531bb\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-cqvdq" Jun 03 21:11:16.967280 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:16.967118 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8p8z\" (UniqueName: \"kubernetes.io/projected/e2944277-de02-47c3-954b-38ed3d7531bb-kube-api-access-t8p8z\") pod \"cert-manager-webhook-7dc76cbb94-cqvdq\" (UID: \"e2944277-de02-47c3-954b-38ed3d7531bb\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-cqvdq" Jun 03 21:11:17.068090 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:17.068033 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e2944277-de02-47c3-954b-38ed3d7531bb-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-cqvdq\" (UID: \"e2944277-de02-47c3-954b-38ed3d7531bb\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-cqvdq" Jun 03 21:11:17.068300 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:17.068106 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8p8z\" (UniqueName: \"kubernetes.io/projected/e2944277-de02-47c3-954b-38ed3d7531bb-kube-api-access-t8p8z\") pod \"cert-manager-webhook-7dc76cbb94-cqvdq\" (UID: \"e2944277-de02-47c3-954b-38ed3d7531bb\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-cqvdq" Jun 03 21:11:17.077139 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:17.077113 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e2944277-de02-47c3-954b-38ed3d7531bb-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-cqvdq\" (UID: \"e2944277-de02-47c3-954b-38ed3d7531bb\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-cqvdq" Jun 03 21:11:17.077391 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:17.077369 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8p8z\" (UniqueName: \"kubernetes.io/projected/e2944277-de02-47c3-954b-38ed3d7531bb-kube-api-access-t8p8z\") pod \"cert-manager-webhook-7dc76cbb94-cqvdq\" (UID: \"e2944277-de02-47c3-954b-38ed3d7531bb\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-cqvdq" Jun 03 21:11:17.170736 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:17.170619 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-cqvdq" Jun 03 21:11:17.306625 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:17.306593 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-cqvdq"] Jun 03 21:11:17.310144 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:11:17.310113 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode2944277_de02_47c3_954b_38ed3d7531bb.slice/crio-a59c2384df8d2b0d241d86383e34c32edb8ef04a90f0d43a0ff45c74e4b62c22 WatchSource:0}: Error finding container a59c2384df8d2b0d241d86383e34c32edb8ef04a90f0d43a0ff45c74e4b62c22: Status 404 returned error can't find the container with id a59c2384df8d2b0d241d86383e34c32edb8ef04a90f0d43a0ff45c74e4b62c22 Jun 03 21:11:17.315984 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:17.315961 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 21:11:17.871509 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:17.871472 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-cqvdq" event={"ID":"e2944277-de02-47c3-954b-38ed3d7531bb","Type":"ContainerStarted","Data":"a59c2384df8d2b0d241d86383e34c32edb8ef04a90f0d43a0ff45c74e4b62c22"} Jun 03 21:11:19.410214 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:19.410180 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-2rg5q"] Jun 03 21:11:19.413822 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:19.413792 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-2rg5q" Jun 03 21:11:19.417005 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:19.416978 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-bjhnx\"" Jun 03 21:11:19.423191 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:19.423156 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-2rg5q"] Jun 03 21:11:19.590424 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:19.590387 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czjv9\" (UniqueName: \"kubernetes.io/projected/0b5f218c-3d79-4f06-a3a1-6f24be0e23cc-kube-api-access-czjv9\") pod \"cert-manager-cainjector-5d99449ffd-2rg5q\" (UID: \"0b5f218c-3d79-4f06-a3a1-6f24be0e23cc\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-2rg5q" Jun 03 21:11:19.590588 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:19.590434 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0b5f218c-3d79-4f06-a3a1-6f24be0e23cc-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-2rg5q\" (UID: \"0b5f218c-3d79-4f06-a3a1-6f24be0e23cc\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-2rg5q" Jun 03 21:11:19.691199 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:19.691157 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0b5f218c-3d79-4f06-a3a1-6f24be0e23cc-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-2rg5q\" (UID: \"0b5f218c-3d79-4f06-a3a1-6f24be0e23cc\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-2rg5q" Jun 03 21:11:19.691389 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:19.691288 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czjv9\" (UniqueName: \"kubernetes.io/projected/0b5f218c-3d79-4f06-a3a1-6f24be0e23cc-kube-api-access-czjv9\") pod \"cert-manager-cainjector-5d99449ffd-2rg5q\" (UID: \"0b5f218c-3d79-4f06-a3a1-6f24be0e23cc\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-2rg5q" Jun 03 21:11:19.700831 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:19.700801 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0b5f218c-3d79-4f06-a3a1-6f24be0e23cc-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-2rg5q\" (UID: \"0b5f218c-3d79-4f06-a3a1-6f24be0e23cc\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-2rg5q" Jun 03 21:11:19.701039 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:19.700944 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czjv9\" (UniqueName: \"kubernetes.io/projected/0b5f218c-3d79-4f06-a3a1-6f24be0e23cc-kube-api-access-czjv9\") pod \"cert-manager-cainjector-5d99449ffd-2rg5q\" (UID: \"0b5f218c-3d79-4f06-a3a1-6f24be0e23cc\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-2rg5q" Jun 03 21:11:19.728818 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:19.728784 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-2rg5q" Jun 03 21:11:20.568272 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:20.568248 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-2rg5q"] Jun 03 21:11:20.570550 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:11:20.570523 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0b5f218c_3d79_4f06_a3a1_6f24be0e23cc.slice/crio-bb23812188d22229f423feed249cb6f1031e4d0180faa58891c2f271dac026b3 WatchSource:0}: Error finding container bb23812188d22229f423feed249cb6f1031e4d0180faa58891c2f271dac026b3: Status 404 returned error can't find the container with id bb23812188d22229f423feed249cb6f1031e4d0180faa58891c2f271dac026b3 Jun 03 21:11:20.887292 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:20.887193 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-2rg5q" event={"ID":"0b5f218c-3d79-4f06-a3a1-6f24be0e23cc","Type":"ContainerStarted","Data":"1b66c86275968098583f17ef4d86238b2a0dd2c6324ab78c307d0dbebe7ec06c"} Jun 03 21:11:20.887292 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:20.887242 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-2rg5q" event={"ID":"0b5f218c-3d79-4f06-a3a1-6f24be0e23cc","Type":"ContainerStarted","Data":"bb23812188d22229f423feed249cb6f1031e4d0180faa58891c2f271dac026b3"} Jun 03 21:11:20.888844 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:20.888811 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-cqvdq" event={"ID":"e2944277-de02-47c3-954b-38ed3d7531bb","Type":"ContainerStarted","Data":"1bd1d36fced0530d69f47690b2d7d92a696cf0266900b559e06b696e5fe153c9"} Jun 03 21:11:20.888982 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:20.888924 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-cqvdq" Jun 03 21:11:20.902566 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:20.902515 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-2rg5q" podStartSLOduration=1.902498906 podStartE2EDuration="1.902498906s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:11:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:11:20.901241867 +0000 UTC m=+319.057420029" watchObservedRunningTime="2026-06-03 21:11:20.902498906 +0000 UTC m=+319.058677053" Jun 03 21:11:20.915186 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:20.915127 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-cqvdq" podStartSLOduration=1.75936426 podStartE2EDuration="4.915112388s" totalImagesPullingTime="3.155748128s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:11:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:11:20.91489582 +0000 UTC m=+319.071073968" watchObservedRunningTime="2026-06-03 21:11:20.915112388 +0000 UTC m=+319.071290538" Jun 03 21:11:26.895163 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:26.895126 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-cqvdq" Jun 03 21:11:41.854764 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:41.854728 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c44b6dfcc-wglm6"] Jun 03 21:11:41.859228 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:41.859205 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5c44b6dfcc-wglm6" Jun 03 21:11:41.861643 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:41.861622 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 03 21:11:41.862226 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:41.862212 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 03 21:11:41.862301 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:41.862222 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 03 21:11:41.862365 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:41.862324 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 03 21:11:41.862410 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:41.862359 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-d455l\"" Jun 03 21:11:41.862586 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:41.862572 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 03 21:11:41.868088 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:41.867722 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c44b6dfcc-wglm6"] Jun 03 21:11:41.886060 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:41.886029 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/377f1170-3361-4026-b8a1-219997ee12a2-manager-config\") pod \"lws-controller-manager-5c44b6dfcc-wglm6\" (UID: \"377f1170-3361-4026-b8a1-219997ee12a2\") " pod="openshift-lws-operator/lws-controller-manager-5c44b6dfcc-wglm6" Jun 03 21:11:41.886227 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:41.886088 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/377f1170-3361-4026-b8a1-219997ee12a2-cert\") pod \"lws-controller-manager-5c44b6dfcc-wglm6\" (UID: \"377f1170-3361-4026-b8a1-219997ee12a2\") " pod="openshift-lws-operator/lws-controller-manager-5c44b6dfcc-wglm6" Jun 03 21:11:41.886227 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:41.886115 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwdxx\" (UniqueName: \"kubernetes.io/projected/377f1170-3361-4026-b8a1-219997ee12a2-kube-api-access-zwdxx\") pod \"lws-controller-manager-5c44b6dfcc-wglm6\" (UID: \"377f1170-3361-4026-b8a1-219997ee12a2\") " pod="openshift-lws-operator/lws-controller-manager-5c44b6dfcc-wglm6" Jun 03 21:11:41.886227 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:41.886149 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/377f1170-3361-4026-b8a1-219997ee12a2-metrics-cert\") pod \"lws-controller-manager-5c44b6dfcc-wglm6\" (UID: \"377f1170-3361-4026-b8a1-219997ee12a2\") " pod="openshift-lws-operator/lws-controller-manager-5c44b6dfcc-wglm6" Jun 03 21:11:41.987424 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:41.987387 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/377f1170-3361-4026-b8a1-219997ee12a2-cert\") pod \"lws-controller-manager-5c44b6dfcc-wglm6\" (UID: \"377f1170-3361-4026-b8a1-219997ee12a2\") " pod="openshift-lws-operator/lws-controller-manager-5c44b6dfcc-wglm6" Jun 03 21:11:41.987424 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:41.987419 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwdxx\" (UniqueName: \"kubernetes.io/projected/377f1170-3361-4026-b8a1-219997ee12a2-kube-api-access-zwdxx\") pod \"lws-controller-manager-5c44b6dfcc-wglm6\" (UID: \"377f1170-3361-4026-b8a1-219997ee12a2\") " pod="openshift-lws-operator/lws-controller-manager-5c44b6dfcc-wglm6" Jun 03 21:11:41.987668 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:41.987458 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/377f1170-3361-4026-b8a1-219997ee12a2-metrics-cert\") pod \"lws-controller-manager-5c44b6dfcc-wglm6\" (UID: \"377f1170-3361-4026-b8a1-219997ee12a2\") " pod="openshift-lws-operator/lws-controller-manager-5c44b6dfcc-wglm6" Jun 03 21:11:41.987668 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:41.987537 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/377f1170-3361-4026-b8a1-219997ee12a2-manager-config\") pod \"lws-controller-manager-5c44b6dfcc-wglm6\" (UID: \"377f1170-3361-4026-b8a1-219997ee12a2\") " pod="openshift-lws-operator/lws-controller-manager-5c44b6dfcc-wglm6" Jun 03 21:11:41.988210 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:41.988186 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/377f1170-3361-4026-b8a1-219997ee12a2-manager-config\") pod \"lws-controller-manager-5c44b6dfcc-wglm6\" (UID: \"377f1170-3361-4026-b8a1-219997ee12a2\") " pod="openshift-lws-operator/lws-controller-manager-5c44b6dfcc-wglm6" Jun 03 21:11:41.989922 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:41.989892 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/377f1170-3361-4026-b8a1-219997ee12a2-metrics-cert\") pod \"lws-controller-manager-5c44b6dfcc-wglm6\" (UID: \"377f1170-3361-4026-b8a1-219997ee12a2\") " pod="openshift-lws-operator/lws-controller-manager-5c44b6dfcc-wglm6" Jun 03 21:11:41.990033 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:41.989970 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/377f1170-3361-4026-b8a1-219997ee12a2-cert\") pod \"lws-controller-manager-5c44b6dfcc-wglm6\" (UID: \"377f1170-3361-4026-b8a1-219997ee12a2\") " pod="openshift-lws-operator/lws-controller-manager-5c44b6dfcc-wglm6" Jun 03 21:11:42.001660 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:42.001630 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwdxx\" (UniqueName: \"kubernetes.io/projected/377f1170-3361-4026-b8a1-219997ee12a2-kube-api-access-zwdxx\") pod \"lws-controller-manager-5c44b6dfcc-wglm6\" (UID: \"377f1170-3361-4026-b8a1-219997ee12a2\") " pod="openshift-lws-operator/lws-controller-manager-5c44b6dfcc-wglm6" Jun 03 21:11:42.170938 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:42.170847 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5c44b6dfcc-wglm6" Jun 03 21:11:42.324222 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:42.324064 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c44b6dfcc-wglm6"] Jun 03 21:11:42.327129 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:11:42.327094 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod377f1170_3361_4026_b8a1_219997ee12a2.slice/crio-2ca4dec1c614a796d5637d0201c6bb1b21afe63193913640ca8f396cdd3dc107 WatchSource:0}: Error finding container 2ca4dec1c614a796d5637d0201c6bb1b21afe63193913640ca8f396cdd3dc107: Status 404 returned error can't find the container with id 2ca4dec1c614a796d5637d0201c6bb1b21afe63193913640ca8f396cdd3dc107 Jun 03 21:11:42.984182 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:42.984140 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5c44b6dfcc-wglm6" event={"ID":"377f1170-3361-4026-b8a1-219997ee12a2","Type":"ContainerStarted","Data":"2ca4dec1c614a796d5637d0201c6bb1b21afe63193913640ca8f396cdd3dc107"} Jun 03 21:11:45.998682 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:45.998639 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5c44b6dfcc-wglm6" event={"ID":"377f1170-3361-4026-b8a1-219997ee12a2","Type":"ContainerStarted","Data":"966b93f3b793e3cae2b85369230a985a8cf021f84bdccaeb814fe11631a31656"} Jun 03 21:11:45.999169 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:45.998755 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5c44b6dfcc-wglm6" Jun 03 21:11:46.026580 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:46.026514 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5c44b6dfcc-wglm6" podStartSLOduration=2.375267537 podStartE2EDuration="5.026494632s" totalImagesPullingTime="2.651227095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:11:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:11:46.025258398 +0000 UTC m=+344.181436546" watchObservedRunningTime="2026-06-03 21:11:46.026494632 +0000 UTC m=+344.182672783" Jun 03 21:11:46.467383 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:46.467351 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6868fcfdd5-bb8c7"] Jun 03 21:11:46.470061 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:46.470040 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6868fcfdd5-bb8c7" Jun 03 21:11:46.472864 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:46.472837 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 03 21:11:46.472864 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:46.472853 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 03 21:11:46.473060 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:46.472906 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7kmr5\"" Jun 03 21:11:46.473060 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:46.472926 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 03 21:11:46.473252 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:46.473237 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 03 21:11:46.492693 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:46.492666 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6868fcfdd5-bb8c7"] Jun 03 21:11:46.528827 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:46.528789 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/189872e0-5517-4998-95ba-062e640af892-manifests\") pod \"opendatahub-operator-controller-manager-6868fcfdd5-bb8c7\" (UID: \"189872e0-5517-4998-95ba-062e640af892\") " pod="opendatahub/opendatahub-operator-controller-manager-6868fcfdd5-bb8c7" Jun 03 21:11:46.528827 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:46.528826 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/189872e0-5517-4998-95ba-062e640af892-tmp\") pod \"opendatahub-operator-controller-manager-6868fcfdd5-bb8c7\" (UID: \"189872e0-5517-4998-95ba-062e640af892\") " pod="opendatahub/opendatahub-operator-controller-manager-6868fcfdd5-bb8c7" Jun 03 21:11:46.529080 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:46.528921 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/189872e0-5517-4998-95ba-062e640af892-webhook-cert\") pod \"opendatahub-operator-controller-manager-6868fcfdd5-bb8c7\" (UID: \"189872e0-5517-4998-95ba-062e640af892\") " pod="opendatahub/opendatahub-operator-controller-manager-6868fcfdd5-bb8c7" Jun 03 21:11:46.529080 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:46.528942 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzdpj\" (UniqueName: \"kubernetes.io/projected/189872e0-5517-4998-95ba-062e640af892-kube-api-access-kzdpj\") pod \"opendatahub-operator-controller-manager-6868fcfdd5-bb8c7\" (UID: \"189872e0-5517-4998-95ba-062e640af892\") " pod="opendatahub/opendatahub-operator-controller-manager-6868fcfdd5-bb8c7" Jun 03 21:11:46.529080 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:46.528967 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/189872e0-5517-4998-95ba-062e640af892-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6868fcfdd5-bb8c7\" (UID: \"189872e0-5517-4998-95ba-062e640af892\") " pod="opendatahub/opendatahub-operator-controller-manager-6868fcfdd5-bb8c7" Jun 03 21:11:46.630289 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:46.630246 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/189872e0-5517-4998-95ba-062e640af892-manifests\") pod \"opendatahub-operator-controller-manager-6868fcfdd5-bb8c7\" (UID: \"189872e0-5517-4998-95ba-062e640af892\") " pod="opendatahub/opendatahub-operator-controller-manager-6868fcfdd5-bb8c7" Jun 03 21:11:46.630289 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:46.630290 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/189872e0-5517-4998-95ba-062e640af892-tmp\") pod \"opendatahub-operator-controller-manager-6868fcfdd5-bb8c7\" (UID: \"189872e0-5517-4998-95ba-062e640af892\") " pod="opendatahub/opendatahub-operator-controller-manager-6868fcfdd5-bb8c7" Jun 03 21:11:46.630556 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:46.630342 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/189872e0-5517-4998-95ba-062e640af892-webhook-cert\") pod \"opendatahub-operator-controller-manager-6868fcfdd5-bb8c7\" (UID: \"189872e0-5517-4998-95ba-062e640af892\") " pod="opendatahub/opendatahub-operator-controller-manager-6868fcfdd5-bb8c7" Jun 03 21:11:46.630556 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:46.630361 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzdpj\" (UniqueName: \"kubernetes.io/projected/189872e0-5517-4998-95ba-062e640af892-kube-api-access-kzdpj\") pod \"opendatahub-operator-controller-manager-6868fcfdd5-bb8c7\" (UID: \"189872e0-5517-4998-95ba-062e640af892\") " pod="opendatahub/opendatahub-operator-controller-manager-6868fcfdd5-bb8c7" Jun 03 21:11:46.630556 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:46.630380 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/189872e0-5517-4998-95ba-062e640af892-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6868fcfdd5-bb8c7\" (UID: \"189872e0-5517-4998-95ba-062e640af892\") " pod="opendatahub/opendatahub-operator-controller-manager-6868fcfdd5-bb8c7" Jun 03 21:11:46.630754 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:46.630665 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/189872e0-5517-4998-95ba-062e640af892-manifests\") pod \"opendatahub-operator-controller-manager-6868fcfdd5-bb8c7\" (UID: \"189872e0-5517-4998-95ba-062e640af892\") " pod="opendatahub/opendatahub-operator-controller-manager-6868fcfdd5-bb8c7" Jun 03 21:11:46.632765 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:46.632735 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/189872e0-5517-4998-95ba-062e640af892-tmp\") pod \"opendatahub-operator-controller-manager-6868fcfdd5-bb8c7\" (UID: \"189872e0-5517-4998-95ba-062e640af892\") " pod="opendatahub/opendatahub-operator-controller-manager-6868fcfdd5-bb8c7" Jun 03 21:11:46.632910 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:46.632894 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/189872e0-5517-4998-95ba-062e640af892-webhook-cert\") pod \"opendatahub-operator-controller-manager-6868fcfdd5-bb8c7\" (UID: \"189872e0-5517-4998-95ba-062e640af892\") " pod="opendatahub/opendatahub-operator-controller-manager-6868fcfdd5-bb8c7" Jun 03 21:11:46.633035 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:46.633016 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/189872e0-5517-4998-95ba-062e640af892-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6868fcfdd5-bb8c7\" (UID: \"189872e0-5517-4998-95ba-062e640af892\") " pod="opendatahub/opendatahub-operator-controller-manager-6868fcfdd5-bb8c7" Jun 03 21:11:46.638739 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:46.638692 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzdpj\" (UniqueName: \"kubernetes.io/projected/189872e0-5517-4998-95ba-062e640af892-kube-api-access-kzdpj\") pod \"opendatahub-operator-controller-manager-6868fcfdd5-bb8c7\" (UID: \"189872e0-5517-4998-95ba-062e640af892\") " pod="opendatahub/opendatahub-operator-controller-manager-6868fcfdd5-bb8c7" Jun 03 21:11:46.780823 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:46.780734 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6868fcfdd5-bb8c7" Jun 03 21:11:46.941289 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:46.941197 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6868fcfdd5-bb8c7"] Jun 03 21:11:46.943728 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:11:46.943683 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod189872e0_5517_4998_95ba_062e640af892.slice/crio-84575eb2060724b3ff2ec8c13de29a43613484e83b5e4e6848090c69e0114d14 WatchSource:0}: Error finding container 84575eb2060724b3ff2ec8c13de29a43613484e83b5e4e6848090c69e0114d14: Status 404 returned error can't find the container with id 84575eb2060724b3ff2ec8c13de29a43613484e83b5e4e6848090c69e0114d14 Jun 03 21:11:47.004206 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:47.004169 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6868fcfdd5-bb8c7" event={"ID":"189872e0-5517-4998-95ba-062e640af892","Type":"ContainerStarted","Data":"84575eb2060724b3ff2ec8c13de29a43613484e83b5e4e6848090c69e0114d14"} Jun 03 21:11:50.021554 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:50.021442 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6868fcfdd5-bb8c7" event={"ID":"189872e0-5517-4998-95ba-062e640af892","Type":"ContainerStarted","Data":"3da37c94e836ce2b1af343bf31428039f15e74e18ad974c90d3b6418618b3913"} Jun 03 21:11:51.027055 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:51.026966 2557 generic.go:356] "Generic (PLEG): container finished" podID="189872e0-5517-4998-95ba-062e640af892" containerID="3da37c94e836ce2b1af343bf31428039f15e74e18ad974c90d3b6418618b3913" exitCode=0 Jun 03 21:11:51.027055 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:51.027014 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6868fcfdd5-bb8c7" event={"ID":"189872e0-5517-4998-95ba-062e640af892","Type":"ContainerDied","Data":"3da37c94e836ce2b1af343bf31428039f15e74e18ad974c90d3b6418618b3913"} Jun 03 21:11:52.033371 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:52.033341 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6868fcfdd5-bb8c7" event={"ID":"189872e0-5517-4998-95ba-062e640af892","Type":"ContainerStarted","Data":"15c617b097c5ed897dde667b7c8f385a75d6e53da68ca5a159b43c69f75085a5"} Jun 03 21:11:52.033808 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:52.033459 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6868fcfdd5-bb8c7" Jun 03 21:11:52.053554 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:52.053493 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6868fcfdd5-bb8c7" podStartSLOduration=1.9754653709999999 podStartE2EDuration="6.05347081s" totalImagesPullingTime="3.083707849s" totalInitContainerRuntime="994.29759ms" isStatefulPod=false podCreationTimestamp="2026-06-03 21:11:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:11:52.051281299 +0000 UTC m=+350.207459460" watchObservedRunningTime="2026-06-03 21:11:52.05347081 +0000 UTC m=+350.209648961" Jun 03 21:11:57.006062 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:11:57.006032 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5c44b6dfcc-wglm6" Jun 03 21:12:03.040257 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:12:03.040222 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6868fcfdd5-bb8c7" Jun 03 21:12:05.537530 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:12:05.537495 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5f9b999fdd-z5fzq"] Jun 03 21:12:05.551403 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:12:05.551377 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f9b999fdd-z5fzq" Jun 03 21:12:05.552473 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:12:05.552442 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f9b999fdd-z5fzq"] Jun 03 21:12:05.553787 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:12:05.553761 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 03 21:12:05.554471 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:12:05.554444 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 21:12:05.554574 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:12:05.554480 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 03 21:12:05.554574 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:12:05.554497 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-5c844\"" Jun 03 21:12:05.554858 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:12:05.554840 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 21:12:05.712895 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:12:05.712844 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c970cc01-615f-4257-9a9f-28328e2c16db-tls-certs\") pod \"kube-auth-proxy-5f9b999fdd-z5fzq\" (UID: \"c970cc01-615f-4257-9a9f-28328e2c16db\") " pod="openshift-ingress/kube-auth-proxy-5f9b999fdd-z5fzq" Jun 03 21:12:05.713078 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:12:05.712902 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c970cc01-615f-4257-9a9f-28328e2c16db-tmp\") pod \"kube-auth-proxy-5f9b999fdd-z5fzq\" (UID: \"c970cc01-615f-4257-9a9f-28328e2c16db\") " pod="openshift-ingress/kube-auth-proxy-5f9b999fdd-z5fzq" Jun 03 21:12:05.713078 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:12:05.713035 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z284p\" (UniqueName: \"kubernetes.io/projected/c970cc01-615f-4257-9a9f-28328e2c16db-kube-api-access-z284p\") pod \"kube-auth-proxy-5f9b999fdd-z5fzq\" (UID: \"c970cc01-615f-4257-9a9f-28328e2c16db\") " pod="openshift-ingress/kube-auth-proxy-5f9b999fdd-z5fzq" Jun 03 21:12:05.813830 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:12:05.813744 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c970cc01-615f-4257-9a9f-28328e2c16db-tls-certs\") pod \"kube-auth-proxy-5f9b999fdd-z5fzq\" (UID: \"c970cc01-615f-4257-9a9f-28328e2c16db\") " pod="openshift-ingress/kube-auth-proxy-5f9b999fdd-z5fzq" Jun 03 21:12:05.813830 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:12:05.813790 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c970cc01-615f-4257-9a9f-28328e2c16db-tmp\") pod \"kube-auth-proxy-5f9b999fdd-z5fzq\" (UID: \"c970cc01-615f-4257-9a9f-28328e2c16db\") " pod="openshift-ingress/kube-auth-proxy-5f9b999fdd-z5fzq" Jun 03 21:12:05.814011 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:12:05.813853 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z284p\" (UniqueName: \"kubernetes.io/projected/c970cc01-615f-4257-9a9f-28328e2c16db-kube-api-access-z284p\") pod \"kube-auth-proxy-5f9b999fdd-z5fzq\" (UID: \"c970cc01-615f-4257-9a9f-28328e2c16db\") " pod="openshift-ingress/kube-auth-proxy-5f9b999fdd-z5fzq" Jun 03 21:12:05.816332 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:12:05.816304 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c970cc01-615f-4257-9a9f-28328e2c16db-tls-certs\") pod \"kube-auth-proxy-5f9b999fdd-z5fzq\" (UID: \"c970cc01-615f-4257-9a9f-28328e2c16db\") " pod="openshift-ingress/kube-auth-proxy-5f9b999fdd-z5fzq" Jun 03 21:12:05.816466 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:12:05.816348 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c970cc01-615f-4257-9a9f-28328e2c16db-tmp\") pod \"kube-auth-proxy-5f9b999fdd-z5fzq\" (UID: \"c970cc01-615f-4257-9a9f-28328e2c16db\") " pod="openshift-ingress/kube-auth-proxy-5f9b999fdd-z5fzq" Jun 03 21:12:05.828417 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:12:05.828380 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z284p\" (UniqueName: \"kubernetes.io/projected/c970cc01-615f-4257-9a9f-28328e2c16db-kube-api-access-z284p\") pod \"kube-auth-proxy-5f9b999fdd-z5fzq\" (UID: \"c970cc01-615f-4257-9a9f-28328e2c16db\") " pod="openshift-ingress/kube-auth-proxy-5f9b999fdd-z5fzq" Jun 03 21:12:05.863561 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:12:05.863522 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f9b999fdd-z5fzq" Jun 03 21:12:06.007653 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:12:06.007585 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f9b999fdd-z5fzq"] Jun 03 21:12:06.010623 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:12:06.010596 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc970cc01_615f_4257_9a9f_28328e2c16db.slice/crio-26b10b51605daecb6fbbb534d999296eabee52f78141bb1bd68bd2517e04f5ea WatchSource:0}: Error finding container 26b10b51605daecb6fbbb534d999296eabee52f78141bb1bd68bd2517e04f5ea: Status 404 returned error can't find the container with id 26b10b51605daecb6fbbb534d999296eabee52f78141bb1bd68bd2517e04f5ea Jun 03 21:12:06.101259 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:12:06.101169 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f9b999fdd-z5fzq" event={"ID":"c970cc01-615f-4257-9a9f-28328e2c16db","Type":"ContainerStarted","Data":"26b10b51605daecb6fbbb534d999296eabee52f78141bb1bd68bd2517e04f5ea"} Jun 03 21:12:09.121322 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:12:09.121289 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f9b999fdd-z5fzq" event={"ID":"c970cc01-615f-4257-9a9f-28328e2c16db","Type":"ContainerStarted","Data":"c14e2125e7a2aa001077f4aacb6c3d8e34ba14a9a973dd31ffd121ccfd37a4cc"} Jun 03 21:12:09.137448 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:12:09.137388 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5f9b999fdd-z5fzq" podStartSLOduration=1.220953457 podStartE2EDuration="4.137367453s" totalImagesPullingTime="2.916413996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:12:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:12:09.136191582 +0000 UTC m=+367.292369742" watchObservedRunningTime="2026-06-03 21:12:09.137367453 +0000 UTC m=+367.293545602" Jun 03 21:13:56.313219 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:13:56.313185 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-4dqmg"] Jun 03 21:13:56.316740 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:13:56.316719 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4dqmg" Jun 03 21:13:56.319901 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:13:56.319880 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 21:13:56.320018 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:13:56.319907 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 03 21:13:56.320654 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:13:56.320619 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-l4vxt\"" Jun 03 21:13:56.320854 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:13:56.320841 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 21:13:56.333539 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:13:56.333505 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-4dqmg"] Jun 03 21:13:56.427054 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:13:56.427018 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnbqm\" (UniqueName: \"kubernetes.io/projected/880d2f82-5a09-44bf-ac3c-d09169aa4067-kube-api-access-bnbqm\") pod \"dns-operator-controller-manager-864dd78c4c-4dqmg\" (UID: \"880d2f82-5a09-44bf-ac3c-d09169aa4067\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4dqmg" Jun 03 21:13:56.528423 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:13:56.528377 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnbqm\" (UniqueName: \"kubernetes.io/projected/880d2f82-5a09-44bf-ac3c-d09169aa4067-kube-api-access-bnbqm\") pod \"dns-operator-controller-manager-864dd78c4c-4dqmg\" (UID: \"880d2f82-5a09-44bf-ac3c-d09169aa4067\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4dqmg" Jun 03 21:13:56.537536 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:13:56.537511 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnbqm\" (UniqueName: \"kubernetes.io/projected/880d2f82-5a09-44bf-ac3c-d09169aa4067-kube-api-access-bnbqm\") pod \"dns-operator-controller-manager-864dd78c4c-4dqmg\" (UID: \"880d2f82-5a09-44bf-ac3c-d09169aa4067\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4dqmg" Jun 03 21:13:56.627897 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:13:56.627801 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4dqmg" Jun 03 21:13:56.762254 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:13:56.762226 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-4dqmg"] Jun 03 21:13:56.764555 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:13:56.764527 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod880d2f82_5a09_44bf_ac3c_d09169aa4067.slice/crio-6a4f6c5b439f236043cd7d5dfbd3cbbdf3b42b16fd6bdfe7ad9322ac42291741 WatchSource:0}: Error finding container 6a4f6c5b439f236043cd7d5dfbd3cbbdf3b42b16fd6bdfe7ad9322ac42291741: Status 404 returned error can't find the container with id 6a4f6c5b439f236043cd7d5dfbd3cbbdf3b42b16fd6bdfe7ad9322ac42291741 Jun 03 21:13:57.622153 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:13:57.622121 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4dqmg" event={"ID":"880d2f82-5a09-44bf-ac3c-d09169aa4067","Type":"ContainerStarted","Data":"6a4f6c5b439f236043cd7d5dfbd3cbbdf3b42b16fd6bdfe7ad9322ac42291741"} Jun 03 21:13:57.695604 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:13:57.695570 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-zdbrn"] Jun 03 21:13:57.699800 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:13:57.699739 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zdbrn" Jun 03 21:13:57.701958 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:13:57.701933 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 03 21:13:57.702072 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:13:57.701969 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2nvhl\"" Jun 03 21:13:57.702072 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:13:57.701947 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 03 21:13:57.709615 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:13:57.709557 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-zdbrn"] Jun 03 21:13:57.740520 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:13:57.740487 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3dba42dc-f4ca-464a-a0d8-3d339b498e7d-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-zdbrn\" (UID: \"3dba42dc-f4ca-464a-a0d8-3d339b498e7d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zdbrn" Jun 03 21:13:57.740701 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:13:57.740571 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cwtz\" (UniqueName: \"kubernetes.io/projected/3dba42dc-f4ca-464a-a0d8-3d339b498e7d-kube-api-access-6cwtz\") pod \"kuadrant-console-plugin-66b5774985-zdbrn\" (UID: \"3dba42dc-f4ca-464a-a0d8-3d339b498e7d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zdbrn" Jun 03 21:13:57.740701 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:13:57.740664 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3dba42dc-f4ca-464a-a0d8-3d339b498e7d-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-zdbrn\" (UID: \"3dba42dc-f4ca-464a-a0d8-3d339b498e7d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zdbrn" Jun 03 21:13:57.841201 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:13:57.841169 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3dba42dc-f4ca-464a-a0d8-3d339b498e7d-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-zdbrn\" (UID: \"3dba42dc-f4ca-464a-a0d8-3d339b498e7d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zdbrn" Jun 03 21:13:57.841350 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:13:57.841231 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cwtz\" (UniqueName: \"kubernetes.io/projected/3dba42dc-f4ca-464a-a0d8-3d339b498e7d-kube-api-access-6cwtz\") pod \"kuadrant-console-plugin-66b5774985-zdbrn\" (UID: \"3dba42dc-f4ca-464a-a0d8-3d339b498e7d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zdbrn" Jun 03 21:13:57.841350 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:13:57.841274 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3dba42dc-f4ca-464a-a0d8-3d339b498e7d-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-zdbrn\" (UID: \"3dba42dc-f4ca-464a-a0d8-3d339b498e7d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zdbrn" Jun 03 21:13:57.841842 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:13:57.841822 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3dba42dc-f4ca-464a-a0d8-3d339b498e7d-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-zdbrn\" (UID: \"3dba42dc-f4ca-464a-a0d8-3d339b498e7d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zdbrn" Jun 03 21:13:57.843666 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:13:57.843643 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3dba42dc-f4ca-464a-a0d8-3d339b498e7d-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-zdbrn\" (UID: \"3dba42dc-f4ca-464a-a0d8-3d339b498e7d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zdbrn" Jun 03 21:13:57.848851 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:13:57.848830 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cwtz\" (UniqueName: \"kubernetes.io/projected/3dba42dc-f4ca-464a-a0d8-3d339b498e7d-kube-api-access-6cwtz\") pod \"kuadrant-console-plugin-66b5774985-zdbrn\" (UID: \"3dba42dc-f4ca-464a-a0d8-3d339b498e7d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zdbrn" Jun 03 21:13:58.013443 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:13:58.013406 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zdbrn" Jun 03 21:13:58.161737 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:13:58.161693 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-zdbrn"] Jun 03 21:13:58.164928 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:13:58.164894 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3dba42dc_f4ca_464a_a0d8_3d339b498e7d.slice/crio-583217f577c74d65754298a5a4b94eed6e350a9f0cc546e4eacbacaf086423c7 WatchSource:0}: Error finding container 583217f577c74d65754298a5a4b94eed6e350a9f0cc546e4eacbacaf086423c7: Status 404 returned error can't find the container with id 583217f577c74d65754298a5a4b94eed6e350a9f0cc546e4eacbacaf086423c7 Jun 03 21:13:58.628851 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:13:58.628815 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zdbrn" event={"ID":"3dba42dc-f4ca-464a-a0d8-3d339b498e7d","Type":"ContainerStarted","Data":"583217f577c74d65754298a5a4b94eed6e350a9f0cc546e4eacbacaf086423c7"} Jun 03 21:13:59.636222 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:13:59.636178 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4dqmg" event={"ID":"880d2f82-5a09-44bf-ac3c-d09169aa4067","Type":"ContainerStarted","Data":"21b15bda979cf550b567197d8b54756ef5e5928a3d477afb4fe948fa01a87897"} Jun 03 21:13:59.636738 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:13:59.636263 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4dqmg" Jun 03 21:13:59.655579 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:13:59.655067 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4dqmg" podStartSLOduration=1.637818035 podStartE2EDuration="3.655019531s" totalImagesPullingTime="2.017201496s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:13:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:13:59.654199479 +0000 UTC m=+477.810377627" watchObservedRunningTime="2026-06-03 21:13:59.655019531 +0000 UTC m=+477.811197679" Jun 03 21:14:08.141687 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:08.141646 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xptqx"] Jun 03 21:14:08.168228 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:08.168182 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xptqx"] Jun 03 21:14:08.168395 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:08.168326 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xptqx" Jun 03 21:14:08.171474 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:08.171447 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-5f2zl\"" Jun 03 21:14:08.244620 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:08.244579 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eaf42fee-cb57-48ce-bd64-a0f8f822656f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-xptqx\" (UID: \"eaf42fee-cb57-48ce-bd64-a0f8f822656f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xptqx" Jun 03 21:14:08.244620 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:08.244627 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4gpg\" (UniqueName: \"kubernetes.io/projected/eaf42fee-cb57-48ce-bd64-a0f8f822656f-kube-api-access-t4gpg\") pod \"kuadrant-operator-controller-manager-55467d9f7-xptqx\" (UID: \"eaf42fee-cb57-48ce-bd64-a0f8f822656f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xptqx" Jun 03 21:14:08.345610 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:08.345568 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eaf42fee-cb57-48ce-bd64-a0f8f822656f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-xptqx\" (UID: \"eaf42fee-cb57-48ce-bd64-a0f8f822656f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xptqx" Jun 03 21:14:08.345610 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:08.345617 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4gpg\" (UniqueName: \"kubernetes.io/projected/eaf42fee-cb57-48ce-bd64-a0f8f822656f-kube-api-access-t4gpg\") pod \"kuadrant-operator-controller-manager-55467d9f7-xptqx\" (UID: \"eaf42fee-cb57-48ce-bd64-a0f8f822656f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xptqx" Jun 03 21:14:08.346228 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:08.346192 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eaf42fee-cb57-48ce-bd64-a0f8f822656f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-xptqx\" (UID: \"eaf42fee-cb57-48ce-bd64-a0f8f822656f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xptqx" Jun 03 21:14:08.355377 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:08.355342 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4gpg\" (UniqueName: \"kubernetes.io/projected/eaf42fee-cb57-48ce-bd64-a0f8f822656f-kube-api-access-t4gpg\") pod \"kuadrant-operator-controller-manager-55467d9f7-xptqx\" (UID: \"eaf42fee-cb57-48ce-bd64-a0f8f822656f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xptqx" Jun 03 21:14:08.411640 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:08.411554 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xptqx"] Jun 03 21:14:08.411969 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:08.411954 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xptqx" Jun 03 21:14:08.417440 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:08.417377 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xptqx"] Jun 03 21:14:08.433257 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:08.433222 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-56p4q"] Jun 03 21:14:08.438346 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:08.438303 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-56p4q" Jun 03 21:14:08.461143 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:08.461095 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-56p4q"] Jun 03 21:14:08.547157 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:08.547108 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dceff209-2801-4047-886b-7e7b2bb0953b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-56p4q\" (UID: \"dceff209-2801-4047-886b-7e7b2bb0953b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-56p4q" Jun 03 21:14:08.547342 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:08.547170 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz6nv\" (UniqueName: \"kubernetes.io/projected/dceff209-2801-4047-886b-7e7b2bb0953b-kube-api-access-vz6nv\") pod \"kuadrant-operator-controller-manager-55467d9f7-56p4q\" (UID: \"dceff209-2801-4047-886b-7e7b2bb0953b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-56p4q" Jun 03 21:14:08.647883 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:08.647841 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dceff209-2801-4047-886b-7e7b2bb0953b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-56p4q\" (UID: \"dceff209-2801-4047-886b-7e7b2bb0953b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-56p4q" Jun 03 21:14:08.648049 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:08.647901 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz6nv\" (UniqueName: \"kubernetes.io/projected/dceff209-2801-4047-886b-7e7b2bb0953b-kube-api-access-vz6nv\") pod \"kuadrant-operator-controller-manager-55467d9f7-56p4q\" (UID: \"dceff209-2801-4047-886b-7e7b2bb0953b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-56p4q" Jun 03 21:14:08.648270 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:08.648249 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dceff209-2801-4047-886b-7e7b2bb0953b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-56p4q\" (UID: \"dceff209-2801-4047-886b-7e7b2bb0953b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-56p4q" Jun 03 21:14:08.656606 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:08.656567 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz6nv\" (UniqueName: \"kubernetes.io/projected/dceff209-2801-4047-886b-7e7b2bb0953b-kube-api-access-vz6nv\") pod \"kuadrant-operator-controller-manager-55467d9f7-56p4q\" (UID: \"dceff209-2801-4047-886b-7e7b2bb0953b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-56p4q" Jun 03 21:14:08.750761 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:08.750702 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-56p4q" Jun 03 21:14:10.644860 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:10.644828 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4dqmg" Jun 03 21:14:21.262171 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:21.262147 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-56p4q"] Jun 03 21:14:21.263680 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:14:21.263652 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddceff209_2801_4047_886b_7e7b2bb0953b.slice/crio-6927caf1e2447f90e56517f4c7726a51269dccbb102d94439fdd9b4c0334c940 WatchSource:0}: Error finding container 6927caf1e2447f90e56517f4c7726a51269dccbb102d94439fdd9b4c0334c940: Status 404 returned error can't find the container with id 6927caf1e2447f90e56517f4c7726a51269dccbb102d94439fdd9b4c0334c940 Jun 03 21:14:21.760265 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:21.760177 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zdbrn" event={"ID":"3dba42dc-f4ca-464a-a0d8-3d339b498e7d","Type":"ContainerStarted","Data":"810f815c025892d23a3e02213b6aaeb1af85587ab3e262428b930ee39b2cff83"} Jun 03 21:14:21.761496 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:21.761472 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-56p4q" event={"ID":"dceff209-2801-4047-886b-7e7b2bb0953b","Type":"ContainerStarted","Data":"6927caf1e2447f90e56517f4c7726a51269dccbb102d94439fdd9b4c0334c940"} Jun 03 21:14:21.775175 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:21.775120 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zdbrn" podStartSLOduration=1.505946238 podStartE2EDuration="24.775100525s" totalImagesPullingTime="23.269154287s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:13:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:14:21.774162804 +0000 UTC m=+499.930340949" watchObservedRunningTime="2026-06-03 21:14:21.775100525 +0000 UTC m=+499.931278674" Jun 03 21:14:23.935418 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:14:23.935372 2557 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-xptqx_kuadrant-system_eaf42fee-cb57-48ce-bd64-a0f8f822656f_0(ac477377a6727e6f88c80dfd0f685ffb4071a63f5a47f379a393238faaf44ce4): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-xptqx to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" Jun 03 21:14:23.935868 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:14:23.935442 2557 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-xptqx_kuadrant-system_eaf42fee-cb57-48ce-bd64-a0f8f822656f_0(ac477377a6727e6f88c80dfd0f685ffb4071a63f5a47f379a393238faaf44ce4): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-xptqx to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xptqx" Jun 03 21:14:24.776529 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:24.776496 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xptqx" Jun 03 21:14:24.778527 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:14:24.778491 2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-xptqx\" is forbidden: User \"system:node:ip-10-0-137-203.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-203.ec2.internal' and this object" podUID="eaf42fee-cb57-48ce-bd64-a0f8f822656f" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xptqx" Jun 03 21:14:24.799272 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:24.799241 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xptqx" Jun 03 21:14:24.801238 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:14:24.801206 2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-xptqx\" is forbidden: User \"system:node:ip-10-0-137-203.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-203.ec2.internal' and this object" podUID="eaf42fee-cb57-48ce-bd64-a0f8f822656f" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xptqx" Jun 03 21:14:24.812517 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:24.812490 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eaf42fee-cb57-48ce-bd64-a0f8f822656f-extensions-socket-volume\") pod \"eaf42fee-cb57-48ce-bd64-a0f8f822656f\" (UID: \"eaf42fee-cb57-48ce-bd64-a0f8f822656f\") " Jun 03 21:14:24.812517 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:24.812527 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t4gpg\" (UniqueName: \"kubernetes.io/projected/eaf42fee-cb57-48ce-bd64-a0f8f822656f-kube-api-access-t4gpg\") pod \"eaf42fee-cb57-48ce-bd64-a0f8f822656f\" (UID: \"eaf42fee-cb57-48ce-bd64-a0f8f822656f\") " Jun 03 21:14:24.812822 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:24.812795 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eaf42fee-cb57-48ce-bd64-a0f8f822656f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "eaf42fee-cb57-48ce-bd64-a0f8f822656f" (UID: "eaf42fee-cb57-48ce-bd64-a0f8f822656f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 21:14:24.814612 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:24.814585 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eaf42fee-cb57-48ce-bd64-a0f8f822656f-kube-api-access-t4gpg" (OuterVolumeSpecName: "kube-api-access-t4gpg") pod "eaf42fee-cb57-48ce-bd64-a0f8f822656f" (UID: "eaf42fee-cb57-48ce-bd64-a0f8f822656f"). InnerVolumeSpecName "kube-api-access-t4gpg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:14:24.913793 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:24.913761 2557 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eaf42fee-cb57-48ce-bd64-a0f8f822656f-extensions-socket-volume\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jun 03 21:14:24.913793 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:24.913788 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t4gpg\" (UniqueName: \"kubernetes.io/projected/eaf42fee-cb57-48ce-bd64-a0f8f822656f-kube-api-access-t4gpg\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jun 03 21:14:25.783017 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:25.782979 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xptqx" Jun 03 21:14:25.785360 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:14:25.785321 2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-xptqx\" is forbidden: User \"system:node:ip-10-0-137-203.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-203.ec2.internal' and this object" podUID="eaf42fee-cb57-48ce-bd64-a0f8f822656f" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xptqx" Jun 03 21:14:25.792865 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:14:25.792834 2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-xptqx\" is forbidden: User \"system:node:ip-10-0-137-203.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-203.ec2.internal' and this object" podUID="eaf42fee-cb57-48ce-bd64-a0f8f822656f" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xptqx" Jun 03 21:14:26.265365 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:26.265330 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eaf42fee-cb57-48ce-bd64-a0f8f822656f" path="/var/lib/kubelet/pods/eaf42fee-cb57-48ce-bd64-a0f8f822656f/volumes" Jun 03 21:14:27.794183 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:27.794148 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-56p4q" event={"ID":"dceff209-2801-4047-886b-7e7b2bb0953b","Type":"ContainerStarted","Data":"1acbf10464fc9ef8ec37491627375eede4f7b0999531801920a8efac3e0adc25"} Jun 03 21:14:27.794666 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:27.794270 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-56p4q" Jun 03 21:14:27.813834 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:27.813784 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-56p4q" podStartSLOduration=14.051450518 podStartE2EDuration="19.813768397s" totalImagesPullingTime="5.762317879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:14:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:14:27.812673751 +0000 UTC m=+505.968851898" watchObservedRunningTime="2026-06-03 21:14:27.813768397 +0000 UTC m=+505.969946543" Jun 03 21:14:38.801335 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:38.801301 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-56p4q" Jun 03 21:14:50.928939 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:50.928840 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-56p4q"] Jun 03 21:14:50.929481 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:50.929068 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-56p4q" podUID="dceff209-2801-4047-886b-7e7b2bb0953b" containerName="manager" containerID="cri-o://1acbf10464fc9ef8ec37491627375eede4f7b0999531801920a8efac3e0adc25" gracePeriod=10 Jun 03 21:14:51.669987 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:51.669962 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-56p4q" Jun 03 21:14:51.762571 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:51.762539 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dceff209-2801-4047-886b-7e7b2bb0953b-extensions-socket-volume\") pod \"dceff209-2801-4047-886b-7e7b2bb0953b\" (UID: \"dceff209-2801-4047-886b-7e7b2bb0953b\") " Jun 03 21:14:51.762782 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:51.762653 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vz6nv\" (UniqueName: \"kubernetes.io/projected/dceff209-2801-4047-886b-7e7b2bb0953b-kube-api-access-vz6nv\") pod \"dceff209-2801-4047-886b-7e7b2bb0953b\" (UID: \"dceff209-2801-4047-886b-7e7b2bb0953b\") " Jun 03 21:14:51.763073 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:51.763040 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dceff209-2801-4047-886b-7e7b2bb0953b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "dceff209-2801-4047-886b-7e7b2bb0953b" (UID: "dceff209-2801-4047-886b-7e7b2bb0953b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 21:14:51.764777 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:51.764756 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dceff209-2801-4047-886b-7e7b2bb0953b-kube-api-access-vz6nv" (OuterVolumeSpecName: "kube-api-access-vz6nv") pod "dceff209-2801-4047-886b-7e7b2bb0953b" (UID: "dceff209-2801-4047-886b-7e7b2bb0953b"). InnerVolumeSpecName "kube-api-access-vz6nv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:14:51.863438 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:51.863340 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vz6nv\" (UniqueName: \"kubernetes.io/projected/dceff209-2801-4047-886b-7e7b2bb0953b-kube-api-access-vz6nv\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jun 03 21:14:51.863438 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:51.863376 2557 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dceff209-2801-4047-886b-7e7b2bb0953b-extensions-socket-volume\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jun 03 21:14:51.912099 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:51.912066 2557 generic.go:356] "Generic (PLEG): container finished" podID="dceff209-2801-4047-886b-7e7b2bb0953b" containerID="1acbf10464fc9ef8ec37491627375eede4f7b0999531801920a8efac3e0adc25" exitCode=0 Jun 03 21:14:51.912271 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:51.912112 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-56p4q" Jun 03 21:14:51.912271 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:51.912144 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-56p4q" event={"ID":"dceff209-2801-4047-886b-7e7b2bb0953b","Type":"ContainerDied","Data":"1acbf10464fc9ef8ec37491627375eede4f7b0999531801920a8efac3e0adc25"} Jun 03 21:14:51.912271 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:51.912193 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-56p4q" event={"ID":"dceff209-2801-4047-886b-7e7b2bb0953b","Type":"ContainerDied","Data":"6927caf1e2447f90e56517f4c7726a51269dccbb102d94439fdd9b4c0334c940"} Jun 03 21:14:51.912271 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:51.912213 2557 scope.go:117] "RemoveContainer" containerID="1acbf10464fc9ef8ec37491627375eede4f7b0999531801920a8efac3e0adc25" Jun 03 21:14:51.921026 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:51.921009 2557 scope.go:117] "RemoveContainer" containerID="1acbf10464fc9ef8ec37491627375eede4f7b0999531801920a8efac3e0adc25" Jun 03 21:14:51.921301 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:14:51.921282 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1acbf10464fc9ef8ec37491627375eede4f7b0999531801920a8efac3e0adc25\": container with ID starting with 1acbf10464fc9ef8ec37491627375eede4f7b0999531801920a8efac3e0adc25 not found: ID does not exist" containerID="1acbf10464fc9ef8ec37491627375eede4f7b0999531801920a8efac3e0adc25" Jun 03 21:14:51.921361 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:51.921310 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1acbf10464fc9ef8ec37491627375eede4f7b0999531801920a8efac3e0adc25"} err="failed to get container status \"1acbf10464fc9ef8ec37491627375eede4f7b0999531801920a8efac3e0adc25\": rpc error: code = NotFound desc = could not find container \"1acbf10464fc9ef8ec37491627375eede4f7b0999531801920a8efac3e0adc25\": container with ID starting with 1acbf10464fc9ef8ec37491627375eede4f7b0999531801920a8efac3e0adc25 not found: ID does not exist" Jun 03 21:14:51.933999 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:51.933971 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-56p4q"] Jun 03 21:14:51.940622 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:51.940599 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-56p4q"] Jun 03 21:14:52.263951 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:52.263916 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dceff209-2801-4047-886b-7e7b2bb0953b" path="/var/lib/kubelet/pods/dceff209-2801-4047-886b-7e7b2bb0953b/volumes" Jun 03 21:14:58.904059 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:58.903965 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mj888"] Jun 03 21:14:58.904885 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:58.904867 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dceff209-2801-4047-886b-7e7b2bb0953b" containerName="manager" Jun 03 21:14:58.904958 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:58.904889 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="dceff209-2801-4047-886b-7e7b2bb0953b" containerName="manager" Jun 03 21:14:58.905070 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:58.905059 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="dceff209-2801-4047-886b-7e7b2bb0953b" containerName="manager" Jun 03 21:14:58.910110 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:58.910086 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-mj888" Jun 03 21:14:58.912625 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:58.912603 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 03 21:14:58.913878 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:58.913854 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mj888"] Jun 03 21:14:58.937400 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:58.937370 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f1d911c2-0af1-464d-92fd-1d255b247829-config-file\") pod \"limitador-limitador-64c94fd64f-mj888\" (UID: \"f1d911c2-0af1-464d-92fd-1d255b247829\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mj888" Jun 03 21:14:58.937542 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:58.937422 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6vbl\" (UniqueName: \"kubernetes.io/projected/f1d911c2-0af1-464d-92fd-1d255b247829-kube-api-access-x6vbl\") pod \"limitador-limitador-64c94fd64f-mj888\" (UID: \"f1d911c2-0af1-464d-92fd-1d255b247829\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mj888" Jun 03 21:14:59.001085 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:59.001056 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mj888"] Jun 03 21:14:59.038416 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:59.038380 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f1d911c2-0af1-464d-92fd-1d255b247829-config-file\") pod \"limitador-limitador-64c94fd64f-mj888\" (UID: \"f1d911c2-0af1-464d-92fd-1d255b247829\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mj888" Jun 03 21:14:59.038623 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:59.038442 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6vbl\" (UniqueName: \"kubernetes.io/projected/f1d911c2-0af1-464d-92fd-1d255b247829-kube-api-access-x6vbl\") pod \"limitador-limitador-64c94fd64f-mj888\" (UID: \"f1d911c2-0af1-464d-92fd-1d255b247829\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mj888" Jun 03 21:14:59.039090 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:59.039061 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f1d911c2-0af1-464d-92fd-1d255b247829-config-file\") pod \"limitador-limitador-64c94fd64f-mj888\" (UID: \"f1d911c2-0af1-464d-92fd-1d255b247829\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mj888" Jun 03 21:14:59.046067 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:59.046046 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6vbl\" (UniqueName: \"kubernetes.io/projected/f1d911c2-0af1-464d-92fd-1d255b247829-kube-api-access-x6vbl\") pod \"limitador-limitador-64c94fd64f-mj888\" (UID: \"f1d911c2-0af1-464d-92fd-1d255b247829\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mj888" Jun 03 21:14:59.222170 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:59.222129 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-mj888" Jun 03 21:14:59.354264 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:59.354234 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mj888"] Jun 03 21:14:59.357861 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:14:59.357827 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1d911c2_0af1_464d_92fd_1d255b247829.slice/crio-da3613db071efecca0b128367293ad89a90bc4e7aef24f987d7448a174fb2c86 WatchSource:0}: Error finding container da3613db071efecca0b128367293ad89a90bc4e7aef24f987d7448a174fb2c86: Status 404 returned error can't find the container with id da3613db071efecca0b128367293ad89a90bc4e7aef24f987d7448a174fb2c86 Jun 03 21:14:59.952233 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:14:59.952197 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-mj888" event={"ID":"f1d911c2-0af1-464d-92fd-1d255b247829","Type":"ContainerStarted","Data":"da3613db071efecca0b128367293ad89a90bc4e7aef24f987d7448a174fb2c86"} Jun 03 21:15:02.969001 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:02.968967 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-mj888" event={"ID":"f1d911c2-0af1-464d-92fd-1d255b247829","Type":"ContainerStarted","Data":"b1ed217c2b6898c715f1f9e9c4ee95b67d74cf9b3e0ff8c2be211f42699f6f86"} Jun 03 21:15:02.969436 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:02.969104 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-mj888" Jun 03 21:15:02.986379 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:02.986311 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-mj888" podStartSLOduration=2.382201949 podStartE2EDuration="4.986286687s" totalImagesPullingTime="2.604084738s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:14:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:15:02.984385318 +0000 UTC m=+541.140563464" watchObservedRunningTime="2026-06-03 21:15:02.986286687 +0000 UTC m=+541.142464834" Jun 03 21:15:13.974446 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:13.974417 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-mj888" Jun 03 21:15:14.031971 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:14.031936 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mj888"] Jun 03 21:15:14.032230 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:14.032200 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-mj888" podUID="f1d911c2-0af1-464d-92fd-1d255b247829" containerName="limitador" containerID="cri-o://b1ed217c2b6898c715f1f9e9c4ee95b67d74cf9b3e0ff8c2be211f42699f6f86" gracePeriod=30 Jun 03 21:15:14.581950 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:14.581924 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-mj888" Jun 03 21:15:14.683944 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:14.683918 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f1d911c2-0af1-464d-92fd-1d255b247829-config-file\") pod \"f1d911c2-0af1-464d-92fd-1d255b247829\" (UID: \"f1d911c2-0af1-464d-92fd-1d255b247829\") " Jun 03 21:15:14.684099 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:14.684025 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6vbl\" (UniqueName: \"kubernetes.io/projected/f1d911c2-0af1-464d-92fd-1d255b247829-kube-api-access-x6vbl\") pod \"f1d911c2-0af1-464d-92fd-1d255b247829\" (UID: \"f1d911c2-0af1-464d-92fd-1d255b247829\") " Jun 03 21:15:14.684294 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:14.684271 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1d911c2-0af1-464d-92fd-1d255b247829-config-file" (OuterVolumeSpecName: "config-file") pod "f1d911c2-0af1-464d-92fd-1d255b247829" (UID: "f1d911c2-0af1-464d-92fd-1d255b247829"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 21:15:14.686069 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:14.686043 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1d911c2-0af1-464d-92fd-1d255b247829-kube-api-access-x6vbl" (OuterVolumeSpecName: "kube-api-access-x6vbl") pod "f1d911c2-0af1-464d-92fd-1d255b247829" (UID: "f1d911c2-0af1-464d-92fd-1d255b247829"). InnerVolumeSpecName "kube-api-access-x6vbl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:15:14.785363 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:14.785319 2557 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f1d911c2-0af1-464d-92fd-1d255b247829-config-file\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jun 03 21:15:14.785363 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:14.785353 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6vbl\" (UniqueName: \"kubernetes.io/projected/f1d911c2-0af1-464d-92fd-1d255b247829-kube-api-access-x6vbl\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jun 03 21:15:15.020448 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:15.020356 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-hh89f"] Jun 03 21:15:15.021009 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:15.020986 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1d911c2-0af1-464d-92fd-1d255b247829" containerName="limitador" Jun 03 21:15:15.021057 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:15.021015 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1d911c2-0af1-464d-92fd-1d255b247829" containerName="limitador" Jun 03 21:15:15.021154 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:15.021141 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1d911c2-0af1-464d-92fd-1d255b247829" containerName="limitador" Jun 03 21:15:15.024424 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:15.024399 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-hh89f" Jun 03 21:15:15.026658 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:15.026586 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-7b87x\"" Jun 03 21:15:15.026658 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:15.026593 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 03 21:15:15.026896 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:15.026873 2557 generic.go:356] "Generic (PLEG): container finished" podID="f1d911c2-0af1-464d-92fd-1d255b247829" containerID="b1ed217c2b6898c715f1f9e9c4ee95b67d74cf9b3e0ff8c2be211f42699f6f86" exitCode=0 Jun 03 21:15:15.026966 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:15.026951 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-mj888" Jun 03 21:15:15.027021 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:15.026971 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-mj888" event={"ID":"f1d911c2-0af1-464d-92fd-1d255b247829","Type":"ContainerDied","Data":"b1ed217c2b6898c715f1f9e9c4ee95b67d74cf9b3e0ff8c2be211f42699f6f86"} Jun 03 21:15:15.027021 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:15.027013 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-mj888" event={"ID":"f1d911c2-0af1-464d-92fd-1d255b247829","Type":"ContainerDied","Data":"da3613db071efecca0b128367293ad89a90bc4e7aef24f987d7448a174fb2c86"} Jun 03 21:15:15.027102 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:15.027041 2557 scope.go:117] "RemoveContainer" containerID="b1ed217c2b6898c715f1f9e9c4ee95b67d74cf9b3e0ff8c2be211f42699f6f86" Jun 03 21:15:15.034247 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:15.034219 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-hh89f"] Jun 03 21:15:15.038990 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:15.038868 2557 scope.go:117] "RemoveContainer" containerID="b1ed217c2b6898c715f1f9e9c4ee95b67d74cf9b3e0ff8c2be211f42699f6f86" Jun 03 21:15:15.039196 ip-10-0-137-203 kubenswrapper[2557]: E0603 21:15:15.039176 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1ed217c2b6898c715f1f9e9c4ee95b67d74cf9b3e0ff8c2be211f42699f6f86\": container with ID starting with b1ed217c2b6898c715f1f9e9c4ee95b67d74cf9b3e0ff8c2be211f42699f6f86 not found: ID does not exist" containerID="b1ed217c2b6898c715f1f9e9c4ee95b67d74cf9b3e0ff8c2be211f42699f6f86" Jun 03 21:15:15.039258 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:15.039204 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1ed217c2b6898c715f1f9e9c4ee95b67d74cf9b3e0ff8c2be211f42699f6f86"} err="failed to get container status \"b1ed217c2b6898c715f1f9e9c4ee95b67d74cf9b3e0ff8c2be211f42699f6f86\": rpc error: code = NotFound desc = could not find container \"b1ed217c2b6898c715f1f9e9c4ee95b67d74cf9b3e0ff8c2be211f42699f6f86\": container with ID starting with b1ed217c2b6898c715f1f9e9c4ee95b67d74cf9b3e0ff8c2be211f42699f6f86 not found: ID does not exist" Jun 03 21:15:15.063186 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:15.063147 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mj888"] Jun 03 21:15:15.066793 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:15.066769 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mj888"] Jun 03 21:15:15.088290 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:15.088258 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95xc5\" (UniqueName: \"kubernetes.io/projected/5be53fc7-e215-4fc8-a162-f81d9319d0bf-kube-api-access-95xc5\") pod \"postgres-69fb4594cf-hh89f\" (UID: \"5be53fc7-e215-4fc8-a162-f81d9319d0bf\") " pod="opendatahub/postgres-69fb4594cf-hh89f" Jun 03 21:15:15.088474 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:15.088378 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5be53fc7-e215-4fc8-a162-f81d9319d0bf-data\") pod \"postgres-69fb4594cf-hh89f\" (UID: \"5be53fc7-e215-4fc8-a162-f81d9319d0bf\") " pod="opendatahub/postgres-69fb4594cf-hh89f" Jun 03 21:15:15.189458 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:15.189416 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95xc5\" (UniqueName: \"kubernetes.io/projected/5be53fc7-e215-4fc8-a162-f81d9319d0bf-kube-api-access-95xc5\") pod \"postgres-69fb4594cf-hh89f\" (UID: \"5be53fc7-e215-4fc8-a162-f81d9319d0bf\") " pod="opendatahub/postgres-69fb4594cf-hh89f" Jun 03 21:15:15.189633 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:15.189527 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5be53fc7-e215-4fc8-a162-f81d9319d0bf-data\") pod \"postgres-69fb4594cf-hh89f\" (UID: \"5be53fc7-e215-4fc8-a162-f81d9319d0bf\") " pod="opendatahub/postgres-69fb4594cf-hh89f" Jun 03 21:15:15.189918 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:15.189899 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5be53fc7-e215-4fc8-a162-f81d9319d0bf-data\") pod \"postgres-69fb4594cf-hh89f\" (UID: \"5be53fc7-e215-4fc8-a162-f81d9319d0bf\") " pod="opendatahub/postgres-69fb4594cf-hh89f" Jun 03 21:15:15.197936 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:15.197914 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95xc5\" (UniqueName: \"kubernetes.io/projected/5be53fc7-e215-4fc8-a162-f81d9319d0bf-kube-api-access-95xc5\") pod \"postgres-69fb4594cf-hh89f\" (UID: \"5be53fc7-e215-4fc8-a162-f81d9319d0bf\") " pod="opendatahub/postgres-69fb4594cf-hh89f" Jun 03 21:15:15.336740 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:15.336610 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-hh89f" Jun 03 21:15:15.468908 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:15.468883 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-hh89f"] Jun 03 21:15:15.471003 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:15:15.470974 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5be53fc7_e215_4fc8_a162_f81d9319d0bf.slice/crio-3c742a3cd1e5e5012da6ff5c33d31e15c065f238e3c9e2f251222ee7bbc1e139 WatchSource:0}: Error finding container 3c742a3cd1e5e5012da6ff5c33d31e15c065f238e3c9e2f251222ee7bbc1e139: Status 404 returned error can't find the container with id 3c742a3cd1e5e5012da6ff5c33d31e15c065f238e3c9e2f251222ee7bbc1e139 Jun 03 21:15:16.033520 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:16.033480 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-hh89f" event={"ID":"5be53fc7-e215-4fc8-a162-f81d9319d0bf","Type":"ContainerStarted","Data":"3c742a3cd1e5e5012da6ff5c33d31e15c065f238e3c9e2f251222ee7bbc1e139"} Jun 03 21:15:16.263640 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:16.263603 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1d911c2-0af1-464d-92fd-1d255b247829" path="/var/lib/kubelet/pods/f1d911c2-0af1-464d-92fd-1d255b247829/volumes" Jun 03 21:15:21.064048 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:21.064011 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-hh89f" event={"ID":"5be53fc7-e215-4fc8-a162-f81d9319d0bf","Type":"ContainerStarted","Data":"640227825b9966f531c48819f7cbf26cbe81ccc433e557848238b1b73b3ebf37"} Jun 03 21:15:21.064462 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:21.064091 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-hh89f" Jun 03 21:15:21.080070 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:21.080006 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-hh89f" podStartSLOduration=1.230425902 podStartE2EDuration="6.079985055s" totalImagesPullingTime="4.849559153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:15:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:15:21.078802832 +0000 UTC m=+559.234980980" watchObservedRunningTime="2026-06-03 21:15:21.079985055 +0000 UTC m=+559.236163200" Jun 03 21:15:27.099061 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:27.099031 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-hh89f" Jun 03 21:15:36.377925 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:36.377894 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-dd84cbf46-nnr26"] Jun 03 21:15:36.398012 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:36.397985 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-dd84cbf46-nnr26"] Jun 03 21:15:36.398164 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:36.398077 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-dd84cbf46-nnr26" Jun 03 21:15:36.400747 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:36.400698 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 03 21:15:36.400747 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:36.400734 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-m8pjf\"" Jun 03 21:15:36.400959 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:36.400774 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 03 21:15:36.588585 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:36.588538 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq79c\" (UniqueName: \"kubernetes.io/projected/04693ee4-4270-4c09-be8a-6b4435c08c1a-kube-api-access-mq79c\") pod \"keycloak-operator-dd84cbf46-nnr26\" (UID: \"04693ee4-4270-4c09-be8a-6b4435c08c1a\") " pod="keycloak-system/keycloak-operator-dd84cbf46-nnr26" Jun 03 21:15:36.689401 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:36.689374 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mq79c\" (UniqueName: \"kubernetes.io/projected/04693ee4-4270-4c09-be8a-6b4435c08c1a-kube-api-access-mq79c\") pod \"keycloak-operator-dd84cbf46-nnr26\" (UID: \"04693ee4-4270-4c09-be8a-6b4435c08c1a\") " pod="keycloak-system/keycloak-operator-dd84cbf46-nnr26" Jun 03 21:15:36.698349 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:36.698300 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq79c\" (UniqueName: \"kubernetes.io/projected/04693ee4-4270-4c09-be8a-6b4435c08c1a-kube-api-access-mq79c\") pod \"keycloak-operator-dd84cbf46-nnr26\" (UID: \"04693ee4-4270-4c09-be8a-6b4435c08c1a\") " pod="keycloak-system/keycloak-operator-dd84cbf46-nnr26" Jun 03 21:15:36.708791 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:36.708762 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-dd84cbf46-nnr26" Jun 03 21:15:36.845441 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:36.845404 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-dd84cbf46-nnr26"] Jun 03 21:15:36.849170 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:15:36.849139 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04693ee4_4270_4c09_be8a_6b4435c08c1a.slice/crio-739821d8f518ab3c08bda4d239428bfbd073b082be25a6e64c6103fe27154a6b WatchSource:0}: Error finding container 739821d8f518ab3c08bda4d239428bfbd073b082be25a6e64c6103fe27154a6b: Status 404 returned error can't find the container with id 739821d8f518ab3c08bda4d239428bfbd073b082be25a6e64c6103fe27154a6b Jun 03 21:15:37.143876 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:37.143783 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-dd84cbf46-nnr26" event={"ID":"04693ee4-4270-4c09-be8a-6b4435c08c1a","Type":"ContainerStarted","Data":"739821d8f518ab3c08bda4d239428bfbd073b082be25a6e64c6103fe27154a6b"} Jun 03 21:15:43.179587 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:43.179543 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-dd84cbf46-nnr26" event={"ID":"04693ee4-4270-4c09-be8a-6b4435c08c1a","Type":"ContainerStarted","Data":"a545d3264834d554f555d60b4b4d66bb48f71e72616b9de7e3b7930c74f8aa36"} Jun 03 21:15:43.196766 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:15:43.196687 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-dd84cbf46-nnr26" podStartSLOduration=1.4683716279999999 podStartE2EDuration="7.196669202s" totalImagesPullingTime="5.728297574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:15:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:15:43.194392959 +0000 UTC m=+581.350571107" watchObservedRunningTime="2026-06-03 21:15:43.196669202 +0000 UTC m=+581.352847349" Jun 03 21:16:02.250601 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:16:02.250574 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjpv5_c606d039-59f8-4cc1-90d3-6ffdae5639ea/ovn-acl-logging/0.log" Jun 03 21:16:02.251100 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:16:02.250574 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjpv5_c606d039-59f8-4cc1-90d3-6ffdae5639ea/ovn-acl-logging/0.log" Jun 03 21:18:40.930498 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:18:40.930453 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pxcrx"] Jun 03 21:18:40.933182 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:18:40.933155 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pxcrx" Jun 03 21:18:40.935565 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:18:40.935541 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 03 21:18:40.936320 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:18:40.936301 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-zx4wr\"" Jun 03 21:18:40.936415 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:18:40.936301 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 03 21:18:40.936415 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:18:40.936357 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 03 21:18:40.944584 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:18:40.944557 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pxcrx"] Jun 03 21:18:41.032032 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:18:41.031977 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7651ec7b-06ea-40ed-ad6e-8859306ca694-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pxcrx\" (UID: \"7651ec7b-06ea-40ed-ad6e-8859306ca694\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pxcrx" Jun 03 21:18:41.032227 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:18:41.032095 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7651ec7b-06ea-40ed-ad6e-8859306ca694-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pxcrx\" (UID: \"7651ec7b-06ea-40ed-ad6e-8859306ca694\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pxcrx" Jun 03 21:18:41.032227 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:18:41.032160 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7651ec7b-06ea-40ed-ad6e-8859306ca694-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pxcrx\" (UID: \"7651ec7b-06ea-40ed-ad6e-8859306ca694\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pxcrx" Jun 03 21:18:41.032227 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:18:41.032215 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7651ec7b-06ea-40ed-ad6e-8859306ca694-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pxcrx\" (UID: \"7651ec7b-06ea-40ed-ad6e-8859306ca694\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pxcrx" Jun 03 21:18:41.032370 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:18:41.032239 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxbqd\" (UniqueName: \"kubernetes.io/projected/7651ec7b-06ea-40ed-ad6e-8859306ca694-kube-api-access-kxbqd\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pxcrx\" (UID: \"7651ec7b-06ea-40ed-ad6e-8859306ca694\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pxcrx" Jun 03 21:18:41.032370 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:18:41.032276 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7651ec7b-06ea-40ed-ad6e-8859306ca694-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pxcrx\" (UID: \"7651ec7b-06ea-40ed-ad6e-8859306ca694\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pxcrx" Jun 03 21:18:41.132910 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:18:41.132876 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7651ec7b-06ea-40ed-ad6e-8859306ca694-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pxcrx\" (UID: \"7651ec7b-06ea-40ed-ad6e-8859306ca694\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pxcrx" Jun 03 21:18:41.132910 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:18:41.132916 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7651ec7b-06ea-40ed-ad6e-8859306ca694-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pxcrx\" (UID: \"7651ec7b-06ea-40ed-ad6e-8859306ca694\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pxcrx" Jun 03 21:18:41.133145 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:18:41.132953 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7651ec7b-06ea-40ed-ad6e-8859306ca694-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pxcrx\" (UID: \"7651ec7b-06ea-40ed-ad6e-8859306ca694\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pxcrx" Jun 03 21:18:41.133145 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:18:41.132973 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxbqd\" (UniqueName: \"kubernetes.io/projected/7651ec7b-06ea-40ed-ad6e-8859306ca694-kube-api-access-kxbqd\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pxcrx\" (UID: \"7651ec7b-06ea-40ed-ad6e-8859306ca694\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pxcrx" Jun 03 21:18:41.133145 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:18:41.133003 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7651ec7b-06ea-40ed-ad6e-8859306ca694-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pxcrx\" (UID: \"7651ec7b-06ea-40ed-ad6e-8859306ca694\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pxcrx" Jun 03 21:18:41.133145 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:18:41.133028 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7651ec7b-06ea-40ed-ad6e-8859306ca694-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pxcrx\" (UID: \"7651ec7b-06ea-40ed-ad6e-8859306ca694\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pxcrx" Jun 03 21:18:41.133336 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:18:41.133312 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7651ec7b-06ea-40ed-ad6e-8859306ca694-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pxcrx\" (UID: \"7651ec7b-06ea-40ed-ad6e-8859306ca694\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pxcrx" Jun 03 21:18:41.133386 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:18:41.133320 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7651ec7b-06ea-40ed-ad6e-8859306ca694-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pxcrx\" (UID: \"7651ec7b-06ea-40ed-ad6e-8859306ca694\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pxcrx" Jun 03 21:18:41.133445 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:18:41.133428 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7651ec7b-06ea-40ed-ad6e-8859306ca694-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pxcrx\" (UID: \"7651ec7b-06ea-40ed-ad6e-8859306ca694\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pxcrx" Jun 03 21:18:41.135188 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:18:41.135156 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7651ec7b-06ea-40ed-ad6e-8859306ca694-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pxcrx\" (UID: \"7651ec7b-06ea-40ed-ad6e-8859306ca694\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pxcrx" Jun 03 21:18:41.135425 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:18:41.135409 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7651ec7b-06ea-40ed-ad6e-8859306ca694-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pxcrx\" (UID: \"7651ec7b-06ea-40ed-ad6e-8859306ca694\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pxcrx" Jun 03 21:18:41.140926 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:18:41.140896 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxbqd\" (UniqueName: \"kubernetes.io/projected/7651ec7b-06ea-40ed-ad6e-8859306ca694-kube-api-access-kxbqd\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pxcrx\" (UID: \"7651ec7b-06ea-40ed-ad6e-8859306ca694\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pxcrx" Jun 03 21:18:41.245073 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:18:41.245029 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pxcrx" Jun 03 21:18:41.388487 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:18:41.388460 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pxcrx"] Jun 03 21:18:41.390736 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:18:41.390684 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7651ec7b_06ea_40ed_ad6e_8859306ca694.slice/crio-e2bc71baf185bb0c9e83c97cbb8d48f0077aca5076646fd58a69b854036d0e50 WatchSource:0}: Error finding container e2bc71baf185bb0c9e83c97cbb8d48f0077aca5076646fd58a69b854036d0e50: Status 404 returned error can't find the container with id e2bc71baf185bb0c9e83c97cbb8d48f0077aca5076646fd58a69b854036d0e50 Jun 03 21:18:41.392690 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:18:41.392672 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 21:18:42.067043 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:18:42.067009 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pxcrx" event={"ID":"7651ec7b-06ea-40ed-ad6e-8859306ca694","Type":"ContainerStarted","Data":"e2bc71baf185bb0c9e83c97cbb8d48f0077aca5076646fd58a69b854036d0e50"} Jun 03 21:18:45.085246 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:18:45.085209 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pxcrx" event={"ID":"7651ec7b-06ea-40ed-ad6e-8859306ca694","Type":"ContainerStarted","Data":"69dfd4e34983863cf39cbe7a2ed84153073dc5024e459f13b8e84ae0e2a31735"} Jun 03 21:18:49.106979 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:18:49.106944 2557 generic.go:356] "Generic (PLEG): container finished" podID="7651ec7b-06ea-40ed-ad6e-8859306ca694" containerID="69dfd4e34983863cf39cbe7a2ed84153073dc5024e459f13b8e84ae0e2a31735" exitCode=0 Jun 03 21:18:49.106979 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:18:49.106990 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pxcrx" event={"ID":"7651ec7b-06ea-40ed-ad6e-8859306ca694","Type":"ContainerDied","Data":"69dfd4e34983863cf39cbe7a2ed84153073dc5024e459f13b8e84ae0e2a31735"} Jun 03 21:18:51.119645 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:18:51.119604 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pxcrx" event={"ID":"7651ec7b-06ea-40ed-ad6e-8859306ca694","Type":"ContainerStarted","Data":"5892f82c04236b724e0ab32d98808486286ba50ce064f1b2415fa9164b35dd9c"} Jun 03 21:18:51.138456 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:18:51.138395 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pxcrx" podStartSLOduration=2.452333488 podStartE2EDuration="11.138373706s" totalImagesPullingTime="4.182942993s" totalInitContainerRuntime="4.503097225s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:18:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:18:51.138145449 +0000 UTC m=+769.294323598" watchObservedRunningTime="2026-06-03 21:18:51.138373706 +0000 UTC m=+769.294551854" Jun 03 21:18:51.245446 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:18:51.245401 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pxcrx" Jun 03 21:18:51.245626 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:18:51.245473 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pxcrx" Jun 03 21:18:51.258317 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:18:51.258287 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pxcrx" Jun 03 21:18:52.135990 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:18:52.135951 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pxcrx" Jun 03 21:21:02.282205 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:21:02.282129 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjpv5_c606d039-59f8-4cc1-90d3-6ffdae5639ea/ovn-acl-logging/0.log" Jun 03 21:21:02.282796 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:21:02.282349 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjpv5_c606d039-59f8-4cc1-90d3-6ffdae5639ea/ovn-acl-logging/0.log" Jun 03 21:24:47.276876 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:24:47.276843 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6868fcfdd5-bb8c7_189872e0-5517-4998-95ba-062e640af892/manager/0.log" Jun 03 21:24:47.291582 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:24:47.291547 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6868fcfdd5-bb8c7_189872e0-5517-4998-95ba-062e640af892/copy-manifests/0.log" Jun 03 21:24:47.641341 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:24:47.641255 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-hh89f_5be53fc7-e215-4fc8-a162-f81d9319d0bf/postgres/0.log" Jun 03 21:24:49.154334 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:24:49.154286 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-4dqmg_880d2f82-5a09-44bf-ac3c-d09169aa4067/manager/0.log" Jun 03 21:24:49.258454 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:24:49.258424 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-zdbrn_3dba42dc-f4ca-464a-a0d8-3d339b498e7d/kuadrant-console-plugin/0.log" Jun 03 21:24:50.435902 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:24:50.435869 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f9b999fdd-z5fzq_c970cc01-615f-4257-9a9f-28328e2c16db/kube-auth-proxy/0.log" Jun 03 21:24:51.350655 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:24:51.350624 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-pxcrx_7651ec7b-06ea-40ed-ad6e-8859306ca694/storage-initializer/0.log" Jun 03 21:24:51.357359 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:24:51.357337 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-pxcrx_7651ec7b-06ea-40ed-ad6e-8859306ca694/main/0.log" Jun 03 21:24:55.936282 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:24:55.936243 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-g5z4p/must-gather-7sc7f"] Jun 03 21:24:55.940027 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:24:55.940004 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g5z4p/must-gather-7sc7f" Jun 03 21:24:55.942254 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:24:55.942231 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-g5z4p\"/\"default-dockercfg-j7hvd\"" Jun 03 21:24:55.942408 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:24:55.942388 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g5z4p\"/\"kube-root-ca.crt\"" Jun 03 21:24:55.942472 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:24:55.942436 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g5z4p\"/\"openshift-service-ca.crt\"" Jun 03 21:24:55.954243 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:24:55.954209 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g5z4p/must-gather-7sc7f"] Jun 03 21:24:56.047907 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:24:56.047870 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9f92514b-af7e-4ac0-8333-26d642eb991c-must-gather-output\") pod \"must-gather-7sc7f\" (UID: \"9f92514b-af7e-4ac0-8333-26d642eb991c\") " pod="openshift-must-gather-g5z4p/must-gather-7sc7f" Jun 03 21:24:56.048088 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:24:56.048035 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wr4p\" (UniqueName: \"kubernetes.io/projected/9f92514b-af7e-4ac0-8333-26d642eb991c-kube-api-access-4wr4p\") pod \"must-gather-7sc7f\" (UID: \"9f92514b-af7e-4ac0-8333-26d642eb991c\") " pod="openshift-must-gather-g5z4p/must-gather-7sc7f" Jun 03 21:24:56.149033 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:24:56.148992 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wr4p\" (UniqueName: \"kubernetes.io/projected/9f92514b-af7e-4ac0-8333-26d642eb991c-kube-api-access-4wr4p\") pod \"must-gather-7sc7f\" (UID: \"9f92514b-af7e-4ac0-8333-26d642eb991c\") " pod="openshift-must-gather-g5z4p/must-gather-7sc7f" Jun 03 21:24:56.149033 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:24:56.149038 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9f92514b-af7e-4ac0-8333-26d642eb991c-must-gather-output\") pod \"must-gather-7sc7f\" (UID: \"9f92514b-af7e-4ac0-8333-26d642eb991c\") " pod="openshift-must-gather-g5z4p/must-gather-7sc7f" Jun 03 21:24:56.149436 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:24:56.149418 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9f92514b-af7e-4ac0-8333-26d642eb991c-must-gather-output\") pod \"must-gather-7sc7f\" (UID: \"9f92514b-af7e-4ac0-8333-26d642eb991c\") " pod="openshift-must-gather-g5z4p/must-gather-7sc7f" Jun 03 21:24:56.159139 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:24:56.159104 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wr4p\" (UniqueName: \"kubernetes.io/projected/9f92514b-af7e-4ac0-8333-26d642eb991c-kube-api-access-4wr4p\") pod \"must-gather-7sc7f\" (UID: \"9f92514b-af7e-4ac0-8333-26d642eb991c\") " pod="openshift-must-gather-g5z4p/must-gather-7sc7f" Jun 03 21:24:56.249908 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:24:56.249820 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g5z4p/must-gather-7sc7f" Jun 03 21:24:56.390905 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:24:56.390878 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g5z4p/must-gather-7sc7f"] Jun 03 21:24:56.393657 ip-10-0-137-203 kubenswrapper[2557]: W0603 21:24:56.393629 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f92514b_af7e_4ac0_8333_26d642eb991c.slice/crio-3ae3b99db74ee10908abb59deb9fbec662f2c6fbab3dec70f1e8afc7ea703c60 WatchSource:0}: Error finding container 3ae3b99db74ee10908abb59deb9fbec662f2c6fbab3dec70f1e8afc7ea703c60: Status 404 returned error can't find the container with id 3ae3b99db74ee10908abb59deb9fbec662f2c6fbab3dec70f1e8afc7ea703c60 Jun 03 21:24:56.395575 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:24:56.395555 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 21:24:56.900377 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:24:56.900344 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g5z4p/must-gather-7sc7f" event={"ID":"9f92514b-af7e-4ac0-8333-26d642eb991c","Type":"ContainerStarted","Data":"3ae3b99db74ee10908abb59deb9fbec662f2c6fbab3dec70f1e8afc7ea703c60"} Jun 03 21:24:57.908780 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:24:57.908744 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g5z4p/must-gather-7sc7f" event={"ID":"9f92514b-af7e-4ac0-8333-26d642eb991c","Type":"ContainerStarted","Data":"74c2c9d3737dc6baf860ee2db1904d50f2ca00666f9235df7433214ab0cf7405"} Jun 03 21:24:57.908780 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:24:57.908789 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g5z4p/must-gather-7sc7f" event={"ID":"9f92514b-af7e-4ac0-8333-26d642eb991c","Type":"ContainerStarted","Data":"44caeced8313550618b349a7f630106f3c7173c3630a740453a0c2bc53f82582"} Jun 03 21:24:57.923896 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:24:57.923842 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-g5z4p/must-gather-7sc7f" podStartSLOduration=2.038126638 podStartE2EDuration="2.923824753s" totalImagesPullingTime="885.698115ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:24:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:24:57.922596387 +0000 UTC m=+1136.078774536" watchObservedRunningTime="2026-06-03 21:24:57.923824753 +0000 UTC m=+1136.080002901" Jun 03 21:24:58.967800 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:24:58.967762 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7mnlx_1239087f-2fb2-48c1-a6d6-a77d4c3a8947/global-pull-secret-syncer/0.log" Jun 03 21:24:59.147585 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:24:59.147550 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ws7rg_bb7a7428-4273-4603-9894-ca260d699287/konnectivity-agent/0.log" Jun 03 21:24:59.189518 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:24:59.189488 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-203.ec2.internal_57aa77ddd45f178c820d6322ca613602/haproxy/0.log" Jun 03 21:25:04.427040 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:04.427008 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-4dqmg_880d2f82-5a09-44bf-ac3c-d09169aa4067/manager/0.log" Jun 03 21:25:04.455542 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:04.455413 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-zdbrn_3dba42dc-f4ca-464a-a0d8-3d339b498e7d/kuadrant-console-plugin/0.log" Jun 03 21:25:06.218628 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:06.218523 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_66cab92f-9aea-45cb-ab37-c63260a5b994/alertmanager/0.log" Jun 03 21:25:06.248287 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:06.248259 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_66cab92f-9aea-45cb-ab37-c63260a5b994/config-reloader/0.log" Jun 03 21:25:06.276757 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:06.276728 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_66cab92f-9aea-45cb-ab37-c63260a5b994/kube-rbac-proxy-web/0.log" Jun 03 21:25:06.298932 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:06.298902 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_66cab92f-9aea-45cb-ab37-c63260a5b994/kube-rbac-proxy/0.log" Jun 03 21:25:06.322856 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:06.322825 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_66cab92f-9aea-45cb-ab37-c63260a5b994/kube-rbac-proxy-metric/0.log" Jun 03 21:25:06.344785 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:06.344750 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_66cab92f-9aea-45cb-ab37-c63260a5b994/prom-label-proxy/0.log" Jun 03 21:25:06.366881 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:06.366852 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_66cab92f-9aea-45cb-ab37-c63260a5b994/init-config-reloader/0.log" Jun 03 21:25:06.440913 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:06.440292 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-79fb7d47d4-jthps_c4f38a31-9f9c-408b-a1a7-4262ba1c1119/kube-state-metrics/0.log" Jun 03 21:25:06.458683 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:06.458635 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-79fb7d47d4-jthps_c4f38a31-9f9c-408b-a1a7-4262ba1c1119/kube-rbac-proxy-main/0.log" Jun 03 21:25:06.485098 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:06.484998 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-79fb7d47d4-jthps_c4f38a31-9f9c-408b-a1a7-4262ba1c1119/kube-rbac-proxy-self/0.log" Jun 03 21:25:06.515077 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:06.515018 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-68c789f4b4-xgmvd_8bc8bac3-062f-473f-a131-7a25f51972f6/metrics-server/0.log" Jun 03 21:25:06.546291 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:06.546252 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-9b9fc658-6dsg4_341ebaee-23b7-4b2d-bfe8-76cde68cf60b/monitoring-plugin/0.log" Jun 03 21:25:06.661037 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:06.661002 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2wrhs_2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b/node-exporter/0.log" Jun 03 21:25:06.682026 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:06.681996 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2wrhs_2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b/kube-rbac-proxy/0.log" Jun 03 21:25:06.703999 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:06.703972 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2wrhs_2d0d74a9-35f9-4f5f-905c-1afd7cbaac4b/init-textfile/0.log" Jun 03 21:25:06.821973 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:06.821929 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-tknds_fdc0db97-8099-4bd7-a458-2edacf4a2696/kube-rbac-proxy-main/0.log" Jun 03 21:25:06.844167 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:06.844132 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-tknds_fdc0db97-8099-4bd7-a458-2edacf4a2696/kube-rbac-proxy-self/0.log" Jun 03 21:25:06.870861 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:06.870823 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-tknds_fdc0db97-8099-4bd7-a458-2edacf4a2696/openshift-state-metrics/0.log" Jun 03 21:25:06.917205 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:06.917158 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c8ce378c-453d-4cbf-a0fa-ca393dee609b/prometheus/0.log" Jun 03 21:25:06.938347 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:06.938308 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c8ce378c-453d-4cbf-a0fa-ca393dee609b/config-reloader/0.log" Jun 03 21:25:06.964244 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:06.964210 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c8ce378c-453d-4cbf-a0fa-ca393dee609b/thanos-sidecar/0.log" Jun 03 21:25:06.992733 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:06.992409 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c8ce378c-453d-4cbf-a0fa-ca393dee609b/kube-rbac-proxy-web/0.log" Jun 03 21:25:07.018781 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:07.018445 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c8ce378c-453d-4cbf-a0fa-ca393dee609b/kube-rbac-proxy/0.log" Jun 03 21:25:07.042049 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:07.041905 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c8ce378c-453d-4cbf-a0fa-ca393dee609b/kube-rbac-proxy-thanos/0.log" Jun 03 21:25:07.064444 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:07.064400 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c8ce378c-453d-4cbf-a0fa-ca393dee609b/init-config-reloader/0.log" Jun 03 21:25:07.099153 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:07.098731 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-pjz2k_98c89919-7f9d-409d-81d6-f883029a7174/prometheus-operator/0.log" Jun 03 21:25:07.123400 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:07.123346 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-pjz2k_98c89919-7f9d-409d-81d6-f883029a7174/kube-rbac-proxy/0.log" Jun 03 21:25:07.148961 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:07.148922 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-2ftfv_aab22389-d525-40b4-9b57-bc40f3fb94c8/prometheus-operator-admission-webhook/0.log" Jun 03 21:25:07.181109 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:07.181063 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b574787c-j86r4_25abc8cb-486f-43ca-9217-e129dc4f8e4f/telemeter-client/0.log" Jun 03 21:25:07.209949 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:07.209915 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b574787c-j86r4_25abc8cb-486f-43ca-9217-e129dc4f8e4f/reload/0.log" Jun 03 21:25:07.232194 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:07.232165 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b574787c-j86r4_25abc8cb-486f-43ca-9217-e129dc4f8e4f/kube-rbac-proxy/0.log" Jun 03 21:25:07.283340 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:07.283246 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6dbbfcb4bd-d9dvl_ac093228-c4a1-4c8e-8ea5-1c25e5959fed/thanos-query/0.log" Jun 03 21:25:07.314216 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:07.314190 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6dbbfcb4bd-d9dvl_ac093228-c4a1-4c8e-8ea5-1c25e5959fed/kube-rbac-proxy-web/0.log" Jun 03 21:25:07.344807 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:07.344782 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6dbbfcb4bd-d9dvl_ac093228-c4a1-4c8e-8ea5-1c25e5959fed/kube-rbac-proxy/0.log" Jun 03 21:25:07.371893 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:07.371869 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6dbbfcb4bd-d9dvl_ac093228-c4a1-4c8e-8ea5-1c25e5959fed/prom-label-proxy/0.log" Jun 03 21:25:07.402779 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:07.402689 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6dbbfcb4bd-d9dvl_ac093228-c4a1-4c8e-8ea5-1c25e5959fed/kube-rbac-proxy-rules/0.log" Jun 03 21:25:07.427129 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:07.427097 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6dbbfcb4bd-d9dvl_ac093228-c4a1-4c8e-8ea5-1c25e5959fed/kube-rbac-proxy-metrics/0.log" Jun 03 21:25:10.139859 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:10.139800 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-56b467f5ff-wrbnh_98f567b5-9549-413d-b661-dfd2a4dc1dc5/download-server/0.log" Jun 03 21:25:10.782538 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:10.782491 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-g5z4p/perf-node-gather-daemonset-bd8b7"] Jun 03 21:25:10.787771 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:10.787734 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g5z4p/perf-node-gather-daemonset-bd8b7" Jun 03 21:25:10.796333 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:10.796296 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g5z4p/perf-node-gather-daemonset-bd8b7"] Jun 03 21:25:10.822733 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:10.821829 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ed37f6bd-3b4d-4594-af26-fe4dd10faea5-sys\") pod \"perf-node-gather-daemonset-bd8b7\" (UID: \"ed37f6bd-3b4d-4594-af26-fe4dd10faea5\") " pod="openshift-must-gather-g5z4p/perf-node-gather-daemonset-bd8b7" Jun 03 21:25:10.822733 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:10.821918 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ed37f6bd-3b4d-4594-af26-fe4dd10faea5-proc\") pod \"perf-node-gather-daemonset-bd8b7\" (UID: \"ed37f6bd-3b4d-4594-af26-fe4dd10faea5\") " pod="openshift-must-gather-g5z4p/perf-node-gather-daemonset-bd8b7" Jun 03 21:25:10.822733 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:10.821988 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ed37f6bd-3b4d-4594-af26-fe4dd10faea5-lib-modules\") pod \"perf-node-gather-daemonset-bd8b7\" (UID: \"ed37f6bd-3b4d-4594-af26-fe4dd10faea5\") " pod="openshift-must-gather-g5z4p/perf-node-gather-daemonset-bd8b7" Jun 03 21:25:10.822733 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:10.822066 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ed37f6bd-3b4d-4594-af26-fe4dd10faea5-podres\") pod \"perf-node-gather-daemonset-bd8b7\" (UID: \"ed37f6bd-3b4d-4594-af26-fe4dd10faea5\") " pod="openshift-must-gather-g5z4p/perf-node-gather-daemonset-bd8b7" Jun 03 21:25:10.822733 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:10.822183 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlw97\" (UniqueName: \"kubernetes.io/projected/ed37f6bd-3b4d-4594-af26-fe4dd10faea5-kube-api-access-mlw97\") pod \"perf-node-gather-daemonset-bd8b7\" (UID: \"ed37f6bd-3b4d-4594-af26-fe4dd10faea5\") " pod="openshift-must-gather-g5z4p/perf-node-gather-daemonset-bd8b7" Jun 03 21:25:10.923774 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:10.923700 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlw97\" (UniqueName: \"kubernetes.io/projected/ed37f6bd-3b4d-4594-af26-fe4dd10faea5-kube-api-access-mlw97\") pod \"perf-node-gather-daemonset-bd8b7\" (UID: \"ed37f6bd-3b4d-4594-af26-fe4dd10faea5\") " pod="openshift-must-gather-g5z4p/perf-node-gather-daemonset-bd8b7" Jun 03 21:25:10.923973 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:10.923855 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ed37f6bd-3b4d-4594-af26-fe4dd10faea5-sys\") pod \"perf-node-gather-daemonset-bd8b7\" (UID: \"ed37f6bd-3b4d-4594-af26-fe4dd10faea5\") " pod="openshift-must-gather-g5z4p/perf-node-gather-daemonset-bd8b7" Jun 03 21:25:10.923973 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:10.923882 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ed37f6bd-3b4d-4594-af26-fe4dd10faea5-proc\") pod \"perf-node-gather-daemonset-bd8b7\" (UID: \"ed37f6bd-3b4d-4594-af26-fe4dd10faea5\") " pod="openshift-must-gather-g5z4p/perf-node-gather-daemonset-bd8b7" Jun 03 21:25:10.923973 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:10.923929 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ed37f6bd-3b4d-4594-af26-fe4dd10faea5-lib-modules\") pod \"perf-node-gather-daemonset-bd8b7\" (UID: \"ed37f6bd-3b4d-4594-af26-fe4dd10faea5\") " pod="openshift-must-gather-g5z4p/perf-node-gather-daemonset-bd8b7" Jun 03 21:25:10.924161 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:10.923979 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ed37f6bd-3b4d-4594-af26-fe4dd10faea5-podres\") pod \"perf-node-gather-daemonset-bd8b7\" (UID: \"ed37f6bd-3b4d-4594-af26-fe4dd10faea5\") " pod="openshift-must-gather-g5z4p/perf-node-gather-daemonset-bd8b7" Jun 03 21:25:10.924161 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:10.923992 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ed37f6bd-3b4d-4594-af26-fe4dd10faea5-sys\") pod \"perf-node-gather-daemonset-bd8b7\" (UID: \"ed37f6bd-3b4d-4594-af26-fe4dd10faea5\") " pod="openshift-must-gather-g5z4p/perf-node-gather-daemonset-bd8b7" Jun 03 21:25:10.924161 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:10.924114 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ed37f6bd-3b4d-4594-af26-fe4dd10faea5-proc\") pod \"perf-node-gather-daemonset-bd8b7\" (UID: \"ed37f6bd-3b4d-4594-af26-fe4dd10faea5\") " pod="openshift-must-gather-g5z4p/perf-node-gather-daemonset-bd8b7" Jun 03 21:25:10.924324 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:10.924177 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ed37f6bd-3b4d-4594-af26-fe4dd10faea5-podres\") pod \"perf-node-gather-daemonset-bd8b7\" (UID: \"ed37f6bd-3b4d-4594-af26-fe4dd10faea5\") " pod="openshift-must-gather-g5z4p/perf-node-gather-daemonset-bd8b7" Jun 03 21:25:10.924324 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:10.924181 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ed37f6bd-3b4d-4594-af26-fe4dd10faea5-lib-modules\") pod \"perf-node-gather-daemonset-bd8b7\" (UID: \"ed37f6bd-3b4d-4594-af26-fe4dd10faea5\") " pod="openshift-must-gather-g5z4p/perf-node-gather-daemonset-bd8b7" Jun 03 21:25:10.932335 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:10.932256 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlw97\" (UniqueName: \"kubernetes.io/projected/ed37f6bd-3b4d-4594-af26-fe4dd10faea5-kube-api-access-mlw97\") pod \"perf-node-gather-daemonset-bd8b7\" (UID: \"ed37f6bd-3b4d-4594-af26-fe4dd10faea5\") " pod="openshift-must-gather-g5z4p/perf-node-gather-daemonset-bd8b7" Jun 03 21:25:11.103317 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:11.103217 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g5z4p/perf-node-gather-daemonset-bd8b7" Jun 03 21:25:11.294564 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:11.294482 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g5z4p/perf-node-gather-daemonset-bd8b7"] Jun 03 21:25:12.018454 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:12.018407 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g5z4p/perf-node-gather-daemonset-bd8b7" event={"ID":"ed37f6bd-3b4d-4594-af26-fe4dd10faea5","Type":"ContainerStarted","Data":"2898832a66c219ae21bbd7b394f446e0a990b75b52e5c8319dc2512f757a9164"} Jun 03 21:25:12.018656 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:12.018519 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g5z4p/perf-node-gather-daemonset-bd8b7" event={"ID":"ed37f6bd-3b4d-4594-af26-fe4dd10faea5","Type":"ContainerStarted","Data":"32128c3942f7d6813cc0c9bd8e271afdf46075a77fdcf70c08e78c163b4f2451"} Jun 03 21:25:12.019161 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:12.019137 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-g5z4p/perf-node-gather-daemonset-bd8b7" Jun 03 21:25:12.034429 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:12.034361 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-g5z4p/perf-node-gather-daemonset-bd8b7" podStartSLOduration=2.034340254 podStartE2EDuration="2.034340254s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:25:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:25:12.034008424 +0000 UTC m=+1150.190186588" watchObservedRunningTime="2026-06-03 21:25:12.034340254 +0000 UTC m=+1150.190518395" Jun 03 21:25:12.239729 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:12.239671 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mw8f6_df3f961e-9c1b-4b9e-a7e3-ba97f25c4359/dns/0.log" Jun 03 21:25:12.260662 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:12.260630 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mw8f6_df3f961e-9c1b-4b9e-a7e3-ba97f25c4359/kube-rbac-proxy/0.log" Jun 03 21:25:12.283067 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:12.282989 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6kb5w_40bf9386-4e9b-4bf1-a193-42924b2ce6b0/dns-node-resolver/0.log" Jun 03 21:25:12.876232 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:12.876200 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-54fxg_e6ccb97c-a4b9-402d-9c33-33a1c4bf9041/node-ca/0.log" Jun 03 21:25:14.036751 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:14.036722 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f9b999fdd-z5fzq_c970cc01-615f-4257-9a9f-28328e2c16db/kube-auth-proxy/0.log" Jun 03 21:25:14.774038 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:14.774007 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zztxm_0d459700-3a74-4042-92c7-8e8c6d127b81/serve-healthcheck-canary/0.log" Jun 03 21:25:15.439902 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:15.439874 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xxkll_5f451f0c-1985-41d0-9a5c-f54fd7c2549a/kube-rbac-proxy/0.log" Jun 03 21:25:15.460033 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:15.460004 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xxkll_5f451f0c-1985-41d0-9a5c-f54fd7c2549a/exporter/0.log" Jun 03 21:25:15.480773 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:15.480723 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xxkll_5f451f0c-1985-41d0-9a5c-f54fd7c2549a/extractor/0.log" Jun 03 21:25:17.987522 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:17.987475 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6868fcfdd5-bb8c7_189872e0-5517-4998-95ba-062e640af892/manager/0.log" Jun 03 21:25:18.004675 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:18.004646 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6868fcfdd5-bb8c7_189872e0-5517-4998-95ba-062e640af892/copy-manifests/0.log" Jun 03 21:25:18.037771 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:18.037745 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-g5z4p/perf-node-gather-daemonset-bd8b7" Jun 03 21:25:18.161590 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:18.161557 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-hh89f_5be53fc7-e215-4fc8-a162-f81d9319d0bf/postgres/0.log" Jun 03 21:25:19.770551 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:19.770519 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5c44b6dfcc-wglm6_377f1170-3361-4026-b8a1-219997ee12a2/manager/0.log" Jun 03 21:25:25.480882 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:25.480850 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f9b999fdd-z5fzq_c970cc01-615f-4257-9a9f-28328e2c16db/kube-auth-proxy/0.log" Jun 03 21:25:26.684642 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:26.684612 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f9b999fdd-z5fzq_c970cc01-615f-4257-9a9f-28328e2c16db/kube-auth-proxy/0.log" Jun 03 21:25:27.418812 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:27.418786 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rpgl8_bc9138b8-63c1-4840-bf59-bc7dc9dc0e41/kube-multus-additional-cni-plugins/0.log" Jun 03 21:25:27.443139 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:27.443094 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rpgl8_bc9138b8-63c1-4840-bf59-bc7dc9dc0e41/egress-router-binary-copy/0.log" Jun 03 21:25:27.463916 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:27.463882 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rpgl8_bc9138b8-63c1-4840-bf59-bc7dc9dc0e41/cni-plugins/0.log" Jun 03 21:25:27.485359 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:27.485329 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rpgl8_bc9138b8-63c1-4840-bf59-bc7dc9dc0e41/bond-cni-plugin/0.log" Jun 03 21:25:27.506793 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:27.506761 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rpgl8_bc9138b8-63c1-4840-bf59-bc7dc9dc0e41/routeoverride-cni/0.log" Jun 03 21:25:27.527273 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:27.527243 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rpgl8_bc9138b8-63c1-4840-bf59-bc7dc9dc0e41/whereabouts-cni-bincopy/0.log" Jun 03 21:25:27.548723 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:27.548681 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rpgl8_bc9138b8-63c1-4840-bf59-bc7dc9dc0e41/whereabouts-cni/0.log" Jun 03 21:25:27.617379 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:27.617329 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wtls7_8f96219f-677e-46d7-adf9-8a6a44c129a3/kube-multus/0.log" Jun 03 21:25:27.641659 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:27.641625 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bpb2j_fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0/network-metrics-daemon/0.log" Jun 03 21:25:27.661588 ip-10-0-137-203 kubenswrapper[2557]: I0603 21:25:27.661555 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bpb2j_fd08c5ed-fd66-4062-bbe5-bb9b55b20bc0/kube-rbac-proxy/0.log"