Jun 09 10:50:56.009943 ip-10-0-136-7 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 09 10:50:56.009953 ip-10-0-136-7 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 09 10:50:56.009959 ip-10-0-136-7 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 09 10:50:56.010173 ip-10-0-136-7 systemd[1]: Failed to start Kubernetes Kubelet. Jun 09 10:51:06.209084 ip-10-0-136-7 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 09 10:51:06.209103 ip-10-0-136-7 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot f75487e1938249e6b4583811680a4fbd -- Jun 09 10:53:30.017897 ip-10-0-136-7 systemd[1]: Starting Kubernetes Kubelet... Jun 09 10:53:30.436635 ip-10-0-136-7 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 10:53:30.436635 ip-10-0-136-7 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 09 10:53:30.436635 ip-10-0-136-7 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 10:53:30.436635 ip-10-0-136-7 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 09 10:53:30.437723 ip-10-0-136-7 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 10:53:30.437723 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.436909 2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 09 10:53:30.441730 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441715 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 10:53:30.441730 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441729 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 10:53:30.441794 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441732 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 10:53:30.441794 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441736 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 10:53:30.441794 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441746 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 10:53:30.441794 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441751 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 10:53:30.441794 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441754 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 10:53:30.441794 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441757 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 10:53:30.441794 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441760 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 10:53:30.441794 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441763 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 10:53:30.441794 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441767 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 10:53:30.441794 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441771 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 10:53:30.441794 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441774 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 10:53:30.441794 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441777 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 10:53:30.441794 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441780 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 10:53:30.441794 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441782 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 10:53:30.441794 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441785 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 10:53:30.441794 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441788 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 10:53:30.441794 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441790 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 10:53:30.441794 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441793 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 10:53:30.441794 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441795 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 10:53:30.441794 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441798 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 10:53:30.442267 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441801 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 10:53:30.442267 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441804 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 10:53:30.442267 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441807 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 10:53:30.442267 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441810 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 10:53:30.442267 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441813 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 10:53:30.442267 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441818 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 10:53:30.442267 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441821 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 10:53:30.442267 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441824 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 10:53:30.442267 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441826 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 10:53:30.442267 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441829 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 10:53:30.442267 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441832 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 10:53:30.442267 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441834 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 10:53:30.442267 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441837 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 10:53:30.442267 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441840 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 10:53:30.442267 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441843 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 10:53:30.442267 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441845 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 10:53:30.442267 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441848 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 10:53:30.442267 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441850 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 10:53:30.442267 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441853 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 10:53:30.442267 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441855 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 10:53:30.442769 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441858 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 10:53:30.442769 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441860 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 10:53:30.442769 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441883 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 10:53:30.442769 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441886 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 10:53:30.442769 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441889 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 10:53:30.442769 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441892 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 10:53:30.442769 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441896 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 10:53:30.442769 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441900 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 10:53:30.442769 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441903 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 10:53:30.442769 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441906 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 10:53:30.442769 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441909 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 10:53:30.442769 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441911 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 10:53:30.442769 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441914 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 10:53:30.442769 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441917 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 10:53:30.442769 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441921 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 10:53:30.442769 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441924 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 10:53:30.442769 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441927 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 10:53:30.442769 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441929 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 10:53:30.443200 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441932 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 09 10:53:30.443200 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441935 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 10:53:30.443200 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441938 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 10:53:30.443200 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441940 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 10:53:30.443200 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441943 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 10:53:30.443200 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441945 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 10:53:30.443200 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441948 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 10:53:30.443200 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441950 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 10:53:30.443200 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441953 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 10:53:30.443200 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441955 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 10:53:30.443200 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441958 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 10:53:30.443200 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441961 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 10:53:30.443200 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441963 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 10:53:30.443200 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441966 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 10:53:30.443200 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441969 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 10:53:30.443200 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441971 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 10:53:30.443200 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441974 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 10:53:30.443200 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441977 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 10:53:30.443200 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441981 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 10:53:30.443200 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441984 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 10:53:30.443699 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441987 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 10:53:30.443699 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441990 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 10:53:30.443699 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441992 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 10:53:30.443699 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441995 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 10:53:30.443699 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.441997 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 10:53:30.443699 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442000 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 10:53:30.443699 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442002 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 10:53:30.443699 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442006 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 10:53:30.443699 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442009 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 10:53:30.443699 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442012 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 10:53:30.443699 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442014 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 10:53:30.443699 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442017 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 10:53:30.443699 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442020 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 10:53:30.443699 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442023 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 10:53:30.443699 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442026 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 10:53:30.443699 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442028 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 10:53:30.443699 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442031 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 10:53:30.443699 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442033 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 10:53:30.443699 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442036 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 10:53:30.444152 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442725 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 10:53:30.444152 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442732 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 10:53:30.444152 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442737 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 10:53:30.444152 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442740 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 10:53:30.444152 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442743 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 10:53:30.444152 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442745 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 10:53:30.444152 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442748 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 10:53:30.444152 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442751 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 10:53:30.444152 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442754 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 10:53:30.444152 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442756 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 10:53:30.444152 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442759 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 10:53:30.444152 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442762 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 10:53:30.444152 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442764 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 10:53:30.444152 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442767 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 10:53:30.444152 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442771 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 10:53:30.444152 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442774 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 10:53:30.444152 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442777 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 10:53:30.444152 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442779 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 10:53:30.444152 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442782 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 10:53:30.444633 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442785 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 10:53:30.444633 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442789 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 10:53:30.444633 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442791 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 10:53:30.444633 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442794 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 10:53:30.444633 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442797 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 10:53:30.444633 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442800 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 10:53:30.444633 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442802 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 10:53:30.444633 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442805 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 10:53:30.444633 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442808 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 10:53:30.444633 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442811 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 10:53:30.444633 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442814 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 10:53:30.444633 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442817 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 10:53:30.444633 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442819 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 10:53:30.444633 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442822 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 10:53:30.444633 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442824 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 10:53:30.444633 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442827 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 10:53:30.444633 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442829 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 10:53:30.444633 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442832 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 10:53:30.444633 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442835 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 10:53:30.444633 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442837 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 10:53:30.445119 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442839 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 10:53:30.445119 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442842 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 10:53:30.445119 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442845 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 10:53:30.445119 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442847 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 10:53:30.445119 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442850 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 10:53:30.445119 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442852 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 10:53:30.445119 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442855 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 10:53:30.445119 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442858 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 10:53:30.445119 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442861 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 10:53:30.445119 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442863 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 10:53:30.445119 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442866 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 10:53:30.445119 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442868 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 10:53:30.445119 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442871 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 10:53:30.445119 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442874 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 10:53:30.445119 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442877 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 10:53:30.445119 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442879 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 10:53:30.445119 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442882 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 10:53:30.445119 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442885 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 10:53:30.445119 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442888 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 10:53:30.445119 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442891 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 09 10:53:30.445624 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442894 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 10:53:30.445624 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442897 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 10:53:30.445624 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442899 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 10:53:30.445624 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442902 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 10:53:30.445624 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442904 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 10:53:30.445624 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442907 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 10:53:30.445624 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442910 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 10:53:30.445624 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442912 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 10:53:30.445624 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442915 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 10:53:30.445624 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442917 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 10:53:30.445624 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442919 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 10:53:30.445624 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442922 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 10:53:30.445624 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442927 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 10:53:30.445624 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442930 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 10:53:30.445624 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442933 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 10:53:30.445624 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442935 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 10:53:30.445624 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442938 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 10:53:30.445624 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442941 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 10:53:30.445624 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442944 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 10:53:30.445624 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442946 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 10:53:30.446112 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442949 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 10:53:30.446112 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442952 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 10:53:30.446112 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442954 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 10:53:30.446112 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442957 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 10:53:30.446112 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442959 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 10:53:30.446112 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442962 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 10:53:30.446112 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442965 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 10:53:30.446112 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442967 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 10:53:30.446112 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442970 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 10:53:30.446112 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442972 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 10:53:30.446112 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442975 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 10:53:30.446112 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442977 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 10:53:30.446112 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442980 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 10:53:30.446112 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442983 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 10:53:30.446112 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442985 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 10:53:30.446112 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442987 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 10:53:30.446112 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442990 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 10:53:30.446112 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442992 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 10:53:30.446112 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442995 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 10:53:30.446112 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.442997 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 10:53:30.446616 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443342 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 10:53:30.446616 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443346 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 10:53:30.446616 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443349 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 10:53:30.446616 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443353 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 10:53:30.446616 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443357 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 10:53:30.446616 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443360 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 10:53:30.446616 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443363 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 10:53:30.446616 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443366 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 09 10:53:30.446616 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443369 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 10:53:30.446616 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443372 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 10:53:30.446616 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443374 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 10:53:30.446616 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443377 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 10:53:30.446616 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443380 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 10:53:30.446616 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443383 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 10:53:30.446616 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443386 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 10:53:30.446616 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443388 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 10:53:30.446616 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443391 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 10:53:30.446616 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443394 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 10:53:30.446616 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443397 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 10:53:30.446616 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443399 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 10:53:30.447097 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443402 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 10:53:30.447097 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443404 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 10:53:30.447097 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443407 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 10:53:30.447097 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443409 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 10:53:30.447097 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443412 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 10:53:30.447097 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443414 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 10:53:30.447097 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443417 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 10:53:30.447097 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443419 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 10:53:30.447097 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443422 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 10:53:30.447097 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443424 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 10:53:30.447097 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443427 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 10:53:30.447097 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443431 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 10:53:30.447097 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443434 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 10:53:30.447097 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443437 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 10:53:30.447097 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443440 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 10:53:30.447097 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443443 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 10:53:30.447097 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443446 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 10:53:30.447097 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443449 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 10:53:30.447097 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443452 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 10:53:30.447097 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443454 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 10:53:30.447620 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443457 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 10:53:30.447620 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443459 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 10:53:30.447620 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443461 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 10:53:30.447620 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443464 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 10:53:30.447620 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443466 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 10:53:30.447620 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443469 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 10:53:30.447620 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443472 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 10:53:30.447620 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443474 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 10:53:30.447620 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443477 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 10:53:30.447620 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443480 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 10:53:30.447620 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443483 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 10:53:30.447620 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443486 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 10:53:30.447620 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443488 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 10:53:30.447620 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443491 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 10:53:30.447620 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443493 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 10:53:30.447620 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443495 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 10:53:30.447620 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443498 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 10:53:30.447620 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443501 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 10:53:30.447620 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443504 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 10:53:30.447620 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443506 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 10:53:30.448089 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443509 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 10:53:30.448089 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443512 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 10:53:30.448089 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443515 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 10:53:30.448089 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443517 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 10:53:30.448089 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443519 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 10:53:30.448089 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443522 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 10:53:30.448089 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443524 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 10:53:30.448089 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443527 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 10:53:30.448089 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443529 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 10:53:30.448089 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443531 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 10:53:30.448089 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443534 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 10:53:30.448089 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443536 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 10:53:30.448089 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443539 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 10:53:30.448089 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443541 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 10:53:30.448089 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443544 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 10:53:30.448089 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443546 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 10:53:30.448089 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443548 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 10:53:30.448089 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443551 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 10:53:30.448089 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443554 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 10:53:30.448569 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443557 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 10:53:30.448569 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443559 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 10:53:30.448569 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443562 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 10:53:30.448569 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443565 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 10:53:30.448569 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443568 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 10:53:30.448569 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443571 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 10:53:30.448569 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443573 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 10:53:30.448569 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443576 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 10:53:30.448569 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443578 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 10:53:30.448569 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443581 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 10:53:30.448569 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443598 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 10:53:30.448569 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443601 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 10:53:30.448569 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443604 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 10:53:30.448569 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443606 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 10:53:30.448569 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443609 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 10:53:30.448569 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443612 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 10:53:30.448569 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443614 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 10:53:30.448569 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443617 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 10:53:30.448569 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443620 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 10:53:30.449041 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.443622 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 10:53:30.449041 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443693 2562 flags.go:64] FLAG: --address="0.0.0.0" Jun 09 10:53:30.449041 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443704 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 09 10:53:30.449041 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443712 2562 flags.go:64] FLAG: --anonymous-auth="true" Jun 09 10:53:30.449041 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443717 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 09 10:53:30.449041 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443721 2562 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 09 10:53:30.449041 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443724 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 09 10:53:30.449041 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443731 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 09 10:53:30.449041 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443735 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 09 10:53:30.449041 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443738 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 09 10:53:30.449041 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443741 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 09 10:53:30.449041 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443744 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 09 10:53:30.449041 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443747 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 09 10:53:30.449041 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443750 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 09 10:53:30.449041 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443754 2562 flags.go:64] FLAG: --cgroup-root="" Jun 09 10:53:30.449041 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443757 2562 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 09 10:53:30.449041 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443760 2562 flags.go:64] FLAG: --client-ca-file="" Jun 09 10:53:30.449041 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443762 2562 flags.go:64] FLAG: --cloud-provider="external" Jun 09 10:53:30.449041 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443765 2562 flags.go:64] FLAG: --cluster-dns="[]" Jun 09 10:53:30.449041 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443769 2562 flags.go:64] FLAG: --cluster-domain="" Jun 09 10:53:30.449041 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443772 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 09 10:53:30.449041 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443775 2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 09 10:53:30.449041 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443778 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 09 10:53:30.449041 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443781 2562 flags.go:64] FLAG: --container-log-max-files="5" Jun 09 10:53:30.449661 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443785 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 09 10:53:30.449661 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443787 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 09 10:53:30.449661 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443790 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 09 10:53:30.449661 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443793 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 09 10:53:30.449661 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443796 2562 flags.go:64] FLAG: --contention-profiling="false" Jun 09 10:53:30.449661 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443799 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 09 10:53:30.449661 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443802 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 09 10:53:30.449661 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443805 2562 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 09 10:53:30.449661 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443808 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 09 10:53:30.449661 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443812 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 09 10:53:30.449661 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443815 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 09 10:53:30.449661 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443819 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 09 10:53:30.449661 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443822 2562 flags.go:64] FLAG: --enable-load-reader="false" Jun 09 10:53:30.449661 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443825 2562 flags.go:64] FLAG: --enable-server="true" Jun 09 10:53:30.449661 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443828 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 09 10:53:30.449661 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443833 2562 flags.go:64] FLAG: --event-burst="100" Jun 09 10:53:30.449661 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443837 2562 flags.go:64] FLAG: --event-qps="50" Jun 09 10:53:30.449661 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443840 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 09 10:53:30.449661 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443843 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 09 10:53:30.449661 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443845 2562 flags.go:64] FLAG: --eviction-hard="" Jun 09 10:53:30.449661 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443849 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 09 10:53:30.449661 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443852 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 09 10:53:30.449661 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443855 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 09 10:53:30.449661 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443858 2562 flags.go:64] FLAG: --eviction-soft="" Jun 09 10:53:30.449661 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443861 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 09 10:53:30.450280 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443864 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 09 10:53:30.450280 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443867 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 09 10:53:30.450280 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443869 2562 flags.go:64] FLAG: --experimental-mounter-path="" Jun 09 10:53:30.450280 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443872 2562 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 09 10:53:30.450280 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443875 2562 flags.go:64] FLAG: --fail-swap-on="true" Jun 09 10:53:30.450280 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443878 2562 flags.go:64] FLAG: --feature-gates="" Jun 09 10:53:30.450280 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443881 2562 flags.go:64] FLAG: --file-check-frequency="20s" Jun 09 10:53:30.450280 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443884 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 09 10:53:30.450280 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443887 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 09 10:53:30.450280 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443890 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 09 10:53:30.450280 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443893 2562 flags.go:64] FLAG: --healthz-port="10248" Jun 09 10:53:30.450280 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443896 2562 flags.go:64] FLAG: --help="false" Jun 09 10:53:30.450280 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443899 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-136-7.ec2.internal" Jun 09 10:53:30.450280 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443903 2562 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 09 10:53:30.450280 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443906 2562 flags.go:64] FLAG: --http-check-frequency="20s" Jun 09 10:53:30.450280 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443909 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 09 10:53:30.450280 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443912 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 09 10:53:30.450280 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443915 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 09 10:53:30.450280 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443919 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 09 10:53:30.450280 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443922 2562 flags.go:64] FLAG: --image-service-endpoint="" Jun 09 10:53:30.450280 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443925 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 09 10:53:30.450280 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443928 2562 flags.go:64] FLAG: --kube-api-burst="100" Jun 09 10:53:30.450280 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443931 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 09 10:53:30.450912 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443935 2562 flags.go:64] FLAG: --kube-api-qps="50" Jun 09 10:53:30.450912 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443938 2562 flags.go:64] FLAG: --kube-reserved="" Jun 09 10:53:30.450912 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443941 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 09 10:53:30.450912 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443943 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 09 10:53:30.450912 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443946 2562 flags.go:64] FLAG: --kubelet-cgroups="" Jun 09 10:53:30.450912 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443949 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 09 10:53:30.450912 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443952 2562 flags.go:64] FLAG: --lock-file="" Jun 09 10:53:30.450912 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443954 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 09 10:53:30.450912 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443958 2562 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 09 10:53:30.450912 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443961 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 09 10:53:30.450912 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443966 2562 flags.go:64] FLAG: --log-json-split-stream="false" Jun 09 10:53:30.450912 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443969 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 09 10:53:30.450912 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443972 2562 flags.go:64] FLAG: --log-text-split-stream="false" Jun 09 10:53:30.450912 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443975 2562 flags.go:64] FLAG: --logging-format="text" Jun 09 10:53:30.450912 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443977 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 09 10:53:30.450912 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443981 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 09 10:53:30.450912 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443983 2562 flags.go:64] FLAG: --manifest-url="" Jun 09 10:53:30.450912 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443986 2562 flags.go:64] FLAG: --manifest-url-header="" Jun 09 10:53:30.450912 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443990 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 09 10:53:30.450912 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443993 2562 flags.go:64] FLAG: --max-open-files="1000000" Jun 09 10:53:30.450912 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.443997 2562 flags.go:64] FLAG: --max-pods="110" Jun 09 10:53:30.450912 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444000 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 09 10:53:30.450912 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444002 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 09 10:53:30.450912 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444005 2562 flags.go:64] FLAG: --memory-manager-policy="None" Jun 09 10:53:30.450912 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444008 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 09 10:53:30.451516 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444011 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 09 10:53:30.451516 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444014 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 09 10:53:30.451516 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444018 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 09 10:53:30.451516 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444025 2562 flags.go:64] FLAG: --node-status-max-images="50" Jun 09 10:53:30.451516 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444028 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 09 10:53:30.451516 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444031 2562 flags.go:64] FLAG: --oom-score-adj="-999" Jun 09 10:53:30.451516 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444035 2562 flags.go:64] FLAG: --pod-cidr="" Jun 09 10:53:30.451516 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444038 2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 09 10:53:30.451516 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444043 2562 flags.go:64] FLAG: --pod-manifest-path="" Jun 09 10:53:30.451516 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444046 2562 flags.go:64] FLAG: --pod-max-pids="-1" Jun 09 10:53:30.451516 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444050 2562 flags.go:64] FLAG: --pods-per-core="0" Jun 09 10:53:30.451516 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444053 2562 flags.go:64] FLAG: --port="10250" Jun 09 10:53:30.451516 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444056 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 09 10:53:30.451516 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444059 2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-077b6eab6c903d337" Jun 09 10:53:30.451516 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444062 2562 flags.go:64] FLAG: --qos-reserved="" Jun 09 10:53:30.451516 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444065 2562 flags.go:64] FLAG: --read-only-port="10255" Jun 09 10:53:30.451516 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444068 2562 flags.go:64] FLAG: --register-node="true" Jun 09 10:53:30.451516 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444071 2562 flags.go:64] FLAG: --register-with-taints="" Jun 09 10:53:30.451516 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444075 2562 flags.go:64] FLAG: --registry-burst="10" Jun 09 10:53:30.451516 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444077 2562 flags.go:64] FLAG: --registry-qps="5" Jun 09 10:53:30.451516 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444080 2562 flags.go:64] FLAG: --reserved-cpus="" Jun 09 10:53:30.451516 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444083 2562 flags.go:64] FLAG: --reserved-memory="" Jun 09 10:53:30.451516 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444087 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 09 10:53:30.451516 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444089 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 09 10:53:30.451516 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444092 2562 flags.go:64] FLAG: --rotate-certificates="false" Jun 09 10:53:30.452147 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444095 2562 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 09 10:53:30.452147 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444098 2562 flags.go:64] FLAG: --runonce="false" Jun 09 10:53:30.452147 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444100 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 09 10:53:30.452147 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444103 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 09 10:53:30.452147 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444106 2562 flags.go:64] FLAG: --seccomp-default="false" Jun 09 10:53:30.452147 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444109 2562 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 09 10:53:30.452147 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444112 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 09 10:53:30.452147 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444115 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 09 10:53:30.452147 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444118 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 09 10:53:30.452147 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444122 2562 flags.go:64] FLAG: --storage-driver-password="root" Jun 09 10:53:30.452147 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444125 2562 flags.go:64] FLAG: --storage-driver-secure="false" Jun 09 10:53:30.452147 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444128 2562 flags.go:64] FLAG: --storage-driver-table="stats" Jun 09 10:53:30.452147 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444131 2562 flags.go:64] FLAG: --storage-driver-user="root" Jun 09 10:53:30.452147 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444134 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 09 10:53:30.452147 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444138 2562 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 09 10:53:30.452147 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444141 2562 flags.go:64] FLAG: --system-cgroups="" Jun 09 10:53:30.452147 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444144 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 09 10:53:30.452147 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444149 2562 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 09 10:53:30.452147 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444152 2562 flags.go:64] FLAG: --tls-cert-file="" Jun 09 10:53:30.452147 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444155 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 09 10:53:30.452147 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444158 2562 flags.go:64] FLAG: --tls-min-version="" Jun 09 10:53:30.452147 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444161 2562 flags.go:64] FLAG: --tls-private-key-file="" Jun 09 10:53:30.452147 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444164 2562 flags.go:64] FLAG: --topology-manager-policy="none" Jun 09 10:53:30.452147 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444167 2562 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 09 10:53:30.452147 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444180 2562 flags.go:64] FLAG: --topology-manager-scope="container" Jun 09 10:53:30.452760 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444183 2562 flags.go:64] FLAG: --v="2" Jun 09 10:53:30.452760 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444191 2562 flags.go:64] FLAG: --version="false" Jun 09 10:53:30.452760 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444195 2562 flags.go:64] FLAG: --vmodule="" Jun 09 10:53:30.452760 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444199 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 09 10:53:30.452760 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444202 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 09 10:53:30.452760 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444307 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 10:53:30.452760 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444311 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 10:53:30.452760 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444314 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 10:53:30.452760 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444317 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 10:53:30.452760 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444320 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 10:53:30.452760 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444323 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 09 10:53:30.452760 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444325 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 10:53:30.452760 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444328 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 10:53:30.452760 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444331 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 10:53:30.452760 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444334 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 10:53:30.452760 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444336 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 10:53:30.452760 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444341 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 10:53:30.452760 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444343 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 10:53:30.452760 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444346 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 10:53:30.452760 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444348 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 10:53:30.452760 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444351 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 10:53:30.453263 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444355 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 10:53:30.453263 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444357 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 10:53:30.453263 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444360 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 10:53:30.453263 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444362 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 10:53:30.453263 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444365 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 10:53:30.453263 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444369 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 10:53:30.453263 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444372 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 10:53:30.453263 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444375 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 10:53:30.453263 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444378 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 10:53:30.453263 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444381 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 10:53:30.453263 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444384 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 10:53:30.453263 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444386 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 10:53:30.453263 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444389 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 10:53:30.453263 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444392 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 10:53:30.453263 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444395 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 10:53:30.453263 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444397 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 10:53:30.453263 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444400 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 10:53:30.453263 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444402 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 10:53:30.453263 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444404 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 10:53:30.453734 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444407 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 10:53:30.453734 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444409 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 10:53:30.453734 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444412 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 10:53:30.453734 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444414 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 10:53:30.453734 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444418 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 10:53:30.453734 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444422 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 10:53:30.453734 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444425 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 10:53:30.453734 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444428 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 10:53:30.453734 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444432 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 10:53:30.453734 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444434 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 10:53:30.453734 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444437 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 10:53:30.453734 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444440 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 10:53:30.453734 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444442 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 10:53:30.453734 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444446 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 10:53:30.453734 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444448 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 10:53:30.453734 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444451 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 10:53:30.453734 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444453 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 10:53:30.453734 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444456 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 10:53:30.453734 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444458 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 10:53:30.454216 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444461 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 10:53:30.454216 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444464 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 10:53:30.454216 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444468 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 10:53:30.454216 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444471 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 10:53:30.454216 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444474 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 10:53:30.454216 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444477 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 10:53:30.454216 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444480 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 10:53:30.454216 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444482 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 10:53:30.454216 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444485 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 10:53:30.454216 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444487 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 10:53:30.454216 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444490 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 10:53:30.454216 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444493 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 10:53:30.454216 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444495 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 10:53:30.454216 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444497 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 10:53:30.454216 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444500 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 10:53:30.454216 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444503 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 10:53:30.454216 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444505 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 10:53:30.454216 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444507 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 10:53:30.454216 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444510 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 10:53:30.454216 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444513 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 10:53:30.454746 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444515 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 10:53:30.454746 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444519 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 10:53:30.454746 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444522 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 10:53:30.454746 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444524 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 10:53:30.454746 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444527 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 10:53:30.454746 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444529 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 10:53:30.454746 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444533 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 10:53:30.454746 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444535 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 10:53:30.454746 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444538 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 10:53:30.454746 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444540 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 10:53:30.454746 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444543 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 10:53:30.454746 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444545 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 10:53:30.454746 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444548 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 10:53:30.454746 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444551 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 10:53:30.454746 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444553 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 10:53:30.454746 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444556 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 10:53:30.454746 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444558 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 10:53:30.454746 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444561 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 10:53:30.454746 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444563 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 10:53:30.454746 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444566 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 10:53:30.455230 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444569 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 10:53:30.455230 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444572 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 10:53:30.455230 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444574 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 10:53:30.455230 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444577 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 10:53:30.455230 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.444579 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 10:53:30.455230 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.444597 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 10:53:30.455230 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.451154 2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 09 10:53:30.455230 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.451171 2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 09 10:53:30.455230 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.451190 2562 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 09 10:53:30.455230 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.451196 2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 09 10:53:30.455230 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451249 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 10:53:30.455230 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451254 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 10:53:30.455230 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451258 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 10:53:30.455230 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451261 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 10:53:30.455583 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451264 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 10:53:30.455583 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451267 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 10:53:30.455583 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451270 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 10:53:30.455583 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451273 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 10:53:30.455583 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451276 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 10:53:30.455583 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451279 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 10:53:30.455583 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451283 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 10:53:30.455583 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451286 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 10:53:30.455583 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451289 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 10:53:30.455583 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451292 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 10:53:30.455583 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451295 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 10:53:30.455583 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451298 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 10:53:30.455583 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451301 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 10:53:30.455583 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451303 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 10:53:30.455583 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451306 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 10:53:30.455583 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451308 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 10:53:30.455583 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451311 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 10:53:30.455583 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451313 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 10:53:30.455583 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451316 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 10:53:30.456179 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451318 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 10:53:30.456179 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451321 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 10:53:30.456179 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451323 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 10:53:30.456179 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451326 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 10:53:30.456179 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451329 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 10:53:30.456179 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451331 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 10:53:30.456179 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451335 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 10:53:30.456179 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451338 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 10:53:30.456179 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451341 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 10:53:30.456179 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451343 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 10:53:30.456179 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451346 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 10:53:30.456179 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451349 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 10:53:30.456179 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451352 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 10:53:30.456179 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451354 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 10:53:30.456179 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451357 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 10:53:30.456179 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451360 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 10:53:30.456179 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451362 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 10:53:30.456179 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451365 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 10:53:30.456179 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451368 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 10:53:30.456179 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451370 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 10:53:30.456674 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451373 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 10:53:30.456674 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451375 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 10:53:30.456674 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451378 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 10:53:30.456674 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451380 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 10:53:30.456674 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451383 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 10:53:30.456674 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451386 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 10:53:30.456674 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451388 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 10:53:30.456674 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451391 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 10:53:30.456674 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451393 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 10:53:30.456674 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451396 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 10:53:30.456674 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451398 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 10:53:30.456674 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451401 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 10:53:30.456674 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451403 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 10:53:30.456674 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451405 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 10:53:30.456674 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451408 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 10:53:30.456674 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451410 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 10:53:30.456674 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451413 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 10:53:30.456674 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451415 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 10:53:30.456674 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451418 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 10:53:30.456674 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451422 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 10:53:30.457154 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451425 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 10:53:30.457154 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451427 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 10:53:30.457154 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451430 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 10:53:30.457154 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451433 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 10:53:30.457154 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451435 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 10:53:30.457154 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451438 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 10:53:30.457154 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451440 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 10:53:30.457154 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451444 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 10:53:30.457154 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451447 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 10:53:30.457154 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451450 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 10:53:30.457154 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451453 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 10:53:30.457154 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451456 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 10:53:30.457154 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451458 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 10:53:30.457154 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451461 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 10:53:30.457154 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451465 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 10:53:30.457154 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451468 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 10:53:30.457154 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451471 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 09 10:53:30.457154 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451474 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 10:53:30.457154 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451476 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 10:53:30.457632 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451479 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 10:53:30.457632 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451481 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 10:53:30.457632 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451483 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 10:53:30.457632 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451486 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 10:53:30.457632 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451489 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 10:53:30.457632 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451491 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 10:53:30.457632 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451493 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 10:53:30.457632 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451496 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 10:53:30.457632 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451498 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 10:53:30.457632 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451501 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 10:53:30.457632 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451503 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 10:53:30.457632 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451507 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 10:53:30.457632 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451509 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 10:53:30.457632 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451512 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 10:53:30.457632 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451515 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 10:53:30.457632 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451517 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 10:53:30.457632 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451520 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 10:53:30.458044 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.451525 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 10:53:30.458044 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451647 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 10:53:30.458044 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451652 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 10:53:30.458044 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451655 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 10:53:30.458044 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451658 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 10:53:30.458044 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451661 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 10:53:30.458044 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451663 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 10:53:30.458044 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451666 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 10:53:30.458044 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451669 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 10:53:30.458044 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451671 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 10:53:30.458044 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451674 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 10:53:30.458044 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451676 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 10:53:30.458044 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451679 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 10:53:30.458044 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451681 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 10:53:30.458409 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451684 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 10:53:30.458409 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451686 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 10:53:30.458409 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451689 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 10:53:30.458409 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451691 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 10:53:30.458409 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451694 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 10:53:30.458409 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451696 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 10:53:30.458409 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451699 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 10:53:30.458409 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451701 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 10:53:30.458409 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451703 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 10:53:30.458409 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451706 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 10:53:30.458409 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451708 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 10:53:30.458409 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451711 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 10:53:30.458409 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451714 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 10:53:30.458409 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451717 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 10:53:30.458409 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451719 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 10:53:30.458409 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451722 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 10:53:30.458409 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451726 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 10:53:30.458409 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451730 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 10:53:30.458409 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451734 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 10:53:30.458866 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451737 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 10:53:30.458866 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451740 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 10:53:30.458866 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451742 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 10:53:30.458866 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451745 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 10:53:30.458866 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451748 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 10:53:30.458866 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451751 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 10:53:30.458866 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451753 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 10:53:30.458866 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451757 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 10:53:30.458866 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451760 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 10:53:30.458866 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451763 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 10:53:30.458866 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451766 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 10:53:30.458866 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451769 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 10:53:30.458866 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451772 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 10:53:30.458866 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451774 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 10:53:30.458866 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451777 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 10:53:30.458866 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451779 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 10:53:30.458866 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451782 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 10:53:30.458866 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451785 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 10:53:30.458866 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451787 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 10:53:30.459465 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451789 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 10:53:30.459465 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451792 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 10:53:30.459465 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451794 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 10:53:30.459465 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451797 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 10:53:30.459465 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451800 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 10:53:30.459465 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451802 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 10:53:30.459465 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451805 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 10:53:30.459465 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451807 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 10:53:30.459465 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451810 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 10:53:30.459465 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451812 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 10:53:30.459465 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451815 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 10:53:30.459465 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451818 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 10:53:30.459465 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451821 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 10:53:30.459465 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451823 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 10:53:30.459465 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451826 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 10:53:30.459465 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451828 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 10:53:30.459465 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451831 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 10:53:30.459465 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451833 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 10:53:30.459465 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451836 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 10:53:30.459465 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451838 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 10:53:30.460389 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451841 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 10:53:30.460389 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451843 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 10:53:30.460389 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451846 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 10:53:30.460389 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451848 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 10:53:30.460389 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451851 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 10:53:30.460389 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451853 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 10:53:30.460389 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451856 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 10:53:30.460389 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451858 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 10:53:30.460389 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451861 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 10:53:30.460389 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451864 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 10:53:30.460389 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451866 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 10:53:30.460389 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451868 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 10:53:30.460389 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451871 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 10:53:30.460389 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451873 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 10:53:30.460389 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451875 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 10:53:30.460389 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451878 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 10:53:30.460389 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451881 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 10:53:30.460389 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451884 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 10:53:30.460389 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451886 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 09 10:53:30.460389 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451889 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 10:53:30.460935 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451892 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 10:53:30.460935 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451894 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 10:53:30.460935 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451897 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 10:53:30.460935 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451900 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 10:53:30.460935 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451902 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 10:53:30.460935 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451905 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 10:53:30.460935 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451907 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 10:53:30.460935 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:30.451910 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 10:53:30.460935 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.451915 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 10:53:30.460935 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.452007 2562 server.go:962] "Client rotation is on, will bootstrap in background" Jun 09 10:53:30.460935 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.454283 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 09 10:53:30.460935 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.455650 2562 server.go:1019] "Starting client certificate rotation" Jun 09 10:53:30.460935 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.455752 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 10:53:30.460935 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.456539 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 10:53:30.461280 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.458545 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 10:53:30.463913 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.463889 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 10:53:30.473358 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.473344 2562 log.go:25] "Validated CRI v1 runtime API" Jun 09 10:53:30.476482 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.476466 2562 log.go:25] "Validated CRI v1 image API" Jun 09 10:53:30.477249 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.477229 2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 09 10:53:30.481499 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.481482 2562 fs.go:135] Filesystem UUIDs: map[05b76faa-ab9d-49ac-a39d-551eca149fcb:/dev/nvme0n1p3 73a5c4bf-040c-49f1-afcc-d7e024542c49:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jun 09 10:53:30.481551 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.481499 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 09 10:53:30.486125 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.485997 2562 manager.go:216] Machine: {Timestamp:2026-06-09 10:53:30.485507113 +0000 UTC m=+0.349746932 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100923 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d80bd87114c5496bbad6dc2375054 SystemUUID:ec2d80bd-8711-4c54-96bb-ad6dc2375054 BootID:f75487e1-9382-49e6-b458-3811680a4fbd Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:22:13:8d:04:2f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:22:13:8d:04:2f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4e:54:55:7c:a8:cd Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 09 10:53:30.486125 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.486123 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 09 10:53:30.486229 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.486183 2562 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 09 10:53:30.490400 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.490385 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 10:53:30.491495 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.491474 2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 09 10:53:30.491633 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.491500 2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-7.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 09 10:53:30.492418 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.492407 2562 topology_manager.go:138] "Creating topology manager with none policy" Jun 09 10:53:30.492418 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.492419 2562 container_manager_linux.go:309] "Creating device plugin manager" Jun 09 10:53:30.492488 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.492426 2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 10:53:30.492488 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.492442 2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 10:53:30.493574 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.493564 2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 09 10:53:30.496679 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.496668 2562 state_mem.go:36] "Initialized new in-memory state store" Jun 09 10:53:30.496897 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.496888 2562 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 09 10:53:30.496926 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.496918 2562 kubelet.go:486] "Attempting to sync node with API server" Jun 09 10:53:30.496959 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.496927 2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 09 10:53:30.496959 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.496937 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 09 10:53:30.496959 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.496947 2562 kubelet.go:398] "Adding apiserver pod source" Jun 09 10:53:30.496959 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.496955 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 09 10:53:30.497297 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.497283 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 10:53:30.497341 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.497311 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 10:53:30.501094 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.501078 2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 09 10:53:30.502502 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.502486 2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 09 10:53:30.502577 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.502533 2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 09 10:53:30.503779 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.503765 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 09 10:53:30.503858 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.503785 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 09 10:53:30.503858 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.503793 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 09 10:53:30.503858 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.503801 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 09 10:53:30.503858 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.503813 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 09 10:53:30.503858 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.503822 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 09 10:53:30.503858 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.503837 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 09 10:53:30.503858 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.503845 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 09 10:53:30.503858 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.503854 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 09 10:53:30.504102 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.503865 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 09 10:53:30.504102 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.503887 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 09 10:53:30.504102 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.503897 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 09 10:53:30.504907 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.504895 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 09 10:53:30.504956 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.504909 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 09 10:53:30.507075 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:30.507021 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 09 10:53:30.507164 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:30.507026 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-7.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 09 10:53:30.507215 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.507196 2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-7.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 09 10:53:30.508734 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.508715 2562 server.go:1268] "Started kubelet" Jun 09 10:53:30.508839 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.508786 2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 09 10:53:30.509056 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.508863 2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 09 10:53:30.509206 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.509175 2562 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 09 10:53:30.509499 ip-10-0-136-7 systemd[1]: Started Kubernetes Kubelet. Jun 09 10:53:30.510933 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.510917 2562 server.go:310] "Adding debug handlers to kubelet server" Jun 09 10:53:30.513003 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.512988 2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 09 10:53:30.516635 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:30.516615 2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 09 10:53:30.518081 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.518043 2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 09 10:53:30.518081 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.518064 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 09 10:53:30.518678 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:30.518544 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-7.ec2.internal\" not found" Jun 09 10:53:30.518886 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.518868 2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 09 10:53:30.518963 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.518902 2562 factory.go:55] Registering systemd factory Jun 09 10:53:30.518963 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.518913 2562 factory.go:223] Registration of the systemd container factory successfully Jun 09 10:53:30.519111 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.519097 2562 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 09 10:53:30.519159 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.519112 2562 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 09 10:53:30.519159 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.519129 2562 factory.go:153] Registering CRI-O factory Jun 09 10:53:30.519159 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.519143 2562 factory.go:223] Registration of the crio container factory successfully Jun 09 10:53:30.519289 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.519190 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 09 10:53:30.519289 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.519216 2562 factory.go:103] Registering Raw factory Jun 09 10:53:30.519289 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.519232 2562 manager.go:1196] Started watching for new ooms in manager Jun 09 10:53:30.519289 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.519272 2562 reconstruct.go:97] "Volume reconstruction finished" Jun 09 10:53:30.519289 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.519280 2562 reconciler.go:29] "Reconciler: start to sync state" Jun 09 10:53:30.519689 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.519665 2562 manager.go:349] Starting recovery of all containers Jun 09 10:53:30.523045 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:30.523017 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 09 10:53:30.523133 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:30.523053 2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-7.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 09 10:53:30.524256 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:30.523130 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-7.ec2.internal.18b76441967c1bd3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-7.ec2.internal,UID:ip-10-0-136-7.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-7.ec2.internal,},FirstTimestamp:2026-06-09 10:53:30.508688339 +0000 UTC m=+0.372928161,LastTimestamp:2026-06-09 10:53:30.508688339 +0000 UTC m=+0.372928161,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-7.ec2.internal,}" Jun 09 10:53:30.529818 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.529720 2562 manager.go:354] Recovery completed Jun 09 10:53:30.533516 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.533501 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 10:53:30.535106 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.535092 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-7.ec2.internal" event="NodeHasSufficientMemory" Jun 09 10:53:30.535198 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.535120 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-7.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 10:53:30.535198 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.535136 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-7.ec2.internal" event="NodeHasSufficientPID" Jun 09 10:53:30.535708 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.535694 2562 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 09 10:53:30.535708 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.535703 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 10:53:30.535708 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.535707 2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 09 10:53:30.535850 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.535721 2562 state_mem.go:36] "Initialized new in-memory state store" Jun 09 10:53:30.536943 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.536921 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-7.ec2.internal" event="NodeHasSufficientMemory" Jun 09 10:53:30.537030 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.536953 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-7.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 10:53:30.537030 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.536968 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-7.ec2.internal" event="NodeHasSufficientPID" Jun 09 10:53:30.537030 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.536977 2562 policy_none.go:49] "None policy: Start" Jun 09 10:53:30.537030 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.536997 2562 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 09 10:53:30.537030 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.537011 2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 09 10:53:30.537754 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:30.537627 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-7.ec2.internal.18b76441980f340f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-7.ec2.internal,UID:ip-10-0-136-7.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-7.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-7.ec2.internal,},FirstTimestamp:2026-06-09 10:53:30.535105551 +0000 UTC m=+0.399345389,LastTimestamp:2026-06-09 10:53:30.535105551 +0000 UTC m=+0.399345389,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-7.ec2.internal,}" Jun 09 10:53:30.538282 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.538267 2562 policy_none.go:47] "Start" Jun 09 10:53:30.546996 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:30.546939 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-7.ec2.internal.18b76441980f88f8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-7.ec2.internal,UID:ip-10-0-136-7.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-7.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-7.ec2.internal,},FirstTimestamp:2026-06-09 10:53:30.535127288 +0000 UTC m=+0.399367114,LastTimestamp:2026-06-09 10:53:30.535127288 +0000 UTC m=+0.399367114,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-7.ec2.internal,}" Jun 09 10:53:30.556716 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:30.556664 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-7.ec2.internal.18b76441980fc196 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-7.ec2.internal,UID:ip-10-0-136-7.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-136-7.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-136-7.ec2.internal,},FirstTimestamp:2026-06-09 10:53:30.535141782 +0000 UTC m=+0.399381606,LastTimestamp:2026-06-09 10:53:30.535141782 +0000 UTC m=+0.399381606,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-7.ec2.internal,}" Jun 09 10:53:30.564491 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:30.564435 2562 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-136-7.ec2.internal.18b76441980f340f\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-7.ec2.internal.18b76441980f340f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-7.ec2.internal,UID:ip-10-0-136-7.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-7.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-7.ec2.internal,},FirstTimestamp:2026-06-09 10:53:30.535105551 +0000 UTC m=+0.399345389,LastTimestamp:2026-06-09 10:53:30.536941067 +0000 UTC m=+0.401180887,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-7.ec2.internal,}" Jun 09 10:53:30.574401 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:30.574343 2562 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-136-7.ec2.internal.18b76441980f88f8\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-7.ec2.internal.18b76441980f88f8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-7.ec2.internal,UID:ip-10-0-136-7.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-7.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-7.ec2.internal,},FirstTimestamp:2026-06-09 10:53:30.535127288 +0000 UTC m=+0.399367114,LastTimestamp:2026-06-09 10:53:30.536959811 +0000 UTC m=+0.401199630,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-7.ec2.internal,}" Jun 09 10:53:30.578337 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.578322 2562 manager.go:337] "Starting Device Plugin manager" Jun 09 10:53:30.593094 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:30.578389 2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 09 10:53:30.593094 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.578404 2562 server.go:87] "Starting device plugin registration server" Jun 09 10:53:30.593094 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.578573 2562 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 09 10:53:30.593094 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.578581 2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 09 10:53:30.593094 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.578653 2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 09 10:53:30.593094 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.578735 2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 09 10:53:30.593094 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.578745 2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 09 10:53:30.593094 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:30.579408 2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 09 10:53:30.593094 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:30.579462 2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-7.ec2.internal\" not found" Jun 09 10:53:30.593094 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:30.585644 2562 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-136-7.ec2.internal.18b76441980fc196\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-7.ec2.internal.18b76441980fc196 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-7.ec2.internal,UID:ip-10-0-136-7.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-136-7.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-136-7.ec2.internal,},FirstTimestamp:2026-06-09 10:53:30.535141782 +0000 UTC m=+0.399381606,LastTimestamp:2026-06-09 10:53:30.536980153 +0000 UTC m=+0.401219978,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-7.ec2.internal,}" Jun 09 10:53:30.593094 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.589120 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5fhx7" Jun 09 10:53:30.593094 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.590716 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 09 10:53:30.593094 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.591763 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 09 10:53:30.593094 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.591794 2562 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 09 10:53:30.593094 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.591811 2562 kubelet.go:2448] "Starting kubelet main sync loop" Jun 09 10:53:30.593094 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:30.591840 2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 09 10:53:30.599139 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.599124 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5fhx7" Jun 09 10:53:30.600247 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:30.600192 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-7.ec2.internal.18b764419b74b462 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-7.ec2.internal,UID:ip-10-0-136-7.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-136-7.ec2.internal,},FirstTimestamp:2026-06-09 10:53:30.592089186 +0000 UTC m=+0.456329006,LastTimestamp:2026-06-09 10:53:30.592089186 +0000 UTC m=+0.456329006,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-7.ec2.internal,}" Jun 09 10:53:30.600247 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:30.600239 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Jun 09 10:53:30.678871 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.678854 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 10:53:30.679641 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.679624 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-7.ec2.internal" event="NodeHasSufficientMemory" Jun 09 10:53:30.679711 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.679653 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-7.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 10:53:30.679711 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.679663 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-7.ec2.internal" event="NodeHasSufficientPID" Jun 09 10:53:30.679711 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.679683 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-7.ec2.internal" Jun 09 10:53:30.682982 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:30.682913 2562 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-136-7.ec2.internal.18b76441980f340f\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-7.ec2.internal.18b76441980f340f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-7.ec2.internal,UID:ip-10-0-136-7.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-7.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-7.ec2.internal,},FirstTimestamp:2026-06-09 10:53:30.535105551 +0000 UTC m=+0.399345389,LastTimestamp:2026-06-09 10:53:30.679640925 +0000 UTC m=+0.543880745,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-7.ec2.internal,}" Jun 09 10:53:30.691924 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.691890 2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-7.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-7.ec2.internal"] Jun 09 10:53:30.692004 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.691939 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 10:53:30.693356 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.693341 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-7.ec2.internal" event="NodeHasSufficientMemory" Jun 09 10:53:30.693437 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.693369 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-7.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 10:53:30.693437 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.693384 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-7.ec2.internal" event="NodeHasSufficientPID" Jun 09 10:53:30.694834 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.694820 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 10:53:30.694914 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.694887 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-7.ec2.internal" Jun 09 10:53:30.694914 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.694913 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 10:53:30.695179 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:30.695165 2562 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-136-7.ec2.internal\" not found" node="ip-10-0-136-7.ec2.internal" Jun 09 10:53:30.695453 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.695437 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-7.ec2.internal" event="NodeHasSufficientMemory" Jun 09 10:53:30.695528 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.695458 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-7.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 10:53:30.695528 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.695467 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-7.ec2.internal" event="NodeHasSufficientPID" Jun 09 10:53:30.695608 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.695527 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-7.ec2.internal" event="NodeHasSufficientMemory" Jun 09 10:53:30.695608 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.695544 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-7.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 10:53:30.695608 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.695553 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-7.ec2.internal" event="NodeHasSufficientPID" Jun 09 10:53:30.696691 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.696678 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-7.ec2.internal" Jun 09 10:53:30.696738 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.696702 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 10:53:30.697348 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.697330 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-7.ec2.internal" event="NodeHasSufficientMemory" Jun 09 10:53:30.697434 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.697357 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-7.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 10:53:30.697434 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.697372 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-7.ec2.internal" event="NodeHasSufficientPID" Jun 09 10:53:30.711065 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:30.711046 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-7.ec2.internal\" not found" node="ip-10-0-136-7.ec2.internal" Jun 09 10:53:30.714730 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:30.714714 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-7.ec2.internal\" not found" node="ip-10-0-136-7.ec2.internal" Jun 09 10:53:30.732834 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:30.732818 2562 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-136-7.ec2.internal\" not found" node="ip-10-0-136-7.ec2.internal" Jun 09 10:53:30.820326 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.820307 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f62cb46264f9ba1a27750bb4e9e56d32-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-7.ec2.internal\" (UID: \"f62cb46264f9ba1a27750bb4e9e56d32\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-7.ec2.internal" Jun 09 10:53:30.820402 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.820328 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f62cb46264f9ba1a27750bb4e9e56d32-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-7.ec2.internal\" (UID: \"f62cb46264f9ba1a27750bb4e9e56d32\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-7.ec2.internal" Jun 09 10:53:30.820402 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.820364 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b71c0eeb3993825aeeedafbff58d9a16-config\") pod \"kube-apiserver-proxy-ip-10-0-136-7.ec2.internal\" (UID: \"b71c0eeb3993825aeeedafbff58d9a16\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-7.ec2.internal" Jun 09 10:53:30.895929 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.895910 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 10:53:30.896632 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.896618 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-7.ec2.internal" event="NodeHasSufficientMemory" Jun 09 10:53:30.896714 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.896641 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-7.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 10:53:30.896714 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.896651 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-7.ec2.internal" event="NodeHasSufficientPID" Jun 09 10:53:30.896714 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.896680 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-7.ec2.internal" Jun 09 10:53:30.906652 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.906635 2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-7.ec2.internal" Jun 09 10:53:30.906652 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:30.906652 2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-7.ec2.internal\": node \"ip-10-0-136-7.ec2.internal\" not found" Jun 09 10:53:30.920958 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.920934 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f62cb46264f9ba1a27750bb4e9e56d32-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-7.ec2.internal\" (UID: \"f62cb46264f9ba1a27750bb4e9e56d32\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-7.ec2.internal" Jun 09 10:53:30.921048 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.920963 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f62cb46264f9ba1a27750bb4e9e56d32-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-7.ec2.internal\" (UID: \"f62cb46264f9ba1a27750bb4e9e56d32\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-7.ec2.internal" Jun 09 10:53:30.921048 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.920986 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b71c0eeb3993825aeeedafbff58d9a16-config\") pod \"kube-apiserver-proxy-ip-10-0-136-7.ec2.internal\" (UID: \"b71c0eeb3993825aeeedafbff58d9a16\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-7.ec2.internal" Jun 09 10:53:30.921048 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.921031 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f62cb46264f9ba1a27750bb4e9e56d32-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-7.ec2.internal\" (UID: \"f62cb46264f9ba1a27750bb4e9e56d32\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-7.ec2.internal" Jun 09 10:53:30.921048 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.921038 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b71c0eeb3993825aeeedafbff58d9a16-config\") pod \"kube-apiserver-proxy-ip-10-0-136-7.ec2.internal\" (UID: \"b71c0eeb3993825aeeedafbff58d9a16\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-7.ec2.internal" Jun 09 10:53:30.921048 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:30.921043 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f62cb46264f9ba1a27750bb4e9e56d32-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-7.ec2.internal\" (UID: \"f62cb46264f9ba1a27750bb4e9e56d32\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-7.ec2.internal" Jun 09 10:53:30.922533 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:30.922520 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-7.ec2.internal\" not found" Jun 09 10:53:31.015920 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.015865 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-7.ec2.internal" Jun 09 10:53:31.019441 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.019427 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-7.ec2.internal" Jun 09 10:53:31.023446 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:31.023427 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-7.ec2.internal\" not found" Jun 09 10:53:31.124431 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:31.124407 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-7.ec2.internal\" not found" Jun 09 10:53:31.224965 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:31.224944 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-7.ec2.internal\" not found" Jun 09 10:53:31.325452 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:31.325398 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-7.ec2.internal\" not found" Jun 09 10:53:31.383110 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.383085 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 10:53:31.426438 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:31.426419 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-7.ec2.internal\" not found" Jun 09 10:53:31.445990 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.445972 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 10:53:31.454976 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.454959 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 09 10:53:31.455099 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.455081 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 10:53:31.455153 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.455109 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 10:53:31.497215 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.497184 2562 apiserver.go:52] "Watching apiserver" Jun 09 10:53:31.518411 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.518323 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 09 10:53:31.518505 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.518325 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-7.ec2.internal" Jun 09 10:53:31.519704 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.519614 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 10:53:31.523202 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.523182 2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 09 10:53:31.523539 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.523521 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-sdrg4","openshift-dns/node-resolver-dgc6w","openshift-network-diagnostics/network-check-target-lnxhs","openshift-network-operator/iptables-alerter-9jczz","kube-system/konnectivity-agent-k99tl","openshift-image-registry/node-ca-qp2c7","openshift-multus/multus-additional-cni-plugins-c9slb","openshift-multus/multus-cbbvr","openshift-multus/network-metrics-daemon-c8zc8","openshift-ovn-kubernetes/ovnkube-node-vjfd2","kube-system/global-pull-secret-syncer-dk56m","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l67g"] Jun 09 10:53:31.525773 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.525753 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sdrg4" Jun 09 10:53:31.527071 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.527054 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dgc6w" Jun 09 10:53:31.527280 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:31.527251 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb71c0eeb3993825aeeedafbff58d9a16.slice/crio-f6c901c9435fd3668ed28af836b27f985e74b53a6e0fe7c6f5c5eaed01994726 WatchSource:0}: Error finding container f6c901c9435fd3668ed28af836b27f985e74b53a6e0fe7c6f5c5eaed01994726: Status 404 returned error can't find the container with id f6c901c9435fd3668ed28af836b27f985e74b53a6e0fe7c6f5c5eaed01994726 Jun 09 10:53:31.527707 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:31.527687 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf62cb46264f9ba1a27750bb4e9e56d32.slice/crio-21492d6460c7eff4d8b3792bde07d4b2ffe978eb33bca489dd578a911b0c0a78 WatchSource:0}: Error finding container 21492d6460c7eff4d8b3792bde07d4b2ffe978eb33bca489dd578a911b0c0a78: Status 404 returned error can't find the container with id 21492d6460c7eff4d8b3792bde07d4b2ffe978eb33bca489dd578a911b0c0a78 Jun 09 10:53:31.528527 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.528510 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-k99tl" Jun 09 10:53:31.529424 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.529406 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 09 10:53:31.529809 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.529788 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 09 10:53:31.529894 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.529836 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6drtw\"" Jun 09 10:53:31.529894 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.529794 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 09 10:53:31.530010 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.529989 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 09 10:53:31.530167 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.530153 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qp2c7" Jun 09 10:53:31.530854 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.530785 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9wbth\"" Jun 09 10:53:31.531115 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.531098 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 09 10:53:31.531181 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.531131 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 09 10:53:31.531483 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.531468 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cbbvr" Jun 09 10:53:31.532157 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.532140 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-b5whk\"" Jun 09 10:53:31.533118 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.533098 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-v775l\"" Jun 09 10:53:31.533200 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.533138 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 09 10:53:31.533973 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.533958 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 10:53:31.534554 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.534535 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c8zc8" Jun 09 10:53:31.534668 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:31.534606 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c8zc8" podUID="09719c2f-d21f-4f27-a982-3595ee62c857" Jun 09 10:53:31.534886 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.534867 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 09 10:53:31.534952 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.534872 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 10:53:31.535041 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.535006 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 09 10:53:31.535041 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.535006 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 09 10:53:31.535161 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.535075 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 09 10:53:31.535161 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.535083 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 09 10:53:31.535161 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.535011 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-7.ec2.internal" Jun 09 10:53:31.535419 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.535403 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 09 10:53:31.535519 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.535505 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-cw4h9\"" Jun 09 10:53:31.536064 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.536047 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.537519 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.537504 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 10:53:31.537867 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.537852 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnxhs" Jun 09 10:53:31.537944 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:31.537914 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnxhs" podUID="f26c0f26-60a4-4966-85ee-ba0bcf29163d" Jun 09 10:53:31.539162 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.539143 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9jczz" Jun 09 10:53:31.540276 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.539932 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 09 10:53:31.540276 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.539937 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 09 10:53:31.540276 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.540002 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-j9qzh\"" Jun 09 10:53:31.540276 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.539937 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 09 10:53:31.540276 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.540182 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 09 10:53:31.540470 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.540418 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 09 10:53:31.540470 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.540446 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 09 10:53:31.540932 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.540915 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-c9slb" Jun 09 10:53:31.541803 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.541784 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hkx95\"" Jun 09 10:53:31.542272 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.542259 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dk56m" Jun 09 10:53:31.542364 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:31.542324 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dk56m" podUID="a4c9995b-4dc8-4453-b83f-db2d253332d2" Jun 09 10:53:31.542684 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.542668 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 09 10:53:31.542734 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.542717 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 09 10:53:31.542778 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.542762 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 09 10:53:31.543756 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.543739 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-7.ec2.internal"] Jun 09 10:53:31.543818 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.543808 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l67g" Jun 09 10:53:31.544754 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.544739 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nhkwb\"" Jun 09 10:53:31.545215 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.545198 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 09 10:53:31.545291 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.545242 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 09 10:53:31.545370 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.545357 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-136-7.ec2.internal"] Jun 09 10:53:31.546784 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.546766 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 10:53:31.546922 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.546906 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4s8k9\"" Jun 09 10:53:31.546922 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.546906 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 09 10:53:31.547220 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.547202 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 09 10:53:31.547620 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.547567 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 09 10:53:31.568806 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.568791 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-nn78b" Jun 09 10:53:31.577728 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.577714 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-nn78b" Jun 09 10:53:31.595407 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.595369 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-7.ec2.internal" event={"ID":"b71c0eeb3993825aeeedafbff58d9a16","Type":"ContainerStarted","Data":"f6c901c9435fd3668ed28af836b27f985e74b53a6e0fe7c6f5c5eaed01994726"} Jun 09 10:53:31.596283 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.596262 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-7.ec2.internal" event={"ID":"f62cb46264f9ba1a27750bb4e9e56d32","Type":"ContainerStarted","Data":"21492d6460c7eff4d8b3792bde07d4b2ffe978eb33bca489dd578a911b0c0a78"} Jun 09 10:53:31.602451 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.602415 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 10:48:30 +0000 UTC" deadline="2028-01-26 20:55:43.813279154 +0000 UTC" Jun 09 10:53:31.602514 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.602452 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14314h2m12.210830772s" Jun 09 10:53:31.620320 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.620295 2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 09 10:53:31.625692 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.625676 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5ae97496-aa59-402a-b6c0-9fa21935f6bd-host-run-k8s-cni-cncf-io\") pod \"multus-cbbvr\" (UID: \"5ae97496-aa59-402a-b6c0-9fa21935f6bd\") " pod="openshift-multus/multus-cbbvr" Jun 09 10:53:31.625773 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.625699 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09719c2f-d21f-4f27-a982-3595ee62c857-metrics-certs\") pod \"network-metrics-daemon-c8zc8\" (UID: \"09719c2f-d21f-4f27-a982-3595ee62c857\") " pod="openshift-multus/network-metrics-daemon-c8zc8" Jun 09 10:53:31.625773 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.625715 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-etc-openvswitch\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.625773 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.625729 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bb366f31-85bc-4642-ae05-6ce8ea4332b6-etc-modprobe-d\") pod \"tuned-sdrg4\" (UID: \"bb366f31-85bc-4642-ae05-6ce8ea4332b6\") " pod="openshift-cluster-node-tuning-operator/tuned-sdrg4" Jun 09 10:53:31.625773 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.625752 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bb366f31-85bc-4642-ae05-6ce8ea4332b6-var-lib-kubelet\") pod \"tuned-sdrg4\" (UID: \"bb366f31-85bc-4642-ae05-6ce8ea4332b6\") " pod="openshift-cluster-node-tuning-operator/tuned-sdrg4" Jun 09 10:53:31.625773 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.625768 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/80f79584-5814-4878-a7cf-06e728baf7dc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c9slb\" (UID: \"80f79584-5814-4878-a7cf-06e728baf7dc\") " pod="openshift-multus/multus-additional-cni-plugins-c9slb" Jun 09 10:53:31.625925 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.625807 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/80f79584-5814-4878-a7cf-06e728baf7dc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c9slb\" (UID: \"80f79584-5814-4878-a7cf-06e728baf7dc\") " pod="openshift-multus/multus-additional-cni-plugins-c9slb" Jun 09 10:53:31.625925 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.625842 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/47e4d25a-0728-4e43-83ac-673201e1647a-host\") pod \"node-ca-qp2c7\" (UID: \"47e4d25a-0728-4e43-83ac-673201e1647a\") " pod="openshift-image-registry/node-ca-qp2c7" Jun 09 10:53:31.625925 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.625874 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnshw\" (UniqueName: \"kubernetes.io/projected/5ae97496-aa59-402a-b6c0-9fa21935f6bd-kube-api-access-wnshw\") pod \"multus-cbbvr\" (UID: \"5ae97496-aa59-402a-b6c0-9fa21935f6bd\") " pod="openshift-multus/multus-cbbvr" Jun 09 10:53:31.625925 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.625896 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-node-log\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.626039 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.625941 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-log-socket\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.626039 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.625958 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80f79584-5814-4878-a7cf-06e728baf7dc-system-cni-dir\") pod \"multus-additional-cni-plugins-c9slb\" (UID: \"80f79584-5814-4878-a7cf-06e728baf7dc\") " pod="openshift-multus/multus-additional-cni-plugins-c9slb" Jun 09 10:53:31.626039 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.625973 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a4c9995b-4dc8-4453-b83f-db2d253332d2-dbus\") pod \"global-pull-secret-syncer-dk56m\" (UID: \"a4c9995b-4dc8-4453-b83f-db2d253332d2\") " pod="kube-system/global-pull-secret-syncer-dk56m" Jun 09 10:53:31.626039 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.625990 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.626039 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626014 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bb366f31-85bc-4642-ae05-6ce8ea4332b6-sys\") pod \"tuned-sdrg4\" (UID: \"bb366f31-85bc-4642-ae05-6ce8ea4332b6\") " pod="openshift-cluster-node-tuning-operator/tuned-sdrg4" Jun 09 10:53:31.626179 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626038 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vxzk\" (UniqueName: \"kubernetes.io/projected/80f79584-5814-4878-a7cf-06e728baf7dc-kube-api-access-9vxzk\") pod \"multus-additional-cni-plugins-c9slb\" (UID: \"80f79584-5814-4878-a7cf-06e728baf7dc\") " pod="openshift-multus/multus-additional-cni-plugins-c9slb" Jun 09 10:53:31.626179 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626056 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d88d356c-48a2-4f25-b063-c322959af6da-tmp-dir\") pod \"node-resolver-dgc6w\" (UID: \"d88d356c-48a2-4f25-b063-c322959af6da\") " pod="openshift-dns/node-resolver-dgc6w" Jun 09 10:53:31.626179 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626069 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5ae97496-aa59-402a-b6c0-9fa21935f6bd-os-release\") pod \"multus-cbbvr\" (UID: \"5ae97496-aa59-402a-b6c0-9fa21935f6bd\") " pod="openshift-multus/multus-cbbvr" Jun 09 10:53:31.626179 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626083 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5ae97496-aa59-402a-b6c0-9fa21935f6bd-hostroot\") pod \"multus-cbbvr\" (UID: \"5ae97496-aa59-402a-b6c0-9fa21935f6bd\") " pod="openshift-multus/multus-cbbvr" Jun 09 10:53:31.626179 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626104 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/80f79584-5814-4878-a7cf-06e728baf7dc-cnibin\") pod \"multus-additional-cni-plugins-c9slb\" (UID: \"80f79584-5814-4878-a7cf-06e728baf7dc\") " pod="openshift-multus/multus-additional-cni-plugins-c9slb" Jun 09 10:53:31.626179 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626140 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/80f79584-5814-4878-a7cf-06e728baf7dc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c9slb\" (UID: \"80f79584-5814-4878-a7cf-06e728baf7dc\") " pod="openshift-multus/multus-additional-cni-plugins-c9slb" Jun 09 10:53:31.626179 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626158 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a4c9995b-4dc8-4453-b83f-db2d253332d2-kubelet-config\") pod \"global-pull-secret-syncer-dk56m\" (UID: \"a4c9995b-4dc8-4453-b83f-db2d253332d2\") " pod="kube-system/global-pull-secret-syncer-dk56m" Jun 09 10:53:31.626179 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626172 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5ae97496-aa59-402a-b6c0-9fa21935f6bd-system-cni-dir\") pod \"multus-cbbvr\" (UID: \"5ae97496-aa59-402a-b6c0-9fa21935f6bd\") " pod="openshift-multus/multus-cbbvr" Jun 09 10:53:31.626397 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626188 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5ae97496-aa59-402a-b6c0-9fa21935f6bd-multus-cni-dir\") pod \"multus-cbbvr\" (UID: \"5ae97496-aa59-402a-b6c0-9fa21935f6bd\") " pod="openshift-multus/multus-cbbvr" Jun 09 10:53:31.626397 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626207 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5ae97496-aa59-402a-b6c0-9fa21935f6bd-cni-binary-copy\") pod \"multus-cbbvr\" (UID: \"5ae97496-aa59-402a-b6c0-9fa21935f6bd\") " pod="openshift-multus/multus-cbbvr" Jun 09 10:53:31.626397 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626220 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5ae97496-aa59-402a-b6c0-9fa21935f6bd-host-run-netns\") pod \"multus-cbbvr\" (UID: \"5ae97496-aa59-402a-b6c0-9fa21935f6bd\") " pod="openshift-multus/multus-cbbvr" Jun 09 10:53:31.626397 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626233 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bb366f31-85bc-4642-ae05-6ce8ea4332b6-etc-systemd\") pod \"tuned-sdrg4\" (UID: \"bb366f31-85bc-4642-ae05-6ce8ea4332b6\") " pod="openshift-cluster-node-tuning-operator/tuned-sdrg4" Jun 09 10:53:31.626397 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626247 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4c9995b-4dc8-4453-b83f-db2d253332d2-original-pull-secret\") pod \"global-pull-secret-syncer-dk56m\" (UID: \"a4c9995b-4dc8-4453-b83f-db2d253332d2\") " pod="kube-system/global-pull-secret-syncer-dk56m" Jun 09 10:53:31.626397 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626261 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/56cf7f64-2643-4248-97d6-9a0fb569586a-sys-fs\") pod \"aws-ebs-csi-driver-node-7l67g\" (UID: \"56cf7f64-2643-4248-97d6-9a0fb569586a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l67g" Jun 09 10:53:31.626397 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626275 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pd7j\" (UniqueName: \"kubernetes.io/projected/d88d356c-48a2-4f25-b063-c322959af6da-kube-api-access-6pd7j\") pod \"node-resolver-dgc6w\" (UID: \"d88d356c-48a2-4f25-b063-c322959af6da\") " pod="openshift-dns/node-resolver-dgc6w" Jun 09 10:53:31.626397 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626300 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5ae97496-aa59-402a-b6c0-9fa21935f6bd-multus-daemon-config\") pod \"multus-cbbvr\" (UID: \"5ae97496-aa59-402a-b6c0-9fa21935f6bd\") " pod="openshift-multus/multus-cbbvr" Jun 09 10:53:31.626397 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626320 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-host-cni-bin\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.626397 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626340 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bb366f31-85bc-4642-ae05-6ce8ea4332b6-etc-sysctl-conf\") pod \"tuned-sdrg4\" (UID: \"bb366f31-85bc-4642-ae05-6ce8ea4332b6\") " pod="openshift-cluster-node-tuning-operator/tuned-sdrg4" Jun 09 10:53:31.626397 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626355 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rj6kl\" (UniqueName: \"kubernetes.io/projected/f26c0f26-60a4-4966-85ee-ba0bcf29163d-kube-api-access-rj6kl\") pod \"network-check-target-lnxhs\" (UID: \"f26c0f26-60a4-4966-85ee-ba0bcf29163d\") " pod="openshift-network-diagnostics/network-check-target-lnxhs" Jun 09 10:53:31.626397 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626373 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xd2gs\" (UniqueName: \"kubernetes.io/projected/54bb7588-9d33-42ed-beee-40735acba85b-kube-api-access-xd2gs\") pod \"iptables-alerter-9jczz\" (UID: \"54bb7588-9d33-42ed-beee-40735acba85b\") " pod="openshift-network-operator/iptables-alerter-9jczz" Jun 09 10:53:31.626397 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626387 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/56cf7f64-2643-4248-97d6-9a0fb569586a-registration-dir\") pod \"aws-ebs-csi-driver-node-7l67g\" (UID: \"56cf7f64-2643-4248-97d6-9a0fb569586a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l67g" Jun 09 10:53:31.626768 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626406 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/56cf7f64-2643-4248-97d6-9a0fb569586a-device-dir\") pod \"aws-ebs-csi-driver-node-7l67g\" (UID: \"56cf7f64-2643-4248-97d6-9a0fb569586a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l67g" Jun 09 10:53:31.626768 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626420 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/031e0407-4688-4603-ac78-f2e099c8aecd-agent-certs\") pod \"konnectivity-agent-k99tl\" (UID: \"031e0407-4688-4603-ac78-f2e099c8aecd\") " pod="kube-system/konnectivity-agent-k99tl" Jun 09 10:53:31.626768 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626433 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ae97496-aa59-402a-b6c0-9fa21935f6bd-etc-kubernetes\") pod \"multus-cbbvr\" (UID: \"5ae97496-aa59-402a-b6c0-9fa21935f6bd\") " pod="openshift-multus/multus-cbbvr" Jun 09 10:53:31.626768 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626446 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnvnz\" (UniqueName: \"kubernetes.io/projected/09719c2f-d21f-4f27-a982-3595ee62c857-kube-api-access-wnvnz\") pod \"network-metrics-daemon-c8zc8\" (UID: \"09719c2f-d21f-4f27-a982-3595ee62c857\") " pod="openshift-multus/network-metrics-daemon-c8zc8" Jun 09 10:53:31.626768 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626460 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-ovnkube-config\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.626768 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626478 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bb366f31-85bc-4642-ae05-6ce8ea4332b6-lib-modules\") pod \"tuned-sdrg4\" (UID: \"bb366f31-85bc-4642-ae05-6ce8ea4332b6\") " pod="openshift-cluster-node-tuning-operator/tuned-sdrg4" Jun 09 10:53:31.626768 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626497 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/56cf7f64-2643-4248-97d6-9a0fb569586a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7l67g\" (UID: \"56cf7f64-2643-4248-97d6-9a0fb569586a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l67g" Jun 09 10:53:31.626768 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626517 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/031e0407-4688-4603-ac78-f2e099c8aecd-konnectivity-ca\") pod \"konnectivity-agent-k99tl\" (UID: \"031e0407-4688-4603-ac78-f2e099c8aecd\") " pod="kube-system/konnectivity-agent-k99tl" Jun 09 10:53:31.626768 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626538 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5ae97496-aa59-402a-b6c0-9fa21935f6bd-multus-socket-dir-parent\") pod \"multus-cbbvr\" (UID: \"5ae97496-aa59-402a-b6c0-9fa21935f6bd\") " pod="openshift-multus/multus-cbbvr" Jun 09 10:53:31.626768 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626553 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5ae97496-aa59-402a-b6c0-9fa21935f6bd-multus-conf-dir\") pod \"multus-cbbvr\" (UID: \"5ae97496-aa59-402a-b6c0-9fa21935f6bd\") " pod="openshift-multus/multus-cbbvr" Jun 09 10:53:31.626768 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626567 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-host-run-netns\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.626768 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626599 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-ovnkube-script-lib\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.626768 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626617 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/54bb7588-9d33-42ed-beee-40735acba85b-iptables-alerter-script\") pod \"iptables-alerter-9jczz\" (UID: \"54bb7588-9d33-42ed-beee-40735acba85b\") " pod="openshift-network-operator/iptables-alerter-9jczz" Jun 09 10:53:31.626768 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626631 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrvxh\" (UniqueName: \"kubernetes.io/projected/56cf7f64-2643-4248-97d6-9a0fb569586a-kube-api-access-zrvxh\") pod \"aws-ebs-csi-driver-node-7l67g\" (UID: \"56cf7f64-2643-4248-97d6-9a0fb569586a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l67g" Jun 09 10:53:31.626768 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626647 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ae97496-aa59-402a-b6c0-9fa21935f6bd-host-var-lib-kubelet\") pod \"multus-cbbvr\" (UID: \"5ae97496-aa59-402a-b6c0-9fa21935f6bd\") " pod="openshift-multus/multus-cbbvr" Jun 09 10:53:31.626768 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626664 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bb366f31-85bc-4642-ae05-6ce8ea4332b6-etc-sysctl-d\") pod \"tuned-sdrg4\" (UID: \"bb366f31-85bc-4642-ae05-6ce8ea4332b6\") " pod="openshift-cluster-node-tuning-operator/tuned-sdrg4" Jun 09 10:53:31.627330 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626684 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bb366f31-85bc-4642-ae05-6ce8ea4332b6-run\") pod \"tuned-sdrg4\" (UID: \"bb366f31-85bc-4642-ae05-6ce8ea4332b6\") " pod="openshift-cluster-node-tuning-operator/tuned-sdrg4" Jun 09 10:53:31.627330 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626703 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54kpl\" (UniqueName: \"kubernetes.io/projected/bb366f31-85bc-4642-ae05-6ce8ea4332b6-kube-api-access-54kpl\") pod \"tuned-sdrg4\" (UID: \"bb366f31-85bc-4642-ae05-6ce8ea4332b6\") " pod="openshift-cluster-node-tuning-operator/tuned-sdrg4" Jun 09 10:53:31.627330 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626718 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/80f79584-5814-4878-a7cf-06e728baf7dc-cni-binary-copy\") pod \"multus-additional-cni-plugins-c9slb\" (UID: \"80f79584-5814-4878-a7cf-06e728baf7dc\") " pod="openshift-multus/multus-additional-cni-plugins-c9slb" Jun 09 10:53:31.627330 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626740 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d88d356c-48a2-4f25-b063-c322959af6da-hosts-file\") pod \"node-resolver-dgc6w\" (UID: \"d88d356c-48a2-4f25-b063-c322959af6da\") " pod="openshift-dns/node-resolver-dgc6w" Jun 09 10:53:31.627330 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626768 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5ae97496-aa59-402a-b6c0-9fa21935f6bd-host-var-lib-cni-bin\") pod \"multus-cbbvr\" (UID: \"5ae97496-aa59-402a-b6c0-9fa21935f6bd\") " pod="openshift-multus/multus-cbbvr" Jun 09 10:53:31.627330 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626786 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-host-slash\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.627330 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626800 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-host-run-ovn-kubernetes\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.627330 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626814 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-env-overrides\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.627330 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626827 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-host-kubelet\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.627330 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626841 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bb366f31-85bc-4642-ae05-6ce8ea4332b6-etc-tuned\") pod \"tuned-sdrg4\" (UID: \"bb366f31-85bc-4642-ae05-6ce8ea4332b6\") " pod="openshift-cluster-node-tuning-operator/tuned-sdrg4" Jun 09 10:53:31.627330 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626855 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/56cf7f64-2643-4248-97d6-9a0fb569586a-etc-selinux\") pod \"aws-ebs-csi-driver-node-7l67g\" (UID: \"56cf7f64-2643-4248-97d6-9a0fb569586a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l67g" Jun 09 10:53:31.627330 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626876 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfhnf\" (UniqueName: \"kubernetes.io/projected/47e4d25a-0728-4e43-83ac-673201e1647a-kube-api-access-gfhnf\") pod \"node-ca-qp2c7\" (UID: \"47e4d25a-0728-4e43-83ac-673201e1647a\") " pod="openshift-image-registry/node-ca-qp2c7" Jun 09 10:53:31.627330 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626903 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5ae97496-aa59-402a-b6c0-9fa21935f6bd-host-var-lib-cni-multus\") pod \"multus-cbbvr\" (UID: \"5ae97496-aa59-402a-b6c0-9fa21935f6bd\") " pod="openshift-multus/multus-cbbvr" Jun 09 10:53:31.627330 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626925 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-run-openvswitch\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.627330 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626942 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-host-cni-netd\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.627330 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626962 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bb366f31-85bc-4642-ae05-6ce8ea4332b6-etc-sysconfig\") pod \"tuned-sdrg4\" (UID: \"bb366f31-85bc-4642-ae05-6ce8ea4332b6\") " pod="openshift-cluster-node-tuning-operator/tuned-sdrg4" Jun 09 10:53:31.627814 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626984 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5ae97496-aa59-402a-b6c0-9fa21935f6bd-cnibin\") pod \"multus-cbbvr\" (UID: \"5ae97496-aa59-402a-b6c0-9fa21935f6bd\") " pod="openshift-multus/multus-cbbvr" Jun 09 10:53:31.627814 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.626998 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-systemd-units\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.627814 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.627023 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-var-lib-openvswitch\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.627814 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.627044 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-run-ovn\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.627814 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.627063 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb366f31-85bc-4642-ae05-6ce8ea4332b6-tmp\") pod \"tuned-sdrg4\" (UID: \"bb366f31-85bc-4642-ae05-6ce8ea4332b6\") " pod="openshift-cluster-node-tuning-operator/tuned-sdrg4" Jun 09 10:53:31.627814 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.627084 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/80f79584-5814-4878-a7cf-06e728baf7dc-os-release\") pod \"multus-additional-cni-plugins-c9slb\" (UID: \"80f79584-5814-4878-a7cf-06e728baf7dc\") " pod="openshift-multus/multus-additional-cni-plugins-c9slb" Jun 09 10:53:31.627814 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.627101 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-run-systemd\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.627814 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.627122 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-ovn-node-metrics-cert\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.627814 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.627136 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzc47\" (UniqueName: \"kubernetes.io/projected/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-kube-api-access-bzc47\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.627814 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.627160 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb366f31-85bc-4642-ae05-6ce8ea4332b6-etc-kubernetes\") pod \"tuned-sdrg4\" (UID: \"bb366f31-85bc-4642-ae05-6ce8ea4332b6\") " pod="openshift-cluster-node-tuning-operator/tuned-sdrg4" Jun 09 10:53:31.627814 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.627175 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/54bb7588-9d33-42ed-beee-40735acba85b-host-slash\") pod \"iptables-alerter-9jczz\" (UID: \"54bb7588-9d33-42ed-beee-40735acba85b\") " pod="openshift-network-operator/iptables-alerter-9jczz" Jun 09 10:53:31.627814 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.627195 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/47e4d25a-0728-4e43-83ac-673201e1647a-serviceca\") pod \"node-ca-qp2c7\" (UID: \"47e4d25a-0728-4e43-83ac-673201e1647a\") " pod="openshift-image-registry/node-ca-qp2c7" Jun 09 10:53:31.627814 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.627212 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5ae97496-aa59-402a-b6c0-9fa21935f6bd-host-run-multus-certs\") pod \"multus-cbbvr\" (UID: \"5ae97496-aa59-402a-b6c0-9fa21935f6bd\") " pod="openshift-multus/multus-cbbvr" Jun 09 10:53:31.627814 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.627228 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bb366f31-85bc-4642-ae05-6ce8ea4332b6-host\") pod \"tuned-sdrg4\" (UID: \"bb366f31-85bc-4642-ae05-6ce8ea4332b6\") " pod="openshift-cluster-node-tuning-operator/tuned-sdrg4" Jun 09 10:53:31.627814 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.627242 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/56cf7f64-2643-4248-97d6-9a0fb569586a-socket-dir\") pod \"aws-ebs-csi-driver-node-7l67g\" (UID: \"56cf7f64-2643-4248-97d6-9a0fb569586a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l67g" Jun 09 10:53:31.627814 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.627418 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 10:53:31.728189 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.728168 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfhnf\" (UniqueName: \"kubernetes.io/projected/47e4d25a-0728-4e43-83ac-673201e1647a-kube-api-access-gfhnf\") pod \"node-ca-qp2c7\" (UID: \"47e4d25a-0728-4e43-83ac-673201e1647a\") " pod="openshift-image-registry/node-ca-qp2c7" Jun 09 10:53:31.728313 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.728199 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5ae97496-aa59-402a-b6c0-9fa21935f6bd-host-var-lib-cni-multus\") pod \"multus-cbbvr\" (UID: \"5ae97496-aa59-402a-b6c0-9fa21935f6bd\") " pod="openshift-multus/multus-cbbvr" Jun 09 10:53:31.728313 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.728223 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-run-openvswitch\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.728313 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.728243 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-host-cni-netd\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.728313 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.728258 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bb366f31-85bc-4642-ae05-6ce8ea4332b6-etc-sysconfig\") pod \"tuned-sdrg4\" (UID: \"bb366f31-85bc-4642-ae05-6ce8ea4332b6\") " pod="openshift-cluster-node-tuning-operator/tuned-sdrg4" Jun 09 10:53:31.728313 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.728279 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5ae97496-aa59-402a-b6c0-9fa21935f6bd-cnibin\") pod \"multus-cbbvr\" (UID: \"5ae97496-aa59-402a-b6c0-9fa21935f6bd\") " pod="openshift-multus/multus-cbbvr" Jun 09 10:53:31.728313 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.728294 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5ae97496-aa59-402a-b6c0-9fa21935f6bd-host-var-lib-cni-multus\") pod \"multus-cbbvr\" (UID: \"5ae97496-aa59-402a-b6c0-9fa21935f6bd\") " pod="openshift-multus/multus-cbbvr" Jun 09 10:53:31.728313 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.728300 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-systemd-units\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.728313 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.728296 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-run-openvswitch\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.728691 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.728310 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-host-cni-netd\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.728691 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.728327 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-var-lib-openvswitch\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.728691 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.728350 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-run-ovn\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.728691 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.728357 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bb366f31-85bc-4642-ae05-6ce8ea4332b6-etc-sysconfig\") pod \"tuned-sdrg4\" (UID: \"bb366f31-85bc-4642-ae05-6ce8ea4332b6\") " pod="openshift-cluster-node-tuning-operator/tuned-sdrg4" Jun 09 10:53:31.728691 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.728361 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-systemd-units\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.728691 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.728373 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb366f31-85bc-4642-ae05-6ce8ea4332b6-tmp\") pod \"tuned-sdrg4\" (UID: \"bb366f31-85bc-4642-ae05-6ce8ea4332b6\") " pod="openshift-cluster-node-tuning-operator/tuned-sdrg4" Jun 09 10:53:31.728691 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.728381 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-var-lib-openvswitch\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.728691 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.728402 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5ae97496-aa59-402a-b6c0-9fa21935f6bd-cnibin\") pod \"multus-cbbvr\" (UID: \"5ae97496-aa59-402a-b6c0-9fa21935f6bd\") " pod="openshift-multus/multus-cbbvr" Jun 09 10:53:31.728691 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.728396 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/80f79584-5814-4878-a7cf-06e728baf7dc-os-release\") pod \"multus-additional-cni-plugins-c9slb\" (UID: \"80f79584-5814-4878-a7cf-06e728baf7dc\") " pod="openshift-multus/multus-additional-cni-plugins-c9slb" Jun 09 10:53:31.728691 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.728413 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-run-ovn\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.728691 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.728447 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-run-systemd\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.728691 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.728455 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/80f79584-5814-4878-a7cf-06e728baf7dc-os-release\") pod \"multus-additional-cni-plugins-c9slb\" (UID: \"80f79584-5814-4878-a7cf-06e728baf7dc\") " pod="openshift-multus/multus-additional-cni-plugins-c9slb" Jun 09 10:53:31.728691 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.728467 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-ovn-node-metrics-cert\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.728691 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.728488 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzc47\" (UniqueName: \"kubernetes.io/projected/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-kube-api-access-bzc47\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.728691 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.728513 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb366f31-85bc-4642-ae05-6ce8ea4332b6-etc-kubernetes\") pod \"tuned-sdrg4\" (UID: \"bb366f31-85bc-4642-ae05-6ce8ea4332b6\") " pod="openshift-cluster-node-tuning-operator/tuned-sdrg4" Jun 09 10:53:31.728691 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.728504 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-run-systemd\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.728691 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.728547 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/54bb7588-9d33-42ed-beee-40735acba85b-host-slash\") pod \"iptables-alerter-9jczz\" (UID: \"54bb7588-9d33-42ed-beee-40735acba85b\") " pod="openshift-network-operator/iptables-alerter-9jczz" Jun 09 10:53:31.728691 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.728575 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/47e4d25a-0728-4e43-83ac-673201e1647a-serviceca\") pod \"node-ca-qp2c7\" (UID: \"47e4d25a-0728-4e43-83ac-673201e1647a\") " pod="openshift-image-registry/node-ca-qp2c7" Jun 09 10:53:31.729477 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.728583 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb366f31-85bc-4642-ae05-6ce8ea4332b6-etc-kubernetes\") pod \"tuned-sdrg4\" (UID: \"bb366f31-85bc-4642-ae05-6ce8ea4332b6\") " pod="openshift-cluster-node-tuning-operator/tuned-sdrg4" Jun 09 10:53:31.729477 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.728620 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/54bb7588-9d33-42ed-beee-40735acba85b-host-slash\") pod \"iptables-alerter-9jczz\" (UID: \"54bb7588-9d33-42ed-beee-40735acba85b\") " pod="openshift-network-operator/iptables-alerter-9jczz" Jun 09 10:53:31.729477 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.728637 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5ae97496-aa59-402a-b6c0-9fa21935f6bd-host-run-multus-certs\") pod \"multus-cbbvr\" (UID: \"5ae97496-aa59-402a-b6c0-9fa21935f6bd\") " pod="openshift-multus/multus-cbbvr" Jun 09 10:53:31.729477 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.728662 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bb366f31-85bc-4642-ae05-6ce8ea4332b6-host\") pod \"tuned-sdrg4\" (UID: \"bb366f31-85bc-4642-ae05-6ce8ea4332b6\") " pod="openshift-cluster-node-tuning-operator/tuned-sdrg4" Jun 09 10:53:31.729477 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.728676 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5ae97496-aa59-402a-b6c0-9fa21935f6bd-host-run-multus-certs\") pod \"multus-cbbvr\" (UID: \"5ae97496-aa59-402a-b6c0-9fa21935f6bd\") " pod="openshift-multus/multus-cbbvr" Jun 09 10:53:31.729477 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.728686 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/56cf7f64-2643-4248-97d6-9a0fb569586a-socket-dir\") pod \"aws-ebs-csi-driver-node-7l67g\" (UID: \"56cf7f64-2643-4248-97d6-9a0fb569586a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l67g" Jun 09 10:53:31.729477 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.728711 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5ae97496-aa59-402a-b6c0-9fa21935f6bd-host-run-k8s-cni-cncf-io\") pod \"multus-cbbvr\" (UID: \"5ae97496-aa59-402a-b6c0-9fa21935f6bd\") " pod="openshift-multus/multus-cbbvr" Jun 09 10:53:31.729477 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.728730 2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 09 10:53:31.729477 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.728736 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09719c2f-d21f-4f27-a982-3595ee62c857-metrics-certs\") pod \"network-metrics-daemon-c8zc8\" (UID: \"09719c2f-d21f-4f27-a982-3595ee62c857\") " pod="openshift-multus/network-metrics-daemon-c8zc8" Jun 09 10:53:31.729477 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.728773 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5ae97496-aa59-402a-b6c0-9fa21935f6bd-host-run-k8s-cni-cncf-io\") pod \"multus-cbbvr\" (UID: \"5ae97496-aa59-402a-b6c0-9fa21935f6bd\") " pod="openshift-multus/multus-cbbvr" Jun 09 10:53:31.729477 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.728779 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-etc-openvswitch\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.729477 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.728802 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/56cf7f64-2643-4248-97d6-9a0fb569586a-socket-dir\") pod \"aws-ebs-csi-driver-node-7l67g\" (UID: \"56cf7f64-2643-4248-97d6-9a0fb569586a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l67g" Jun 09 10:53:31.729477 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.728736 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bb366f31-85bc-4642-ae05-6ce8ea4332b6-host\") pod \"tuned-sdrg4\" (UID: \"bb366f31-85bc-4642-ae05-6ce8ea4332b6\") " pod="openshift-cluster-node-tuning-operator/tuned-sdrg4" Jun 09 10:53:31.729477 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.728813 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bb366f31-85bc-4642-ae05-6ce8ea4332b6-etc-modprobe-d\") pod \"tuned-sdrg4\" (UID: \"bb366f31-85bc-4642-ae05-6ce8ea4332b6\") " pod="openshift-cluster-node-tuning-operator/tuned-sdrg4" Jun 09 10:53:31.729477 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:31.728807 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 10:53:31.729477 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.728842 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bb366f31-85bc-4642-ae05-6ce8ea4332b6-var-lib-kubelet\") pod \"tuned-sdrg4\" (UID: \"bb366f31-85bc-4642-ae05-6ce8ea4332b6\") " pod="openshift-cluster-node-tuning-operator/tuned-sdrg4" Jun 09 10:53:31.729477 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:31.728895 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09719c2f-d21f-4f27-a982-3595ee62c857-metrics-certs podName:09719c2f-d21f-4f27-a982-3595ee62c857 nodeName:}" failed. No retries permitted until 2026-06-09 10:53:32.228857092 +0000 UTC m=+2.093096914 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/09719c2f-d21f-4f27-a982-3595ee62c857-metrics-certs") pod "network-metrics-daemon-c8zc8" (UID: "09719c2f-d21f-4f27-a982-3595ee62c857") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 10:53:31.729477 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.728822 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-etc-openvswitch\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.730356 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.728922 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/80f79584-5814-4878-a7cf-06e728baf7dc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c9slb\" (UID: \"80f79584-5814-4878-a7cf-06e728baf7dc\") " pod="openshift-multus/multus-additional-cni-plugins-c9slb" Jun 09 10:53:31.730356 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.728940 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bb366f31-85bc-4642-ae05-6ce8ea4332b6-var-lib-kubelet\") pod \"tuned-sdrg4\" (UID: \"bb366f31-85bc-4642-ae05-6ce8ea4332b6\") " pod="openshift-cluster-node-tuning-operator/tuned-sdrg4" Jun 09 10:53:31.730356 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.728950 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/80f79584-5814-4878-a7cf-06e728baf7dc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c9slb\" (UID: \"80f79584-5814-4878-a7cf-06e728baf7dc\") " pod="openshift-multus/multus-additional-cni-plugins-c9slb" Jun 09 10:53:31.730356 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.728974 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/47e4d25a-0728-4e43-83ac-673201e1647a-host\") pod \"node-ca-qp2c7\" (UID: \"47e4d25a-0728-4e43-83ac-673201e1647a\") " pod="openshift-image-registry/node-ca-qp2c7" Jun 09 10:53:31.730356 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.728997 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnshw\" (UniqueName: \"kubernetes.io/projected/5ae97496-aa59-402a-b6c0-9fa21935f6bd-kube-api-access-wnshw\") pod \"multus-cbbvr\" (UID: \"5ae97496-aa59-402a-b6c0-9fa21935f6bd\") " pod="openshift-multus/multus-cbbvr" Jun 09 10:53:31.730356 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.729017 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-node-log\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.730356 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.729020 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bb366f31-85bc-4642-ae05-6ce8ea4332b6-etc-modprobe-d\") pod \"tuned-sdrg4\" (UID: \"bb366f31-85bc-4642-ae05-6ce8ea4332b6\") " pod="openshift-cluster-node-tuning-operator/tuned-sdrg4" Jun 09 10:53:31.730356 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.729037 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-log-socket\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.730356 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.729058 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80f79584-5814-4878-a7cf-06e728baf7dc-system-cni-dir\") pod \"multus-additional-cni-plugins-c9slb\" (UID: \"80f79584-5814-4878-a7cf-06e728baf7dc\") " pod="openshift-multus/multus-additional-cni-plugins-c9slb" Jun 09 10:53:31.730356 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.729081 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a4c9995b-4dc8-4453-b83f-db2d253332d2-dbus\") pod \"global-pull-secret-syncer-dk56m\" (UID: \"a4c9995b-4dc8-4453-b83f-db2d253332d2\") " pod="kube-system/global-pull-secret-syncer-dk56m" Jun 09 10:53:31.730356 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.729105 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.730356 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.729127 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bb366f31-85bc-4642-ae05-6ce8ea4332b6-sys\") pod \"tuned-sdrg4\" (UID: \"bb366f31-85bc-4642-ae05-6ce8ea4332b6\") " pod="openshift-cluster-node-tuning-operator/tuned-sdrg4" Jun 09 10:53:31.730356 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.729150 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vxzk\" (UniqueName: \"kubernetes.io/projected/80f79584-5814-4878-a7cf-06e728baf7dc-kube-api-access-9vxzk\") pod \"multus-additional-cni-plugins-c9slb\" (UID: \"80f79584-5814-4878-a7cf-06e728baf7dc\") " pod="openshift-multus/multus-additional-cni-plugins-c9slb" Jun 09 10:53:31.730356 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.729157 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/80f79584-5814-4878-a7cf-06e728baf7dc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c9slb\" (UID: \"80f79584-5814-4878-a7cf-06e728baf7dc\") " pod="openshift-multus/multus-additional-cni-plugins-c9slb" Jun 09 10:53:31.730356 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.729175 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d88d356c-48a2-4f25-b063-c322959af6da-tmp-dir\") pod \"node-resolver-dgc6w\" (UID: \"d88d356c-48a2-4f25-b063-c322959af6da\") " pod="openshift-dns/node-resolver-dgc6w" Jun 09 10:53:31.730356 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.729200 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5ae97496-aa59-402a-b6c0-9fa21935f6bd-os-release\") pod \"multus-cbbvr\" (UID: \"5ae97496-aa59-402a-b6c0-9fa21935f6bd\") " pod="openshift-multus/multus-cbbvr" Jun 09 10:53:31.730356 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.729221 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5ae97496-aa59-402a-b6c0-9fa21935f6bd-hostroot\") pod \"multus-cbbvr\" (UID: \"5ae97496-aa59-402a-b6c0-9fa21935f6bd\") " pod="openshift-multus/multus-cbbvr" Jun 09 10:53:31.731229 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.729244 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/80f79584-5814-4878-a7cf-06e728baf7dc-cnibin\") pod \"multus-additional-cni-plugins-c9slb\" (UID: \"80f79584-5814-4878-a7cf-06e728baf7dc\") " pod="openshift-multus/multus-additional-cni-plugins-c9slb" Jun 09 10:53:31.731229 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.729270 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/80f79584-5814-4878-a7cf-06e728baf7dc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c9slb\" (UID: \"80f79584-5814-4878-a7cf-06e728baf7dc\") " pod="openshift-multus/multus-additional-cni-plugins-c9slb" Jun 09 10:53:31.731229 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.729317 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a4c9995b-4dc8-4453-b83f-db2d253332d2-kubelet-config\") pod \"global-pull-secret-syncer-dk56m\" (UID: \"a4c9995b-4dc8-4453-b83f-db2d253332d2\") " pod="kube-system/global-pull-secret-syncer-dk56m" Jun 09 10:53:31.731229 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.729362 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5ae97496-aa59-402a-b6c0-9fa21935f6bd-system-cni-dir\") pod \"multus-cbbvr\" (UID: \"5ae97496-aa59-402a-b6c0-9fa21935f6bd\") " pod="openshift-multus/multus-cbbvr" Jun 09 10:53:31.731229 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.729367 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-log-socket\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.731229 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.729400 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5ae97496-aa59-402a-b6c0-9fa21935f6bd-multus-cni-dir\") pod \"multus-cbbvr\" (UID: \"5ae97496-aa59-402a-b6c0-9fa21935f6bd\") " pod="openshift-multus/multus-cbbvr" Jun 09 10:53:31.731229 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.729427 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5ae97496-aa59-402a-b6c0-9fa21935f6bd-cni-binary-copy\") pod \"multus-cbbvr\" (UID: \"5ae97496-aa59-402a-b6c0-9fa21935f6bd\") " pod="openshift-multus/multus-cbbvr" Jun 09 10:53:31.731229 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.729432 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/80f79584-5814-4878-a7cf-06e728baf7dc-cnibin\") pod \"multus-additional-cni-plugins-c9slb\" (UID: \"80f79584-5814-4878-a7cf-06e728baf7dc\") " pod="openshift-multus/multus-additional-cni-plugins-c9slb" Jun 09 10:53:31.731229 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.729437 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80f79584-5814-4878-a7cf-06e728baf7dc-system-cni-dir\") pod \"multus-additional-cni-plugins-c9slb\" (UID: \"80f79584-5814-4878-a7cf-06e728baf7dc\") " pod="openshift-multus/multus-additional-cni-plugins-c9slb" Jun 09 10:53:31.731229 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.729456 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5ae97496-aa59-402a-b6c0-9fa21935f6bd-host-run-netns\") pod \"multus-cbbvr\" (UID: \"5ae97496-aa59-402a-b6c0-9fa21935f6bd\") " pod="openshift-multus/multus-cbbvr" Jun 09 10:53:31.731229 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.729473 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bb366f31-85bc-4642-ae05-6ce8ea4332b6-sys\") pod \"tuned-sdrg4\" (UID: \"bb366f31-85bc-4642-ae05-6ce8ea4332b6\") " pod="openshift-cluster-node-tuning-operator/tuned-sdrg4" Jun 09 10:53:31.731229 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.729456 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/47e4d25a-0728-4e43-83ac-673201e1647a-host\") pod \"node-ca-qp2c7\" (UID: \"47e4d25a-0728-4e43-83ac-673201e1647a\") " pod="openshift-image-registry/node-ca-qp2c7" Jun 09 10:53:31.731229 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.729378 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.731229 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.729499 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5ae97496-aa59-402a-b6c0-9fa21935f6bd-host-run-netns\") pod \"multus-cbbvr\" (UID: \"5ae97496-aa59-402a-b6c0-9fa21935f6bd\") " pod="openshift-multus/multus-cbbvr" Jun 09 10:53:31.731229 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.729519 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5ae97496-aa59-402a-b6c0-9fa21935f6bd-hostroot\") pod \"multus-cbbvr\" (UID: \"5ae97496-aa59-402a-b6c0-9fa21935f6bd\") " pod="openshift-multus/multus-cbbvr" Jun 09 10:53:31.731229 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.729564 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5ae97496-aa59-402a-b6c0-9fa21935f6bd-multus-cni-dir\") pod \"multus-cbbvr\" (UID: \"5ae97496-aa59-402a-b6c0-9fa21935f6bd\") " pod="openshift-multus/multus-cbbvr" Jun 09 10:53:31.731229 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.729564 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5ae97496-aa59-402a-b6c0-9fa21935f6bd-system-cni-dir\") pod \"multus-cbbvr\" (UID: \"5ae97496-aa59-402a-b6c0-9fa21935f6bd\") " pod="openshift-multus/multus-cbbvr" Jun 09 10:53:31.731229 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.729638 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5ae97496-aa59-402a-b6c0-9fa21935f6bd-os-release\") pod \"multus-cbbvr\" (UID: \"5ae97496-aa59-402a-b6c0-9fa21935f6bd\") " pod="openshift-multus/multus-cbbvr" Jun 09 10:53:31.732074 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.729320 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a4c9995b-4dc8-4453-b83f-db2d253332d2-dbus\") pod \"global-pull-secret-syncer-dk56m\" (UID: \"a4c9995b-4dc8-4453-b83f-db2d253332d2\") " pod="kube-system/global-pull-secret-syncer-dk56m" Jun 09 10:53:31.732074 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.729651 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a4c9995b-4dc8-4453-b83f-db2d253332d2-kubelet-config\") pod \"global-pull-secret-syncer-dk56m\" (UID: \"a4c9995b-4dc8-4453-b83f-db2d253332d2\") " pod="kube-system/global-pull-secret-syncer-dk56m" Jun 09 10:53:31.732074 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.729702 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/80f79584-5814-4878-a7cf-06e728baf7dc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c9slb\" (UID: \"80f79584-5814-4878-a7cf-06e728baf7dc\") " pod="openshift-multus/multus-additional-cni-plugins-c9slb" Jun 09 10:53:31.732074 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.729761 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d88d356c-48a2-4f25-b063-c322959af6da-tmp-dir\") pod \"node-resolver-dgc6w\" (UID: \"d88d356c-48a2-4f25-b063-c322959af6da\") " pod="openshift-dns/node-resolver-dgc6w" Jun 09 10:53:31.732074 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.729786 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-node-log\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.732074 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.729812 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bb366f31-85bc-4642-ae05-6ce8ea4332b6-etc-systemd\") pod \"tuned-sdrg4\" (UID: \"bb366f31-85bc-4642-ae05-6ce8ea4332b6\") " pod="openshift-cluster-node-tuning-operator/tuned-sdrg4" Jun 09 10:53:31.732074 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.729839 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4c9995b-4dc8-4453-b83f-db2d253332d2-original-pull-secret\") pod \"global-pull-secret-syncer-dk56m\" (UID: \"a4c9995b-4dc8-4453-b83f-db2d253332d2\") " pod="kube-system/global-pull-secret-syncer-dk56m" Jun 09 10:53:31.732074 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.729865 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/56cf7f64-2643-4248-97d6-9a0fb569586a-sys-fs\") pod \"aws-ebs-csi-driver-node-7l67g\" (UID: \"56cf7f64-2643-4248-97d6-9a0fb569586a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l67g" Jun 09 10:53:31.732074 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.729878 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bb366f31-85bc-4642-ae05-6ce8ea4332b6-etc-systemd\") pod \"tuned-sdrg4\" (UID: \"bb366f31-85bc-4642-ae05-6ce8ea4332b6\") " pod="openshift-cluster-node-tuning-operator/tuned-sdrg4" Jun 09 10:53:31.732074 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.729889 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pd7j\" (UniqueName: \"kubernetes.io/projected/d88d356c-48a2-4f25-b063-c322959af6da-kube-api-access-6pd7j\") pod \"node-resolver-dgc6w\" (UID: \"d88d356c-48a2-4f25-b063-c322959af6da\") " pod="openshift-dns/node-resolver-dgc6w" Jun 09 10:53:31.732074 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.729916 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5ae97496-aa59-402a-b6c0-9fa21935f6bd-multus-daemon-config\") pod \"multus-cbbvr\" (UID: \"5ae97496-aa59-402a-b6c0-9fa21935f6bd\") " pod="openshift-multus/multus-cbbvr" Jun 09 10:53:31.732074 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.729940 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-host-cni-bin\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.732074 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:31.729949 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 10:53:31.732074 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.729963 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bb366f31-85bc-4642-ae05-6ce8ea4332b6-etc-sysctl-conf\") pod \"tuned-sdrg4\" (UID: \"bb366f31-85bc-4642-ae05-6ce8ea4332b6\") " pod="openshift-cluster-node-tuning-operator/tuned-sdrg4" Jun 09 10:53:31.732074 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.729987 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rj6kl\" (UniqueName: \"kubernetes.io/projected/f26c0f26-60a4-4966-85ee-ba0bcf29163d-kube-api-access-rj6kl\") pod \"network-check-target-lnxhs\" (UID: \"f26c0f26-60a4-4966-85ee-ba0bcf29163d\") " pod="openshift-network-diagnostics/network-check-target-lnxhs" Jun 09 10:53:31.732074 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.730072 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5ae97496-aa59-402a-b6c0-9fa21935f6bd-cni-binary-copy\") pod \"multus-cbbvr\" (UID: \"5ae97496-aa59-402a-b6c0-9fa21935f6bd\") " pod="openshift-multus/multus-cbbvr" Jun 09 10:53:31.732074 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.730114 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/80f79584-5814-4878-a7cf-06e728baf7dc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c9slb\" (UID: \"80f79584-5814-4878-a7cf-06e728baf7dc\") " pod="openshift-multus/multus-additional-cni-plugins-c9slb" Jun 09 10:53:31.732074 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.730136 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/56cf7f64-2643-4248-97d6-9a0fb569586a-sys-fs\") pod \"aws-ebs-csi-driver-node-7l67g\" (UID: \"56cf7f64-2643-4248-97d6-9a0fb569586a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l67g" Jun 09 10:53:31.732912 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.730178 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-host-cni-bin\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.732912 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.730247 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bb366f31-85bc-4642-ae05-6ce8ea4332b6-etc-sysctl-conf\") pod \"tuned-sdrg4\" (UID: \"bb366f31-85bc-4642-ae05-6ce8ea4332b6\") " pod="openshift-cluster-node-tuning-operator/tuned-sdrg4" Jun 09 10:53:31.732912 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.730347 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/47e4d25a-0728-4e43-83ac-673201e1647a-serviceca\") pod \"node-ca-qp2c7\" (UID: \"47e4d25a-0728-4e43-83ac-673201e1647a\") " pod="openshift-image-registry/node-ca-qp2c7" Jun 09 10:53:31.732912 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.730513 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5ae97496-aa59-402a-b6c0-9fa21935f6bd-multus-daemon-config\") pod \"multus-cbbvr\" (UID: \"5ae97496-aa59-402a-b6c0-9fa21935f6bd\") " pod="openshift-multus/multus-cbbvr" Jun 09 10:53:31.732912 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:31.730553 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4c9995b-4dc8-4453-b83f-db2d253332d2-original-pull-secret podName:a4c9995b-4dc8-4453-b83f-db2d253332d2 nodeName:}" failed. No retries permitted until 2026-06-09 10:53:32.229981778 +0000 UTC m=+2.094221603 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a4c9995b-4dc8-4453-b83f-db2d253332d2-original-pull-secret") pod "global-pull-secret-syncer-dk56m" (UID: "a4c9995b-4dc8-4453-b83f-db2d253332d2") : object "kube-system"/"original-pull-secret" not registered Jun 09 10:53:31.732912 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.730611 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xd2gs\" (UniqueName: \"kubernetes.io/projected/54bb7588-9d33-42ed-beee-40735acba85b-kube-api-access-xd2gs\") pod \"iptables-alerter-9jczz\" (UID: \"54bb7588-9d33-42ed-beee-40735acba85b\") " pod="openshift-network-operator/iptables-alerter-9jczz" Jun 09 10:53:31.732912 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.730635 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/56cf7f64-2643-4248-97d6-9a0fb569586a-registration-dir\") pod \"aws-ebs-csi-driver-node-7l67g\" (UID: \"56cf7f64-2643-4248-97d6-9a0fb569586a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l67g" Jun 09 10:53:31.732912 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.730652 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/56cf7f64-2643-4248-97d6-9a0fb569586a-device-dir\") pod \"aws-ebs-csi-driver-node-7l67g\" (UID: \"56cf7f64-2643-4248-97d6-9a0fb569586a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l67g" Jun 09 10:53:31.732912 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.730671 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/031e0407-4688-4603-ac78-f2e099c8aecd-agent-certs\") pod \"konnectivity-agent-k99tl\" (UID: \"031e0407-4688-4603-ac78-f2e099c8aecd\") " pod="kube-system/konnectivity-agent-k99tl" Jun 09 10:53:31.732912 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.730693 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ae97496-aa59-402a-b6c0-9fa21935f6bd-etc-kubernetes\") pod \"multus-cbbvr\" (UID: \"5ae97496-aa59-402a-b6c0-9fa21935f6bd\") " pod="openshift-multus/multus-cbbvr" Jun 09 10:53:31.732912 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.730717 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnvnz\" (UniqueName: \"kubernetes.io/projected/09719c2f-d21f-4f27-a982-3595ee62c857-kube-api-access-wnvnz\") pod \"network-metrics-daemon-c8zc8\" (UID: \"09719c2f-d21f-4f27-a982-3595ee62c857\") " pod="openshift-multus/network-metrics-daemon-c8zc8" Jun 09 10:53:31.732912 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.730728 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/56cf7f64-2643-4248-97d6-9a0fb569586a-device-dir\") pod \"aws-ebs-csi-driver-node-7l67g\" (UID: \"56cf7f64-2643-4248-97d6-9a0fb569586a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l67g" Jun 09 10:53:31.732912 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.730742 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-ovnkube-config\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.732912 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.730765 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bb366f31-85bc-4642-ae05-6ce8ea4332b6-lib-modules\") pod \"tuned-sdrg4\" (UID: \"bb366f31-85bc-4642-ae05-6ce8ea4332b6\") " pod="openshift-cluster-node-tuning-operator/tuned-sdrg4" Jun 09 10:53:31.732912 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.730783 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ae97496-aa59-402a-b6c0-9fa21935f6bd-etc-kubernetes\") pod \"multus-cbbvr\" (UID: \"5ae97496-aa59-402a-b6c0-9fa21935f6bd\") " pod="openshift-multus/multus-cbbvr" Jun 09 10:53:31.732912 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.730787 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/56cf7f64-2643-4248-97d6-9a0fb569586a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7l67g\" (UID: \"56cf7f64-2643-4248-97d6-9a0fb569586a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l67g" Jun 09 10:53:31.733726 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.730818 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/031e0407-4688-4603-ac78-f2e099c8aecd-konnectivity-ca\") pod \"konnectivity-agent-k99tl\" (UID: \"031e0407-4688-4603-ac78-f2e099c8aecd\") " pod="kube-system/konnectivity-agent-k99tl" Jun 09 10:53:31.733726 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.730831 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/56cf7f64-2643-4248-97d6-9a0fb569586a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7l67g\" (UID: \"56cf7f64-2643-4248-97d6-9a0fb569586a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l67g" Jun 09 10:53:31.733726 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.730843 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5ae97496-aa59-402a-b6c0-9fa21935f6bd-multus-socket-dir-parent\") pod \"multus-cbbvr\" (UID: \"5ae97496-aa59-402a-b6c0-9fa21935f6bd\") " pod="openshift-multus/multus-cbbvr" Jun 09 10:53:31.733726 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.730866 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5ae97496-aa59-402a-b6c0-9fa21935f6bd-multus-conf-dir\") pod \"multus-cbbvr\" (UID: \"5ae97496-aa59-402a-b6c0-9fa21935f6bd\") " pod="openshift-multus/multus-cbbvr" Jun 09 10:53:31.733726 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.730888 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-host-run-netns\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.733726 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.730911 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-ovnkube-script-lib\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.733726 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.730915 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bb366f31-85bc-4642-ae05-6ce8ea4332b6-lib-modules\") pod \"tuned-sdrg4\" (UID: \"bb366f31-85bc-4642-ae05-6ce8ea4332b6\") " pod="openshift-cluster-node-tuning-operator/tuned-sdrg4" Jun 09 10:53:31.733726 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.730948 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/54bb7588-9d33-42ed-beee-40735acba85b-iptables-alerter-script\") pod \"iptables-alerter-9jczz\" (UID: \"54bb7588-9d33-42ed-beee-40735acba85b\") " pod="openshift-network-operator/iptables-alerter-9jczz" Jun 09 10:53:31.733726 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.730977 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrvxh\" (UniqueName: \"kubernetes.io/projected/56cf7f64-2643-4248-97d6-9a0fb569586a-kube-api-access-zrvxh\") pod \"aws-ebs-csi-driver-node-7l67g\" (UID: \"56cf7f64-2643-4248-97d6-9a0fb569586a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l67g" Jun 09 10:53:31.733726 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.731003 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ae97496-aa59-402a-b6c0-9fa21935f6bd-host-var-lib-kubelet\") pod \"multus-cbbvr\" (UID: \"5ae97496-aa59-402a-b6c0-9fa21935f6bd\") " pod="openshift-multus/multus-cbbvr" Jun 09 10:53:31.733726 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.731027 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bb366f31-85bc-4642-ae05-6ce8ea4332b6-etc-sysctl-d\") pod \"tuned-sdrg4\" (UID: \"bb366f31-85bc-4642-ae05-6ce8ea4332b6\") " pod="openshift-cluster-node-tuning-operator/tuned-sdrg4" Jun 09 10:53:31.733726 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.731050 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bb366f31-85bc-4642-ae05-6ce8ea4332b6-run\") pod \"tuned-sdrg4\" (UID: \"bb366f31-85bc-4642-ae05-6ce8ea4332b6\") " pod="openshift-cluster-node-tuning-operator/tuned-sdrg4" Jun 09 10:53:31.733726 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.731075 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54kpl\" (UniqueName: \"kubernetes.io/projected/bb366f31-85bc-4642-ae05-6ce8ea4332b6-kube-api-access-54kpl\") pod \"tuned-sdrg4\" (UID: \"bb366f31-85bc-4642-ae05-6ce8ea4332b6\") " pod="openshift-cluster-node-tuning-operator/tuned-sdrg4" Jun 09 10:53:31.733726 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.731105 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/80f79584-5814-4878-a7cf-06e728baf7dc-cni-binary-copy\") pod \"multus-additional-cni-plugins-c9slb\" (UID: \"80f79584-5814-4878-a7cf-06e728baf7dc\") " pod="openshift-multus/multus-additional-cni-plugins-c9slb" Jun 09 10:53:31.733726 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.731116 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ae97496-aa59-402a-b6c0-9fa21935f6bd-host-var-lib-kubelet\") pod \"multus-cbbvr\" (UID: \"5ae97496-aa59-402a-b6c0-9fa21935f6bd\") " pod="openshift-multus/multus-cbbvr" Jun 09 10:53:31.733726 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.731131 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d88d356c-48a2-4f25-b063-c322959af6da-hosts-file\") pod \"node-resolver-dgc6w\" (UID: \"d88d356c-48a2-4f25-b063-c322959af6da\") " pod="openshift-dns/node-resolver-dgc6w" Jun 09 10:53:31.733726 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.731182 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d88d356c-48a2-4f25-b063-c322959af6da-hosts-file\") pod \"node-resolver-dgc6w\" (UID: \"d88d356c-48a2-4f25-b063-c322959af6da\") " pod="openshift-dns/node-resolver-dgc6w" Jun 09 10:53:31.734578 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.731266 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bb366f31-85bc-4642-ae05-6ce8ea4332b6-etc-sysctl-d\") pod \"tuned-sdrg4\" (UID: \"bb366f31-85bc-4642-ae05-6ce8ea4332b6\") " pod="openshift-cluster-node-tuning-operator/tuned-sdrg4" Jun 09 10:53:31.734578 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.731312 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bb366f31-85bc-4642-ae05-6ce8ea4332b6-run\") pod \"tuned-sdrg4\" (UID: \"bb366f31-85bc-4642-ae05-6ce8ea4332b6\") " pod="openshift-cluster-node-tuning-operator/tuned-sdrg4" Jun 09 10:53:31.734578 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.731368 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-ovnkube-config\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.734578 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.731402 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-ovnkube-script-lib\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.734578 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.731705 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5ae97496-aa59-402a-b6c0-9fa21935f6bd-multus-conf-dir\") pod \"multus-cbbvr\" (UID: \"5ae97496-aa59-402a-b6c0-9fa21935f6bd\") " pod="openshift-multus/multus-cbbvr" Jun 09 10:53:31.734578 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.731720 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/54bb7588-9d33-42ed-beee-40735acba85b-iptables-alerter-script\") pod \"iptables-alerter-9jczz\" (UID: \"54bb7588-9d33-42ed-beee-40735acba85b\") " pod="openshift-network-operator/iptables-alerter-9jczz" Jun 09 10:53:31.734578 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.731764 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5ae97496-aa59-402a-b6c0-9fa21935f6bd-multus-socket-dir-parent\") pod \"multus-cbbvr\" (UID: \"5ae97496-aa59-402a-b6c0-9fa21935f6bd\") " pod="openshift-multus/multus-cbbvr" Jun 09 10:53:31.734578 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.731768 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5ae97496-aa59-402a-b6c0-9fa21935f6bd-host-var-lib-cni-bin\") pod \"multus-cbbvr\" (UID: \"5ae97496-aa59-402a-b6c0-9fa21935f6bd\") " pod="openshift-multus/multus-cbbvr" Jun 09 10:53:31.734578 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.731802 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-host-slash\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.734578 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.731808 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5ae97496-aa59-402a-b6c0-9fa21935f6bd-host-var-lib-cni-bin\") pod \"multus-cbbvr\" (UID: \"5ae97496-aa59-402a-b6c0-9fa21935f6bd\") " pod="openshift-multus/multus-cbbvr" Jun 09 10:53:31.734578 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.731825 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-host-run-ovn-kubernetes\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.734578 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.731848 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-env-overrides\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.734578 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.731847 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/80f79584-5814-4878-a7cf-06e728baf7dc-cni-binary-copy\") pod \"multus-additional-cni-plugins-c9slb\" (UID: \"80f79584-5814-4878-a7cf-06e728baf7dc\") " pod="openshift-multus/multus-additional-cni-plugins-c9slb" Jun 09 10:53:31.734578 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.731870 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-host-kubelet\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.734578 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.731878 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-host-run-netns\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.734578 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.731849 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-host-slash\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.734578 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.731880 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/031e0407-4688-4603-ac78-f2e099c8aecd-konnectivity-ca\") pod \"konnectivity-agent-k99tl\" (UID: \"031e0407-4688-4603-ac78-f2e099c8aecd\") " pod="kube-system/konnectivity-agent-k99tl" Jun 09 10:53:31.734578 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.731895 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bb366f31-85bc-4642-ae05-6ce8ea4332b6-etc-tuned\") pod \"tuned-sdrg4\" (UID: \"bb366f31-85bc-4642-ae05-6ce8ea4332b6\") " pod="openshift-cluster-node-tuning-operator/tuned-sdrg4" Jun 09 10:53:31.735433 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.731919 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/56cf7f64-2643-4248-97d6-9a0fb569586a-etc-selinux\") pod \"aws-ebs-csi-driver-node-7l67g\" (UID: \"56cf7f64-2643-4248-97d6-9a0fb569586a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l67g" Jun 09 10:53:31.735433 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.731930 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-host-run-ovn-kubernetes\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.735433 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.731933 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-host-kubelet\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.735433 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.732001 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/56cf7f64-2643-4248-97d6-9a0fb569586a-registration-dir\") pod \"aws-ebs-csi-driver-node-7l67g\" (UID: \"56cf7f64-2643-4248-97d6-9a0fb569586a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l67g" Jun 09 10:53:31.735433 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.732012 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/56cf7f64-2643-4248-97d6-9a0fb569586a-etc-selinux\") pod \"aws-ebs-csi-driver-node-7l67g\" (UID: \"56cf7f64-2643-4248-97d6-9a0fb569586a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l67g" Jun 09 10:53:31.735433 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.732207 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-env-overrides\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.735433 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.732288 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb366f31-85bc-4642-ae05-6ce8ea4332b6-tmp\") pod \"tuned-sdrg4\" (UID: \"bb366f31-85bc-4642-ae05-6ce8ea4332b6\") " pod="openshift-cluster-node-tuning-operator/tuned-sdrg4" Jun 09 10:53:31.735433 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.732390 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-ovn-node-metrics-cert\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.735433 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.733173 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/031e0407-4688-4603-ac78-f2e099c8aecd-agent-certs\") pod \"konnectivity-agent-k99tl\" (UID: \"031e0407-4688-4603-ac78-f2e099c8aecd\") " pod="kube-system/konnectivity-agent-k99tl" Jun 09 10:53:31.735433 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.733582 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bb366f31-85bc-4642-ae05-6ce8ea4332b6-etc-tuned\") pod \"tuned-sdrg4\" (UID: \"bb366f31-85bc-4642-ae05-6ce8ea4332b6\") " pod="openshift-cluster-node-tuning-operator/tuned-sdrg4" Jun 09 10:53:31.748054 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.747970 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54kpl\" (UniqueName: \"kubernetes.io/projected/bb366f31-85bc-4642-ae05-6ce8ea4332b6-kube-api-access-54kpl\") pod \"tuned-sdrg4\" (UID: \"bb366f31-85bc-4642-ae05-6ce8ea4332b6\") " pod="openshift-cluster-node-tuning-operator/tuned-sdrg4" Jun 09 10:53:31.748054 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.748017 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnvnz\" (UniqueName: \"kubernetes.io/projected/09719c2f-d21f-4f27-a982-3595ee62c857-kube-api-access-wnvnz\") pod \"network-metrics-daemon-c8zc8\" (UID: \"09719c2f-d21f-4f27-a982-3595ee62c857\") " pod="openshift-multus/network-metrics-daemon-c8zc8" Jun 09 10:53:31.748251 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:31.748176 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 10:53:31.748251 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:31.748200 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 10:53:31.748251 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:31.748212 2562 projected.go:196] Error preparing data for projected volume kube-api-access-rj6kl for pod openshift-network-diagnostics/network-check-target-lnxhs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 10:53:31.748403 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:31.748331 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f26c0f26-60a4-4966-85ee-ba0bcf29163d-kube-api-access-rj6kl podName:f26c0f26-60a4-4966-85ee-ba0bcf29163d nodeName:}" failed. No retries permitted until 2026-06-09 10:53:32.248315091 +0000 UTC m=+2.112554917 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rj6kl" (UniqueName: "kubernetes.io/projected/f26c0f26-60a4-4966-85ee-ba0bcf29163d-kube-api-access-rj6kl") pod "network-check-target-lnxhs" (UID: "f26c0f26-60a4-4966-85ee-ba0bcf29163d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 10:53:31.748624 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.748577 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfhnf\" (UniqueName: \"kubernetes.io/projected/47e4d25a-0728-4e43-83ac-673201e1647a-kube-api-access-gfhnf\") pod \"node-ca-qp2c7\" (UID: \"47e4d25a-0728-4e43-83ac-673201e1647a\") " pod="openshift-image-registry/node-ca-qp2c7" Jun 09 10:53:31.748738 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.748723 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pd7j\" (UniqueName: \"kubernetes.io/projected/d88d356c-48a2-4f25-b063-c322959af6da-kube-api-access-6pd7j\") pod \"node-resolver-dgc6w\" (UID: \"d88d356c-48a2-4f25-b063-c322959af6da\") " pod="openshift-dns/node-resolver-dgc6w" Jun 09 10:53:31.749155 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.749134 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrvxh\" (UniqueName: \"kubernetes.io/projected/56cf7f64-2643-4248-97d6-9a0fb569586a-kube-api-access-zrvxh\") pod \"aws-ebs-csi-driver-node-7l67g\" (UID: \"56cf7f64-2643-4248-97d6-9a0fb569586a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l67g" Jun 09 10:53:31.750200 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.750178 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzc47\" (UniqueName: \"kubernetes.io/projected/1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070-kube-api-access-bzc47\") pod \"ovnkube-node-vjfd2\" (UID: \"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.750356 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.750337 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xd2gs\" (UniqueName: \"kubernetes.io/projected/54bb7588-9d33-42ed-beee-40735acba85b-kube-api-access-xd2gs\") pod \"iptables-alerter-9jczz\" (UID: \"54bb7588-9d33-42ed-beee-40735acba85b\") " pod="openshift-network-operator/iptables-alerter-9jczz" Jun 09 10:53:31.750683 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.750668 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnshw\" (UniqueName: \"kubernetes.io/projected/5ae97496-aa59-402a-b6c0-9fa21935f6bd-kube-api-access-wnshw\") pod \"multus-cbbvr\" (UID: \"5ae97496-aa59-402a-b6c0-9fa21935f6bd\") " pod="openshift-multus/multus-cbbvr" Jun 09 10:53:31.754322 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.754301 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vxzk\" (UniqueName: \"kubernetes.io/projected/80f79584-5814-4878-a7cf-06e728baf7dc-kube-api-access-9vxzk\") pod \"multus-additional-cni-plugins-c9slb\" (UID: \"80f79584-5814-4878-a7cf-06e728baf7dc\") " pod="openshift-multus/multus-additional-cni-plugins-c9slb" Jun 09 10:53:31.835624 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.835557 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sdrg4" Jun 09 10:53:31.842370 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.842352 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dgc6w" Jun 09 10:53:31.842838 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:31.842821 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb366f31_85bc_4642_ae05_6ce8ea4332b6.slice/crio-5bea0af8cc2774f8d2a8d43c9d9d7f4a8dc8e411ffa54c47310d8cce83e296eb WatchSource:0}: Error finding container 5bea0af8cc2774f8d2a8d43c9d9d7f4a8dc8e411ffa54c47310d8cce83e296eb: Status 404 returned error can't find the container with id 5bea0af8cc2774f8d2a8d43c9d9d7f4a8dc8e411ffa54c47310d8cce83e296eb Jun 09 10:53:31.849112 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:31.849095 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd88d356c_48a2_4f25_b063_c322959af6da.slice/crio-b1c41e4b269ba3aa40347b37bae6eb451e0f7eb73c7ea91050fb4b455cb95c4c WatchSource:0}: Error finding container b1c41e4b269ba3aa40347b37bae6eb451e0f7eb73c7ea91050fb4b455cb95c4c: Status 404 returned error can't find the container with id b1c41e4b269ba3aa40347b37bae6eb451e0f7eb73c7ea91050fb4b455cb95c4c Jun 09 10:53:31.850433 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.850417 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-k99tl" Jun 09 10:53:31.855802 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.855783 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qp2c7" Jun 09 10:53:31.860818 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:31.860798 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod031e0407_4688_4603_ac78_f2e099c8aecd.slice/crio-ce09d18bb6aceccc75c03ed11cadb92b138689aeaa71b14a3854efcc03f1ea1c WatchSource:0}: Error finding container ce09d18bb6aceccc75c03ed11cadb92b138689aeaa71b14a3854efcc03f1ea1c: Status 404 returned error can't find the container with id ce09d18bb6aceccc75c03ed11cadb92b138689aeaa71b14a3854efcc03f1ea1c Jun 09 10:53:31.862055 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.861956 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cbbvr" Jun 09 10:53:31.864831 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:31.864805 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47e4d25a_0728_4e43_83ac_673201e1647a.slice/crio-b4f65044bf67ace6a951f6b8aca5b19001d19b8e02735afa64f502c89dc18f1e WatchSource:0}: Error finding container b4f65044bf67ace6a951f6b8aca5b19001d19b8e02735afa64f502c89dc18f1e: Status 404 returned error can't find the container with id b4f65044bf67ace6a951f6b8aca5b19001d19b8e02735afa64f502c89dc18f1e Jun 09 10:53:31.866675 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.866656 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:31.869782 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:31.869737 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ae97496_aa59_402a_b6c0_9fa21935f6bd.slice/crio-39d306bcad525e3623ca199738f6944d9559d929d477fa12e356826dbb4bd027 WatchSource:0}: Error finding container 39d306bcad525e3623ca199738f6944d9559d929d477fa12e356826dbb4bd027: Status 404 returned error can't find the container with id 39d306bcad525e3623ca199738f6944d9559d929d477fa12e356826dbb4bd027 Jun 09 10:53:31.873233 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.873212 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9jczz" Jun 09 10:53:31.874852 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:31.874832 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ef9b0dc_b26a_43e6_b0bf_0b72c22c3070.slice/crio-561aa56e41b1a2d36947affaf874678861ba835bf7fa191b7dda46c0d5378762 WatchSource:0}: Error finding container 561aa56e41b1a2d36947affaf874678861ba835bf7fa191b7dda46c0d5378762: Status 404 returned error can't find the container with id 561aa56e41b1a2d36947affaf874678861ba835bf7fa191b7dda46c0d5378762 Jun 09 10:53:31.878557 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.878536 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-c9slb" Jun 09 10:53:31.883011 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:31.882990 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l67g" Jun 09 10:53:31.884032 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:31.884011 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54bb7588_9d33_42ed_beee_40735acba85b.slice/crio-e1a43d4ff720efd34fddde7218ea240869e3937b5a7e218ec075b6b1ac8f3b64 WatchSource:0}: Error finding container e1a43d4ff720efd34fddde7218ea240869e3937b5a7e218ec075b6b1ac8f3b64: Status 404 returned error can't find the container with id e1a43d4ff720efd34fddde7218ea240869e3937b5a7e218ec075b6b1ac8f3b64 Jun 09 10:53:31.888070 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:31.888047 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80f79584_5814_4878_a7cf_06e728baf7dc.slice/crio-191e8317c51518eb8c66cca28f6e754579196aaa7f135140e63fbb08f3a03ff8 WatchSource:0}: Error finding container 191e8317c51518eb8c66cca28f6e754579196aaa7f135140e63fbb08f3a03ff8: Status 404 returned error can't find the container with id 191e8317c51518eb8c66cca28f6e754579196aaa7f135140e63fbb08f3a03ff8 Jun 09 10:53:31.892377 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:53:31.892355 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56cf7f64_2643_4248_97d6_9a0fb569586a.slice/crio-9fb143f9a906e18e3d97f68c38ef8a3fc49593879faf2a3805ddaedd6b93b8a9 WatchSource:0}: Error finding container 9fb143f9a906e18e3d97f68c38ef8a3fc49593879faf2a3805ddaedd6b93b8a9: Status 404 returned error can't find the container with id 9fb143f9a906e18e3d97f68c38ef8a3fc49593879faf2a3805ddaedd6b93b8a9 Jun 09 10:53:32.235450 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:32.235414 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4c9995b-4dc8-4453-b83f-db2d253332d2-original-pull-secret\") pod \"global-pull-secret-syncer-dk56m\" (UID: \"a4c9995b-4dc8-4453-b83f-db2d253332d2\") " pod="kube-system/global-pull-secret-syncer-dk56m" Jun 09 10:53:32.235630 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:32.235517 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09719c2f-d21f-4f27-a982-3595ee62c857-metrics-certs\") pod \"network-metrics-daemon-c8zc8\" (UID: \"09719c2f-d21f-4f27-a982-3595ee62c857\") " pod="openshift-multus/network-metrics-daemon-c8zc8" Jun 09 10:53:32.235712 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:32.235660 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 10:53:32.235764 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:32.235723 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09719c2f-d21f-4f27-a982-3595ee62c857-metrics-certs podName:09719c2f-d21f-4f27-a982-3595ee62c857 nodeName:}" failed. No retries permitted until 2026-06-09 10:53:33.235703095 +0000 UTC m=+3.099942917 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/09719c2f-d21f-4f27-a982-3595ee62c857-metrics-certs") pod "network-metrics-daemon-c8zc8" (UID: "09719c2f-d21f-4f27-a982-3595ee62c857") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 10:53:32.235999 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:32.235931 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 10:53:32.235999 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:32.235980 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4c9995b-4dc8-4453-b83f-db2d253332d2-original-pull-secret podName:a4c9995b-4dc8-4453-b83f-db2d253332d2 nodeName:}" failed. No retries permitted until 2026-06-09 10:53:33.235967787 +0000 UTC m=+3.100207610 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a4c9995b-4dc8-4453-b83f-db2d253332d2-original-pull-secret") pod "global-pull-secret-syncer-dk56m" (UID: "a4c9995b-4dc8-4453-b83f-db2d253332d2") : object "kube-system"/"original-pull-secret" not registered Jun 09 10:53:32.336854 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:32.336819 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rj6kl\" (UniqueName: \"kubernetes.io/projected/f26c0f26-60a4-4966-85ee-ba0bcf29163d-kube-api-access-rj6kl\") pod \"network-check-target-lnxhs\" (UID: \"f26c0f26-60a4-4966-85ee-ba0bcf29163d\") " pod="openshift-network-diagnostics/network-check-target-lnxhs" Jun 09 10:53:32.337041 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:32.337024 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 10:53:32.337116 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:32.337049 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 10:53:32.337116 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:32.337061 2562 projected.go:196] Error preparing data for projected volume kube-api-access-rj6kl for pod openshift-network-diagnostics/network-check-target-lnxhs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 10:53:32.337212 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:32.337118 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f26c0f26-60a4-4966-85ee-ba0bcf29163d-kube-api-access-rj6kl podName:f26c0f26-60a4-4966-85ee-ba0bcf29163d nodeName:}" failed. No retries permitted until 2026-06-09 10:53:33.337100177 +0000 UTC m=+3.201339998 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rj6kl" (UniqueName: "kubernetes.io/projected/f26c0f26-60a4-4966-85ee-ba0bcf29163d-kube-api-access-rj6kl") pod "network-check-target-lnxhs" (UID: "f26c0f26-60a4-4966-85ee-ba0bcf29163d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 10:53:32.580362 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:32.580271 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 10:48:31 +0000 UTC" deadline="2028-01-31 11:37:06.102425286 +0000 UTC" Jun 09 10:53:32.580362 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:32.580315 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14424h43m33.522115072s" Jun 09 10:53:32.621482 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:32.621447 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qp2c7" event={"ID":"47e4d25a-0728-4e43-83ac-673201e1647a","Type":"ContainerStarted","Data":"b4f65044bf67ace6a951f6b8aca5b19001d19b8e02735afa64f502c89dc18f1e"} Jun 09 10:53:32.643517 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:32.643490 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l67g" event={"ID":"56cf7f64-2643-4248-97d6-9a0fb569586a","Type":"ContainerStarted","Data":"9fb143f9a906e18e3d97f68c38ef8a3fc49593879faf2a3805ddaedd6b93b8a9"} Jun 09 10:53:32.664541 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:32.664403 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c9slb" event={"ID":"80f79584-5814-4878-a7cf-06e728baf7dc","Type":"ContainerStarted","Data":"191e8317c51518eb8c66cca28f6e754579196aaa7f135140e63fbb08f3a03ff8"} Jun 09 10:53:32.680380 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:32.680352 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cbbvr" event={"ID":"5ae97496-aa59-402a-b6c0-9fa21935f6bd","Type":"ContainerStarted","Data":"39d306bcad525e3623ca199738f6944d9559d929d477fa12e356826dbb4bd027"} Jun 09 10:53:32.693871 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:32.693844 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-k99tl" event={"ID":"031e0407-4688-4603-ac78-f2e099c8aecd","Type":"ContainerStarted","Data":"ce09d18bb6aceccc75c03ed11cadb92b138689aeaa71b14a3854efcc03f1ea1c"} Jun 09 10:53:32.698159 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:32.698135 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dgc6w" event={"ID":"d88d356c-48a2-4f25-b063-c322959af6da","Type":"ContainerStarted","Data":"b1c41e4b269ba3aa40347b37bae6eb451e0f7eb73c7ea91050fb4b455cb95c4c"} Jun 09 10:53:32.703683 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:32.703656 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sdrg4" event={"ID":"bb366f31-85bc-4642-ae05-6ce8ea4332b6","Type":"ContainerStarted","Data":"5bea0af8cc2774f8d2a8d43c9d9d7f4a8dc8e411ffa54c47310d8cce83e296eb"} Jun 09 10:53:32.715791 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:32.715767 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9jczz" event={"ID":"54bb7588-9d33-42ed-beee-40735acba85b","Type":"ContainerStarted","Data":"e1a43d4ff720efd34fddde7218ea240869e3937b5a7e218ec075b6b1ac8f3b64"} Jun 09 10:53:32.720948 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:32.720844 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" event={"ID":"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070","Type":"ContainerStarted","Data":"561aa56e41b1a2d36947affaf874678861ba835bf7fa191b7dda46c0d5378762"} Jun 09 10:53:33.244833 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:33.244031 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4c9995b-4dc8-4453-b83f-db2d253332d2-original-pull-secret\") pod \"global-pull-secret-syncer-dk56m\" (UID: \"a4c9995b-4dc8-4453-b83f-db2d253332d2\") " pod="kube-system/global-pull-secret-syncer-dk56m" Jun 09 10:53:33.244833 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:33.244112 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09719c2f-d21f-4f27-a982-3595ee62c857-metrics-certs\") pod \"network-metrics-daemon-c8zc8\" (UID: \"09719c2f-d21f-4f27-a982-3595ee62c857\") " pod="openshift-multus/network-metrics-daemon-c8zc8" Jun 09 10:53:33.244833 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:33.244233 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 10:53:33.244833 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:33.244291 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09719c2f-d21f-4f27-a982-3595ee62c857-metrics-certs podName:09719c2f-d21f-4f27-a982-3595ee62c857 nodeName:}" failed. No retries permitted until 2026-06-09 10:53:35.244273933 +0000 UTC m=+5.108513755 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/09719c2f-d21f-4f27-a982-3595ee62c857-metrics-certs") pod "network-metrics-daemon-c8zc8" (UID: "09719c2f-d21f-4f27-a982-3595ee62c857") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 10:53:33.244833 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:33.244716 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 10:53:33.244833 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:33.244778 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4c9995b-4dc8-4453-b83f-db2d253332d2-original-pull-secret podName:a4c9995b-4dc8-4453-b83f-db2d253332d2 nodeName:}" failed. No retries permitted until 2026-06-09 10:53:35.244750473 +0000 UTC m=+5.108990284 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a4c9995b-4dc8-4453-b83f-db2d253332d2-original-pull-secret") pod "global-pull-secret-syncer-dk56m" (UID: "a4c9995b-4dc8-4453-b83f-db2d253332d2") : object "kube-system"/"original-pull-secret" not registered Jun 09 10:53:33.344611 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:33.344565 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rj6kl\" (UniqueName: \"kubernetes.io/projected/f26c0f26-60a4-4966-85ee-ba0bcf29163d-kube-api-access-rj6kl\") pod \"network-check-target-lnxhs\" (UID: \"f26c0f26-60a4-4966-85ee-ba0bcf29163d\") " pod="openshift-network-diagnostics/network-check-target-lnxhs" Jun 09 10:53:33.344780 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:33.344718 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 10:53:33.344780 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:33.344736 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 10:53:33.344780 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:33.344748 2562 projected.go:196] Error preparing data for projected volume kube-api-access-rj6kl for pod openshift-network-diagnostics/network-check-target-lnxhs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 10:53:33.344938 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:33.344801 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f26c0f26-60a4-4966-85ee-ba0bcf29163d-kube-api-access-rj6kl podName:f26c0f26-60a4-4966-85ee-ba0bcf29163d nodeName:}" failed. No retries permitted until 2026-06-09 10:53:35.344783535 +0000 UTC m=+5.209023358 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rj6kl" (UniqueName: "kubernetes.io/projected/f26c0f26-60a4-4966-85ee-ba0bcf29163d-kube-api-access-rj6kl") pod "network-check-target-lnxhs" (UID: "f26c0f26-60a4-4966-85ee-ba0bcf29163d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 10:53:33.581307 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:33.581177 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 10:48:31 +0000 UTC" deadline="2028-01-14 16:38:22.27982476 +0000 UTC" Jun 09 10:53:33.581307 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:33.581232 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14021h44m48.698596874s" Jun 09 10:53:33.592512 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:33.592482 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dk56m" Jun 09 10:53:33.592681 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:33.592618 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dk56m" podUID="a4c9995b-4dc8-4453-b83f-db2d253332d2" Jun 09 10:53:33.593125 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:33.592998 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c8zc8" Jun 09 10:53:33.593125 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:33.593105 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c8zc8" podUID="09719c2f-d21f-4f27-a982-3595ee62c857" Jun 09 10:53:33.593237 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:33.593166 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnxhs" Jun 09 10:53:33.593237 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:33.593230 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnxhs" podUID="f26c0f26-60a4-4966-85ee-ba0bcf29163d" Jun 09 10:53:34.437903 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:34.437438 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 10:53:34.627331 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:34.627302 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 10:53:35.260698 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:35.260541 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4c9995b-4dc8-4453-b83f-db2d253332d2-original-pull-secret\") pod \"global-pull-secret-syncer-dk56m\" (UID: \"a4c9995b-4dc8-4453-b83f-db2d253332d2\") " pod="kube-system/global-pull-secret-syncer-dk56m" Jun 09 10:53:35.260698 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:35.260643 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09719c2f-d21f-4f27-a982-3595ee62c857-metrics-certs\") pod \"network-metrics-daemon-c8zc8\" (UID: \"09719c2f-d21f-4f27-a982-3595ee62c857\") " pod="openshift-multus/network-metrics-daemon-c8zc8" Jun 09 10:53:35.260944 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:35.260719 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 10:53:35.260944 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:35.260744 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 10:53:35.260944 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:35.260791 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4c9995b-4dc8-4453-b83f-db2d253332d2-original-pull-secret podName:a4c9995b-4dc8-4453-b83f-db2d253332d2 nodeName:}" failed. No retries permitted until 2026-06-09 10:53:39.26077121 +0000 UTC m=+9.125011033 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a4c9995b-4dc8-4453-b83f-db2d253332d2-original-pull-secret") pod "global-pull-secret-syncer-dk56m" (UID: "a4c9995b-4dc8-4453-b83f-db2d253332d2") : object "kube-system"/"original-pull-secret" not registered Jun 09 10:53:35.260944 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:35.260812 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09719c2f-d21f-4f27-a982-3595ee62c857-metrics-certs podName:09719c2f-d21f-4f27-a982-3595ee62c857 nodeName:}" failed. No retries permitted until 2026-06-09 10:53:39.260802878 +0000 UTC m=+9.125042689 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/09719c2f-d21f-4f27-a982-3595ee62c857-metrics-certs") pod "network-metrics-daemon-c8zc8" (UID: "09719c2f-d21f-4f27-a982-3595ee62c857") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 10:53:35.360965 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:35.360932 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rj6kl\" (UniqueName: \"kubernetes.io/projected/f26c0f26-60a4-4966-85ee-ba0bcf29163d-kube-api-access-rj6kl\") pod \"network-check-target-lnxhs\" (UID: \"f26c0f26-60a4-4966-85ee-ba0bcf29163d\") " pod="openshift-network-diagnostics/network-check-target-lnxhs" Jun 09 10:53:35.361126 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:35.361093 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 10:53:35.361126 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:35.361117 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 10:53:35.361230 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:35.361129 2562 projected.go:196] Error preparing data for projected volume kube-api-access-rj6kl for pod openshift-network-diagnostics/network-check-target-lnxhs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 10:53:35.361230 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:35.361188 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f26c0f26-60a4-4966-85ee-ba0bcf29163d-kube-api-access-rj6kl podName:f26c0f26-60a4-4966-85ee-ba0bcf29163d nodeName:}" failed. No retries permitted until 2026-06-09 10:53:39.361170863 +0000 UTC m=+9.225410673 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rj6kl" (UniqueName: "kubernetes.io/projected/f26c0f26-60a4-4966-85ee-ba0bcf29163d-kube-api-access-rj6kl") pod "network-check-target-lnxhs" (UID: "f26c0f26-60a4-4966-85ee-ba0bcf29163d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 10:53:35.592057 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:35.591978 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dk56m" Jun 09 10:53:35.592219 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:35.592096 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dk56m" podUID="a4c9995b-4dc8-4453-b83f-db2d253332d2" Jun 09 10:53:35.592462 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:35.592441 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c8zc8" Jun 09 10:53:35.592573 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:35.592542 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c8zc8" podUID="09719c2f-d21f-4f27-a982-3595ee62c857" Jun 09 10:53:35.592673 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:35.592654 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnxhs" Jun 09 10:53:35.592756 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:35.592737 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnxhs" podUID="f26c0f26-60a4-4966-85ee-ba0bcf29163d" Jun 09 10:53:37.592676 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:37.592644 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dk56m" Jun 09 10:53:37.593106 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:37.592817 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dk56m" podUID="a4c9995b-4dc8-4453-b83f-db2d253332d2" Jun 09 10:53:37.593282 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:37.593258 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c8zc8" Jun 09 10:53:37.593395 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:37.593375 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c8zc8" podUID="09719c2f-d21f-4f27-a982-3595ee62c857" Jun 09 10:53:37.593457 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:37.593427 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnxhs" Jun 09 10:53:37.593516 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:37.593498 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnxhs" podUID="f26c0f26-60a4-4966-85ee-ba0bcf29163d" Jun 09 10:53:39.294775 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:39.294286 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09719c2f-d21f-4f27-a982-3595ee62c857-metrics-certs\") pod \"network-metrics-daemon-c8zc8\" (UID: \"09719c2f-d21f-4f27-a982-3595ee62c857\") " pod="openshift-multus/network-metrics-daemon-c8zc8" Jun 09 10:53:39.294775 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:39.294346 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4c9995b-4dc8-4453-b83f-db2d253332d2-original-pull-secret\") pod \"global-pull-secret-syncer-dk56m\" (UID: \"a4c9995b-4dc8-4453-b83f-db2d253332d2\") " pod="kube-system/global-pull-secret-syncer-dk56m" Jun 09 10:53:39.294775 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:39.294527 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 10:53:39.294775 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:39.294608 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4c9995b-4dc8-4453-b83f-db2d253332d2-original-pull-secret podName:a4c9995b-4dc8-4453-b83f-db2d253332d2 nodeName:}" failed. No retries permitted until 2026-06-09 10:53:47.294573141 +0000 UTC m=+17.158812947 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a4c9995b-4dc8-4453-b83f-db2d253332d2-original-pull-secret") pod "global-pull-secret-syncer-dk56m" (UID: "a4c9995b-4dc8-4453-b83f-db2d253332d2") : object "kube-system"/"original-pull-secret" not registered Jun 09 10:53:39.294775 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:39.294763 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 10:53:39.295337 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:39.294828 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09719c2f-d21f-4f27-a982-3595ee62c857-metrics-certs podName:09719c2f-d21f-4f27-a982-3595ee62c857 nodeName:}" failed. No retries permitted until 2026-06-09 10:53:47.294809669 +0000 UTC m=+17.159049490 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/09719c2f-d21f-4f27-a982-3595ee62c857-metrics-certs") pod "network-metrics-daemon-c8zc8" (UID: "09719c2f-d21f-4f27-a982-3595ee62c857") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 10:53:39.395784 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:39.395752 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rj6kl\" (UniqueName: \"kubernetes.io/projected/f26c0f26-60a4-4966-85ee-ba0bcf29163d-kube-api-access-rj6kl\") pod \"network-check-target-lnxhs\" (UID: \"f26c0f26-60a4-4966-85ee-ba0bcf29163d\") " pod="openshift-network-diagnostics/network-check-target-lnxhs" Jun 09 10:53:39.395948 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:39.395906 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 10:53:39.395948 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:39.395926 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 10:53:39.395948 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:39.395939 2562 projected.go:196] Error preparing data for projected volume kube-api-access-rj6kl for pod openshift-network-diagnostics/network-check-target-lnxhs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 10:53:39.396111 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:39.395997 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f26c0f26-60a4-4966-85ee-ba0bcf29163d-kube-api-access-rj6kl podName:f26c0f26-60a4-4966-85ee-ba0bcf29163d nodeName:}" failed. No retries permitted until 2026-06-09 10:53:47.395981175 +0000 UTC m=+17.260220987 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rj6kl" (UniqueName: "kubernetes.io/projected/f26c0f26-60a4-4966-85ee-ba0bcf29163d-kube-api-access-rj6kl") pod "network-check-target-lnxhs" (UID: "f26c0f26-60a4-4966-85ee-ba0bcf29163d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 10:53:39.592350 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:39.592275 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c8zc8" Jun 09 10:53:39.592350 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:39.592317 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dk56m" Jun 09 10:53:39.592350 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:39.592276 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnxhs" Jun 09 10:53:39.592620 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:39.592417 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c8zc8" podUID="09719c2f-d21f-4f27-a982-3595ee62c857" Jun 09 10:53:39.592620 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:39.592549 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dk56m" podUID="a4c9995b-4dc8-4453-b83f-db2d253332d2" Jun 09 10:53:39.592742 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:39.592651 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnxhs" podUID="f26c0f26-60a4-4966-85ee-ba0bcf29163d" Jun 09 10:53:41.592485 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:41.592408 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c8zc8" Jun 09 10:53:41.592485 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:41.592426 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnxhs" Jun 09 10:53:41.593015 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:41.592528 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c8zc8" podUID="09719c2f-d21f-4f27-a982-3595ee62c857" Jun 09 10:53:41.593015 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:41.592936 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnxhs" podUID="f26c0f26-60a4-4966-85ee-ba0bcf29163d" Jun 09 10:53:41.593015 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:41.592993 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dk56m" Jun 09 10:53:41.593150 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:41.593074 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dk56m" podUID="a4c9995b-4dc8-4453-b83f-db2d253332d2" Jun 09 10:53:43.593008 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:43.592971 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dk56m" Jun 09 10:53:43.593008 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:43.593003 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c8zc8" Jun 09 10:53:43.593514 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:43.592977 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnxhs" Jun 09 10:53:43.593514 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:43.593089 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dk56m" podUID="a4c9995b-4dc8-4453-b83f-db2d253332d2" Jun 09 10:53:43.593514 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:43.593140 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnxhs" podUID="f26c0f26-60a4-4966-85ee-ba0bcf29163d" Jun 09 10:53:43.593514 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:43.593273 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c8zc8" podUID="09719c2f-d21f-4f27-a982-3595ee62c857" Jun 09 10:53:45.592849 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:45.592813 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dk56m" Jun 09 10:53:45.593281 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:45.592933 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c8zc8" Jun 09 10:53:45.593281 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:45.592943 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnxhs" Jun 09 10:53:45.593281 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:45.592941 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dk56m" podUID="a4c9995b-4dc8-4453-b83f-db2d253332d2" Jun 09 10:53:45.593281 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:45.593063 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c8zc8" podUID="09719c2f-d21f-4f27-a982-3595ee62c857" Jun 09 10:53:45.593281 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:45.593136 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnxhs" podUID="f26c0f26-60a4-4966-85ee-ba0bcf29163d" Jun 09 10:53:47.360950 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:47.360916 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09719c2f-d21f-4f27-a982-3595ee62c857-metrics-certs\") pod \"network-metrics-daemon-c8zc8\" (UID: \"09719c2f-d21f-4f27-a982-3595ee62c857\") " pod="openshift-multus/network-metrics-daemon-c8zc8" Jun 09 10:53:47.361414 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:47.360969 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4c9995b-4dc8-4453-b83f-db2d253332d2-original-pull-secret\") pod \"global-pull-secret-syncer-dk56m\" (UID: \"a4c9995b-4dc8-4453-b83f-db2d253332d2\") " pod="kube-system/global-pull-secret-syncer-dk56m" Jun 09 10:53:47.361414 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:47.361108 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 10:53:47.361414 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:47.361191 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4c9995b-4dc8-4453-b83f-db2d253332d2-original-pull-secret podName:a4c9995b-4dc8-4453-b83f-db2d253332d2 nodeName:}" failed. No retries permitted until 2026-06-09 10:54:03.361171483 +0000 UTC m=+33.225411304 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a4c9995b-4dc8-4453-b83f-db2d253332d2-original-pull-secret") pod "global-pull-secret-syncer-dk56m" (UID: "a4c9995b-4dc8-4453-b83f-db2d253332d2") : object "kube-system"/"original-pull-secret" not registered Jun 09 10:53:47.361414 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:47.361223 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 10:53:47.361414 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:47.361286 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09719c2f-d21f-4f27-a982-3595ee62c857-metrics-certs podName:09719c2f-d21f-4f27-a982-3595ee62c857 nodeName:}" failed. No retries permitted until 2026-06-09 10:54:03.361269307 +0000 UTC m=+33.225509131 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/09719c2f-d21f-4f27-a982-3595ee62c857-metrics-certs") pod "network-metrics-daemon-c8zc8" (UID: "09719c2f-d21f-4f27-a982-3595ee62c857") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 10:53:47.462056 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:47.462026 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rj6kl\" (UniqueName: \"kubernetes.io/projected/f26c0f26-60a4-4966-85ee-ba0bcf29163d-kube-api-access-rj6kl\") pod \"network-check-target-lnxhs\" (UID: \"f26c0f26-60a4-4966-85ee-ba0bcf29163d\") " pod="openshift-network-diagnostics/network-check-target-lnxhs" Jun 09 10:53:47.462206 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:47.462191 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 10:53:47.462271 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:47.462208 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 10:53:47.462271 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:47.462218 2562 projected.go:196] Error preparing data for projected volume kube-api-access-rj6kl for pod openshift-network-diagnostics/network-check-target-lnxhs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 10:53:47.462271 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:47.462269 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f26c0f26-60a4-4966-85ee-ba0bcf29163d-kube-api-access-rj6kl podName:f26c0f26-60a4-4966-85ee-ba0bcf29163d nodeName:}" failed. No retries permitted until 2026-06-09 10:54:03.462252694 +0000 UTC m=+33.326492501 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rj6kl" (UniqueName: "kubernetes.io/projected/f26c0f26-60a4-4966-85ee-ba0bcf29163d-kube-api-access-rj6kl") pod "network-check-target-lnxhs" (UID: "f26c0f26-60a4-4966-85ee-ba0bcf29163d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 10:53:47.592407 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:47.592369 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dk56m" Jun 09 10:53:47.592603 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:47.592457 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnxhs" Jun 09 10:53:47.592603 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:47.592490 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c8zc8" Jun 09 10:53:47.592603 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:47.592479 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dk56m" podUID="a4c9995b-4dc8-4453-b83f-db2d253332d2" Jun 09 10:53:47.592762 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:47.592601 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnxhs" podUID="f26c0f26-60a4-4966-85ee-ba0bcf29163d" Jun 09 10:53:47.592762 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:47.592704 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c8zc8" podUID="09719c2f-d21f-4f27-a982-3595ee62c857" Jun 09 10:53:49.592535 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:49.592490 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnxhs" Jun 09 10:53:49.593013 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:49.592490 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c8zc8" Jun 09 10:53:49.593013 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:49.592642 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnxhs" podUID="f26c0f26-60a4-4966-85ee-ba0bcf29163d" Jun 09 10:53:49.593013 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:49.592490 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dk56m" Jun 09 10:53:49.593013 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:49.592730 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c8zc8" podUID="09719c2f-d21f-4f27-a982-3595ee62c857" Jun 09 10:53:49.593013 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:49.592796 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dk56m" podUID="a4c9995b-4dc8-4453-b83f-db2d253332d2" Jun 09 10:53:51.593065 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:51.593043 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dk56m" Jun 09 10:53:51.593065 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:51.593061 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c8zc8" Jun 09 10:53:51.593065 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:51.593069 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnxhs" Jun 09 10:53:51.593518 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:51.593154 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dk56m" podUID="a4c9995b-4dc8-4453-b83f-db2d253332d2" Jun 09 10:53:51.593518 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:51.593289 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c8zc8" podUID="09719c2f-d21f-4f27-a982-3595ee62c857" Jun 09 10:53:51.593518 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:51.593407 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnxhs" podUID="f26c0f26-60a4-4966-85ee-ba0bcf29163d" Jun 09 10:53:51.766618 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:51.766574 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-7.ec2.internal" event={"ID":"b71c0eeb3993825aeeedafbff58d9a16","Type":"ContainerStarted","Data":"93a792df6f1994c98981437b09dd4b79e19fefe81a22fc23c31ce9d625466170"} Jun 09 10:53:51.767913 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:51.767892 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cbbvr" event={"ID":"5ae97496-aa59-402a-b6c0-9fa21935f6bd","Type":"ContainerStarted","Data":"28bd456972bcb9322c157fb605ef56ba9db9cbf1f651c03fc64b75198167c5d4"} Jun 09 10:53:51.769089 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:51.769070 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sdrg4" event={"ID":"bb366f31-85bc-4642-ae05-6ce8ea4332b6","Type":"ContainerStarted","Data":"b38ba3035de3c72678ea8b46b94ffba1194950db983b93fdca390c688aab0f8f"} Jun 09 10:53:51.770365 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:51.770347 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" event={"ID":"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070","Type":"ContainerStarted","Data":"2ba4387d76f7e3e42460f2ad99520ca4a3d6d787d55f7d770aca9622e42a8d68"} Jun 09 10:53:51.793424 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:51.793388 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-7.ec2.internal" podStartSLOduration=20.793377766 podStartE2EDuration="20.793377766s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 10:53:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:53:51.793129102 +0000 UTC m=+21.657368929" watchObservedRunningTime="2026-06-09 10:53:51.793377766 +0000 UTC m=+21.657617594" Jun 09 10:53:51.812968 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:51.812930 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-cbbvr" podStartSLOduration=2.230150503 podStartE2EDuration="21.812917272s" totalImagesPullingTime="19.582766769s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 10:53:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:53:51.812529631 +0000 UTC m=+21.676769459" watchObservedRunningTime="2026-06-09 10:53:51.812917272 +0000 UTC m=+21.677157128" Jun 09 10:53:51.829236 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:51.829204 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-sdrg4" podStartSLOduration=2.226194623 podStartE2EDuration="21.829192605s" totalImagesPullingTime="19.602997982s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 10:53:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:53:51.8288054 +0000 UTC m=+21.693045229" watchObservedRunningTime="2026-06-09 10:53:51.829192605 +0000 UTC m=+21.693432432" Jun 09 10:53:52.773826 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:52.773470 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l67g" event={"ID":"56cf7f64-2643-4248-97d6-9a0fb569586a","Type":"ContainerStarted","Data":"a9a17d170f2df679bf4c4748499fbf4e6230d4e7ff469eb418fce8e9d5f1417b"} Jun 09 10:53:52.774850 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:52.774830 2562 generic.go:356] "Generic (PLEG): container finished" podID="80f79584-5814-4878-a7cf-06e728baf7dc" containerID="c612a49929dca0d1d409b4f6567977ec93b981e5d7fa6ce1389028e128515b05" exitCode=0 Jun 09 10:53:52.774937 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:52.774897 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c9slb" event={"ID":"80f79584-5814-4878-a7cf-06e728baf7dc","Type":"ContainerDied","Data":"c612a49929dca0d1d409b4f6567977ec93b981e5d7fa6ce1389028e128515b05"} Jun 09 10:53:52.776310 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:52.776296 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-k99tl" event={"ID":"031e0407-4688-4603-ac78-f2e099c8aecd","Type":"ContainerStarted","Data":"b4bd4506e82d3454b68426451812cd3888ad898d7e5887e475bd39b814df3bd9"} Jun 09 10:53:52.777763 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:52.777727 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dgc6w" event={"ID":"d88d356c-48a2-4f25-b063-c322959af6da","Type":"ContainerStarted","Data":"7f7e9a36677757a3c997776b15608bc1c5a5ab317973f928e1aac50c3cd37323"} Jun 09 10:53:52.780434 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:52.780416 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vjfd2_1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070/ovn-acl-logging/0.log" Jun 09 10:53:52.781115 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:52.781095 2562 generic.go:356] "Generic (PLEG): container finished" podID="1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070" containerID="86443b40a319d8be227389e530cd7d144608dea8c2c981184634dd0ed111eee8" exitCode=1 Jun 09 10:53:52.781201 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:52.781157 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" event={"ID":"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070","Type":"ContainerStarted","Data":"d223176dde2446ca53e1c4e184e3916cf5332ab2611d04d10775236ff2d82fe6"} Jun 09 10:53:52.781262 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:52.781204 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" event={"ID":"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070","Type":"ContainerStarted","Data":"8076af90553194fbe56f5d09f3f13fd52b62f430f924c289e9a6c6d81b0c1714"} Jun 09 10:53:52.781262 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:52.781234 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" event={"ID":"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070","Type":"ContainerStarted","Data":"396a23fb2df13799db16530232e7ff7302bb08f8ee3987bd2a31eea6fa8b89e6"} Jun 09 10:53:52.781328 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:52.781269 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" event={"ID":"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070","Type":"ContainerStarted","Data":"7e9145ac179a59a97147d371ba70130fc98996f3080a7d0f6ce9823ad1c57536"} Jun 09 10:53:52.781328 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:52.781296 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" event={"ID":"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070","Type":"ContainerDied","Data":"86443b40a319d8be227389e530cd7d144608dea8c2c981184634dd0ed111eee8"} Jun 09 10:53:52.782372 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:52.782354 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qp2c7" event={"ID":"47e4d25a-0728-4e43-83ac-673201e1647a","Type":"ContainerStarted","Data":"c3fff483ed15293a2f598fe9fa94e629583fe8a3c31d7e013871dc9f220129b4"} Jun 09 10:53:52.783634 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:52.783615 2562 generic.go:356] "Generic (PLEG): container finished" podID="f62cb46264f9ba1a27750bb4e9e56d32" containerID="054875c9caf4486e7ffc1d8c0e57556fb351d4e4129c26d8d902bbed362e8cb7" exitCode=0 Jun 09 10:53:52.783716 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:52.783699 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-7.ec2.internal" event={"ID":"f62cb46264f9ba1a27750bb4e9e56d32","Type":"ContainerDied","Data":"054875c9caf4486e7ffc1d8c0e57556fb351d4e4129c26d8d902bbed362e8cb7"} Jun 09 10:53:52.812937 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:52.812900 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dgc6w" podStartSLOduration=3.275708191 podStartE2EDuration="22.81288402s" totalImagesPullingTime="19.537175829s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 10:53:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:53:52.812817996 +0000 UTC m=+22.677057815" watchObservedRunningTime="2026-06-09 10:53:52.81288402 +0000 UTC m=+22.677123847" Jun 09 10:53:52.830004 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:52.829934 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-k99tl" podStartSLOduration=3.246441375 podStartE2EDuration="22.829922936s" totalImagesPullingTime="19.583481561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 10:53:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:53:52.829779509 +0000 UTC m=+22.694019334" watchObservedRunningTime="2026-06-09 10:53:52.829922936 +0000 UTC m=+22.694162761" Jun 09 10:53:53.592302 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:53.592263 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dk56m" Jun 09 10:53:53.592535 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:53.592358 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c8zc8" Jun 09 10:53:53.592535 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:53.592371 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dk56m" podUID="a4c9995b-4dc8-4453-b83f-db2d253332d2" Jun 09 10:53:53.592535 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:53.592385 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnxhs" Jun 09 10:53:53.592535 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:53.592451 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c8zc8" podUID="09719c2f-d21f-4f27-a982-3595ee62c857" Jun 09 10:53:53.592535 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:53.592523 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnxhs" podUID="f26c0f26-60a4-4966-85ee-ba0bcf29163d" Jun 09 10:53:53.786956 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:53.786913 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9jczz" event={"ID":"54bb7588-9d33-42ed-beee-40735acba85b","Type":"ContainerStarted","Data":"6b5e46738a12dda5f47628d8f5afbc93d318edfac6e8810cebd93121790a77fe"} Jun 09 10:53:53.802535 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:53.802489 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9jczz" podStartSLOduration=3.270762047 podStartE2EDuration="22.802470637s" totalImagesPullingTime="19.53170859s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 10:53:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:53:53.802258178 +0000 UTC m=+23.666498006" watchObservedRunningTime="2026-06-09 10:53:53.802470637 +0000 UTC m=+23.666710466" Jun 09 10:53:53.802726 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:53.802673 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qp2c7" podStartSLOduration=4.281515774 podStartE2EDuration="23.802665673s" totalImagesPullingTime="19.521149899s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 10:53:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:53:52.846124561 +0000 UTC m=+22.710364400" watchObservedRunningTime="2026-06-09 10:53:53.802665673 +0000 UTC m=+23.666905502" Jun 09 10:53:53.928347 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:53.928324 2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 09 10:53:54.590046 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:54.589880 2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T10:53:53.928343212Z","UUID":"b0cacd6c-6bdd-4385-b073-64da7e4081fa","Handler":null,"Name":"","Endpoint":""} Jun 09 10:53:54.591565 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:54.591527 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 09 10:53:54.591704 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:54.591570 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 09 10:53:54.792868 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:54.792845 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vjfd2_1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070/ovn-acl-logging/0.log" Jun 09 10:53:54.793421 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:54.793249 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" event={"ID":"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070","Type":"ContainerStarted","Data":"aa80d6f1dac6050106079adc94ec6be5a7acc07bf370bf9fc5f31b307a2c6a07"} Jun 09 10:53:54.795172 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:54.795145 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-7.ec2.internal" event={"ID":"f62cb46264f9ba1a27750bb4e9e56d32","Type":"ContainerStarted","Data":"05df6530d8ce74780d8d58e0c495d73e4135bb1d68eefdc3642cc293bda37d2f"} Jun 09 10:53:54.797156 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:54.797131 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l67g" event={"ID":"56cf7f64-2643-4248-97d6-9a0fb569586a","Type":"ContainerStarted","Data":"5a6405efd0125a8b44194eccef932ab10203920d28dfd5d2c0a9663e97d7fdeb"} Jun 09 10:53:54.813308 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:54.813246 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-7.ec2.internal" podStartSLOduration=23.813232866 podStartE2EDuration="23.813232866s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 10:53:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:53:54.812273964 +0000 UTC m=+24.676513793" watchObservedRunningTime="2026-06-09 10:53:54.813232866 +0000 UTC m=+24.677472695" Jun 09 10:53:55.592181 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:55.592151 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c8zc8" Jun 09 10:53:55.592359 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:55.592153 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dk56m" Jun 09 10:53:55.592359 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:55.592274 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c8zc8" podUID="09719c2f-d21f-4f27-a982-3595ee62c857" Jun 09 10:53:55.592359 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:55.592283 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnxhs" Jun 09 10:53:55.592523 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:55.592367 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dk56m" podUID="a4c9995b-4dc8-4453-b83f-db2d253332d2" Jun 09 10:53:55.592523 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:55.592444 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnxhs" podUID="f26c0f26-60a4-4966-85ee-ba0bcf29163d" Jun 09 10:53:55.801963 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:55.801923 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l67g" event={"ID":"56cf7f64-2643-4248-97d6-9a0fb569586a","Type":"ContainerStarted","Data":"77d58ebff2b7d76eefddc9a504fb5d1391e527180b9df0cc0288d71216b29783"} Jun 09 10:53:55.819834 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:55.819791 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l67g" podStartSLOduration=3.078010493 podStartE2EDuration="24.819777003s" totalImagesPullingTime="21.74176651s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 10:53:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:53:55.8197552 +0000 UTC m=+25.683995019" watchObservedRunningTime="2026-06-09 10:53:55.819777003 +0000 UTC m=+25.684016827" Jun 09 10:53:56.809320 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:56.809027 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vjfd2_1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070/ovn-acl-logging/0.log" Jun 09 10:53:56.810211 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:56.809646 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" event={"ID":"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070","Type":"ContainerStarted","Data":"cb952f3c8b7b50d267dac813c34af0648d8741112b545ce753fec7d869c40332"} Jun 09 10:53:56.811009 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:56.810325 2562 scope.go:117] "RemoveContainer" containerID="86443b40a319d8be227389e530cd7d144608dea8c2c981184634dd0ed111eee8" Jun 09 10:53:56.942972 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:56.942813 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-k99tl" Jun 09 10:53:56.943455 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:56.943432 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-k99tl" Jun 09 10:53:57.592959 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:57.592928 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnxhs" Jun 09 10:53:57.593135 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:57.593011 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dk56m" Jun 09 10:53:57.593135 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:57.593019 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c8zc8" Jun 09 10:53:57.593135 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:57.593015 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnxhs" podUID="f26c0f26-60a4-4966-85ee-ba0bcf29163d" Jun 09 10:53:57.593135 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:57.593086 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dk56m" podUID="a4c9995b-4dc8-4453-b83f-db2d253332d2" Jun 09 10:53:57.593303 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:57.593179 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c8zc8" podUID="09719c2f-d21f-4f27-a982-3595ee62c857" Jun 09 10:53:57.817103 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:57.817083 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vjfd2_1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070/ovn-acl-logging/0.log" Jun 09 10:53:57.817485 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:57.817450 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" event={"ID":"1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070","Type":"ContainerStarted","Data":"d9088b6c0cb44fb037c4e38ba6cf50c72ce2903511949c005b7d239a52003240"} Jun 09 10:53:57.817721 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:57.817694 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:57.817857 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:57.817832 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:57.817927 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:57.817896 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:57.819304 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:57.819283 2562 generic.go:356] "Generic (PLEG): container finished" podID="80f79584-5814-4878-a7cf-06e728baf7dc" containerID="0dc92dbb5fbe507229e70c310c5d73df5c7b267a69f39c004e397eca8317815b" exitCode=0 Jun 09 10:53:57.819400 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:57.819342 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c9slb" event={"ID":"80f79584-5814-4878-a7cf-06e728baf7dc","Type":"ContainerDied","Data":"0dc92dbb5fbe507229e70c310c5d73df5c7b267a69f39c004e397eca8317815b"} Jun 09 10:53:57.819637 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:57.819620 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-k99tl" Jun 09 10:53:57.820711 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:57.819977 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-k99tl" Jun 09 10:53:57.832616 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:57.832599 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:57.832887 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:57.832874 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:53:57.854761 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:57.853039 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" podStartSLOduration=8.155621777 podStartE2EDuration="27.853023094s" totalImagesPullingTime="19.697401317s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 10:53:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:53:57.852405267 +0000 UTC m=+27.716645098" watchObservedRunningTime="2026-06-09 10:53:57.853023094 +0000 UTC m=+27.717262924" Jun 09 10:53:58.692082 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:58.692058 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dk56m"] Jun 09 10:53:58.692204 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:58.692161 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dk56m" Jun 09 10:53:58.692257 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:58.692238 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dk56m" podUID="a4c9995b-4dc8-4453-b83f-db2d253332d2" Jun 09 10:53:58.696941 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:58.696907 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lnxhs"] Jun 09 10:53:58.697063 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:58.697022 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnxhs" Jun 09 10:53:58.697142 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:58.697122 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnxhs" podUID="f26c0f26-60a4-4966-85ee-ba0bcf29163d" Jun 09 10:53:58.697569 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:58.697548 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-c8zc8"] Jun 09 10:53:58.697680 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:58.697663 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c8zc8" Jun 09 10:53:58.697788 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:53:58.697766 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c8zc8" podUID="09719c2f-d21f-4f27-a982-3595ee62c857" Jun 09 10:53:58.823044 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:58.823019 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c9slb" event={"ID":"80f79584-5814-4878-a7cf-06e728baf7dc","Type":"ContainerStarted","Data":"108a9a0e64e70bc3eb6c941a256b6b159087d53d1ef08a17ffd4ffd86e45e802"} Jun 09 10:53:59.827109 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:59.827072 2562 generic.go:356] "Generic (PLEG): container finished" podID="80f79584-5814-4878-a7cf-06e728baf7dc" containerID="108a9a0e64e70bc3eb6c941a256b6b159087d53d1ef08a17ffd4ffd86e45e802" exitCode=0 Jun 09 10:53:59.827461 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:53:59.827160 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c9slb" event={"ID":"80f79584-5814-4878-a7cf-06e728baf7dc","Type":"ContainerDied","Data":"108a9a0e64e70bc3eb6c941a256b6b159087d53d1ef08a17ffd4ffd86e45e802"} Jun 09 10:54:00.593750 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:00.593718 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dk56m" Jun 09 10:54:00.593880 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:54:00.593814 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dk56m" podUID="a4c9995b-4dc8-4453-b83f-db2d253332d2" Jun 09 10:54:00.593880 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:00.593826 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c8zc8" Jun 09 10:54:00.593880 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:00.593850 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnxhs" Jun 09 10:54:00.593982 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:54:00.593947 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c8zc8" podUID="09719c2f-d21f-4f27-a982-3595ee62c857" Jun 09 10:54:00.594045 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:54:00.594026 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnxhs" podUID="f26c0f26-60a4-4966-85ee-ba0bcf29163d" Jun 09 10:54:01.833680 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:01.833429 2562 generic.go:356] "Generic (PLEG): container finished" podID="80f79584-5814-4878-a7cf-06e728baf7dc" containerID="6f9566d0e31f74ea44a5968d1c67cb66289e912289e36202674bfb6f4f7c8372" exitCode=0 Jun 09 10:54:01.834040 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:01.833506 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c9slb" event={"ID":"80f79584-5814-4878-a7cf-06e728baf7dc","Type":"ContainerDied","Data":"6f9566d0e31f74ea44a5968d1c67cb66289e912289e36202674bfb6f4f7c8372"} Jun 09 10:54:02.592907 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:02.592855 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c8zc8" Jun 09 10:54:02.593084 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:02.592855 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnxhs" Jun 09 10:54:02.593084 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:54:02.592989 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c8zc8" podUID="09719c2f-d21f-4f27-a982-3595ee62c857" Jun 09 10:54:02.593084 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:02.592863 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dk56m" Jun 09 10:54:02.593084 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:54:02.593071 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnxhs" podUID="f26c0f26-60a4-4966-85ee-ba0bcf29163d" Jun 09 10:54:02.593292 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:54:02.593137 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dk56m" podUID="a4c9995b-4dc8-4453-b83f-db2d253332d2" Jun 09 10:54:03.381743 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:03.381699 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09719c2f-d21f-4f27-a982-3595ee62c857-metrics-certs\") pod \"network-metrics-daemon-c8zc8\" (UID: \"09719c2f-d21f-4f27-a982-3595ee62c857\") " pod="openshift-multus/network-metrics-daemon-c8zc8" Jun 09 10:54:03.382271 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:03.381770 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4c9995b-4dc8-4453-b83f-db2d253332d2-original-pull-secret\") pod \"global-pull-secret-syncer-dk56m\" (UID: \"a4c9995b-4dc8-4453-b83f-db2d253332d2\") " pod="kube-system/global-pull-secret-syncer-dk56m" Jun 09 10:54:03.382271 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:54:03.381868 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 10:54:03.382271 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:54:03.381912 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 10:54:03.382271 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:54:03.381945 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09719c2f-d21f-4f27-a982-3595ee62c857-metrics-certs podName:09719c2f-d21f-4f27-a982-3595ee62c857 nodeName:}" failed. No retries permitted until 2026-06-09 10:54:35.381925986 +0000 UTC m=+65.246165792 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/09719c2f-d21f-4f27-a982-3595ee62c857-metrics-certs") pod "network-metrics-daemon-c8zc8" (UID: "09719c2f-d21f-4f27-a982-3595ee62c857") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 10:54:03.382271 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:54:03.381963 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4c9995b-4dc8-4453-b83f-db2d253332d2-original-pull-secret podName:a4c9995b-4dc8-4453-b83f-db2d253332d2 nodeName:}" failed. No retries permitted until 2026-06-09 10:54:35.381955717 +0000 UTC m=+65.246195529 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a4c9995b-4dc8-4453-b83f-db2d253332d2-original-pull-secret") pod "global-pull-secret-syncer-dk56m" (UID: "a4c9995b-4dc8-4453-b83f-db2d253332d2") : object "kube-system"/"original-pull-secret" not registered Jun 09 10:54:03.482730 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:03.482699 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rj6kl\" (UniqueName: \"kubernetes.io/projected/f26c0f26-60a4-4966-85ee-ba0bcf29163d-kube-api-access-rj6kl\") pod \"network-check-target-lnxhs\" (UID: \"f26c0f26-60a4-4966-85ee-ba0bcf29163d\") " pod="openshift-network-diagnostics/network-check-target-lnxhs" Jun 09 10:54:03.482887 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:54:03.482862 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 10:54:03.482887 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:54:03.482882 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 10:54:03.482996 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:54:03.482894 2562 projected.go:196] Error preparing data for projected volume kube-api-access-rj6kl for pod openshift-network-diagnostics/network-check-target-lnxhs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 10:54:03.482996 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:54:03.482952 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f26c0f26-60a4-4966-85ee-ba0bcf29163d-kube-api-access-rj6kl podName:f26c0f26-60a4-4966-85ee-ba0bcf29163d nodeName:}" failed. No retries permitted until 2026-06-09 10:54:35.48293522 +0000 UTC m=+65.347175041 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rj6kl" (UniqueName: "kubernetes.io/projected/f26c0f26-60a4-4966-85ee-ba0bcf29163d-kube-api-access-rj6kl") pod "network-check-target-lnxhs" (UID: "f26c0f26-60a4-4966-85ee-ba0bcf29163d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 10:54:04.428201 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.428173 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-7.ec2.internal" event="NodeReady" Jun 09 10:54:04.428773 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.428320 2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 09 10:54:04.462362 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.462339 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6ddd8f7d48-bv2x5"] Jun 09 10:54:04.481547 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.481525 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rjjhk"] Jun 09 10:54:04.481693 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.481679 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6ddd8f7d48-bv2x5" Jun 09 10:54:04.486522 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.486493 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 09 10:54:04.486663 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.486551 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vv4rr\"" Jun 09 10:54:04.486730 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.486692 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 09 10:54:04.486790 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.486751 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 09 10:54:04.492228 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.492199 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 09 10:54:04.493798 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.493772 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6ddd8f7d48-bv2x5"] Jun 09 10:54:04.493926 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.493811 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jwgsk"] Jun 09 10:54:04.493994 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.493975 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rjjhk" Jun 09 10:54:04.497060 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.496950 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 09 10:54:04.497161 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.497102 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 09 10:54:04.497489 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.497469 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-k9trm\"" Jun 09 10:54:04.509639 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.509621 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jwgsk"] Jun 09 10:54:04.509807 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.509656 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rjjhk"] Jun 09 10:54:04.509807 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.509621 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jwgsk" Jun 09 10:54:04.512300 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.512269 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 09 10:54:04.512300 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.512292 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 09 10:54:04.512582 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.512566 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ghcvx\"" Jun 09 10:54:04.512673 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.512626 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 09 10:54:04.590438 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.590359 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/07db5071-a553-482a-8d61-beccf9aa2f34-registry-certificates\") pod \"image-registry-6ddd8f7d48-bv2x5\" (UID: \"07db5071-a553-482a-8d61-beccf9aa2f34\") " pod="openshift-image-registry/image-registry-6ddd8f7d48-bv2x5" Jun 09 10:54:04.590438 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.590392 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chggh\" (UniqueName: \"kubernetes.io/projected/40572faa-ff5a-4e83-a728-7e356e6feb69-kube-api-access-chggh\") pod \"ingress-canary-jwgsk\" (UID: \"40572faa-ff5a-4e83-a728-7e356e6feb69\") " pod="openshift-ingress-canary/ingress-canary-jwgsk" Jun 09 10:54:04.590438 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.590426 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27fb5ab9-ed22-433a-90cd-bfb7577f9ee8-metrics-tls\") pod \"dns-default-rjjhk\" (UID: \"27fb5ab9-ed22-433a-90cd-bfb7577f9ee8\") " pod="openshift-dns/dns-default-rjjhk" Jun 09 10:54:04.590671 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.590452 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/40572faa-ff5a-4e83-a728-7e356e6feb69-cert\") pod \"ingress-canary-jwgsk\" (UID: \"40572faa-ff5a-4e83-a728-7e356e6feb69\") " pod="openshift-ingress-canary/ingress-canary-jwgsk" Jun 09 10:54:04.590671 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.590467 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27fb5ab9-ed22-433a-90cd-bfb7577f9ee8-tmp-dir\") pod \"dns-default-rjjhk\" (UID: \"27fb5ab9-ed22-433a-90cd-bfb7577f9ee8\") " pod="openshift-dns/dns-default-rjjhk" Jun 09 10:54:04.590671 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.590482 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/07db5071-a553-482a-8d61-beccf9aa2f34-ca-trust-extracted\") pod \"image-registry-6ddd8f7d48-bv2x5\" (UID: \"07db5071-a553-482a-8d61-beccf9aa2f34\") " pod="openshift-image-registry/image-registry-6ddd8f7d48-bv2x5" Jun 09 10:54:04.590671 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.590496 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/07db5071-a553-482a-8d61-beccf9aa2f34-installation-pull-secrets\") pod \"image-registry-6ddd8f7d48-bv2x5\" (UID: \"07db5071-a553-482a-8d61-beccf9aa2f34\") " pod="openshift-image-registry/image-registry-6ddd8f7d48-bv2x5" Jun 09 10:54:04.590671 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.590516 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/07db5071-a553-482a-8d61-beccf9aa2f34-bound-sa-token\") pod \"image-registry-6ddd8f7d48-bv2x5\" (UID: \"07db5071-a553-482a-8d61-beccf9aa2f34\") " pod="openshift-image-registry/image-registry-6ddd8f7d48-bv2x5" Jun 09 10:54:04.590671 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.590566 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/27fb5ab9-ed22-433a-90cd-bfb7577f9ee8-config-volume\") pod \"dns-default-rjjhk\" (UID: \"27fb5ab9-ed22-433a-90cd-bfb7577f9ee8\") " pod="openshift-dns/dns-default-rjjhk" Jun 09 10:54:04.590671 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.590665 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rl2z\" (UniqueName: \"kubernetes.io/projected/27fb5ab9-ed22-433a-90cd-bfb7577f9ee8-kube-api-access-8rl2z\") pod \"dns-default-rjjhk\" (UID: \"27fb5ab9-ed22-433a-90cd-bfb7577f9ee8\") " pod="openshift-dns/dns-default-rjjhk" Jun 09 10:54:04.590925 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.590728 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/07db5071-a553-482a-8d61-beccf9aa2f34-trusted-ca\") pod \"image-registry-6ddd8f7d48-bv2x5\" (UID: \"07db5071-a553-482a-8d61-beccf9aa2f34\") " pod="openshift-image-registry/image-registry-6ddd8f7d48-bv2x5" Jun 09 10:54:04.590925 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.590772 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkwr9\" (UniqueName: \"kubernetes.io/projected/07db5071-a553-482a-8d61-beccf9aa2f34-kube-api-access-pkwr9\") pod \"image-registry-6ddd8f7d48-bv2x5\" (UID: \"07db5071-a553-482a-8d61-beccf9aa2f34\") " pod="openshift-image-registry/image-registry-6ddd8f7d48-bv2x5" Jun 09 10:54:04.590925 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.590828 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/07db5071-a553-482a-8d61-beccf9aa2f34-image-registry-private-configuration\") pod \"image-registry-6ddd8f7d48-bv2x5\" (UID: \"07db5071-a553-482a-8d61-beccf9aa2f34\") " pod="openshift-image-registry/image-registry-6ddd8f7d48-bv2x5" Jun 09 10:54:04.590925 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.590878 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/07db5071-a553-482a-8d61-beccf9aa2f34-registry-tls\") pod \"image-registry-6ddd8f7d48-bv2x5\" (UID: \"07db5071-a553-482a-8d61-beccf9aa2f34\") " pod="openshift-image-registry/image-registry-6ddd8f7d48-bv2x5" Jun 09 10:54:04.592506 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.592471 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnxhs" Jun 09 10:54:04.592643 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.592475 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c8zc8" Jun 09 10:54:04.592643 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.592618 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dk56m" Jun 09 10:54:04.595439 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.595415 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 10:54:04.595596 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.595457 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vng8v\"" Jun 09 10:54:04.595596 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.595492 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 10:54:04.595596 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.595508 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qfn6d\"" Jun 09 10:54:04.595827 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.595780 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 10:54:04.595886 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.595853 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 10:54:04.691528 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.691494 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/07db5071-a553-482a-8d61-beccf9aa2f34-ca-trust-extracted\") pod \"image-registry-6ddd8f7d48-bv2x5\" (UID: \"07db5071-a553-482a-8d61-beccf9aa2f34\") " pod="openshift-image-registry/image-registry-6ddd8f7d48-bv2x5" Jun 09 10:54:04.691699 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.691535 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/07db5071-a553-482a-8d61-beccf9aa2f34-installation-pull-secrets\") pod \"image-registry-6ddd8f7d48-bv2x5\" (UID: \"07db5071-a553-482a-8d61-beccf9aa2f34\") " pod="openshift-image-registry/image-registry-6ddd8f7d48-bv2x5" Jun 09 10:54:04.691699 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.691557 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/07db5071-a553-482a-8d61-beccf9aa2f34-bound-sa-token\") pod \"image-registry-6ddd8f7d48-bv2x5\" (UID: \"07db5071-a553-482a-8d61-beccf9aa2f34\") " pod="openshift-image-registry/image-registry-6ddd8f7d48-bv2x5" Jun 09 10:54:04.691699 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.691578 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/27fb5ab9-ed22-433a-90cd-bfb7577f9ee8-config-volume\") pod \"dns-default-rjjhk\" (UID: \"27fb5ab9-ed22-433a-90cd-bfb7577f9ee8\") " pod="openshift-dns/dns-default-rjjhk" Jun 09 10:54:04.691699 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.691618 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rl2z\" (UniqueName: \"kubernetes.io/projected/27fb5ab9-ed22-433a-90cd-bfb7577f9ee8-kube-api-access-8rl2z\") pod \"dns-default-rjjhk\" (UID: \"27fb5ab9-ed22-433a-90cd-bfb7577f9ee8\") " pod="openshift-dns/dns-default-rjjhk" Jun 09 10:54:04.691699 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.691646 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/07db5071-a553-482a-8d61-beccf9aa2f34-trusted-ca\") pod \"image-registry-6ddd8f7d48-bv2x5\" (UID: \"07db5071-a553-482a-8d61-beccf9aa2f34\") " pod="openshift-image-registry/image-registry-6ddd8f7d48-bv2x5" Jun 09 10:54:04.691699 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.691670 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkwr9\" (UniqueName: \"kubernetes.io/projected/07db5071-a553-482a-8d61-beccf9aa2f34-kube-api-access-pkwr9\") pod \"image-registry-6ddd8f7d48-bv2x5\" (UID: \"07db5071-a553-482a-8d61-beccf9aa2f34\") " pod="openshift-image-registry/image-registry-6ddd8f7d48-bv2x5" Jun 09 10:54:04.692072 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.691747 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/07db5071-a553-482a-8d61-beccf9aa2f34-image-registry-private-configuration\") pod \"image-registry-6ddd8f7d48-bv2x5\" (UID: \"07db5071-a553-482a-8d61-beccf9aa2f34\") " pod="openshift-image-registry/image-registry-6ddd8f7d48-bv2x5" Jun 09 10:54:04.692072 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.691771 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/07db5071-a553-482a-8d61-beccf9aa2f34-registry-tls\") pod \"image-registry-6ddd8f7d48-bv2x5\" (UID: \"07db5071-a553-482a-8d61-beccf9aa2f34\") " pod="openshift-image-registry/image-registry-6ddd8f7d48-bv2x5" Jun 09 10:54:04.692072 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.691827 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/07db5071-a553-482a-8d61-beccf9aa2f34-registry-certificates\") pod \"image-registry-6ddd8f7d48-bv2x5\" (UID: \"07db5071-a553-482a-8d61-beccf9aa2f34\") " pod="openshift-image-registry/image-registry-6ddd8f7d48-bv2x5" Jun 09 10:54:04.692072 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.691851 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chggh\" (UniqueName: \"kubernetes.io/projected/40572faa-ff5a-4e83-a728-7e356e6feb69-kube-api-access-chggh\") pod \"ingress-canary-jwgsk\" (UID: \"40572faa-ff5a-4e83-a728-7e356e6feb69\") " pod="openshift-ingress-canary/ingress-canary-jwgsk" Jun 09 10:54:04.692072 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.691872 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/07db5071-a553-482a-8d61-beccf9aa2f34-ca-trust-extracted\") pod \"image-registry-6ddd8f7d48-bv2x5\" (UID: \"07db5071-a553-482a-8d61-beccf9aa2f34\") " pod="openshift-image-registry/image-registry-6ddd8f7d48-bv2x5" Jun 09 10:54:04.692072 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.691887 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27fb5ab9-ed22-433a-90cd-bfb7577f9ee8-metrics-tls\") pod \"dns-default-rjjhk\" (UID: \"27fb5ab9-ed22-433a-90cd-bfb7577f9ee8\") " pod="openshift-dns/dns-default-rjjhk" Jun 09 10:54:04.692072 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.691918 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/40572faa-ff5a-4e83-a728-7e356e6feb69-cert\") pod \"ingress-canary-jwgsk\" (UID: \"40572faa-ff5a-4e83-a728-7e356e6feb69\") " pod="openshift-ingress-canary/ingress-canary-jwgsk" Jun 09 10:54:04.692072 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.691941 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27fb5ab9-ed22-433a-90cd-bfb7577f9ee8-tmp-dir\") pod \"dns-default-rjjhk\" (UID: \"27fb5ab9-ed22-433a-90cd-bfb7577f9ee8\") " pod="openshift-dns/dns-default-rjjhk" Jun 09 10:54:04.692452 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.692217 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27fb5ab9-ed22-433a-90cd-bfb7577f9ee8-tmp-dir\") pod \"dns-default-rjjhk\" (UID: \"27fb5ab9-ed22-433a-90cd-bfb7577f9ee8\") " pod="openshift-dns/dns-default-rjjhk" Jun 09 10:54:04.692452 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:54:04.692400 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 10:54:04.692452 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:54:04.692415 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ddd8f7d48-bv2x5: secret "image-registry-tls" not found Jun 09 10:54:04.692620 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:54:04.692476 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07db5071-a553-482a-8d61-beccf9aa2f34-registry-tls podName:07db5071-a553-482a-8d61-beccf9aa2f34 nodeName:}" failed. No retries permitted until 2026-06-09 10:54:05.192454655 +0000 UTC m=+35.056694479 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/07db5071-a553-482a-8d61-beccf9aa2f34-registry-tls") pod "image-registry-6ddd8f7d48-bv2x5" (UID: "07db5071-a553-482a-8d61-beccf9aa2f34") : secret "image-registry-tls" not found Jun 09 10:54:04.693068 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.692718 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/07db5071-a553-482a-8d61-beccf9aa2f34-registry-certificates\") pod \"image-registry-6ddd8f7d48-bv2x5\" (UID: \"07db5071-a553-482a-8d61-beccf9aa2f34\") " pod="openshift-image-registry/image-registry-6ddd8f7d48-bv2x5" Jun 09 10:54:04.693068 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:54:04.692923 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 10:54:04.693068 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:54:04.692965 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27fb5ab9-ed22-433a-90cd-bfb7577f9ee8-metrics-tls podName:27fb5ab9-ed22-433a-90cd-bfb7577f9ee8 nodeName:}" failed. No retries permitted until 2026-06-09 10:54:05.192951435 +0000 UTC m=+35.057191246 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/27fb5ab9-ed22-433a-90cd-bfb7577f9ee8-metrics-tls") pod "dns-default-rjjhk" (UID: "27fb5ab9-ed22-433a-90cd-bfb7577f9ee8") : secret "dns-default-metrics-tls" not found Jun 09 10:54:04.693352 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.693311 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/27fb5ab9-ed22-433a-90cd-bfb7577f9ee8-config-volume\") pod \"dns-default-rjjhk\" (UID: \"27fb5ab9-ed22-433a-90cd-bfb7577f9ee8\") " pod="openshift-dns/dns-default-rjjhk" Jun 09 10:54:04.694039 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.693995 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/07db5071-a553-482a-8d61-beccf9aa2f34-trusted-ca\") pod \"image-registry-6ddd8f7d48-bv2x5\" (UID: \"07db5071-a553-482a-8d61-beccf9aa2f34\") " pod="openshift-image-registry/image-registry-6ddd8f7d48-bv2x5" Jun 09 10:54:04.695901 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.695880 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/07db5071-a553-482a-8d61-beccf9aa2f34-image-registry-private-configuration\") pod \"image-registry-6ddd8f7d48-bv2x5\" (UID: \"07db5071-a553-482a-8d61-beccf9aa2f34\") " pod="openshift-image-registry/image-registry-6ddd8f7d48-bv2x5" Jun 09 10:54:04.696005 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.695955 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/07db5071-a553-482a-8d61-beccf9aa2f34-installation-pull-secrets\") pod \"image-registry-6ddd8f7d48-bv2x5\" (UID: \"07db5071-a553-482a-8d61-beccf9aa2f34\") " pod="openshift-image-registry/image-registry-6ddd8f7d48-bv2x5" Jun 09 10:54:04.696100 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.696072 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/40572faa-ff5a-4e83-a728-7e356e6feb69-cert\") pod \"ingress-canary-jwgsk\" (UID: \"40572faa-ff5a-4e83-a728-7e356e6feb69\") " pod="openshift-ingress-canary/ingress-canary-jwgsk" Jun 09 10:54:04.701315 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.701272 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/07db5071-a553-482a-8d61-beccf9aa2f34-bound-sa-token\") pod \"image-registry-6ddd8f7d48-bv2x5\" (UID: \"07db5071-a553-482a-8d61-beccf9aa2f34\") " pod="openshift-image-registry/image-registry-6ddd8f7d48-bv2x5" Jun 09 10:54:04.701516 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.701498 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkwr9\" (UniqueName: \"kubernetes.io/projected/07db5071-a553-482a-8d61-beccf9aa2f34-kube-api-access-pkwr9\") pod \"image-registry-6ddd8f7d48-bv2x5\" (UID: \"07db5071-a553-482a-8d61-beccf9aa2f34\") " pod="openshift-image-registry/image-registry-6ddd8f7d48-bv2x5" Jun 09 10:54:04.701668 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.701646 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rl2z\" (UniqueName: \"kubernetes.io/projected/27fb5ab9-ed22-433a-90cd-bfb7577f9ee8-kube-api-access-8rl2z\") pod \"dns-default-rjjhk\" (UID: \"27fb5ab9-ed22-433a-90cd-bfb7577f9ee8\") " pod="openshift-dns/dns-default-rjjhk" Jun 09 10:54:04.701987 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.701966 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chggh\" (UniqueName: \"kubernetes.io/projected/40572faa-ff5a-4e83-a728-7e356e6feb69-kube-api-access-chggh\") pod \"ingress-canary-jwgsk\" (UID: \"40572faa-ff5a-4e83-a728-7e356e6feb69\") " pod="openshift-ingress-canary/ingress-canary-jwgsk" Jun 09 10:54:04.818906 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:04.818872 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jwgsk" Jun 09 10:54:05.195535 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:05.195496 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/07db5071-a553-482a-8d61-beccf9aa2f34-registry-tls\") pod \"image-registry-6ddd8f7d48-bv2x5\" (UID: \"07db5071-a553-482a-8d61-beccf9aa2f34\") " pod="openshift-image-registry/image-registry-6ddd8f7d48-bv2x5" Jun 09 10:54:05.195733 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:05.195558 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27fb5ab9-ed22-433a-90cd-bfb7577f9ee8-metrics-tls\") pod \"dns-default-rjjhk\" (UID: \"27fb5ab9-ed22-433a-90cd-bfb7577f9ee8\") " pod="openshift-dns/dns-default-rjjhk" Jun 09 10:54:05.195733 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:54:05.195685 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 10:54:05.195844 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:54:05.195755 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27fb5ab9-ed22-433a-90cd-bfb7577f9ee8-metrics-tls podName:27fb5ab9-ed22-433a-90cd-bfb7577f9ee8 nodeName:}" failed. No retries permitted until 2026-06-09 10:54:06.195735808 +0000 UTC m=+36.059975617 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/27fb5ab9-ed22-433a-90cd-bfb7577f9ee8-metrics-tls") pod "dns-default-rjjhk" (UID: "27fb5ab9-ed22-433a-90cd-bfb7577f9ee8") : secret "dns-default-metrics-tls" not found Jun 09 10:54:05.195844 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:54:05.195688 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 10:54:05.195844 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:54:05.195811 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ddd8f7d48-bv2x5: secret "image-registry-tls" not found Jun 09 10:54:05.195998 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:54:05.195895 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07db5071-a553-482a-8d61-beccf9aa2f34-registry-tls podName:07db5071-a553-482a-8d61-beccf9aa2f34 nodeName:}" failed. No retries permitted until 2026-06-09 10:54:06.195874138 +0000 UTC m=+36.060113945 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/07db5071-a553-482a-8d61-beccf9aa2f34-registry-tls") pod "image-registry-6ddd8f7d48-bv2x5" (UID: "07db5071-a553-482a-8d61-beccf9aa2f34") : secret "image-registry-tls" not found Jun 09 10:54:05.973859 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:05.973681 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jwgsk"] Jun 09 10:54:05.977255 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:54:05.977219 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40572faa_ff5a_4e83_a728_7e356e6feb69.slice/crio-3a2629cd770f0e1eb093459b407c20eb0b64027604a1c0fab23ddcc1bda80e2c WatchSource:0}: Error finding container 3a2629cd770f0e1eb093459b407c20eb0b64027604a1c0fab23ddcc1bda80e2c: Status 404 returned error can't find the container with id 3a2629cd770f0e1eb093459b407c20eb0b64027604a1c0fab23ddcc1bda80e2c Jun 09 10:54:06.203871 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:06.203849 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/07db5071-a553-482a-8d61-beccf9aa2f34-registry-tls\") pod \"image-registry-6ddd8f7d48-bv2x5\" (UID: \"07db5071-a553-482a-8d61-beccf9aa2f34\") " pod="openshift-image-registry/image-registry-6ddd8f7d48-bv2x5" Jun 09 10:54:06.203964 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:06.203893 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27fb5ab9-ed22-433a-90cd-bfb7577f9ee8-metrics-tls\") pod \"dns-default-rjjhk\" (UID: \"27fb5ab9-ed22-433a-90cd-bfb7577f9ee8\") " pod="openshift-dns/dns-default-rjjhk" Jun 09 10:54:06.204036 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:54:06.203994 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 10:54:06.204036 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:54:06.204011 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 10:54:06.204036 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:54:06.204030 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ddd8f7d48-bv2x5: secret "image-registry-tls" not found Jun 09 10:54:06.204036 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:54:06.204036 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27fb5ab9-ed22-433a-90cd-bfb7577f9ee8-metrics-tls podName:27fb5ab9-ed22-433a-90cd-bfb7577f9ee8 nodeName:}" failed. No retries permitted until 2026-06-09 10:54:08.204023006 +0000 UTC m=+38.068262811 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/27fb5ab9-ed22-433a-90cd-bfb7577f9ee8-metrics-tls") pod "dns-default-rjjhk" (UID: "27fb5ab9-ed22-433a-90cd-bfb7577f9ee8") : secret "dns-default-metrics-tls" not found Jun 09 10:54:06.204206 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:54:06.204094 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07db5071-a553-482a-8d61-beccf9aa2f34-registry-tls podName:07db5071-a553-482a-8d61-beccf9aa2f34 nodeName:}" failed. No retries permitted until 2026-06-09 10:54:08.204076422 +0000 UTC m=+38.068316242 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/07db5071-a553-482a-8d61-beccf9aa2f34-registry-tls") pod "image-registry-6ddd8f7d48-bv2x5" (UID: "07db5071-a553-482a-8d61-beccf9aa2f34") : secret "image-registry-tls" not found Jun 09 10:54:06.847001 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:06.846963 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jwgsk" event={"ID":"40572faa-ff5a-4e83-a728-7e356e6feb69","Type":"ContainerStarted","Data":"3a2629cd770f0e1eb093459b407c20eb0b64027604a1c0fab23ddcc1bda80e2c"} Jun 09 10:54:06.850039 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:06.850010 2562 generic.go:356] "Generic (PLEG): container finished" podID="80f79584-5814-4878-a7cf-06e728baf7dc" containerID="74bb9ad3aff0c81d01c30062813d4ccfc7bf5d015c46cd039ce4618f7920cdf4" exitCode=0 Jun 09 10:54:06.850227 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:06.850052 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c9slb" event={"ID":"80f79584-5814-4878-a7cf-06e728baf7dc","Type":"ContainerDied","Data":"74bb9ad3aff0c81d01c30062813d4ccfc7bf5d015c46cd039ce4618f7920cdf4"} Jun 09 10:54:07.855448 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:07.855420 2562 generic.go:356] "Generic (PLEG): container finished" podID="80f79584-5814-4878-a7cf-06e728baf7dc" containerID="d39c1953925fe3c35fa30e3d5d0767a3f68b8dd0da9d88b846d653b64f6c0872" exitCode=0 Jun 09 10:54:07.855824 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:07.855474 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c9slb" event={"ID":"80f79584-5814-4878-a7cf-06e728baf7dc","Type":"ContainerDied","Data":"d39c1953925fe3c35fa30e3d5d0767a3f68b8dd0da9d88b846d653b64f6c0872"} Jun 09 10:54:08.228579 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:08.228387 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27fb5ab9-ed22-433a-90cd-bfb7577f9ee8-metrics-tls\") pod \"dns-default-rjjhk\" (UID: \"27fb5ab9-ed22-433a-90cd-bfb7577f9ee8\") " pod="openshift-dns/dns-default-rjjhk" Jun 09 10:54:08.228753 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:08.228657 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/07db5071-a553-482a-8d61-beccf9aa2f34-registry-tls\") pod \"image-registry-6ddd8f7d48-bv2x5\" (UID: \"07db5071-a553-482a-8d61-beccf9aa2f34\") " pod="openshift-image-registry/image-registry-6ddd8f7d48-bv2x5" Jun 09 10:54:08.228753 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:54:08.228531 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 10:54:08.228753 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:54:08.228733 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 10:54:08.228753 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:54:08.228747 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ddd8f7d48-bv2x5: secret "image-registry-tls" not found Jun 09 10:54:08.228881 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:54:08.228771 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27fb5ab9-ed22-433a-90cd-bfb7577f9ee8-metrics-tls podName:27fb5ab9-ed22-433a-90cd-bfb7577f9ee8 nodeName:}" failed. No retries permitted until 2026-06-09 10:54:12.228753915 +0000 UTC m=+42.092993741 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/27fb5ab9-ed22-433a-90cd-bfb7577f9ee8-metrics-tls") pod "dns-default-rjjhk" (UID: "27fb5ab9-ed22-433a-90cd-bfb7577f9ee8") : secret "dns-default-metrics-tls" not found Jun 09 10:54:08.228881 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:54:08.228787 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07db5071-a553-482a-8d61-beccf9aa2f34-registry-tls podName:07db5071-a553-482a-8d61-beccf9aa2f34 nodeName:}" failed. No retries permitted until 2026-06-09 10:54:12.228779617 +0000 UTC m=+42.093019424 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/07db5071-a553-482a-8d61-beccf9aa2f34-registry-tls") pod "image-registry-6ddd8f7d48-bv2x5" (UID: "07db5071-a553-482a-8d61-beccf9aa2f34") : secret "image-registry-tls" not found Jun 09 10:54:08.861653 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:08.861622 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c9slb" event={"ID":"80f79584-5814-4878-a7cf-06e728baf7dc","Type":"ContainerStarted","Data":"0431d770b9bc66ba2574f13ee8841c368b3183444b8eb487e5089dc1b3314b9d"} Jun 09 10:54:08.866191 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:08.866163 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jwgsk" event={"ID":"40572faa-ff5a-4e83-a728-7e356e6feb69","Type":"ContainerStarted","Data":"916e022d08c4d88113986b815a5ee06c90f9acd0051318f4e585372af2bacc99"} Jun 09 10:54:08.890105 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:08.890063 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-c9slb" podStartSLOduration=8.196745114 podStartE2EDuration="37.890051228s" totalImagesPullingTime="29.693306114s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 10:53:31 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:54:08.888441782 +0000 UTC m=+38.752681633" watchObservedRunningTime="2026-06-09 10:54:08.890051228 +0000 UTC m=+38.754291055" Jun 09 10:54:08.911562 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:08.911522 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jwgsk" podStartSLOduration=3.102790884 podStartE2EDuration="4.911507996s" totalImagesPullingTime="1.808717112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 10:54:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:54:08.910339198 +0000 UTC m=+38.774579098" watchObservedRunningTime="2026-06-09 10:54:08.911507996 +0000 UTC m=+38.775747823" Jun 09 10:54:12.260158 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:12.260125 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/07db5071-a553-482a-8d61-beccf9aa2f34-registry-tls\") pod \"image-registry-6ddd8f7d48-bv2x5\" (UID: \"07db5071-a553-482a-8d61-beccf9aa2f34\") " pod="openshift-image-registry/image-registry-6ddd8f7d48-bv2x5" Jun 09 10:54:12.260485 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:12.260172 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27fb5ab9-ed22-433a-90cd-bfb7577f9ee8-metrics-tls\") pod \"dns-default-rjjhk\" (UID: \"27fb5ab9-ed22-433a-90cd-bfb7577f9ee8\") " pod="openshift-dns/dns-default-rjjhk" Jun 09 10:54:12.260485 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:54:12.260281 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 10:54:12.260485 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:54:12.260302 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ddd8f7d48-bv2x5: secret "image-registry-tls" not found Jun 09 10:54:12.260485 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:54:12.260282 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 10:54:12.260728 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:54:12.260696 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27fb5ab9-ed22-433a-90cd-bfb7577f9ee8-metrics-tls podName:27fb5ab9-ed22-433a-90cd-bfb7577f9ee8 nodeName:}" failed. No retries permitted until 2026-06-09 10:54:20.260669245 +0000 UTC m=+50.124909110 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/27fb5ab9-ed22-433a-90cd-bfb7577f9ee8-metrics-tls") pod "dns-default-rjjhk" (UID: "27fb5ab9-ed22-433a-90cd-bfb7577f9ee8") : secret "dns-default-metrics-tls" not found Jun 09 10:54:12.260790 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:54:12.260740 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07db5071-a553-482a-8d61-beccf9aa2f34-registry-tls podName:07db5071-a553-482a-8d61-beccf9aa2f34 nodeName:}" failed. No retries permitted until 2026-06-09 10:54:20.26072777 +0000 UTC m=+50.124967583 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/07db5071-a553-482a-8d61-beccf9aa2f34-registry-tls") pod "image-registry-6ddd8f7d48-bv2x5" (UID: "07db5071-a553-482a-8d61-beccf9aa2f34") : secret "image-registry-tls" not found Jun 09 10:54:20.314101 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:20.314062 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/07db5071-a553-482a-8d61-beccf9aa2f34-registry-tls\") pod \"image-registry-6ddd8f7d48-bv2x5\" (UID: \"07db5071-a553-482a-8d61-beccf9aa2f34\") " pod="openshift-image-registry/image-registry-6ddd8f7d48-bv2x5" Jun 09 10:54:20.314530 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:20.314111 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27fb5ab9-ed22-433a-90cd-bfb7577f9ee8-metrics-tls\") pod \"dns-default-rjjhk\" (UID: \"27fb5ab9-ed22-433a-90cd-bfb7577f9ee8\") " pod="openshift-dns/dns-default-rjjhk" Jun 09 10:54:20.314530 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:54:20.314209 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 10:54:20.314530 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:54:20.314235 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ddd8f7d48-bv2x5: secret "image-registry-tls" not found Jun 09 10:54:20.314530 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:54:20.314283 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07db5071-a553-482a-8d61-beccf9aa2f34-registry-tls podName:07db5071-a553-482a-8d61-beccf9aa2f34 nodeName:}" failed. No retries permitted until 2026-06-09 10:54:36.314268476 +0000 UTC m=+66.178508283 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/07db5071-a553-482a-8d61-beccf9aa2f34-registry-tls") pod "image-registry-6ddd8f7d48-bv2x5" (UID: "07db5071-a553-482a-8d61-beccf9aa2f34") : secret "image-registry-tls" not found Jun 09 10:54:20.314530 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:54:20.314219 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 10:54:20.314530 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:54:20.314346 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27fb5ab9-ed22-433a-90cd-bfb7577f9ee8-metrics-tls podName:27fb5ab9-ed22-433a-90cd-bfb7577f9ee8 nodeName:}" failed. No retries permitted until 2026-06-09 10:54:36.314334423 +0000 UTC m=+66.178574230 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/27fb5ab9-ed22-433a-90cd-bfb7577f9ee8-metrics-tls") pod "dns-default-rjjhk" (UID: "27fb5ab9-ed22-433a-90cd-bfb7577f9ee8") : secret "dns-default-metrics-tls" not found Jun 09 10:54:29.837989 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:29.837962 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vjfd2" Jun 09 10:54:35.417207 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:35.417169 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09719c2f-d21f-4f27-a982-3595ee62c857-metrics-certs\") pod \"network-metrics-daemon-c8zc8\" (UID: \"09719c2f-d21f-4f27-a982-3595ee62c857\") " pod="openshift-multus/network-metrics-daemon-c8zc8" Jun 09 10:54:35.417575 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:35.417213 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4c9995b-4dc8-4453-b83f-db2d253332d2-original-pull-secret\") pod \"global-pull-secret-syncer-dk56m\" (UID: \"a4c9995b-4dc8-4453-b83f-db2d253332d2\") " pod="kube-system/global-pull-secret-syncer-dk56m" Jun 09 10:54:35.419987 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:35.419970 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 10:54:35.420129 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:35.420111 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 10:54:35.428202 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:54:35.428184 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 10:54:35.428256 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:54:35.428245 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09719c2f-d21f-4f27-a982-3595ee62c857-metrics-certs podName:09719c2f-d21f-4f27-a982-3595ee62c857 nodeName:}" failed. No retries permitted until 2026-06-09 10:55:39.428231092 +0000 UTC m=+129.292470897 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/09719c2f-d21f-4f27-a982-3595ee62c857-metrics-certs") pod "network-metrics-daemon-c8zc8" (UID: "09719c2f-d21f-4f27-a982-3595ee62c857") : secret "metrics-daemon-secret" not found Jun 09 10:54:35.431529 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:35.431513 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4c9995b-4dc8-4453-b83f-db2d253332d2-original-pull-secret\") pod \"global-pull-secret-syncer-dk56m\" (UID: \"a4c9995b-4dc8-4453-b83f-db2d253332d2\") " pod="kube-system/global-pull-secret-syncer-dk56m" Jun 09 10:54:35.517174 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:35.517146 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dk56m" Jun 09 10:54:35.518316 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:35.518299 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rj6kl\" (UniqueName: \"kubernetes.io/projected/f26c0f26-60a4-4966-85ee-ba0bcf29163d-kube-api-access-rj6kl\") pod \"network-check-target-lnxhs\" (UID: \"f26c0f26-60a4-4966-85ee-ba0bcf29163d\") " pod="openshift-network-diagnostics/network-check-target-lnxhs" Jun 09 10:54:35.521152 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:35.521137 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 10:54:35.531757 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:35.531737 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 10:54:35.542128 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:35.542091 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rj6kl\" (UniqueName: \"kubernetes.io/projected/f26c0f26-60a4-4966-85ee-ba0bcf29163d-kube-api-access-rj6kl\") pod \"network-check-target-lnxhs\" (UID: \"f26c0f26-60a4-4966-85ee-ba0bcf29163d\") " pod="openshift-network-diagnostics/network-check-target-lnxhs" Jun 09 10:54:35.631752 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:35.631719 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dk56m"] Jun 09 10:54:35.634532 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:54:35.634510 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4c9995b_4dc8_4453_b83f_db2d253332d2.slice/crio-ae2f148741f492a56574f24a4d0ee73c5acfff67c9555c0c414f3c551b303fdb WatchSource:0}: Error finding container ae2f148741f492a56574f24a4d0ee73c5acfff67c9555c0c414f3c551b303fdb: Status 404 returned error can't find the container with id ae2f148741f492a56574f24a4d0ee73c5acfff67c9555c0c414f3c551b303fdb Jun 09 10:54:35.806388 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:35.806354 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vng8v\"" Jun 09 10:54:35.814026 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:35.814007 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnxhs" Jun 09 10:54:35.924602 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:35.924549 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dk56m" event={"ID":"a4c9995b-4dc8-4453-b83f-db2d253332d2","Type":"ContainerStarted","Data":"ae2f148741f492a56574f24a4d0ee73c5acfff67c9555c0c414f3c551b303fdb"} Jun 09 10:54:35.940660 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:35.940574 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lnxhs"] Jun 09 10:54:35.942936 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:54:35.942915 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf26c0f26_60a4_4966_85ee_ba0bcf29163d.slice/crio-cc56c9d788e3a427d8ebfd0363ec1ed5451de024079e4fbf3d52a69c800f6a11 WatchSource:0}: Error finding container cc56c9d788e3a427d8ebfd0363ec1ed5451de024079e4fbf3d52a69c800f6a11: Status 404 returned error can't find the container with id cc56c9d788e3a427d8ebfd0363ec1ed5451de024079e4fbf3d52a69c800f6a11 Jun 09 10:54:36.324303 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:36.324275 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/07db5071-a553-482a-8d61-beccf9aa2f34-registry-tls\") pod \"image-registry-6ddd8f7d48-bv2x5\" (UID: \"07db5071-a553-482a-8d61-beccf9aa2f34\") " pod="openshift-image-registry/image-registry-6ddd8f7d48-bv2x5" Jun 09 10:54:36.324487 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:36.324313 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27fb5ab9-ed22-433a-90cd-bfb7577f9ee8-metrics-tls\") pod \"dns-default-rjjhk\" (UID: \"27fb5ab9-ed22-433a-90cd-bfb7577f9ee8\") " pod="openshift-dns/dns-default-rjjhk" Jun 09 10:54:36.324487 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:54:36.324446 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 10:54:36.324487 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:54:36.324469 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ddd8f7d48-bv2x5: secret "image-registry-tls" not found Jun 09 10:54:36.324487 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:54:36.324481 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 10:54:36.324711 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:54:36.324537 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07db5071-a553-482a-8d61-beccf9aa2f34-registry-tls podName:07db5071-a553-482a-8d61-beccf9aa2f34 nodeName:}" failed. No retries permitted until 2026-06-09 10:55:08.324515192 +0000 UTC m=+98.188755003 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/07db5071-a553-482a-8d61-beccf9aa2f34-registry-tls") pod "image-registry-6ddd8f7d48-bv2x5" (UID: "07db5071-a553-482a-8d61-beccf9aa2f34") : secret "image-registry-tls" not found Jun 09 10:54:36.324711 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:54:36.324555 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27fb5ab9-ed22-433a-90cd-bfb7577f9ee8-metrics-tls podName:27fb5ab9-ed22-433a-90cd-bfb7577f9ee8 nodeName:}" failed. No retries permitted until 2026-06-09 10:55:08.324545546 +0000 UTC m=+98.188785355 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/27fb5ab9-ed22-433a-90cd-bfb7577f9ee8-metrics-tls") pod "dns-default-rjjhk" (UID: "27fb5ab9-ed22-433a-90cd-bfb7577f9ee8") : secret "dns-default-metrics-tls" not found Jun 09 10:54:36.929690 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:36.929655 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lnxhs" event={"ID":"f26c0f26-60a4-4966-85ee-ba0bcf29163d","Type":"ContainerStarted","Data":"cc56c9d788e3a427d8ebfd0363ec1ed5451de024079e4fbf3d52a69c800f6a11"} Jun 09 10:54:40.941494 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:40.941395 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dk56m" event={"ID":"a4c9995b-4dc8-4453-b83f-db2d253332d2","Type":"ContainerStarted","Data":"037801cc7a86723854ab17bcc997be9ab5c1fad16e949237947f768ec1427bb7"} Jun 09 10:54:40.942837 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:40.942813 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lnxhs" event={"ID":"f26c0f26-60a4-4966-85ee-ba0bcf29163d","Type":"ContainerStarted","Data":"42146070c24145759fcbeb9c9bb0ee11840453e18299bb6b8059a5d1a5f7b1c8"} Jun 09 10:54:40.942963 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:40.942947 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lnxhs" Jun 09 10:54:40.956983 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:40.956939 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-dk56m" podStartSLOduration=64.90329423 podStartE2EDuration="1m9.956926986s" totalImagesPullingTime="5.053632756s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 10:53:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:54:40.956626549 +0000 UTC m=+70.820866374" watchObservedRunningTime="2026-06-09 10:54:40.956926986 +0000 UTC m=+70.821166814" Jun 09 10:54:40.971791 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:54:40.971747 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lnxhs" podStartSLOduration=65.238801165 podStartE2EDuration="1m9.971734382s" totalImagesPullingTime="4.732933217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 10:53:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:54:40.971288008 +0000 UTC m=+70.835527835" watchObservedRunningTime="2026-06-09 10:54:40.971734382 +0000 UTC m=+70.835974210" Jun 09 10:55:08.333796 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:55:08.333758 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/07db5071-a553-482a-8d61-beccf9aa2f34-registry-tls\") pod \"image-registry-6ddd8f7d48-bv2x5\" (UID: \"07db5071-a553-482a-8d61-beccf9aa2f34\") " pod="openshift-image-registry/image-registry-6ddd8f7d48-bv2x5" Jun 09 10:55:08.333796 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:55:08.333812 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27fb5ab9-ed22-433a-90cd-bfb7577f9ee8-metrics-tls\") pod \"dns-default-rjjhk\" (UID: \"27fb5ab9-ed22-433a-90cd-bfb7577f9ee8\") " pod="openshift-dns/dns-default-rjjhk" Jun 09 10:55:08.334220 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:55:08.333921 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 10:55:08.334220 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:55:08.333940 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ddd8f7d48-bv2x5: secret "image-registry-tls" not found Jun 09 10:55:08.334220 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:55:08.333983 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 10:55:08.334220 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:55:08.333990 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07db5071-a553-482a-8d61-beccf9aa2f34-registry-tls podName:07db5071-a553-482a-8d61-beccf9aa2f34 nodeName:}" failed. No retries permitted until 2026-06-09 10:56:12.333975055 +0000 UTC m=+162.198214865 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/07db5071-a553-482a-8d61-beccf9aa2f34-registry-tls") pod "image-registry-6ddd8f7d48-bv2x5" (UID: "07db5071-a553-482a-8d61-beccf9aa2f34") : secret "image-registry-tls" not found Jun 09 10:55:08.334220 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:55:08.334023 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27fb5ab9-ed22-433a-90cd-bfb7577f9ee8-metrics-tls podName:27fb5ab9-ed22-433a-90cd-bfb7577f9ee8 nodeName:}" failed. No retries permitted until 2026-06-09 10:56:12.334011387 +0000 UTC m=+162.198251193 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/27fb5ab9-ed22-433a-90cd-bfb7577f9ee8-metrics-tls") pod "dns-default-rjjhk" (UID: "27fb5ab9-ed22-433a-90cd-bfb7577f9ee8") : secret "dns-default-metrics-tls" not found Jun 09 10:55:11.946655 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:55:11.946621 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lnxhs" Jun 09 10:55:39.436482 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:55:39.436443 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09719c2f-d21f-4f27-a982-3595ee62c857-metrics-certs\") pod \"network-metrics-daemon-c8zc8\" (UID: \"09719c2f-d21f-4f27-a982-3595ee62c857\") " pod="openshift-multus/network-metrics-daemon-c8zc8" Jun 09 10:55:39.436947 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:55:39.436583 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 10:55:39.436947 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:55:39.436667 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09719c2f-d21f-4f27-a982-3595ee62c857-metrics-certs podName:09719c2f-d21f-4f27-a982-3595ee62c857 nodeName:}" failed. No retries permitted until 2026-06-09 10:57:41.436650953 +0000 UTC m=+251.300890759 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/09719c2f-d21f-4f27-a982-3595ee62c857-metrics-certs") pod "network-metrics-daemon-c8zc8" (UID: "09719c2f-d21f-4f27-a982-3595ee62c857") : secret "metrics-daemon-secret" not found Jun 09 10:56:07.496426 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:56:07.496373 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6ddd8f7d48-bv2x5" podUID="07db5071-a553-482a-8d61-beccf9aa2f34" Jun 09 10:56:07.504624 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:56:07.504582 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-rjjhk" podUID="27fb5ab9-ed22-433a-90cd-bfb7577f9ee8" Jun 09 10:56:07.611542 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:56:07.611513 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-c8zc8" podUID="09719c2f-d21f-4f27-a982-3595ee62c857" Jun 09 10:56:08.142855 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:56:08.142822 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rjjhk" Jun 09 10:56:08.143034 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:56:08.142822 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6ddd8f7d48-bv2x5" Jun 09 10:56:12.347631 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:56:12.347574 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27fb5ab9-ed22-433a-90cd-bfb7577f9ee8-metrics-tls\") pod \"dns-default-rjjhk\" (UID: \"27fb5ab9-ed22-433a-90cd-bfb7577f9ee8\") " pod="openshift-dns/dns-default-rjjhk" Jun 09 10:56:12.347999 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:56:12.347655 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/07db5071-a553-482a-8d61-beccf9aa2f34-registry-tls\") pod \"image-registry-6ddd8f7d48-bv2x5\" (UID: \"07db5071-a553-482a-8d61-beccf9aa2f34\") " pod="openshift-image-registry/image-registry-6ddd8f7d48-bv2x5" Jun 09 10:56:12.347999 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:56:12.347742 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 10:56:12.347999 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:56:12.347742 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 10:56:12.347999 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:56:12.347752 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ddd8f7d48-bv2x5: secret "image-registry-tls" not found Jun 09 10:56:12.347999 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:56:12.347814 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07db5071-a553-482a-8d61-beccf9aa2f34-registry-tls podName:07db5071-a553-482a-8d61-beccf9aa2f34 nodeName:}" failed. No retries permitted until 2026-06-09 10:58:14.347799862 +0000 UTC m=+284.212039669 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/07db5071-a553-482a-8d61-beccf9aa2f34-registry-tls") pod "image-registry-6ddd8f7d48-bv2x5" (UID: "07db5071-a553-482a-8d61-beccf9aa2f34") : secret "image-registry-tls" not found Jun 09 10:56:12.347999 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:56:12.347828 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27fb5ab9-ed22-433a-90cd-bfb7577f9ee8-metrics-tls podName:27fb5ab9-ed22-433a-90cd-bfb7577f9ee8 nodeName:}" failed. No retries permitted until 2026-06-09 10:58:14.34782209 +0000 UTC m=+284.212061895 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/27fb5ab9-ed22-433a-90cd-bfb7577f9ee8-metrics-tls") pod "dns-default-rjjhk" (UID: "27fb5ab9-ed22-433a-90cd-bfb7577f9ee8") : secret "dns-default-metrics-tls" not found Jun 09 10:56:19.593026 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:56:19.592988 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c8zc8" Jun 09 10:57:03.676011 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.675983 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-btx7z"] Jun 09 10:57:03.678010 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.677995 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-g4tcz"] Jun 09 10:57:03.678133 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.678117 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-btx7z" Jun 09 10:57:03.679887 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.679866 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dqdjs"] Jun 09 10:57:03.680007 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.679989 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-g4tcz" Jun 09 10:57:03.681331 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.681310 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 10:57:03.681891 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.681876 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 09 10:57:03.682137 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.682116 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dqdjs" Jun 09 10:57:03.682315 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.682293 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 09 10:57:03.683119 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.683101 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-9zwrn\"" Jun 09 10:57:03.685838 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.685754 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 10:57:03.685956 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.685937 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 10:57:03.686017 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.685972 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 09 10:57:03.686069 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.686019 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lk9jv\" (UniqueName: \"kubernetes.io/projected/59478af7-0fe0-48e9-a4d8-e6cf1aa02aa9-kube-api-access-lk9jv\") pod \"insights-operator-896549976-btx7z\" (UID: \"59478af7-0fe0-48e9-a4d8-e6cf1aa02aa9\") " pod="openshift-insights/insights-operator-896549976-btx7z" Jun 09 10:57:03.686069 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.686050 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59478af7-0fe0-48e9-a4d8-e6cf1aa02aa9-tmp\") pod \"insights-operator-896549976-btx7z\" (UID: \"59478af7-0fe0-48e9-a4d8-e6cf1aa02aa9\") " pod="openshift-insights/insights-operator-896549976-btx7z" Jun 09 10:57:03.686168 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.686084 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/59478af7-0fe0-48e9-a4d8-e6cf1aa02aa9-serving-cert\") pod \"insights-operator-896549976-btx7z\" (UID: \"59478af7-0fe0-48e9-a4d8-e6cf1aa02aa9\") " pod="openshift-insights/insights-operator-896549976-btx7z" Jun 09 10:57:03.686205 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.686180 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 10:57:03.686243 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.686224 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/59478af7-0fe0-48e9-a4d8-e6cf1aa02aa9-snapshots\") pod \"insights-operator-896549976-btx7z\" (UID: \"59478af7-0fe0-48e9-a4d8-e6cf1aa02aa9\") " pod="openshift-insights/insights-operator-896549976-btx7z" Jun 09 10:57:03.686321 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.686266 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59478af7-0fe0-48e9-a4d8-e6cf1aa02aa9-service-ca-bundle\") pod \"insights-operator-896549976-btx7z\" (UID: \"59478af7-0fe0-48e9-a4d8-e6cf1aa02aa9\") " pod="openshift-insights/insights-operator-896549976-btx7z" Jun 09 10:57:03.686363 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.686349 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59478af7-0fe0-48e9-a4d8-e6cf1aa02aa9-trusted-ca-bundle\") pod \"insights-operator-896549976-btx7z\" (UID: \"59478af7-0fe0-48e9-a4d8-e6cf1aa02aa9\") " pod="openshift-insights/insights-operator-896549976-btx7z" Jun 09 10:57:03.687660 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.687644 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 09 10:57:03.687746 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.687649 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 09 10:57:03.687746 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.687673 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 09 10:57:03.688760 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.688738 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-76gx4\"" Jun 09 10:57:03.689015 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.688764 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-lwbpg\"" Jun 09 10:57:03.689015 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.688790 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 09 10:57:03.696378 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.696359 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-btx7z"] Jun 09 10:57:03.699088 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.699039 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-g4tcz"] Jun 09 10:57:03.699196 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.699149 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 09 10:57:03.703987 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.703959 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dqdjs"] Jun 09 10:57:03.768158 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.768138 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-hng2g"] Jun 09 10:57:03.769906 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.769893 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-hng2g" Jun 09 10:57:03.772376 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.772360 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-vlhmp\"" Jun 09 10:57:03.775059 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.775039 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-44tjq"] Jun 09 10:57:03.776872 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.776855 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-m22jj"] Jun 09 10:57:03.776962 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.776954 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-44tjq" Jun 09 10:57:03.778821 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.778803 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-ph2xt"] Jun 09 10:57:03.778939 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.778904 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-m22jj" Jun 09 10:57:03.779811 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.779795 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 09 10:57:03.779950 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.779934 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 09 10:57:03.780111 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.780091 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 09 10:57:03.780559 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.780539 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 09 10:57:03.780669 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.780626 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-2627g\"" Jun 09 10:57:03.780915 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.780895 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-ph2xt" Jun 09 10:57:03.781305 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.781283 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-hng2g"] Jun 09 10:57:03.783126 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.783097 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 09 10:57:03.783222 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.783160 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 09 10:57:03.783285 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.783268 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-dd7hp\"" Jun 09 10:57:03.783364 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.783339 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 09 10:57:03.783462 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.783368 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 09 10:57:03.783855 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.783835 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-75m2l\"" Jun 09 10:57:03.783985 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.783923 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 09 10:57:03.784357 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.784261 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 09 10:57:03.784433 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.784381 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 09 10:57:03.784522 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.784486 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 09 10:57:03.786703 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.786658 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/707cf306-5509-4d46-b1da-f16e4d4aebc8-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-44tjq\" (UID: \"707cf306-5509-4d46-b1da-f16e4d4aebc8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-44tjq" Jun 09 10:57:03.786804 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.786722 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59478af7-0fe0-48e9-a4d8-e6cf1aa02aa9-tmp\") pod \"insights-operator-896549976-btx7z\" (UID: \"59478af7-0fe0-48e9-a4d8-e6cf1aa02aa9\") " pod="openshift-insights/insights-operator-896549976-btx7z" Jun 09 10:57:03.786804 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.786763 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/59478af7-0fe0-48e9-a4d8-e6cf1aa02aa9-serving-cert\") pod \"insights-operator-896549976-btx7z\" (UID: \"59478af7-0fe0-48e9-a4d8-e6cf1aa02aa9\") " pod="openshift-insights/insights-operator-896549976-btx7z" Jun 09 10:57:03.786804 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.786786 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4130e4e7-212c-4aea-a2ef-e7cbd5d645c0-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-dqdjs\" (UID: \"4130e4e7-212c-4aea-a2ef-e7cbd5d645c0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dqdjs" Jun 09 10:57:03.786968 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.786818 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/59478af7-0fe0-48e9-a4d8-e6cf1aa02aa9-snapshots\") pod \"insights-operator-896549976-btx7z\" (UID: \"59478af7-0fe0-48e9-a4d8-e6cf1aa02aa9\") " pod="openshift-insights/insights-operator-896549976-btx7z" Jun 09 10:57:03.786968 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.786834 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59478af7-0fe0-48e9-a4d8-e6cf1aa02aa9-service-ca-bundle\") pod \"insights-operator-896549976-btx7z\" (UID: \"59478af7-0fe0-48e9-a4d8-e6cf1aa02aa9\") " pod="openshift-insights/insights-operator-896549976-btx7z" Jun 09 10:57:03.786968 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.786852 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rftbh\" (UniqueName: \"kubernetes.io/projected/873a6d91-1994-421b-9d98-8de76fee4784-kube-api-access-rftbh\") pod \"network-check-source-dbd9cf844-hng2g\" (UID: \"873a6d91-1994-421b-9d98-8de76fee4784\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-hng2g" Jun 09 10:57:03.787126 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.787030 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/707cf306-5509-4d46-b1da-f16e4d4aebc8-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-44tjq\" (UID: \"707cf306-5509-4d46-b1da-f16e4d4aebc8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-44tjq" Jun 09 10:57:03.787126 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.787063 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eaebd996-a743-4487-8700-221b2b9cb45c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-g4tcz\" (UID: \"eaebd996-a743-4487-8700-221b2b9cb45c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-g4tcz" Jun 09 10:57:03.787126 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.787101 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59478af7-0fe0-48e9-a4d8-e6cf1aa02aa9-tmp\") pod \"insights-operator-896549976-btx7z\" (UID: \"59478af7-0fe0-48e9-a4d8-e6cf1aa02aa9\") " pod="openshift-insights/insights-operator-896549976-btx7z" Jun 09 10:57:03.787126 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.787101 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c97d3b6d-c1d6-4b6d-83e8-957727e59f9a-config\") pod \"service-ca-operator-6bc5ff68f5-m22jj\" (UID: \"c97d3b6d-c1d6-4b6d-83e8-957727e59f9a\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-m22jj" Jun 09 10:57:03.787335 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.787154 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbsnb\" (UniqueName: \"kubernetes.io/projected/c97d3b6d-c1d6-4b6d-83e8-957727e59f9a-kube-api-access-cbsnb\") pod \"service-ca-operator-6bc5ff68f5-m22jj\" (UID: \"c97d3b6d-c1d6-4b6d-83e8-957727e59f9a\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-m22jj" Jun 09 10:57:03.787335 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.787279 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lk9jv\" (UniqueName: \"kubernetes.io/projected/59478af7-0fe0-48e9-a4d8-e6cf1aa02aa9-kube-api-access-lk9jv\") pod \"insights-operator-896549976-btx7z\" (UID: \"59478af7-0fe0-48e9-a4d8-e6cf1aa02aa9\") " pod="openshift-insights/insights-operator-896549976-btx7z" Jun 09 10:57:03.787335 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.787326 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsvfm\" (UniqueName: \"kubernetes.io/projected/eaebd996-a743-4487-8700-221b2b9cb45c-kube-api-access-nsvfm\") pod \"cluster-monitoring-operator-74bbf69bbb-g4tcz\" (UID: \"eaebd996-a743-4487-8700-221b2b9cb45c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-g4tcz" Jun 09 10:57:03.787486 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.787350 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59478af7-0fe0-48e9-a4d8-e6cf1aa02aa9-service-ca-bundle\") pod \"insights-operator-896549976-btx7z\" (UID: \"59478af7-0fe0-48e9-a4d8-e6cf1aa02aa9\") " pod="openshift-insights/insights-operator-896549976-btx7z" Jun 09 10:57:03.787486 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.787373 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/59478af7-0fe0-48e9-a4d8-e6cf1aa02aa9-snapshots\") pod \"insights-operator-896549976-btx7z\" (UID: \"59478af7-0fe0-48e9-a4d8-e6cf1aa02aa9\") " pod="openshift-insights/insights-operator-896549976-btx7z" Jun 09 10:57:03.787486 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.787436 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/eaebd996-a743-4487-8700-221b2b9cb45c-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-g4tcz\" (UID: \"eaebd996-a743-4487-8700-221b2b9cb45c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-g4tcz" Jun 09 10:57:03.787486 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.787469 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnbgc\" (UniqueName: \"kubernetes.io/projected/4130e4e7-212c-4aea-a2ef-e7cbd5d645c0-kube-api-access-mnbgc\") pod \"cluster-samples-operator-854f8b96b6-dqdjs\" (UID: \"4130e4e7-212c-4aea-a2ef-e7cbd5d645c0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dqdjs" Jun 09 10:57:03.787697 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.787496 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c97d3b6d-c1d6-4b6d-83e8-957727e59f9a-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-m22jj\" (UID: \"c97d3b6d-c1d6-4b6d-83e8-957727e59f9a\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-m22jj" Jun 09 10:57:03.787697 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.787535 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59478af7-0fe0-48e9-a4d8-e6cf1aa02aa9-trusted-ca-bundle\") pod \"insights-operator-896549976-btx7z\" (UID: \"59478af7-0fe0-48e9-a4d8-e6cf1aa02aa9\") " pod="openshift-insights/insights-operator-896549976-btx7z" Jun 09 10:57:03.787697 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.787557 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pbdn\" (UniqueName: \"kubernetes.io/projected/707cf306-5509-4d46-b1da-f16e4d4aebc8-kube-api-access-2pbdn\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-44tjq\" (UID: \"707cf306-5509-4d46-b1da-f16e4d4aebc8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-44tjq" Jun 09 10:57:03.788237 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.788218 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59478af7-0fe0-48e9-a4d8-e6cf1aa02aa9-trusted-ca-bundle\") pod \"insights-operator-896549976-btx7z\" (UID: \"59478af7-0fe0-48e9-a4d8-e6cf1aa02aa9\") " pod="openshift-insights/insights-operator-896549976-btx7z" Jun 09 10:57:03.789226 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.789207 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 09 10:57:03.789455 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.789437 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/59478af7-0fe0-48e9-a4d8-e6cf1aa02aa9-serving-cert\") pod \"insights-operator-896549976-btx7z\" (UID: \"59478af7-0fe0-48e9-a4d8-e6cf1aa02aa9\") " pod="openshift-insights/insights-operator-896549976-btx7z" Jun 09 10:57:03.797333 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.797313 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-ph2xt"] Jun 09 10:57:03.798374 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.798351 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-m22jj"] Jun 09 10:57:03.799207 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.799190 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-44tjq"] Jun 09 10:57:03.802045 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.802026 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lk9jv\" (UniqueName: \"kubernetes.io/projected/59478af7-0fe0-48e9-a4d8-e6cf1aa02aa9-kube-api-access-lk9jv\") pod \"insights-operator-896549976-btx7z\" (UID: \"59478af7-0fe0-48e9-a4d8-e6cf1aa02aa9\") " pod="openshift-insights/insights-operator-896549976-btx7z" Jun 09 10:57:03.888220 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.888201 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnbgc\" (UniqueName: \"kubernetes.io/projected/4130e4e7-212c-4aea-a2ef-e7cbd5d645c0-kube-api-access-mnbgc\") pod \"cluster-samples-operator-854f8b96b6-dqdjs\" (UID: \"4130e4e7-212c-4aea-a2ef-e7cbd5d645c0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dqdjs" Jun 09 10:57:03.888307 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.888228 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c97d3b6d-c1d6-4b6d-83e8-957727e59f9a-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-m22jj\" (UID: \"c97d3b6d-c1d6-4b6d-83e8-957727e59f9a\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-m22jj" Jun 09 10:57:03.888307 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.888262 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pbdn\" (UniqueName: \"kubernetes.io/projected/707cf306-5509-4d46-b1da-f16e4d4aebc8-kube-api-access-2pbdn\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-44tjq\" (UID: \"707cf306-5509-4d46-b1da-f16e4d4aebc8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-44tjq" Jun 09 10:57:03.888307 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.888291 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/707cf306-5509-4d46-b1da-f16e4d4aebc8-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-44tjq\" (UID: \"707cf306-5509-4d46-b1da-f16e4d4aebc8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-44tjq" Jun 09 10:57:03.888473 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.888312 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4130e4e7-212c-4aea-a2ef-e7cbd5d645c0-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-dqdjs\" (UID: \"4130e4e7-212c-4aea-a2ef-e7cbd5d645c0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dqdjs" Jun 09 10:57:03.888473 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:57:03.888392 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 10:57:03.888473 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.888437 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/56eeb8e9-a748-4e99-b04a-6d998c6aad8b-trusted-ca\") pod \"console-operator-668fdbf85c-ph2xt\" (UID: \"56eeb8e9-a748-4e99-b04a-6d998c6aad8b\") " pod="openshift-console-operator/console-operator-668fdbf85c-ph2xt" Jun 09 10:57:03.888473 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:57:03.888448 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4130e4e7-212c-4aea-a2ef-e7cbd5d645c0-samples-operator-tls podName:4130e4e7-212c-4aea-a2ef-e7cbd5d645c0 nodeName:}" failed. No retries permitted until 2026-06-09 10:57:04.388433124 +0000 UTC m=+214.252672931 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4130e4e7-212c-4aea-a2ef-e7cbd5d645c0-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-dqdjs" (UID: "4130e4e7-212c-4aea-a2ef-e7cbd5d645c0") : secret "samples-operator-tls" not found Jun 09 10:57:03.888650 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.888493 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rftbh\" (UniqueName: \"kubernetes.io/projected/873a6d91-1994-421b-9d98-8de76fee4784-kube-api-access-rftbh\") pod \"network-check-source-dbd9cf844-hng2g\" (UID: \"873a6d91-1994-421b-9d98-8de76fee4784\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-hng2g" Jun 09 10:57:03.888650 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.888524 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/707cf306-5509-4d46-b1da-f16e4d4aebc8-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-44tjq\" (UID: \"707cf306-5509-4d46-b1da-f16e4d4aebc8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-44tjq" Jun 09 10:57:03.888650 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.888628 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eaebd996-a743-4487-8700-221b2b9cb45c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-g4tcz\" (UID: \"eaebd996-a743-4487-8700-221b2b9cb45c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-g4tcz" Jun 09 10:57:03.888789 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.888679 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/56eeb8e9-a748-4e99-b04a-6d998c6aad8b-config\") pod \"console-operator-668fdbf85c-ph2xt\" (UID: \"56eeb8e9-a748-4e99-b04a-6d998c6aad8b\") " pod="openshift-console-operator/console-operator-668fdbf85c-ph2xt" Jun 09 10:57:03.888789 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.888702 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/56eeb8e9-a748-4e99-b04a-6d998c6aad8b-serving-cert\") pod \"console-operator-668fdbf85c-ph2xt\" (UID: \"56eeb8e9-a748-4e99-b04a-6d998c6aad8b\") " pod="openshift-console-operator/console-operator-668fdbf85c-ph2xt" Jun 09 10:57:03.888789 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.888751 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c97d3b6d-c1d6-4b6d-83e8-957727e59f9a-config\") pod \"service-ca-operator-6bc5ff68f5-m22jj\" (UID: \"c97d3b6d-c1d6-4b6d-83e8-957727e59f9a\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-m22jj" Jun 09 10:57:03.888789 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:57:03.888755 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 10:57:03.888789 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.888770 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbsnb\" (UniqueName: \"kubernetes.io/projected/c97d3b6d-c1d6-4b6d-83e8-957727e59f9a-kube-api-access-cbsnb\") pod \"service-ca-operator-6bc5ff68f5-m22jj\" (UID: \"c97d3b6d-c1d6-4b6d-83e8-957727e59f9a\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-m22jj" Jun 09 10:57:03.889031 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.888795 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tp45\" (UniqueName: \"kubernetes.io/projected/56eeb8e9-a748-4e99-b04a-6d998c6aad8b-kube-api-access-8tp45\") pod \"console-operator-668fdbf85c-ph2xt\" (UID: \"56eeb8e9-a748-4e99-b04a-6d998c6aad8b\") " pod="openshift-console-operator/console-operator-668fdbf85c-ph2xt" Jun 09 10:57:03.889031 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:57:03.888809 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eaebd996-a743-4487-8700-221b2b9cb45c-cluster-monitoring-operator-tls podName:eaebd996-a743-4487-8700-221b2b9cb45c nodeName:}" failed. No retries permitted until 2026-06-09 10:57:04.38879277 +0000 UTC m=+214.253032585 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/eaebd996-a743-4487-8700-221b2b9cb45c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-g4tcz" (UID: "eaebd996-a743-4487-8700-221b2b9cb45c") : secret "cluster-monitoring-operator-tls" not found Jun 09 10:57:03.889031 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.888848 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsvfm\" (UniqueName: \"kubernetes.io/projected/eaebd996-a743-4487-8700-221b2b9cb45c-kube-api-access-nsvfm\") pod \"cluster-monitoring-operator-74bbf69bbb-g4tcz\" (UID: \"eaebd996-a743-4487-8700-221b2b9cb45c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-g4tcz" Jun 09 10:57:03.889031 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.888901 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/eaebd996-a743-4487-8700-221b2b9cb45c-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-g4tcz\" (UID: \"eaebd996-a743-4487-8700-221b2b9cb45c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-g4tcz" Jun 09 10:57:03.889228 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.889137 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/707cf306-5509-4d46-b1da-f16e4d4aebc8-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-44tjq\" (UID: \"707cf306-5509-4d46-b1da-f16e4d4aebc8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-44tjq" Jun 09 10:57:03.889289 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.889270 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c97d3b6d-c1d6-4b6d-83e8-957727e59f9a-config\") pod \"service-ca-operator-6bc5ff68f5-m22jj\" (UID: \"c97d3b6d-c1d6-4b6d-83e8-957727e59f9a\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-m22jj" Jun 09 10:57:03.889695 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.889675 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/eaebd996-a743-4487-8700-221b2b9cb45c-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-g4tcz\" (UID: \"eaebd996-a743-4487-8700-221b2b9cb45c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-g4tcz" Jun 09 10:57:03.890439 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.890417 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c97d3b6d-c1d6-4b6d-83e8-957727e59f9a-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-m22jj\" (UID: \"c97d3b6d-c1d6-4b6d-83e8-957727e59f9a\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-m22jj" Jun 09 10:57:03.890565 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.890549 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/707cf306-5509-4d46-b1da-f16e4d4aebc8-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-44tjq\" (UID: \"707cf306-5509-4d46-b1da-f16e4d4aebc8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-44tjq" Jun 09 10:57:03.901699 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.901679 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pbdn\" (UniqueName: \"kubernetes.io/projected/707cf306-5509-4d46-b1da-f16e4d4aebc8-kube-api-access-2pbdn\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-44tjq\" (UID: \"707cf306-5509-4d46-b1da-f16e4d4aebc8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-44tjq" Jun 09 10:57:03.901949 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.901928 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbsnb\" (UniqueName: \"kubernetes.io/projected/c97d3b6d-c1d6-4b6d-83e8-957727e59f9a-kube-api-access-cbsnb\") pod \"service-ca-operator-6bc5ff68f5-m22jj\" (UID: \"c97d3b6d-c1d6-4b6d-83e8-957727e59f9a\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-m22jj" Jun 09 10:57:03.902028 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.902018 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnbgc\" (UniqueName: \"kubernetes.io/projected/4130e4e7-212c-4aea-a2ef-e7cbd5d645c0-kube-api-access-mnbgc\") pod \"cluster-samples-operator-854f8b96b6-dqdjs\" (UID: \"4130e4e7-212c-4aea-a2ef-e7cbd5d645c0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dqdjs" Jun 09 10:57:03.902822 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.902801 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsvfm\" (UniqueName: \"kubernetes.io/projected/eaebd996-a743-4487-8700-221b2b9cb45c-kube-api-access-nsvfm\") pod \"cluster-monitoring-operator-74bbf69bbb-g4tcz\" (UID: \"eaebd996-a743-4487-8700-221b2b9cb45c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-g4tcz" Jun 09 10:57:03.902884 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.902809 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rftbh\" (UniqueName: \"kubernetes.io/projected/873a6d91-1994-421b-9d98-8de76fee4784-kube-api-access-rftbh\") pod \"network-check-source-dbd9cf844-hng2g\" (UID: \"873a6d91-1994-421b-9d98-8de76fee4784\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-hng2g" Jun 09 10:57:03.989053 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.989035 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-btx7z" Jun 09 10:57:03.989153 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.989134 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/56eeb8e9-a748-4e99-b04a-6d998c6aad8b-config\") pod \"console-operator-668fdbf85c-ph2xt\" (UID: \"56eeb8e9-a748-4e99-b04a-6d998c6aad8b\") " pod="openshift-console-operator/console-operator-668fdbf85c-ph2xt" Jun 09 10:57:03.989217 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.989156 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/56eeb8e9-a748-4e99-b04a-6d998c6aad8b-serving-cert\") pod \"console-operator-668fdbf85c-ph2xt\" (UID: \"56eeb8e9-a748-4e99-b04a-6d998c6aad8b\") " pod="openshift-console-operator/console-operator-668fdbf85c-ph2xt" Jun 09 10:57:03.989217 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.989178 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tp45\" (UniqueName: \"kubernetes.io/projected/56eeb8e9-a748-4e99-b04a-6d998c6aad8b-kube-api-access-8tp45\") pod \"console-operator-668fdbf85c-ph2xt\" (UID: \"56eeb8e9-a748-4e99-b04a-6d998c6aad8b\") " pod="openshift-console-operator/console-operator-668fdbf85c-ph2xt" Jun 09 10:57:03.989288 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.989242 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/56eeb8e9-a748-4e99-b04a-6d998c6aad8b-trusted-ca\") pod \"console-operator-668fdbf85c-ph2xt\" (UID: \"56eeb8e9-a748-4e99-b04a-6d998c6aad8b\") " pod="openshift-console-operator/console-operator-668fdbf85c-ph2xt" Jun 09 10:57:03.989871 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.989850 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/56eeb8e9-a748-4e99-b04a-6d998c6aad8b-config\") pod \"console-operator-668fdbf85c-ph2xt\" (UID: \"56eeb8e9-a748-4e99-b04a-6d998c6aad8b\") " pod="openshift-console-operator/console-operator-668fdbf85c-ph2xt" Jun 09 10:57:03.990035 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.990017 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/56eeb8e9-a748-4e99-b04a-6d998c6aad8b-trusted-ca\") pod \"console-operator-668fdbf85c-ph2xt\" (UID: \"56eeb8e9-a748-4e99-b04a-6d998c6aad8b\") " pod="openshift-console-operator/console-operator-668fdbf85c-ph2xt" Jun 09 10:57:03.991106 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.991089 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/56eeb8e9-a748-4e99-b04a-6d998c6aad8b-serving-cert\") pod \"console-operator-668fdbf85c-ph2xt\" (UID: \"56eeb8e9-a748-4e99-b04a-6d998c6aad8b\") " pod="openshift-console-operator/console-operator-668fdbf85c-ph2xt" Jun 09 10:57:03.997231 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:03.997212 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tp45\" (UniqueName: \"kubernetes.io/projected/56eeb8e9-a748-4e99-b04a-6d998c6aad8b-kube-api-access-8tp45\") pod \"console-operator-668fdbf85c-ph2xt\" (UID: \"56eeb8e9-a748-4e99-b04a-6d998c6aad8b\") " pod="openshift-console-operator/console-operator-668fdbf85c-ph2xt" Jun 09 10:57:04.077977 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:04.077946 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-hng2g" Jun 09 10:57:04.087768 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:04.087741 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-44tjq" Jun 09 10:57:04.099689 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:04.099670 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-m22jj" Jun 09 10:57:04.106533 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:04.106451 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-btx7z"] Jun 09 10:57:04.109345 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:04.109319 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-ph2xt" Jun 09 10:57:04.109482 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:57:04.109437 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59478af7_0fe0_48e9_a4d8_e6cf1aa02aa9.slice/crio-099664a891972f8860ed32a5e8f4888134b8fd511cba4e82088e5a5e7c05b6d7 WatchSource:0}: Error finding container 099664a891972f8860ed32a5e8f4888134b8fd511cba4e82088e5a5e7c05b6d7: Status 404 returned error can't find the container with id 099664a891972f8860ed32a5e8f4888134b8fd511cba4e82088e5a5e7c05b6d7 Jun 09 10:57:04.230779 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:04.230750 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-hng2g"] Jun 09 10:57:04.233308 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:57:04.233277 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod873a6d91_1994_421b_9d98_8de76fee4784.slice/crio-5e405f542e0b7a662cb66db7229b2f4020002931cd683fd852ecf4ac23d32bcf WatchSource:0}: Error finding container 5e405f542e0b7a662cb66db7229b2f4020002931cd683fd852ecf4ac23d32bcf: Status 404 returned error can't find the container with id 5e405f542e0b7a662cb66db7229b2f4020002931cd683fd852ecf4ac23d32bcf Jun 09 10:57:04.271359 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:04.271332 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-btx7z" event={"ID":"59478af7-0fe0-48e9-a4d8-e6cf1aa02aa9","Type":"ContainerStarted","Data":"099664a891972f8860ed32a5e8f4888134b8fd511cba4e82088e5a5e7c05b6d7"} Jun 09 10:57:04.272390 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:04.272368 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-hng2g" event={"ID":"873a6d91-1994-421b-9d98-8de76fee4784","Type":"ContainerStarted","Data":"5e405f542e0b7a662cb66db7229b2f4020002931cd683fd852ecf4ac23d32bcf"} Jun 09 10:57:04.278105 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:04.276447 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-ph2xt"] Jun 09 10:57:04.282267 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:57:04.282236 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56eeb8e9_a748_4e99_b04a_6d998c6aad8b.slice/crio-51cc8387eac68839864e131e8c1bab8048b043f8f53627c77e63bb3e59de0fac WatchSource:0}: Error finding container 51cc8387eac68839864e131e8c1bab8048b043f8f53627c77e63bb3e59de0fac: Status 404 returned error can't find the container with id 51cc8387eac68839864e131e8c1bab8048b043f8f53627c77e63bb3e59de0fac Jun 09 10:57:04.392214 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:04.392180 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eaebd996-a743-4487-8700-221b2b9cb45c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-g4tcz\" (UID: \"eaebd996-a743-4487-8700-221b2b9cb45c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-g4tcz" Jun 09 10:57:04.392342 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:57:04.392322 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 10:57:04.392404 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:57:04.392394 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eaebd996-a743-4487-8700-221b2b9cb45c-cluster-monitoring-operator-tls podName:eaebd996-a743-4487-8700-221b2b9cb45c nodeName:}" failed. No retries permitted until 2026-06-09 10:57:05.392375989 +0000 UTC m=+215.256615812 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/eaebd996-a743-4487-8700-221b2b9cb45c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-g4tcz" (UID: "eaebd996-a743-4487-8700-221b2b9cb45c") : secret "cluster-monitoring-operator-tls" not found Jun 09 10:57:04.392448 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:04.392414 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4130e4e7-212c-4aea-a2ef-e7cbd5d645c0-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-dqdjs\" (UID: \"4130e4e7-212c-4aea-a2ef-e7cbd5d645c0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dqdjs" Jun 09 10:57:04.392504 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:57:04.392495 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 10:57:04.392541 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:57:04.392537 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4130e4e7-212c-4aea-a2ef-e7cbd5d645c0-samples-operator-tls podName:4130e4e7-212c-4aea-a2ef-e7cbd5d645c0 nodeName:}" failed. No retries permitted until 2026-06-09 10:57:05.392525963 +0000 UTC m=+215.256765785 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4130e4e7-212c-4aea-a2ef-e7cbd5d645c0-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-dqdjs" (UID: "4130e4e7-212c-4aea-a2ef-e7cbd5d645c0") : secret "samples-operator-tls" not found Jun 09 10:57:04.449113 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:04.449063 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-44tjq"] Jun 09 10:57:04.451813 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:57:04.451784 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod707cf306_5509_4d46_b1da_f16e4d4aebc8.slice/crio-03599eb0b89c31da005b32164f0cb4f946da4adf0def42cb765fc95de6643a89 WatchSource:0}: Error finding container 03599eb0b89c31da005b32164f0cb4f946da4adf0def42cb765fc95de6643a89: Status 404 returned error can't find the container with id 03599eb0b89c31da005b32164f0cb4f946da4adf0def42cb765fc95de6643a89 Jun 09 10:57:04.452548 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:04.452520 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-m22jj"] Jun 09 10:57:04.455029 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:57:04.454995 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc97d3b6d_c1d6_4b6d_83e8_957727e59f9a.slice/crio-ff459b1aeacc393ae2464cd19b59cf491cbfcb4656466177c41f45855d33c303 WatchSource:0}: Error finding container ff459b1aeacc393ae2464cd19b59cf491cbfcb4656466177c41f45855d33c303: Status 404 returned error can't find the container with id ff459b1aeacc393ae2464cd19b59cf491cbfcb4656466177c41f45855d33c303 Jun 09 10:57:05.277769 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:05.277732 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-44tjq" event={"ID":"707cf306-5509-4d46-b1da-f16e4d4aebc8","Type":"ContainerStarted","Data":"03599eb0b89c31da005b32164f0cb4f946da4adf0def42cb765fc95de6643a89"} Jun 09 10:57:05.281538 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:05.280869 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-hng2g" event={"ID":"873a6d91-1994-421b-9d98-8de76fee4784","Type":"ContainerStarted","Data":"97631ac5c3f228dcd07d7a1eb3982ba023da2af21e7e6ba5718a34d6f4f821f5"} Jun 09 10:57:05.285636 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:05.284839 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-ph2xt" event={"ID":"56eeb8e9-a748-4e99-b04a-6d998c6aad8b","Type":"ContainerStarted","Data":"51cc8387eac68839864e131e8c1bab8048b043f8f53627c77e63bb3e59de0fac"} Jun 09 10:57:05.287943 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:05.287894 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-m22jj" event={"ID":"c97d3b6d-c1d6-4b6d-83e8-957727e59f9a","Type":"ContainerStarted","Data":"ff459b1aeacc393ae2464cd19b59cf491cbfcb4656466177c41f45855d33c303"} Jun 09 10:57:05.299863 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:05.299813 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-hng2g" podStartSLOduration=2.299795321 podStartE2EDuration="2.299795321s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 10:57:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:57:05.297291849 +0000 UTC m=+215.161531678" watchObservedRunningTime="2026-06-09 10:57:05.299795321 +0000 UTC m=+215.164035151" Jun 09 10:57:05.403124 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:05.403090 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4130e4e7-212c-4aea-a2ef-e7cbd5d645c0-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-dqdjs\" (UID: \"4130e4e7-212c-4aea-a2ef-e7cbd5d645c0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dqdjs" Jun 09 10:57:05.403290 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:05.403155 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eaebd996-a743-4487-8700-221b2b9cb45c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-g4tcz\" (UID: \"eaebd996-a743-4487-8700-221b2b9cb45c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-g4tcz" Jun 09 10:57:05.403364 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:57:05.403348 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 10:57:05.403429 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:57:05.403418 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4130e4e7-212c-4aea-a2ef-e7cbd5d645c0-samples-operator-tls podName:4130e4e7-212c-4aea-a2ef-e7cbd5d645c0 nodeName:}" failed. No retries permitted until 2026-06-09 10:57:07.403398261 +0000 UTC m=+217.267638072 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4130e4e7-212c-4aea-a2ef-e7cbd5d645c0-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-dqdjs" (UID: "4130e4e7-212c-4aea-a2ef-e7cbd5d645c0") : secret "samples-operator-tls" not found Jun 09 10:57:05.403850 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:57:05.403783 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 10:57:05.403957 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:57:05.403864 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eaebd996-a743-4487-8700-221b2b9cb45c-cluster-monitoring-operator-tls podName:eaebd996-a743-4487-8700-221b2b9cb45c nodeName:}" failed. No retries permitted until 2026-06-09 10:57:07.40384861 +0000 UTC m=+217.268088421 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/eaebd996-a743-4487-8700-221b2b9cb45c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-g4tcz" (UID: "eaebd996-a743-4487-8700-221b2b9cb45c") : secret "cluster-monitoring-operator-tls" not found Jun 09 10:57:07.420657 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:07.420623 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4130e4e7-212c-4aea-a2ef-e7cbd5d645c0-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-dqdjs\" (UID: \"4130e4e7-212c-4aea-a2ef-e7cbd5d645c0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dqdjs" Jun 09 10:57:07.421108 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:07.420691 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eaebd996-a743-4487-8700-221b2b9cb45c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-g4tcz\" (UID: \"eaebd996-a743-4487-8700-221b2b9cb45c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-g4tcz" Jun 09 10:57:07.421108 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:57:07.420752 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 10:57:07.421108 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:57:07.420807 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 10:57:07.421108 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:57:07.420836 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4130e4e7-212c-4aea-a2ef-e7cbd5d645c0-samples-operator-tls podName:4130e4e7-212c-4aea-a2ef-e7cbd5d645c0 nodeName:}" failed. No retries permitted until 2026-06-09 10:57:11.420815941 +0000 UTC m=+221.285055811 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4130e4e7-212c-4aea-a2ef-e7cbd5d645c0-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-dqdjs" (UID: "4130e4e7-212c-4aea-a2ef-e7cbd5d645c0") : secret "samples-operator-tls" not found Jun 09 10:57:07.421108 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:57:07.420858 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eaebd996-a743-4487-8700-221b2b9cb45c-cluster-monitoring-operator-tls podName:eaebd996-a743-4487-8700-221b2b9cb45c nodeName:}" failed. No retries permitted until 2026-06-09 10:57:11.420848579 +0000 UTC m=+221.285088385 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/eaebd996-a743-4487-8700-221b2b9cb45c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-g4tcz" (UID: "eaebd996-a743-4487-8700-221b2b9cb45c") : secret "cluster-monitoring-operator-tls" not found Jun 09 10:57:08.299615 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:08.299556 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-44tjq" event={"ID":"707cf306-5509-4d46-b1da-f16e4d4aebc8","Type":"ContainerStarted","Data":"4583039a677dce1cb106b70738b7925afde78fa7f0b1ec0a4064744005b60d38"} Jun 09 10:57:08.301095 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:08.301069 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-btx7z" event={"ID":"59478af7-0fe0-48e9-a4d8-e6cf1aa02aa9","Type":"ContainerStarted","Data":"80e4eb1a31f72e6e7a4a047c7dd78e6bf7b06f4e744b2ec1115c870b1caf46a2"} Jun 09 10:57:08.302957 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:08.302935 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-ph2xt_56eeb8e9-a748-4e99-b04a-6d998c6aad8b/console-operator/0.log" Jun 09 10:57:08.303062 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:08.302972 2562 generic.go:356] "Generic (PLEG): container finished" podID="56eeb8e9-a748-4e99-b04a-6d998c6aad8b" containerID="43793204f2143d17d8a5d582698d96d514a39e0696756501a414913981751cfa" exitCode=255 Jun 09 10:57:08.303062 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:08.303037 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-ph2xt" event={"ID":"56eeb8e9-a748-4e99-b04a-6d998c6aad8b","Type":"ContainerDied","Data":"43793204f2143d17d8a5d582698d96d514a39e0696756501a414913981751cfa"} Jun 09 10:57:08.303396 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:08.303378 2562 scope.go:117] "RemoveContainer" containerID="43793204f2143d17d8a5d582698d96d514a39e0696756501a414913981751cfa" Jun 09 10:57:08.305175 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:08.305151 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-m22jj" event={"ID":"c97d3b6d-c1d6-4b6d-83e8-957727e59f9a","Type":"ContainerStarted","Data":"a64ebd2f919d3c41349ebdb31856279106f8b8260866b8e18a6a5c823b90fd28"} Jun 09 10:57:08.318124 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:08.318079 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-44tjq" podStartSLOduration=2.028795311 podStartE2EDuration="5.318061068s" totalImagesPullingTime="3.289265757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 10:57:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:57:08.315929406 +0000 UTC m=+218.180169238" watchObservedRunningTime="2026-06-09 10:57:08.318061068 +0000 UTC m=+218.182300897" Jun 09 10:57:08.334034 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:08.333986 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-btx7z" podStartSLOduration=1.708942723 podStartE2EDuration="5.333968339s" totalImagesPullingTime="3.625025616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 10:57:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:57:08.333943487 +0000 UTC m=+218.198183315" watchObservedRunningTime="2026-06-09 10:57:08.333968339 +0000 UTC m=+218.198208171" Jun 09 10:57:08.371831 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:08.371784 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-m22jj" podStartSLOduration=2.083818058 podStartE2EDuration="5.371765775s" totalImagesPullingTime="3.287947717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 10:57:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:57:08.35496478 +0000 UTC m=+218.219204609" watchObservedRunningTime="2026-06-09 10:57:08.371765775 +0000 UTC m=+218.236005606" Jun 09 10:57:09.284468 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:09.284430 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-64v5t"] Jun 09 10:57:09.287505 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:09.287484 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-64v5t" Jun 09 10:57:09.290502 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:09.290482 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-r9srh\"" Jun 09 10:57:09.290652 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:09.290502 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 09 10:57:09.290652 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:09.290489 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 09 10:57:09.295924 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:09.295904 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-64v5t"] Jun 09 10:57:09.311519 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:09.311504 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-ph2xt_56eeb8e9-a748-4e99-b04a-6d998c6aad8b/console-operator/1.log" Jun 09 10:57:09.311913 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:09.311897 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-ph2xt_56eeb8e9-a748-4e99-b04a-6d998c6aad8b/console-operator/0.log" Jun 09 10:57:09.312007 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:09.311927 2562 generic.go:356] "Generic (PLEG): container finished" podID="56eeb8e9-a748-4e99-b04a-6d998c6aad8b" containerID="350417af04db785ead2350063833a58415188ce23be7de2fc08ebdcae60a7d8d" exitCode=255 Jun 09 10:57:09.312007 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:09.311953 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-ph2xt" event={"ID":"56eeb8e9-a748-4e99-b04a-6d998c6aad8b","Type":"ContainerDied","Data":"350417af04db785ead2350063833a58415188ce23be7de2fc08ebdcae60a7d8d"} Jun 09 10:57:09.312104 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:09.312010 2562 scope.go:117] "RemoveContainer" containerID="43793204f2143d17d8a5d582698d96d514a39e0696756501a414913981751cfa" Jun 09 10:57:09.312216 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:09.312191 2562 scope.go:117] "RemoveContainer" containerID="350417af04db785ead2350063833a58415188ce23be7de2fc08ebdcae60a7d8d" Jun 09 10:57:09.312394 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:57:09.312367 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-ph2xt_openshift-console-operator(56eeb8e9-a748-4e99-b04a-6d998c6aad8b)\"" pod="openshift-console-operator/console-operator-668fdbf85c-ph2xt" podUID="56eeb8e9-a748-4e99-b04a-6d998c6aad8b" Jun 09 10:57:09.346707 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:09.346686 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njsnj\" (UniqueName: \"kubernetes.io/projected/e3ef5abe-3382-4a11-af17-4e0fb08427bc-kube-api-access-njsnj\") pod \"migrator-955ffdf5f-64v5t\" (UID: \"e3ef5abe-3382-4a11-af17-4e0fb08427bc\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-64v5t" Jun 09 10:57:09.447752 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:09.447730 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njsnj\" (UniqueName: \"kubernetes.io/projected/e3ef5abe-3382-4a11-af17-4e0fb08427bc-kube-api-access-njsnj\") pod \"migrator-955ffdf5f-64v5t\" (UID: \"e3ef5abe-3382-4a11-af17-4e0fb08427bc\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-64v5t" Jun 09 10:57:09.456222 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:09.456203 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njsnj\" (UniqueName: \"kubernetes.io/projected/e3ef5abe-3382-4a11-af17-4e0fb08427bc-kube-api-access-njsnj\") pod \"migrator-955ffdf5f-64v5t\" (UID: \"e3ef5abe-3382-4a11-af17-4e0fb08427bc\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-64v5t" Jun 09 10:57:09.598831 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:09.598785 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-64v5t" Jun 09 10:57:09.718136 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:09.718115 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-64v5t"] Jun 09 10:57:09.719940 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:57:09.719916 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3ef5abe_3382_4a11_af17_4e0fb08427bc.slice/crio-6128cde16edda7f1de90609970be2e5617666f220c472cccb871d1f6a98f0a01 WatchSource:0}: Error finding container 6128cde16edda7f1de90609970be2e5617666f220c472cccb871d1f6a98f0a01: Status 404 returned error can't find the container with id 6128cde16edda7f1de90609970be2e5617666f220c472cccb871d1f6a98f0a01 Jun 09 10:57:10.317653 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:10.317621 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-ph2xt_56eeb8e9-a748-4e99-b04a-6d998c6aad8b/console-operator/1.log" Jun 09 10:57:10.318114 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:10.318013 2562 scope.go:117] "RemoveContainer" containerID="350417af04db785ead2350063833a58415188ce23be7de2fc08ebdcae60a7d8d" Jun 09 10:57:10.318217 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:57:10.318194 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-ph2xt_openshift-console-operator(56eeb8e9-a748-4e99-b04a-6d998c6aad8b)\"" pod="openshift-console-operator/console-operator-668fdbf85c-ph2xt" podUID="56eeb8e9-a748-4e99-b04a-6d998c6aad8b" Jun 09 10:57:10.319116 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:10.319092 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-64v5t" event={"ID":"e3ef5abe-3382-4a11-af17-4e0fb08427bc","Type":"ContainerStarted","Data":"6128cde16edda7f1de90609970be2e5617666f220c472cccb871d1f6a98f0a01"} Jun 09 10:57:10.817461 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:10.817442 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dgc6w_d88d356c-48a2-4f25-b063-c322959af6da/dns-node-resolver/0.log" Jun 09 10:57:11.323990 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:11.323958 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-64v5t" event={"ID":"e3ef5abe-3382-4a11-af17-4e0fb08427bc","Type":"ContainerStarted","Data":"faba4e26ff4b5349d0a21cabdd68420c963711dbd9811d81c8cc1d1f6c130663"} Jun 09 10:57:11.324381 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:11.324051 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-64v5t" event={"ID":"e3ef5abe-3382-4a11-af17-4e0fb08427bc","Type":"ContainerStarted","Data":"b62d3018d76866ab30b9f959b309adfbc8809980ad074f2257d429fac5f38a67"} Jun 09 10:57:11.341351 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:11.341295 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-64v5t" podStartSLOduration=1.268382276 podStartE2EDuration="2.341282898s" totalImagesPullingTime="1.072900622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 10:57:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:57:11.340385147 +0000 UTC m=+221.204624974" watchObservedRunningTime="2026-06-09 10:57:11.341282898 +0000 UTC m=+221.205522726" Jun 09 10:57:11.464629 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:11.464602 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4130e4e7-212c-4aea-a2ef-e7cbd5d645c0-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-dqdjs\" (UID: \"4130e4e7-212c-4aea-a2ef-e7cbd5d645c0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dqdjs" Jun 09 10:57:11.464730 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:11.464649 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eaebd996-a743-4487-8700-221b2b9cb45c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-g4tcz\" (UID: \"eaebd996-a743-4487-8700-221b2b9cb45c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-g4tcz" Jun 09 10:57:11.464776 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:57:11.464743 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 10:57:11.464811 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:57:11.464744 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 10:57:11.464853 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:57:11.464840 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4130e4e7-212c-4aea-a2ef-e7cbd5d645c0-samples-operator-tls podName:4130e4e7-212c-4aea-a2ef-e7cbd5d645c0 nodeName:}" failed. No retries permitted until 2026-06-09 10:57:19.464818618 +0000 UTC m=+229.329058424 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4130e4e7-212c-4aea-a2ef-e7cbd5d645c0-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-dqdjs" (UID: "4130e4e7-212c-4aea-a2ef-e7cbd5d645c0") : secret "samples-operator-tls" not found Jun 09 10:57:11.464899 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:57:11.464861 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eaebd996-a743-4487-8700-221b2b9cb45c-cluster-monitoring-operator-tls podName:eaebd996-a743-4487-8700-221b2b9cb45c nodeName:}" failed. No retries permitted until 2026-06-09 10:57:19.464854374 +0000 UTC m=+229.329094180 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/eaebd996-a743-4487-8700-221b2b9cb45c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-g4tcz" (UID: "eaebd996-a743-4487-8700-221b2b9cb45c") : secret "cluster-monitoring-operator-tls" not found Jun 09 10:57:12.017371 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:12.017343 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qp2c7_47e4d25a-0728-4e43-83ac-673201e1647a/node-ca/0.log" Jun 09 10:57:12.817930 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:12.817899 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jwgsk_40572faa-ff5a-4e83-a728-7e356e6feb69/serve-healthcheck-canary/0.log" Jun 09 10:57:14.110119 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:14.110048 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-ph2xt" Jun 09 10:57:14.110119 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:14.110092 2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-ph2xt" Jun 09 10:57:14.110475 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:14.110371 2562 scope.go:117] "RemoveContainer" containerID="350417af04db785ead2350063833a58415188ce23be7de2fc08ebdcae60a7d8d" Jun 09 10:57:14.110519 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:57:14.110499 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-ph2xt_openshift-console-operator(56eeb8e9-a748-4e99-b04a-6d998c6aad8b)\"" pod="openshift-console-operator/console-operator-668fdbf85c-ph2xt" podUID="56eeb8e9-a748-4e99-b04a-6d998c6aad8b" Jun 09 10:57:19.527539 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:19.527507 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4130e4e7-212c-4aea-a2ef-e7cbd5d645c0-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-dqdjs\" (UID: \"4130e4e7-212c-4aea-a2ef-e7cbd5d645c0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dqdjs" Jun 09 10:57:19.527991 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:19.527546 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eaebd996-a743-4487-8700-221b2b9cb45c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-g4tcz\" (UID: \"eaebd996-a743-4487-8700-221b2b9cb45c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-g4tcz" Jun 09 10:57:19.527991 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:57:19.527696 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 10:57:19.527991 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:57:19.527772 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eaebd996-a743-4487-8700-221b2b9cb45c-cluster-monitoring-operator-tls podName:eaebd996-a743-4487-8700-221b2b9cb45c nodeName:}" failed. No retries permitted until 2026-06-09 10:57:35.527751703 +0000 UTC m=+245.391991522 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/eaebd996-a743-4487-8700-221b2b9cb45c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-g4tcz" (UID: "eaebd996-a743-4487-8700-221b2b9cb45c") : secret "cluster-monitoring-operator-tls" not found Jun 09 10:57:19.529920 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:19.529896 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4130e4e7-212c-4aea-a2ef-e7cbd5d645c0-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-dqdjs\" (UID: \"4130e4e7-212c-4aea-a2ef-e7cbd5d645c0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dqdjs" Jun 09 10:57:19.601131 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:19.601110 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dqdjs" Jun 09 10:57:19.720025 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:19.719997 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dqdjs"] Jun 09 10:57:20.350509 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:20.350450 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dqdjs" event={"ID":"4130e4e7-212c-4aea-a2ef-e7cbd5d645c0","Type":"ContainerStarted","Data":"2c995b70f88ddf8637c6cf3856876ea303efca3800beeef68a0b7e5821fefc66"} Jun 09 10:57:22.358710 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:22.358679 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dqdjs" event={"ID":"4130e4e7-212c-4aea-a2ef-e7cbd5d645c0","Type":"ContainerStarted","Data":"f8dae878ab1da8427fe3e7217ca15a151aa31eb5f13690b8c9ac50867fd3e5cb"} Jun 09 10:57:22.359079 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:22.358728 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dqdjs" event={"ID":"4130e4e7-212c-4aea-a2ef-e7cbd5d645c0","Type":"ContainerStarted","Data":"c57d7238477d50f27777c3be7669fd0b182a812d83ad1c1b1cf87ab957c2a214"} Jun 09 10:57:22.377605 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:22.377548 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dqdjs" podStartSLOduration=17.703684293 podStartE2EDuration="19.377535292s" totalImagesPullingTime="1.673850999s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 10:57:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:57:22.377108266 +0000 UTC m=+232.241348095" watchObservedRunningTime="2026-06-09 10:57:22.377535292 +0000 UTC m=+232.241775120" Jun 09 10:57:28.593236 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:28.593207 2562 scope.go:117] "RemoveContainer" containerID="350417af04db785ead2350063833a58415188ce23be7de2fc08ebdcae60a7d8d" Jun 09 10:57:29.379498 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:29.379472 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-ph2xt_56eeb8e9-a748-4e99-b04a-6d998c6aad8b/console-operator/2.log" Jun 09 10:57:29.379916 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:29.379901 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-ph2xt_56eeb8e9-a748-4e99-b04a-6d998c6aad8b/console-operator/1.log" Jun 09 10:57:29.379984 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:29.379932 2562 generic.go:356] "Generic (PLEG): container finished" podID="56eeb8e9-a748-4e99-b04a-6d998c6aad8b" containerID="dfd721fb902a86e1e9d8f46d944e563e26e2c4852165c3917db5ce6745d34b89" exitCode=255 Jun 09 10:57:29.379984 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:29.379961 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-ph2xt" event={"ID":"56eeb8e9-a748-4e99-b04a-6d998c6aad8b","Type":"ContainerDied","Data":"dfd721fb902a86e1e9d8f46d944e563e26e2c4852165c3917db5ce6745d34b89"} Jun 09 10:57:29.380047 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:29.380001 2562 scope.go:117] "RemoveContainer" containerID="350417af04db785ead2350063833a58415188ce23be7de2fc08ebdcae60a7d8d" Jun 09 10:57:29.380320 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:29.380302 2562 scope.go:117] "RemoveContainer" containerID="dfd721fb902a86e1e9d8f46d944e563e26e2c4852165c3917db5ce6745d34b89" Jun 09 10:57:29.380472 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:57:29.380452 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-ph2xt_openshift-console-operator(56eeb8e9-a748-4e99-b04a-6d998c6aad8b)\"" pod="openshift-console-operator/console-operator-668fdbf85c-ph2xt" podUID="56eeb8e9-a748-4e99-b04a-6d998c6aad8b" Jun 09 10:57:30.384401 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:30.384375 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-ph2xt_56eeb8e9-a748-4e99-b04a-6d998c6aad8b/console-operator/2.log" Jun 09 10:57:31.899912 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:31.899880 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-chjlb"] Jun 09 10:57:31.904287 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:31.904270 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-chjlb" Jun 09 10:57:31.907444 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:31.907413 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 10:57:31.908607 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:31.908573 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6cr7b\"" Jun 09 10:57:31.908717 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:31.908607 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 10:57:31.922623 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:31.922601 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-chjlb"] Jun 09 10:57:32.018972 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:32.018931 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b12fa03-7b45-45ec-a0e4-5e104fe34e5b-data-volume\") pod \"insights-runtime-extractor-chjlb\" (UID: \"3b12fa03-7b45-45ec-a0e4-5e104fe34e5b\") " pod="openshift-insights/insights-runtime-extractor-chjlb" Jun 09 10:57:32.019142 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:32.018992 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3b12fa03-7b45-45ec-a0e4-5e104fe34e5b-crio-socket\") pod \"insights-runtime-extractor-chjlb\" (UID: \"3b12fa03-7b45-45ec-a0e4-5e104fe34e5b\") " pod="openshift-insights/insights-runtime-extractor-chjlb" Jun 09 10:57:32.019142 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:32.019058 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3b12fa03-7b45-45ec-a0e4-5e104fe34e5b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-chjlb\" (UID: \"3b12fa03-7b45-45ec-a0e4-5e104fe34e5b\") " pod="openshift-insights/insights-runtime-extractor-chjlb" Jun 09 10:57:32.019142 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:32.019085 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxht7\" (UniqueName: \"kubernetes.io/projected/3b12fa03-7b45-45ec-a0e4-5e104fe34e5b-kube-api-access-hxht7\") pod \"insights-runtime-extractor-chjlb\" (UID: \"3b12fa03-7b45-45ec-a0e4-5e104fe34e5b\") " pod="openshift-insights/insights-runtime-extractor-chjlb" Jun 09 10:57:32.019142 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:32.019103 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3b12fa03-7b45-45ec-a0e4-5e104fe34e5b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-chjlb\" (UID: \"3b12fa03-7b45-45ec-a0e4-5e104fe34e5b\") " pod="openshift-insights/insights-runtime-extractor-chjlb" Jun 09 10:57:32.119577 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:32.119547 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b12fa03-7b45-45ec-a0e4-5e104fe34e5b-data-volume\") pod \"insights-runtime-extractor-chjlb\" (UID: \"3b12fa03-7b45-45ec-a0e4-5e104fe34e5b\") " pod="openshift-insights/insights-runtime-extractor-chjlb" Jun 09 10:57:32.119770 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:32.119607 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3b12fa03-7b45-45ec-a0e4-5e104fe34e5b-crio-socket\") pod \"insights-runtime-extractor-chjlb\" (UID: \"3b12fa03-7b45-45ec-a0e4-5e104fe34e5b\") " pod="openshift-insights/insights-runtime-extractor-chjlb" Jun 09 10:57:32.119770 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:32.119649 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3b12fa03-7b45-45ec-a0e4-5e104fe34e5b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-chjlb\" (UID: \"3b12fa03-7b45-45ec-a0e4-5e104fe34e5b\") " pod="openshift-insights/insights-runtime-extractor-chjlb" Jun 09 10:57:32.119770 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:32.119669 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxht7\" (UniqueName: \"kubernetes.io/projected/3b12fa03-7b45-45ec-a0e4-5e104fe34e5b-kube-api-access-hxht7\") pod \"insights-runtime-extractor-chjlb\" (UID: \"3b12fa03-7b45-45ec-a0e4-5e104fe34e5b\") " pod="openshift-insights/insights-runtime-extractor-chjlb" Jun 09 10:57:32.119770 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:32.119688 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3b12fa03-7b45-45ec-a0e4-5e104fe34e5b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-chjlb\" (UID: \"3b12fa03-7b45-45ec-a0e4-5e104fe34e5b\") " pod="openshift-insights/insights-runtime-extractor-chjlb" Jun 09 10:57:32.119977 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:32.119766 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3b12fa03-7b45-45ec-a0e4-5e104fe34e5b-crio-socket\") pod \"insights-runtime-extractor-chjlb\" (UID: \"3b12fa03-7b45-45ec-a0e4-5e104fe34e5b\") " pod="openshift-insights/insights-runtime-extractor-chjlb" Jun 09 10:57:32.119977 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:32.119898 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b12fa03-7b45-45ec-a0e4-5e104fe34e5b-data-volume\") pod \"insights-runtime-extractor-chjlb\" (UID: \"3b12fa03-7b45-45ec-a0e4-5e104fe34e5b\") " pod="openshift-insights/insights-runtime-extractor-chjlb" Jun 09 10:57:32.120302 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:32.120277 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3b12fa03-7b45-45ec-a0e4-5e104fe34e5b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-chjlb\" (UID: \"3b12fa03-7b45-45ec-a0e4-5e104fe34e5b\") " pod="openshift-insights/insights-runtime-extractor-chjlb" Jun 09 10:57:32.121933 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:32.121917 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3b12fa03-7b45-45ec-a0e4-5e104fe34e5b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-chjlb\" (UID: \"3b12fa03-7b45-45ec-a0e4-5e104fe34e5b\") " pod="openshift-insights/insights-runtime-extractor-chjlb" Jun 09 10:57:32.128025 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:32.128006 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxht7\" (UniqueName: \"kubernetes.io/projected/3b12fa03-7b45-45ec-a0e4-5e104fe34e5b-kube-api-access-hxht7\") pod \"insights-runtime-extractor-chjlb\" (UID: \"3b12fa03-7b45-45ec-a0e4-5e104fe34e5b\") " pod="openshift-insights/insights-runtime-extractor-chjlb" Jun 09 10:57:32.213622 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:32.213599 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-chjlb" Jun 09 10:57:32.334244 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:32.334214 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-chjlb"] Jun 09 10:57:32.337007 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:57:32.336980 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b12fa03_7b45_45ec_a0e4_5e104fe34e5b.slice/crio-26ef638d028410292427fdc6b75b17463d20620f2159edae28605705d987bc07 WatchSource:0}: Error finding container 26ef638d028410292427fdc6b75b17463d20620f2159edae28605705d987bc07: Status 404 returned error can't find the container with id 26ef638d028410292427fdc6b75b17463d20620f2159edae28605705d987bc07 Jun 09 10:57:32.391815 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:32.391787 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-chjlb" event={"ID":"3b12fa03-7b45-45ec-a0e4-5e104fe34e5b","Type":"ContainerStarted","Data":"5b2da1a4c6eb9da43a068ee49d9da55585bc77e94766fd04bcada6c7d6010bac"} Jun 09 10:57:32.391896 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:32.391851 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-chjlb" event={"ID":"3b12fa03-7b45-45ec-a0e4-5e104fe34e5b","Type":"ContainerStarted","Data":"26ef638d028410292427fdc6b75b17463d20620f2159edae28605705d987bc07"} Jun 09 10:57:33.399519 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:33.399436 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-chjlb" event={"ID":"3b12fa03-7b45-45ec-a0e4-5e104fe34e5b","Type":"ContainerStarted","Data":"66f440affc57c3ff435be5cb391defdf9272155469fa3109f6d7f929ba8b5c35"} Jun 09 10:57:34.109788 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:34.109743 2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-ph2xt" Jun 09 10:57:34.109982 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:34.109839 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-ph2xt" Jun 09 10:57:34.110140 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:34.110128 2562 scope.go:117] "RemoveContainer" containerID="dfd721fb902a86e1e9d8f46d944e563e26e2c4852165c3917db5ce6745d34b89" Jun 09 10:57:34.110296 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:57:34.110277 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-ph2xt_openshift-console-operator(56eeb8e9-a748-4e99-b04a-6d998c6aad8b)\"" pod="openshift-console-operator/console-operator-668fdbf85c-ph2xt" podUID="56eeb8e9-a748-4e99-b04a-6d998c6aad8b" Jun 09 10:57:35.407468 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:35.407435 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-chjlb" event={"ID":"3b12fa03-7b45-45ec-a0e4-5e104fe34e5b","Type":"ContainerStarted","Data":"0b09954c2b72c8994f47f65517252af0d352932979920f1e4fb0ee9e4ff69a3d"} Jun 09 10:57:35.544832 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:35.544803 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eaebd996-a743-4487-8700-221b2b9cb45c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-g4tcz\" (UID: \"eaebd996-a743-4487-8700-221b2b9cb45c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-g4tcz" Jun 09 10:57:35.547100 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:35.547078 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eaebd996-a743-4487-8700-221b2b9cb45c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-g4tcz\" (UID: \"eaebd996-a743-4487-8700-221b2b9cb45c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-g4tcz" Jun 09 10:57:35.797243 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:35.797221 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-76gx4\"" Jun 09 10:57:35.804615 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:35.804583 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-g4tcz" Jun 09 10:57:35.923999 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:35.923889 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-chjlb" podStartSLOduration=2.618751499 podStartE2EDuration="4.923865197s" totalImagesPullingTime="2.305113698s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 10:57:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:57:35.426188788 +0000 UTC m=+245.290428616" watchObservedRunningTime="2026-06-09 10:57:35.923865197 +0000 UTC m=+245.788105026" Jun 09 10:57:35.924285 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:35.924266 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-g4tcz"] Jun 09 10:57:35.926529 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:57:35.926501 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaebd996_a743_4487_8700_221b2b9cb45c.slice/crio-a438de5d036adff5bf344554d9edad4e75f46b928ad1a57d5b1425c114bdca09 WatchSource:0}: Error finding container a438de5d036adff5bf344554d9edad4e75f46b928ad1a57d5b1425c114bdca09: Status 404 returned error can't find the container with id a438de5d036adff5bf344554d9edad4e75f46b928ad1a57d5b1425c114bdca09 Jun 09 10:57:36.411631 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:36.411597 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-g4tcz" event={"ID":"eaebd996-a743-4487-8700-221b2b9cb45c","Type":"ContainerStarted","Data":"a438de5d036adff5bf344554d9edad4e75f46b928ad1a57d5b1425c114bdca09"} Jun 09 10:57:38.420088 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:38.420011 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-g4tcz" event={"ID":"eaebd996-a743-4487-8700-221b2b9cb45c","Type":"ContainerStarted","Data":"1000fe438ac038a18a189163946884a8ad88d014705a2c5f7111735a6d651791"} Jun 09 10:57:38.439295 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:38.439242 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-g4tcz" podStartSLOduration=33.257281469 podStartE2EDuration="35.439223126s" totalImagesPullingTime="2.181941657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 10:57:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:57:38.437432288 +0000 UTC m=+248.301672115" watchObservedRunningTime="2026-06-09 10:57:38.439223126 +0000 UTC m=+248.303462955" Jun 09 10:57:38.588512 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:38.588481 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-p9njf"] Jun 09 10:57:38.591484 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:38.591470 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-p9njf" Jun 09 10:57:38.594521 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:38.594484 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 09 10:57:38.594861 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:38.594831 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-nrn9k\"" Jun 09 10:57:38.602916 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:38.602897 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-p9njf"] Jun 09 10:57:38.769693 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:38.769663 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/525075d5-d7fc-4dd7-af95-b5defbc74a88-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-p9njf\" (UID: \"525075d5-d7fc-4dd7-af95-b5defbc74a88\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-p9njf" Jun 09 10:57:38.870689 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:38.870657 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/525075d5-d7fc-4dd7-af95-b5defbc74a88-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-p9njf\" (UID: \"525075d5-d7fc-4dd7-af95-b5defbc74a88\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-p9njf" Jun 09 10:57:38.872926 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:38.872908 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/525075d5-d7fc-4dd7-af95-b5defbc74a88-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-p9njf\" (UID: \"525075d5-d7fc-4dd7-af95-b5defbc74a88\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-p9njf" Jun 09 10:57:38.899883 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:38.899862 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-p9njf" Jun 09 10:57:39.022462 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:39.022438 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-p9njf"] Jun 09 10:57:39.024820 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:57:39.024790 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod525075d5_d7fc_4dd7_af95_b5defbc74a88.slice/crio-59c2bc2bd04ffc7ae58ab0ac3225c0bf6d09390ecb69f00a0987f1a6d1329c4b WatchSource:0}: Error finding container 59c2bc2bd04ffc7ae58ab0ac3225c0bf6d09390ecb69f00a0987f1a6d1329c4b: Status 404 returned error can't find the container with id 59c2bc2bd04ffc7ae58ab0ac3225c0bf6d09390ecb69f00a0987f1a6d1329c4b Jun 09 10:57:39.424670 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:39.424582 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-p9njf" event={"ID":"525075d5-d7fc-4dd7-af95-b5defbc74a88","Type":"ContainerStarted","Data":"59c2bc2bd04ffc7ae58ab0ac3225c0bf6d09390ecb69f00a0987f1a6d1329c4b"} Jun 09 10:57:41.432409 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:41.432372 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-p9njf" event={"ID":"525075d5-d7fc-4dd7-af95-b5defbc74a88","Type":"ContainerStarted","Data":"03fad3e203022a257528be72ac0d90fbeac95f3ad2ce5faa76978730205d84fa"} Jun 09 10:57:41.432852 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:41.432600 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-p9njf" Jun 09 10:57:41.437106 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:41.437086 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-p9njf" Jun 09 10:57:41.449246 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:41.449208 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-p9njf" podStartSLOduration=2.064057878 podStartE2EDuration="3.449196508s" totalImagesPullingTime="1.38513863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 10:57:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:57:41.447410275 +0000 UTC m=+251.311650102" watchObservedRunningTime="2026-06-09 10:57:41.449196508 +0000 UTC m=+251.313436335" Jun 09 10:57:41.492124 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:41.492100 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09719c2f-d21f-4f27-a982-3595ee62c857-metrics-certs\") pod \"network-metrics-daemon-c8zc8\" (UID: \"09719c2f-d21f-4f27-a982-3595ee62c857\") " pod="openshift-multus/network-metrics-daemon-c8zc8" Jun 09 10:57:41.494248 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:41.494228 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09719c2f-d21f-4f27-a982-3595ee62c857-metrics-certs\") pod \"network-metrics-daemon-c8zc8\" (UID: \"09719c2f-d21f-4f27-a982-3595ee62c857\") " pod="openshift-multus/network-metrics-daemon-c8zc8" Jun 09 10:57:41.497133 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:41.497115 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qfn6d\"" Jun 09 10:57:41.504941 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:41.504925 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c8zc8" Jun 09 10:57:41.645951 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:41.645923 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-stgj5"] Jun 09 10:57:41.652217 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:57:41.652191 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09719c2f_d21f_4f27_a982_3595ee62c857.slice/crio-b359adcbadf6401f4fb2b344edc4218ce2b2a54ccfb7886abf925e99b358414b WatchSource:0}: Error finding container b359adcbadf6401f4fb2b344edc4218ce2b2a54ccfb7886abf925e99b358414b: Status 404 returned error can't find the container with id b359adcbadf6401f4fb2b344edc4218ce2b2a54ccfb7886abf925e99b358414b Jun 09 10:57:41.681034 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:41.681011 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-c8zc8"] Jun 09 10:57:41.681109 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:41.681045 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-stgj5"] Jun 09 10:57:41.681153 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:41.681126 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-stgj5" Jun 09 10:57:41.684200 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:41.684148 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-6t7bv\"" Jun 09 10:57:41.684200 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:41.684151 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 09 10:57:41.684313 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:41.684304 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 09 10:57:41.684394 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:41.684381 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 10:57:41.793995 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:41.793970 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/840b1856-69b6-4ba4-b37c-abfde7119744-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-stgj5\" (UID: \"840b1856-69b6-4ba4-b37c-abfde7119744\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-stgj5" Jun 09 10:57:41.794094 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:41.794011 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rvzk\" (UniqueName: \"kubernetes.io/projected/840b1856-69b6-4ba4-b37c-abfde7119744-kube-api-access-9rvzk\") pod \"prometheus-operator-7f7d445d84-stgj5\" (UID: \"840b1856-69b6-4ba4-b37c-abfde7119744\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-stgj5" Jun 09 10:57:41.794094 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:41.794029 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/840b1856-69b6-4ba4-b37c-abfde7119744-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-stgj5\" (UID: \"840b1856-69b6-4ba4-b37c-abfde7119744\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-stgj5" Jun 09 10:57:41.794168 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:41.794095 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/840b1856-69b6-4ba4-b37c-abfde7119744-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-stgj5\" (UID: \"840b1856-69b6-4ba4-b37c-abfde7119744\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-stgj5" Jun 09 10:57:41.895298 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:41.895273 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/840b1856-69b6-4ba4-b37c-abfde7119744-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-stgj5\" (UID: \"840b1856-69b6-4ba4-b37c-abfde7119744\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-stgj5" Jun 09 10:57:41.895407 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:41.895316 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/840b1856-69b6-4ba4-b37c-abfde7119744-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-stgj5\" (UID: \"840b1856-69b6-4ba4-b37c-abfde7119744\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-stgj5" Jun 09 10:57:41.895407 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:41.895364 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/840b1856-69b6-4ba4-b37c-abfde7119744-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-stgj5\" (UID: \"840b1856-69b6-4ba4-b37c-abfde7119744\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-stgj5" Jun 09 10:57:41.895407 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:41.895391 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rvzk\" (UniqueName: \"kubernetes.io/projected/840b1856-69b6-4ba4-b37c-abfde7119744-kube-api-access-9rvzk\") pod \"prometheus-operator-7f7d445d84-stgj5\" (UID: \"840b1856-69b6-4ba4-b37c-abfde7119744\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-stgj5" Jun 09 10:57:41.895905 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:41.895886 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/840b1856-69b6-4ba4-b37c-abfde7119744-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-stgj5\" (UID: \"840b1856-69b6-4ba4-b37c-abfde7119744\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-stgj5" Jun 09 10:57:41.897775 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:41.897751 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/840b1856-69b6-4ba4-b37c-abfde7119744-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-stgj5\" (UID: \"840b1856-69b6-4ba4-b37c-abfde7119744\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-stgj5" Jun 09 10:57:41.897775 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:41.897765 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/840b1856-69b6-4ba4-b37c-abfde7119744-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-stgj5\" (UID: \"840b1856-69b6-4ba4-b37c-abfde7119744\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-stgj5" Jun 09 10:57:41.903319 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:41.903295 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rvzk\" (UniqueName: \"kubernetes.io/projected/840b1856-69b6-4ba4-b37c-abfde7119744-kube-api-access-9rvzk\") pod \"prometheus-operator-7f7d445d84-stgj5\" (UID: \"840b1856-69b6-4ba4-b37c-abfde7119744\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-stgj5" Jun 09 10:57:41.989717 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:41.989689 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-stgj5" Jun 09 10:57:42.144109 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:42.144077 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-stgj5"] Jun 09 10:57:42.147354 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:57:42.147328 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod840b1856_69b6_4ba4_b37c_abfde7119744.slice/crio-ade2235b7b05f58d1960d0ff3fdf9d300cd7be6474f0a4b8a035d51957949fd0 WatchSource:0}: Error finding container ade2235b7b05f58d1960d0ff3fdf9d300cd7be6474f0a4b8a035d51957949fd0: Status 404 returned error can't find the container with id ade2235b7b05f58d1960d0ff3fdf9d300cd7be6474f0a4b8a035d51957949fd0 Jun 09 10:57:42.436822 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:42.436733 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-stgj5" event={"ID":"840b1856-69b6-4ba4-b37c-abfde7119744","Type":"ContainerStarted","Data":"ade2235b7b05f58d1960d0ff3fdf9d300cd7be6474f0a4b8a035d51957949fd0"} Jun 09 10:57:42.437966 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:42.437937 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-c8zc8" event={"ID":"09719c2f-d21f-4f27-a982-3595ee62c857","Type":"ContainerStarted","Data":"b359adcbadf6401f4fb2b344edc4218ce2b2a54ccfb7886abf925e99b358414b"} Jun 09 10:57:43.443668 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:43.443627 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-c8zc8" event={"ID":"09719c2f-d21f-4f27-a982-3595ee62c857","Type":"ContainerStarted","Data":"296c3f1387bf067fee152e2ddef881dd70001a043cadcdc18f8699082897b2a6"} Jun 09 10:57:43.444059 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:43.443733 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-c8zc8" event={"ID":"09719c2f-d21f-4f27-a982-3595ee62c857","Type":"ContainerStarted","Data":"89cc311ae03a1e6b7e32d2aa55a5fee4f4531f07062cb13ceaee07e189184950"} Jun 09 10:57:43.467029 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:43.466951 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-c8zc8" podStartSLOduration=252.166123598 podStartE2EDuration="4m13.466936703s" totalImagesPullingTime="1.300813105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 10:53:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:57:43.466621448 +0000 UTC m=+253.330861277" watchObservedRunningTime="2026-06-09 10:57:43.466936703 +0000 UTC m=+253.331176530" Jun 09 10:57:44.449168 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:44.449127 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-stgj5" event={"ID":"840b1856-69b6-4ba4-b37c-abfde7119744","Type":"ContainerStarted","Data":"60af03034a23e423aeac264f854b7f7858b35f2e6925a7411c42036d94fcbf7f"} Jun 09 10:57:44.449522 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:44.449191 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-stgj5" event={"ID":"840b1856-69b6-4ba4-b37c-abfde7119744","Type":"ContainerStarted","Data":"b9bdaea0ca9f48ce371d00ba00e2a406bf8d067611e26641b0f4249cef14a63a"} Jun 09 10:57:44.468573 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:44.468526 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-stgj5" podStartSLOduration=1.918257159 podStartE2EDuration="3.468512774s" totalImagesPullingTime="1.550255615s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 10:57:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:57:44.467344402 +0000 UTC m=+254.331584232" watchObservedRunningTime="2026-06-09 10:57:44.468512774 +0000 UTC m=+254.332752601" Jun 09 10:57:46.010928 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.010894 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-c42qn"] Jun 09 10:57:46.013190 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.013175 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-c42qn" Jun 09 10:57:46.015885 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.015863 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 09 10:57:46.016118 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.016101 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 09 10:57:46.016118 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.016112 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 09 10:57:46.017323 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.017304 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-6pkjw\"" Jun 09 10:57:46.022157 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.022135 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-qhsrm"] Jun 09 10:57:46.024328 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.024314 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qhsrm" Jun 09 10:57:46.026525 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.026500 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0-node-exporter-accelerators-collector-config\") pod \"node-exporter-qhsrm\" (UID: \"bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0\") " pod="openshift-monitoring/node-exporter-qhsrm" Jun 09 10:57:46.026699 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.026682 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/beec5f6e-1e29-4ab0-a7f1-014aed6a6643-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-c42qn\" (UID: \"beec5f6e-1e29-4ab0-a7f1-014aed6a6643\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-c42qn" Jun 09 10:57:46.026783 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.026753 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/beec5f6e-1e29-4ab0-a7f1-014aed6a6643-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-c42qn\" (UID: \"beec5f6e-1e29-4ab0-a7f1-014aed6a6643\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-c42qn" Jun 09 10:57:46.026877 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.026811 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/beec5f6e-1e29-4ab0-a7f1-014aed6a6643-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-c42qn\" (UID: \"beec5f6e-1e29-4ab0-a7f1-014aed6a6643\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-c42qn" Jun 09 10:57:46.026877 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.026841 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrvzz\" (UniqueName: \"kubernetes.io/projected/beec5f6e-1e29-4ab0-a7f1-014aed6a6643-kube-api-access-nrvzz\") pod \"kube-state-metrics-57bbf8bfb5-c42qn\" (UID: \"beec5f6e-1e29-4ab0-a7f1-014aed6a6643\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-c42qn" Jun 09 10:57:46.026983 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.026882 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0-node-exporter-tls\") pod \"node-exporter-qhsrm\" (UID: \"bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0\") " pod="openshift-monitoring/node-exporter-qhsrm" Jun 09 10:57:46.026983 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.026958 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0-node-exporter-wtmp\") pod \"node-exporter-qhsrm\" (UID: \"bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0\") " pod="openshift-monitoring/node-exporter-qhsrm" Jun 09 10:57:46.027079 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.026992 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4p2zq\" (UniqueName: \"kubernetes.io/projected/bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0-kube-api-access-4p2zq\") pod \"node-exporter-qhsrm\" (UID: \"bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0\") " pod="openshift-monitoring/node-exporter-qhsrm" Jun 09 10:57:46.027079 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.027032 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0-sys\") pod \"node-exporter-qhsrm\" (UID: \"bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0\") " pod="openshift-monitoring/node-exporter-qhsrm" Jun 09 10:57:46.027079 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.027059 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/beec5f6e-1e29-4ab0-a7f1-014aed6a6643-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-c42qn\" (UID: \"beec5f6e-1e29-4ab0-a7f1-014aed6a6643\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-c42qn" Jun 09 10:57:46.027224 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.027082 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0-node-exporter-textfile\") pod \"node-exporter-qhsrm\" (UID: \"bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0\") " pod="openshift-monitoring/node-exporter-qhsrm" Jun 09 10:57:46.027224 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.027114 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0-metrics-client-ca\") pod \"node-exporter-qhsrm\" (UID: \"bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0\") " pod="openshift-monitoring/node-exporter-qhsrm" Jun 09 10:57:46.027224 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.027143 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/beec5f6e-1e29-4ab0-a7f1-014aed6a6643-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-c42qn\" (UID: \"beec5f6e-1e29-4ab0-a7f1-014aed6a6643\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-c42qn" Jun 09 10:57:46.027224 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.027162 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0-root\") pod \"node-exporter-qhsrm\" (UID: \"bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0\") " pod="openshift-monitoring/node-exporter-qhsrm" Jun 09 10:57:46.027224 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.027193 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qhsrm\" (UID: \"bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0\") " pod="openshift-monitoring/node-exporter-qhsrm" Jun 09 10:57:46.027467 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.027375 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 10:57:46.027704 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.027651 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pj64z\"" Jun 09 10:57:46.027704 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.027682 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 10:57:46.027704 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.027694 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 10:57:46.028929 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.028910 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-c42qn"] Jun 09 10:57:46.127894 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.127866 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0-node-exporter-accelerators-collector-config\") pod \"node-exporter-qhsrm\" (UID: \"bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0\") " pod="openshift-monitoring/node-exporter-qhsrm" Jun 09 10:57:46.128003 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.127913 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/beec5f6e-1e29-4ab0-a7f1-014aed6a6643-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-c42qn\" (UID: \"beec5f6e-1e29-4ab0-a7f1-014aed6a6643\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-c42qn" Jun 09 10:57:46.128053 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.128029 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/beec5f6e-1e29-4ab0-a7f1-014aed6a6643-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-c42qn\" (UID: \"beec5f6e-1e29-4ab0-a7f1-014aed6a6643\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-c42qn" Jun 09 10:57:46.128096 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.128064 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/beec5f6e-1e29-4ab0-a7f1-014aed6a6643-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-c42qn\" (UID: \"beec5f6e-1e29-4ab0-a7f1-014aed6a6643\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-c42qn" Jun 09 10:57:46.128096 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.128087 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrvzz\" (UniqueName: \"kubernetes.io/projected/beec5f6e-1e29-4ab0-a7f1-014aed6a6643-kube-api-access-nrvzz\") pod \"kube-state-metrics-57bbf8bfb5-c42qn\" (UID: \"beec5f6e-1e29-4ab0-a7f1-014aed6a6643\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-c42qn" Jun 09 10:57:46.128194 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.128102 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0-node-exporter-tls\") pod \"node-exporter-qhsrm\" (UID: \"bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0\") " pod="openshift-monitoring/node-exporter-qhsrm" Jun 09 10:57:46.128194 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.128123 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0-node-exporter-wtmp\") pod \"node-exporter-qhsrm\" (UID: \"bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0\") " pod="openshift-monitoring/node-exporter-qhsrm" Jun 09 10:57:46.128287 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.128235 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0-node-exporter-wtmp\") pod \"node-exporter-qhsrm\" (UID: \"bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0\") " pod="openshift-monitoring/node-exporter-qhsrm" Jun 09 10:57:46.128338 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.128292 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4p2zq\" (UniqueName: \"kubernetes.io/projected/bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0-kube-api-access-4p2zq\") pod \"node-exporter-qhsrm\" (UID: \"bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0\") " pod="openshift-monitoring/node-exporter-qhsrm" Jun 09 10:57:46.128395 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.128336 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0-sys\") pod \"node-exporter-qhsrm\" (UID: \"bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0\") " pod="openshift-monitoring/node-exporter-qhsrm" Jun 09 10:57:46.128395 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.128366 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/beec5f6e-1e29-4ab0-a7f1-014aed6a6643-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-c42qn\" (UID: \"beec5f6e-1e29-4ab0-a7f1-014aed6a6643\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-c42qn" Jun 09 10:57:46.128395 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:57:46.128386 2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 09 10:57:46.128537 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:57:46.128440 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0-node-exporter-tls podName:bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0 nodeName:}" failed. No retries permitted until 2026-06-09 10:57:46.62842305 +0000 UTC m=+256.492662869 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0-node-exporter-tls") pod "node-exporter-qhsrm" (UID: "bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0") : secret "node-exporter-tls" not found Jun 09 10:57:46.128537 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.128497 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0-node-exporter-accelerators-collector-config\") pod \"node-exporter-qhsrm\" (UID: \"bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0\") " pod="openshift-monitoring/node-exporter-qhsrm" Jun 09 10:57:46.128537 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.128389 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0-node-exporter-textfile\") pod \"node-exporter-qhsrm\" (UID: \"bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0\") " pod="openshift-monitoring/node-exporter-qhsrm" Jun 09 10:57:46.128725 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.128558 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0-metrics-client-ca\") pod \"node-exporter-qhsrm\" (UID: \"bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0\") " pod="openshift-monitoring/node-exporter-qhsrm" Jun 09 10:57:46.128725 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.128613 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/beec5f6e-1e29-4ab0-a7f1-014aed6a6643-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-c42qn\" (UID: \"beec5f6e-1e29-4ab0-a7f1-014aed6a6643\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-c42qn" Jun 09 10:57:46.128725 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.128559 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0-sys\") pod \"node-exporter-qhsrm\" (UID: \"bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0\") " pod="openshift-monitoring/node-exporter-qhsrm" Jun 09 10:57:46.128725 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.128634 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0-node-exporter-textfile\") pod \"node-exporter-qhsrm\" (UID: \"bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0\") " pod="openshift-monitoring/node-exporter-qhsrm" Jun 09 10:57:46.128725 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.128648 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/beec5f6e-1e29-4ab0-a7f1-014aed6a6643-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-c42qn\" (UID: \"beec5f6e-1e29-4ab0-a7f1-014aed6a6643\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-c42qn" Jun 09 10:57:46.128725 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:57:46.128692 2562 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 09 10:57:46.128996 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:57:46.128745 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/beec5f6e-1e29-4ab0-a7f1-014aed6a6643-kube-state-metrics-tls podName:beec5f6e-1e29-4ab0-a7f1-014aed6a6643 nodeName:}" failed. No retries permitted until 2026-06-09 10:57:46.628728762 +0000 UTC m=+256.492968569 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/beec5f6e-1e29-4ab0-a7f1-014aed6a6643-kube-state-metrics-tls") pod "kube-state-metrics-57bbf8bfb5-c42qn" (UID: "beec5f6e-1e29-4ab0-a7f1-014aed6a6643") : secret "kube-state-metrics-tls" not found Jun 09 10:57:46.128996 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.128747 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/beec5f6e-1e29-4ab0-a7f1-014aed6a6643-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-c42qn\" (UID: \"beec5f6e-1e29-4ab0-a7f1-014aed6a6643\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-c42qn" Jun 09 10:57:46.128996 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.128766 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0-root\") pod \"node-exporter-qhsrm\" (UID: \"bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0\") " pod="openshift-monitoring/node-exporter-qhsrm" Jun 09 10:57:46.128996 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.128807 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qhsrm\" (UID: \"bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0\") " pod="openshift-monitoring/node-exporter-qhsrm" Jun 09 10:57:46.128996 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.128834 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0-root\") pod \"node-exporter-qhsrm\" (UID: \"bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0\") " pod="openshift-monitoring/node-exporter-qhsrm" Jun 09 10:57:46.128996 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.128908 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/beec5f6e-1e29-4ab0-a7f1-014aed6a6643-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-c42qn\" (UID: \"beec5f6e-1e29-4ab0-a7f1-014aed6a6643\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-c42qn" Jun 09 10:57:46.128996 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.128977 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0-metrics-client-ca\") pod \"node-exporter-qhsrm\" (UID: \"bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0\") " pod="openshift-monitoring/node-exporter-qhsrm" Jun 09 10:57:46.130601 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.130573 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/beec5f6e-1e29-4ab0-a7f1-014aed6a6643-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-c42qn\" (UID: \"beec5f6e-1e29-4ab0-a7f1-014aed6a6643\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-c42qn" Jun 09 10:57:46.130883 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.130867 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qhsrm\" (UID: \"bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0\") " pod="openshift-monitoring/node-exporter-qhsrm" Jun 09 10:57:46.138397 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.138370 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4p2zq\" (UniqueName: \"kubernetes.io/projected/bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0-kube-api-access-4p2zq\") pod \"node-exporter-qhsrm\" (UID: \"bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0\") " pod="openshift-monitoring/node-exporter-qhsrm" Jun 09 10:57:46.138820 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.138802 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrvzz\" (UniqueName: \"kubernetes.io/projected/beec5f6e-1e29-4ab0-a7f1-014aed6a6643-kube-api-access-nrvzz\") pod \"kube-state-metrics-57bbf8bfb5-c42qn\" (UID: \"beec5f6e-1e29-4ab0-a7f1-014aed6a6643\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-c42qn" Jun 09 10:57:46.592517 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.592484 2562 scope.go:117] "RemoveContainer" containerID="dfd721fb902a86e1e9d8f46d944e563e26e2c4852165c3917db5ce6745d34b89" Jun 09 10:57:46.592713 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:57:46.592674 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-ph2xt_openshift-console-operator(56eeb8e9-a748-4e99-b04a-6d998c6aad8b)\"" pod="openshift-console-operator/console-operator-668fdbf85c-ph2xt" podUID="56eeb8e9-a748-4e99-b04a-6d998c6aad8b" Jun 09 10:57:46.633110 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.633079 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0-node-exporter-tls\") pod \"node-exporter-qhsrm\" (UID: \"bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0\") " pod="openshift-monitoring/node-exporter-qhsrm" Jun 09 10:57:46.633244 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.633136 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/beec5f6e-1e29-4ab0-a7f1-014aed6a6643-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-c42qn\" (UID: \"beec5f6e-1e29-4ab0-a7f1-014aed6a6643\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-c42qn" Jun 09 10:57:46.633244 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:57:46.633195 2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 09 10:57:46.633368 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:57:46.633256 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0-node-exporter-tls podName:bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0 nodeName:}" failed. No retries permitted until 2026-06-09 10:57:47.633237378 +0000 UTC m=+257.497477200 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0-node-exporter-tls") pod "node-exporter-qhsrm" (UID: "bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0") : secret "node-exporter-tls" not found Jun 09 10:57:46.635466 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.635440 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/beec5f6e-1e29-4ab0-a7f1-014aed6a6643-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-c42qn\" (UID: \"beec5f6e-1e29-4ab0-a7f1-014aed6a6643\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-c42qn" Jun 09 10:57:46.922733 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:46.922671 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-c42qn" Jun 09 10:57:47.059650 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.059630 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-c42qn"] Jun 09 10:57:47.061977 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:57:47.061942 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeec5f6e_1e29_4ab0_a7f1_014aed6a6643.slice/crio-73b5c6f23e13509d0506480c264ed858b0170e19a858a68e9e2d0a6f7b5ffa93 WatchSource:0}: Error finding container 73b5c6f23e13509d0506480c264ed858b0170e19a858a68e9e2d0a6f7b5ffa93: Status 404 returned error can't find the container with id 73b5c6f23e13509d0506480c264ed858b0170e19a858a68e9e2d0a6f7b5ffa93 Jun 09 10:57:47.150343 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.150314 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 10:57:47.153987 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.153969 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 10:57:47.157518 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.157472 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 09 10:57:47.157641 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.157500 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 09 10:57:47.158026 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.157998 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 09 10:57:47.158127 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.158021 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 09 10:57:47.158127 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.158041 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 09 10:57:47.158127 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.158065 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 09 10:57:47.158283 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.158131 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 09 10:57:47.158344 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.158327 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 09 10:57:47.158403 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.158363 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 09 10:57:47.158403 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.158388 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vqppj\"" Jun 09 10:57:47.169977 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.169955 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 10:57:47.238555 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.238531 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/14da75ba-9dd9-48bc-aa46-9df51710811f-config-out\") pod \"alertmanager-main-0\" (UID: \"14da75ba-9dd9-48bc-aa46-9df51710811f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 10:57:47.238676 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.238559 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/14da75ba-9dd9-48bc-aa46-9df51710811f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"14da75ba-9dd9-48bc-aa46-9df51710811f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 10:57:47.238676 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.238607 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14da75ba-9dd9-48bc-aa46-9df51710811f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"14da75ba-9dd9-48bc-aa46-9df51710811f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 10:57:47.238676 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.238638 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmvxk\" (UniqueName: \"kubernetes.io/projected/14da75ba-9dd9-48bc-aa46-9df51710811f-kube-api-access-gmvxk\") pod \"alertmanager-main-0\" (UID: \"14da75ba-9dd9-48bc-aa46-9df51710811f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 10:57:47.238839 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.238683 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/14da75ba-9dd9-48bc-aa46-9df51710811f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"14da75ba-9dd9-48bc-aa46-9df51710811f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 10:57:47.238839 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.238767 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/14da75ba-9dd9-48bc-aa46-9df51710811f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"14da75ba-9dd9-48bc-aa46-9df51710811f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 10:57:47.238839 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.238801 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/14da75ba-9dd9-48bc-aa46-9df51710811f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"14da75ba-9dd9-48bc-aa46-9df51710811f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 10:57:47.238839 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.238827 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/14da75ba-9dd9-48bc-aa46-9df51710811f-web-config\") pod \"alertmanager-main-0\" (UID: \"14da75ba-9dd9-48bc-aa46-9df51710811f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 10:57:47.238973 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.238867 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14da75ba-9dd9-48bc-aa46-9df51710811f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"14da75ba-9dd9-48bc-aa46-9df51710811f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 10:57:47.238973 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.238894 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/14da75ba-9dd9-48bc-aa46-9df51710811f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"14da75ba-9dd9-48bc-aa46-9df51710811f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 10:57:47.238973 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.238937 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/14da75ba-9dd9-48bc-aa46-9df51710811f-config-volume\") pod \"alertmanager-main-0\" (UID: \"14da75ba-9dd9-48bc-aa46-9df51710811f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 10:57:47.238973 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.238971 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/14da75ba-9dd9-48bc-aa46-9df51710811f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"14da75ba-9dd9-48bc-aa46-9df51710811f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 10:57:47.239105 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.238989 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/14da75ba-9dd9-48bc-aa46-9df51710811f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"14da75ba-9dd9-48bc-aa46-9df51710811f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 10:57:47.339729 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.339688 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/14da75ba-9dd9-48bc-aa46-9df51710811f-config-out\") pod \"alertmanager-main-0\" (UID: \"14da75ba-9dd9-48bc-aa46-9df51710811f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 10:57:47.339729 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.339734 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/14da75ba-9dd9-48bc-aa46-9df51710811f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"14da75ba-9dd9-48bc-aa46-9df51710811f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 10:57:47.339926 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.339765 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14da75ba-9dd9-48bc-aa46-9df51710811f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"14da75ba-9dd9-48bc-aa46-9df51710811f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 10:57:47.339926 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.339782 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmvxk\" (UniqueName: \"kubernetes.io/projected/14da75ba-9dd9-48bc-aa46-9df51710811f-kube-api-access-gmvxk\") pod \"alertmanager-main-0\" (UID: \"14da75ba-9dd9-48bc-aa46-9df51710811f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 10:57:47.339926 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.339800 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/14da75ba-9dd9-48bc-aa46-9df51710811f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"14da75ba-9dd9-48bc-aa46-9df51710811f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 10:57:47.339926 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.339842 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/14da75ba-9dd9-48bc-aa46-9df51710811f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"14da75ba-9dd9-48bc-aa46-9df51710811f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 10:57:47.339926 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.339868 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/14da75ba-9dd9-48bc-aa46-9df51710811f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"14da75ba-9dd9-48bc-aa46-9df51710811f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 10:57:47.339926 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.339890 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/14da75ba-9dd9-48bc-aa46-9df51710811f-web-config\") pod \"alertmanager-main-0\" (UID: \"14da75ba-9dd9-48bc-aa46-9df51710811f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 10:57:47.339926 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.339922 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14da75ba-9dd9-48bc-aa46-9df51710811f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"14da75ba-9dd9-48bc-aa46-9df51710811f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 10:57:47.340248 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.339954 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/14da75ba-9dd9-48bc-aa46-9df51710811f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"14da75ba-9dd9-48bc-aa46-9df51710811f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 10:57:47.340248 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.339981 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/14da75ba-9dd9-48bc-aa46-9df51710811f-config-volume\") pod \"alertmanager-main-0\" (UID: \"14da75ba-9dd9-48bc-aa46-9df51710811f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 10:57:47.340248 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.340010 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/14da75ba-9dd9-48bc-aa46-9df51710811f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"14da75ba-9dd9-48bc-aa46-9df51710811f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 10:57:47.340248 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.340034 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/14da75ba-9dd9-48bc-aa46-9df51710811f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"14da75ba-9dd9-48bc-aa46-9df51710811f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 10:57:47.340631 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.340555 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14da75ba-9dd9-48bc-aa46-9df51710811f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"14da75ba-9dd9-48bc-aa46-9df51710811f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 10:57:47.341070 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.340857 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/14da75ba-9dd9-48bc-aa46-9df51710811f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"14da75ba-9dd9-48bc-aa46-9df51710811f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 10:57:47.341868 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.341844 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14da75ba-9dd9-48bc-aa46-9df51710811f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"14da75ba-9dd9-48bc-aa46-9df51710811f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 10:57:47.343379 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.342916 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/14da75ba-9dd9-48bc-aa46-9df51710811f-config-out\") pod \"alertmanager-main-0\" (UID: \"14da75ba-9dd9-48bc-aa46-9df51710811f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 10:57:47.343379 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.343342 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/14da75ba-9dd9-48bc-aa46-9df51710811f-web-config\") pod \"alertmanager-main-0\" (UID: \"14da75ba-9dd9-48bc-aa46-9df51710811f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 10:57:47.343379 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.343363 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/14da75ba-9dd9-48bc-aa46-9df51710811f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"14da75ba-9dd9-48bc-aa46-9df51710811f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 10:57:47.344081 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.344058 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/14da75ba-9dd9-48bc-aa46-9df51710811f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"14da75ba-9dd9-48bc-aa46-9df51710811f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 10:57:47.344237 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.344193 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/14da75ba-9dd9-48bc-aa46-9df51710811f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"14da75ba-9dd9-48bc-aa46-9df51710811f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 10:57:47.344328 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.344309 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/14da75ba-9dd9-48bc-aa46-9df51710811f-config-volume\") pod \"alertmanager-main-0\" (UID: \"14da75ba-9dd9-48bc-aa46-9df51710811f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 10:57:47.344802 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.344783 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/14da75ba-9dd9-48bc-aa46-9df51710811f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"14da75ba-9dd9-48bc-aa46-9df51710811f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 10:57:47.345263 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.345241 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/14da75ba-9dd9-48bc-aa46-9df51710811f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"14da75ba-9dd9-48bc-aa46-9df51710811f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 10:57:47.345515 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.345500 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/14da75ba-9dd9-48bc-aa46-9df51710811f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"14da75ba-9dd9-48bc-aa46-9df51710811f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 10:57:47.348400 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.348378 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmvxk\" (UniqueName: \"kubernetes.io/projected/14da75ba-9dd9-48bc-aa46-9df51710811f-kube-api-access-gmvxk\") pod \"alertmanager-main-0\" (UID: \"14da75ba-9dd9-48bc-aa46-9df51710811f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 10:57:47.461428 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.461395 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-c42qn" event={"ID":"beec5f6e-1e29-4ab0-a7f1-014aed6a6643","Type":"ContainerStarted","Data":"73b5c6f23e13509d0506480c264ed858b0170e19a858a68e9e2d0a6f7b5ffa93"} Jun 09 10:57:47.465692 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.465675 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 10:57:47.600387 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.600362 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 10:57:47.601437 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:57:47.601407 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14da75ba_9dd9_48bc_aa46_9df51710811f.slice/crio-77203946968fb53a9708565f933853a327867dd990a3f6a1bb76c8ec36bdf7a7 WatchSource:0}: Error finding container 77203946968fb53a9708565f933853a327867dd990a3f6a1bb76c8ec36bdf7a7: Status 404 returned error can't find the container with id 77203946968fb53a9708565f933853a327867dd990a3f6a1bb76c8ec36bdf7a7 Jun 09 10:57:47.642348 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.642319 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0-node-exporter-tls\") pod \"node-exporter-qhsrm\" (UID: \"bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0\") " pod="openshift-monitoring/node-exporter-qhsrm" Jun 09 10:57:47.644396 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.644378 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0-node-exporter-tls\") pod \"node-exporter-qhsrm\" (UID: \"bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0\") " pod="openshift-monitoring/node-exporter-qhsrm" Jun 09 10:57:47.833201 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:47.833128 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qhsrm" Jun 09 10:57:47.845244 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:57:47.845219 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbae45bd2_ed2b_4dd0_aeb4_7b609a9aaea0.slice/crio-bb912964d90088f2c6bd6d83c20aead82ce61edb0ad3d2b7f08ac99b29c74bcd WatchSource:0}: Error finding container bb912964d90088f2c6bd6d83c20aead82ce61edb0ad3d2b7f08ac99b29c74bcd: Status 404 returned error can't find the container with id bb912964d90088f2c6bd6d83c20aead82ce61edb0ad3d2b7f08ac99b29c74bcd Jun 09 10:57:48.473657 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:48.473550 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qhsrm" event={"ID":"bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0","Type":"ContainerStarted","Data":"bb912964d90088f2c6bd6d83c20aead82ce61edb0ad3d2b7f08ac99b29c74bcd"} Jun 09 10:57:48.475815 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:48.475788 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"14da75ba-9dd9-48bc-aa46-9df51710811f","Type":"ContainerStarted","Data":"77203946968fb53a9708565f933853a327867dd990a3f6a1bb76c8ec36bdf7a7"} Jun 09 10:57:49.004341 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:49.004307 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-644ff788bd-ddt69"] Jun 09 10:57:49.006939 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:49.006914 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-644ff788bd-ddt69" Jun 09 10:57:49.009892 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:49.009848 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 09 10:57:49.009892 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:49.009854 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 09 10:57:49.010063 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:49.009871 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-dxwdx\"" Jun 09 10:57:49.010127 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:49.010069 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 09 10:57:49.011211 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:49.011190 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-1dcjka108t1lh\"" Jun 09 10:57:49.011323 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:49.011273 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 09 10:57:49.014165 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:49.014129 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 09 10:57:49.018578 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:49.018559 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-644ff788bd-ddt69"] Jun 09 10:57:49.056110 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:49.056074 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/62b2d026-aef3-4f2b-9f95-d66c52905d07-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-644ff788bd-ddt69\" (UID: \"62b2d026-aef3-4f2b-9f95-d66c52905d07\") " pod="openshift-monitoring/thanos-querier-644ff788bd-ddt69" Jun 09 10:57:49.056110 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:49.056107 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/62b2d026-aef3-4f2b-9f95-d66c52905d07-secret-grpc-tls\") pod \"thanos-querier-644ff788bd-ddt69\" (UID: \"62b2d026-aef3-4f2b-9f95-d66c52905d07\") " pod="openshift-monitoring/thanos-querier-644ff788bd-ddt69" Jun 09 10:57:49.056284 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:49.056130 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62b2d026-aef3-4f2b-9f95-d66c52905d07-metrics-client-ca\") pod \"thanos-querier-644ff788bd-ddt69\" (UID: \"62b2d026-aef3-4f2b-9f95-d66c52905d07\") " pod="openshift-monitoring/thanos-querier-644ff788bd-ddt69" Jun 09 10:57:49.056284 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:49.056158 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/62b2d026-aef3-4f2b-9f95-d66c52905d07-secret-thanos-querier-tls\") pod \"thanos-querier-644ff788bd-ddt69\" (UID: \"62b2d026-aef3-4f2b-9f95-d66c52905d07\") " pod="openshift-monitoring/thanos-querier-644ff788bd-ddt69" Jun 09 10:57:49.056284 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:49.056192 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/62b2d026-aef3-4f2b-9f95-d66c52905d07-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-644ff788bd-ddt69\" (UID: \"62b2d026-aef3-4f2b-9f95-d66c52905d07\") " pod="openshift-monitoring/thanos-querier-644ff788bd-ddt69" Jun 09 10:57:49.056284 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:49.056254 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/62b2d026-aef3-4f2b-9f95-d66c52905d07-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-644ff788bd-ddt69\" (UID: \"62b2d026-aef3-4f2b-9f95-d66c52905d07\") " pod="openshift-monitoring/thanos-querier-644ff788bd-ddt69" Jun 09 10:57:49.056442 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:49.056286 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc8q5\" (UniqueName: \"kubernetes.io/projected/62b2d026-aef3-4f2b-9f95-d66c52905d07-kube-api-access-lc8q5\") pod \"thanos-querier-644ff788bd-ddt69\" (UID: \"62b2d026-aef3-4f2b-9f95-d66c52905d07\") " pod="openshift-monitoring/thanos-querier-644ff788bd-ddt69" Jun 09 10:57:49.056442 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:49.056314 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/62b2d026-aef3-4f2b-9f95-d66c52905d07-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-644ff788bd-ddt69\" (UID: \"62b2d026-aef3-4f2b-9f95-d66c52905d07\") " pod="openshift-monitoring/thanos-querier-644ff788bd-ddt69" Jun 09 10:57:49.157484 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:49.157445 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62b2d026-aef3-4f2b-9f95-d66c52905d07-metrics-client-ca\") pod \"thanos-querier-644ff788bd-ddt69\" (UID: \"62b2d026-aef3-4f2b-9f95-d66c52905d07\") " pod="openshift-monitoring/thanos-querier-644ff788bd-ddt69" Jun 09 10:57:49.157695 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:49.157504 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/62b2d026-aef3-4f2b-9f95-d66c52905d07-secret-thanos-querier-tls\") pod \"thanos-querier-644ff788bd-ddt69\" (UID: \"62b2d026-aef3-4f2b-9f95-d66c52905d07\") " pod="openshift-monitoring/thanos-querier-644ff788bd-ddt69" Jun 09 10:57:49.157777 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:49.157721 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/62b2d026-aef3-4f2b-9f95-d66c52905d07-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-644ff788bd-ddt69\" (UID: \"62b2d026-aef3-4f2b-9f95-d66c52905d07\") " pod="openshift-monitoring/thanos-querier-644ff788bd-ddt69" Jun 09 10:57:49.157846 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:49.157813 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/62b2d026-aef3-4f2b-9f95-d66c52905d07-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-644ff788bd-ddt69\" (UID: \"62b2d026-aef3-4f2b-9f95-d66c52905d07\") " pod="openshift-monitoring/thanos-querier-644ff788bd-ddt69" Jun 09 10:57:49.157904 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:49.157861 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc8q5\" (UniqueName: \"kubernetes.io/projected/62b2d026-aef3-4f2b-9f95-d66c52905d07-kube-api-access-lc8q5\") pod \"thanos-querier-644ff788bd-ddt69\" (UID: \"62b2d026-aef3-4f2b-9f95-d66c52905d07\") " pod="openshift-monitoring/thanos-querier-644ff788bd-ddt69" Jun 09 10:57:49.157957 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:49.157919 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/62b2d026-aef3-4f2b-9f95-d66c52905d07-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-644ff788bd-ddt69\" (UID: \"62b2d026-aef3-4f2b-9f95-d66c52905d07\") " pod="openshift-monitoring/thanos-querier-644ff788bd-ddt69" Jun 09 10:57:49.158015 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:49.158005 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/62b2d026-aef3-4f2b-9f95-d66c52905d07-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-644ff788bd-ddt69\" (UID: \"62b2d026-aef3-4f2b-9f95-d66c52905d07\") " pod="openshift-monitoring/thanos-querier-644ff788bd-ddt69" Jun 09 10:57:49.158075 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:49.158029 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/62b2d026-aef3-4f2b-9f95-d66c52905d07-secret-grpc-tls\") pod \"thanos-querier-644ff788bd-ddt69\" (UID: \"62b2d026-aef3-4f2b-9f95-d66c52905d07\") " pod="openshift-monitoring/thanos-querier-644ff788bd-ddt69" Jun 09 10:57:49.158712 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:49.158357 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62b2d026-aef3-4f2b-9f95-d66c52905d07-metrics-client-ca\") pod \"thanos-querier-644ff788bd-ddt69\" (UID: \"62b2d026-aef3-4f2b-9f95-d66c52905d07\") " pod="openshift-monitoring/thanos-querier-644ff788bd-ddt69" Jun 09 10:57:49.160659 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:49.160632 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/62b2d026-aef3-4f2b-9f95-d66c52905d07-secret-thanos-querier-tls\") pod \"thanos-querier-644ff788bd-ddt69\" (UID: \"62b2d026-aef3-4f2b-9f95-d66c52905d07\") " pod="openshift-monitoring/thanos-querier-644ff788bd-ddt69" Jun 09 10:57:49.160792 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:49.160772 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/62b2d026-aef3-4f2b-9f95-d66c52905d07-secret-grpc-tls\") pod \"thanos-querier-644ff788bd-ddt69\" (UID: \"62b2d026-aef3-4f2b-9f95-d66c52905d07\") " pod="openshift-monitoring/thanos-querier-644ff788bd-ddt69" Jun 09 10:57:49.161090 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:49.161063 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/62b2d026-aef3-4f2b-9f95-d66c52905d07-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-644ff788bd-ddt69\" (UID: \"62b2d026-aef3-4f2b-9f95-d66c52905d07\") " pod="openshift-monitoring/thanos-querier-644ff788bd-ddt69" Jun 09 10:57:49.161213 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:49.161195 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/62b2d026-aef3-4f2b-9f95-d66c52905d07-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-644ff788bd-ddt69\" (UID: \"62b2d026-aef3-4f2b-9f95-d66c52905d07\") " pod="openshift-monitoring/thanos-querier-644ff788bd-ddt69" Jun 09 10:57:49.161316 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:49.161296 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/62b2d026-aef3-4f2b-9f95-d66c52905d07-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-644ff788bd-ddt69\" (UID: \"62b2d026-aef3-4f2b-9f95-d66c52905d07\") " pod="openshift-monitoring/thanos-querier-644ff788bd-ddt69" Jun 09 10:57:49.161600 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:49.161569 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/62b2d026-aef3-4f2b-9f95-d66c52905d07-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-644ff788bd-ddt69\" (UID: \"62b2d026-aef3-4f2b-9f95-d66c52905d07\") " pod="openshift-monitoring/thanos-querier-644ff788bd-ddt69" Jun 09 10:57:49.166742 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:49.166723 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc8q5\" (UniqueName: \"kubernetes.io/projected/62b2d026-aef3-4f2b-9f95-d66c52905d07-kube-api-access-lc8q5\") pod \"thanos-querier-644ff788bd-ddt69\" (UID: \"62b2d026-aef3-4f2b-9f95-d66c52905d07\") " pod="openshift-monitoring/thanos-querier-644ff788bd-ddt69" Jun 09 10:57:49.318350 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:49.318330 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-644ff788bd-ddt69" Jun 09 10:57:49.487038 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:49.486176 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-644ff788bd-ddt69"] Jun 09 10:57:49.492819 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:49.492749 2562 generic.go:356] "Generic (PLEG): container finished" podID="14da75ba-9dd9-48bc-aa46-9df51710811f" containerID="0345a74f02fa4d3a112edd8e13e358579f871be71177a67531443808d647377b" exitCode=0 Jun 09 10:57:49.492937 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:49.492878 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"14da75ba-9dd9-48bc-aa46-9df51710811f","Type":"ContainerDied","Data":"0345a74f02fa4d3a112edd8e13e358579f871be71177a67531443808d647377b"} Jun 09 10:57:49.496739 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:49.496712 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-c42qn" event={"ID":"beec5f6e-1e29-4ab0-a7f1-014aed6a6643","Type":"ContainerStarted","Data":"5332eba67133fb5341c0005a145ac9ed06cd8bdb0159b6dc297e8a7dd85cba43"} Jun 09 10:57:49.496828 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:49.496793 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-c42qn" event={"ID":"beec5f6e-1e29-4ab0-a7f1-014aed6a6643","Type":"ContainerStarted","Data":"0543b281f196d07103844653a07cf32b2f2440429d5890721b8d1954572cd9a2"} Jun 09 10:57:49.499732 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:49.499291 2562 generic.go:356] "Generic (PLEG): container finished" podID="bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0" containerID="ea0bfeb9ac8918ca50edbc18cc3628890434209e0485678f3d427aee8280eeb2" exitCode=0 Jun 09 10:57:49.499732 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:49.499349 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qhsrm" event={"ID":"bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0","Type":"ContainerDied","Data":"ea0bfeb9ac8918ca50edbc18cc3628890434209e0485678f3d427aee8280eeb2"} Jun 09 10:57:50.505370 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:50.505283 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-644ff788bd-ddt69" event={"ID":"62b2d026-aef3-4f2b-9f95-d66c52905d07","Type":"ContainerStarted","Data":"d85685790ab82a61609a57ef3253b42402a0d6a288244509fde037d913becdcb"} Jun 09 10:57:50.508191 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:50.507948 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-c42qn" event={"ID":"beec5f6e-1e29-4ab0-a7f1-014aed6a6643","Type":"ContainerStarted","Data":"4a8e4371ef9fd088497f79dd957667b9039f11c369f358f601400151eb678f49"} Jun 09 10:57:50.510532 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:50.510507 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qhsrm" event={"ID":"bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0","Type":"ContainerStarted","Data":"1b0b275a685b4228e43604647dfbd89cc06db0eba996dea2450f04a91e423275"} Jun 09 10:57:50.510664 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:50.510557 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qhsrm" event={"ID":"bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0","Type":"ContainerStarted","Data":"5e1f5687d88b319933d0ac1652918801f3bf5471d377e2b30d78ef4285bf70a7"} Jun 09 10:57:50.540508 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:50.540424 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-c42qn" podStartSLOduration=3.323550891 podStartE2EDuration="5.54040323s" totalImagesPullingTime="2.216852339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 10:57:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:57:50.537679629 +0000 UTC m=+260.401919458" watchObservedRunningTime="2026-06-09 10:57:50.54040323 +0000 UTC m=+260.404643059" Jun 09 10:57:50.575296 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:50.575251 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-qhsrm" podStartSLOduration=4.050485627 podStartE2EDuration="5.575231546s" totalImagesPullingTime="1.435378291s" totalInitContainerRuntime="89.367628ms" isStatefulPod=true podCreationTimestamp="2026-06-09 10:57:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:57:50.574647148 +0000 UTC m=+260.438886977" watchObservedRunningTime="2026-06-09 10:57:50.575231546 +0000 UTC m=+260.439471374" Jun 09 10:57:52.164766 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.164674 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 10:57:52.169765 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.169741 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.173410 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.172970 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rk57d\"" Jun 09 10:57:52.173410 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.173224 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 09 10:57:52.173410 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.173396 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 09 10:57:52.173654 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.173580 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 09 10:57:52.173706 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.173659 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 09 10:57:52.173706 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.173681 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 09 10:57:52.174006 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.173983 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 09 10:57:52.174006 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.174004 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 09 10:57:52.174234 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.174025 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 09 10:57:52.174301 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.174267 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 09 10:57:52.174388 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.174306 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 09 10:57:52.174526 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.174508 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 09 10:57:52.174642 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.174626 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 09 10:57:52.174703 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.174578 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 09 10:57:52.174763 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.174723 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-efm4l8b3f57hn\"" Jun 09 10:57:52.174822 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.174774 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 09 10:57:52.177303 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.177125 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 09 10:57:52.185937 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.185856 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 10:57:52.186208 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.186182 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c2734ba1-7317-4180-b1cd-90852a899fb2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.186303 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.186225 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c2734ba1-7317-4180-b1cd-90852a899fb2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.186303 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.186259 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c2734ba1-7317-4180-b1cd-90852a899fb2-config\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.186403 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.186301 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c2734ba1-7317-4180-b1cd-90852a899fb2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.186403 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.186358 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2734ba1-7317-4180-b1cd-90852a899fb2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.186403 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.186383 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c2734ba1-7317-4180-b1cd-90852a899fb2-web-config\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.186615 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.186424 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c2734ba1-7317-4180-b1cd-90852a899fb2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.186615 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.186464 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2734ba1-7317-4180-b1cd-90852a899fb2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.186615 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.186494 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c2734ba1-7317-4180-b1cd-90852a899fb2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.186615 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.186522 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c2734ba1-7317-4180-b1cd-90852a899fb2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.186615 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.186562 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c2734ba1-7317-4180-b1cd-90852a899fb2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.186615 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.186603 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c2734ba1-7317-4180-b1cd-90852a899fb2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.186895 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.186632 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2734ba1-7317-4180-b1cd-90852a899fb2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.186895 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.186661 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c2734ba1-7317-4180-b1cd-90852a899fb2-config-out\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.186895 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.186691 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c2734ba1-7317-4180-b1cd-90852a899fb2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.186895 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.186718 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bzgj\" (UniqueName: \"kubernetes.io/projected/c2734ba1-7317-4180-b1cd-90852a899fb2-kube-api-access-2bzgj\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.186895 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.186749 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c2734ba1-7317-4180-b1cd-90852a899fb2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.186895 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.186786 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c2734ba1-7317-4180-b1cd-90852a899fb2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.186895 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.186817 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c2734ba1-7317-4180-b1cd-90852a899fb2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.187130 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.186907 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2734ba1-7317-4180-b1cd-90852a899fb2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.288075 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.288035 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c2734ba1-7317-4180-b1cd-90852a899fb2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.288252 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.288097 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2734ba1-7317-4180-b1cd-90852a899fb2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.288252 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.288129 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c2734ba1-7317-4180-b1cd-90852a899fb2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.288252 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.288159 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c2734ba1-7317-4180-b1cd-90852a899fb2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.288252 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.288195 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c2734ba1-7317-4180-b1cd-90852a899fb2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.288252 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.288216 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c2734ba1-7317-4180-b1cd-90852a899fb2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.288252 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.288241 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2734ba1-7317-4180-b1cd-90852a899fb2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.288530 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.288272 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c2734ba1-7317-4180-b1cd-90852a899fb2-config-out\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.288530 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.288300 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c2734ba1-7317-4180-b1cd-90852a899fb2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.288530 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.288325 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bzgj\" (UniqueName: \"kubernetes.io/projected/c2734ba1-7317-4180-b1cd-90852a899fb2-kube-api-access-2bzgj\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.288530 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.288353 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c2734ba1-7317-4180-b1cd-90852a899fb2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.288530 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.288393 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c2734ba1-7317-4180-b1cd-90852a899fb2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.288530 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.288423 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c2734ba1-7317-4180-b1cd-90852a899fb2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.288530 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.288451 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2734ba1-7317-4180-b1cd-90852a899fb2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.288530 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.288498 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c2734ba1-7317-4180-b1cd-90852a899fb2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.288530 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.288524 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c2734ba1-7317-4180-b1cd-90852a899fb2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.288974 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.288628 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c2734ba1-7317-4180-b1cd-90852a899fb2-config\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.288974 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.288670 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c2734ba1-7317-4180-b1cd-90852a899fb2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.288974 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:57:52.288694 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c2734ba1-7317-4180-b1cd-90852a899fb2-prometheus-trusted-ca-bundle podName:c2734ba1-7317-4180-b1cd-90852a899fb2 nodeName:}" failed. No retries permitted until 2026-06-09 10:57:52.788671609 +0000 UTC m=+262.652911438 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/c2734ba1-7317-4180-b1cd-90852a899fb2-prometheus-trusted-ca-bundle") pod "prometheus-k8s-0" (UID: "c2734ba1-7317-4180-b1cd-90852a899fb2") : configmap references non-existent config key: ca-bundle.crt Jun 09 10:57:52.288974 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.288792 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2734ba1-7317-4180-b1cd-90852a899fb2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.288974 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.288822 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c2734ba1-7317-4180-b1cd-90852a899fb2-web-config\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.288974 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.288949 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c2734ba1-7317-4180-b1cd-90852a899fb2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.289253 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.289037 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2734ba1-7317-4180-b1cd-90852a899fb2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.289305 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.289285 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c2734ba1-7317-4180-b1cd-90852a899fb2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.289659 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.289634 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c2734ba1-7317-4180-b1cd-90852a899fb2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.291237 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.290896 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2734ba1-7317-4180-b1cd-90852a899fb2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.291237 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.291044 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2734ba1-7317-4180-b1cd-90852a899fb2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.291949 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.291670 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c2734ba1-7317-4180-b1cd-90852a899fb2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.291949 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.291874 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c2734ba1-7317-4180-b1cd-90852a899fb2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.292725 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.292702 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c2734ba1-7317-4180-b1cd-90852a899fb2-config-out\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.292993 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.292972 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c2734ba1-7317-4180-b1cd-90852a899fb2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.293376 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.293310 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c2734ba1-7317-4180-b1cd-90852a899fb2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.293677 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.293654 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c2734ba1-7317-4180-b1cd-90852a899fb2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.294051 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.294028 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c2734ba1-7317-4180-b1cd-90852a899fb2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.294384 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.294245 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c2734ba1-7317-4180-b1cd-90852a899fb2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.294569 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.294520 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c2734ba1-7317-4180-b1cd-90852a899fb2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.295096 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.295073 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c2734ba1-7317-4180-b1cd-90852a899fb2-web-config\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.295877 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.295821 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c2734ba1-7317-4180-b1cd-90852a899fb2-config\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.296475 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.296152 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c2734ba1-7317-4180-b1cd-90852a899fb2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.300526 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.300501 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bzgj\" (UniqueName: \"kubernetes.io/projected/c2734ba1-7317-4180-b1cd-90852a899fb2-kube-api-access-2bzgj\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.529627 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.529546 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"14da75ba-9dd9-48bc-aa46-9df51710811f","Type":"ContainerStarted","Data":"c76211f83d52ab264b4db46ee03f3af0191b21358d92f366785e74da90ffa710"} Jun 09 10:57:52.529842 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.529664 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"14da75ba-9dd9-48bc-aa46-9df51710811f","Type":"ContainerStarted","Data":"678e4c69e5cab5bd22878a1aecab3fd61744018825c08021fa684764ea82cb06"} Jun 09 10:57:52.529842 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.529711 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"14da75ba-9dd9-48bc-aa46-9df51710811f","Type":"ContainerStarted","Data":"9a474ae0283233a58fbcf548d985d9c04dbb26c9a559d9be9ed12e9c87d3518a"} Jun 09 10:57:52.529842 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.529741 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"14da75ba-9dd9-48bc-aa46-9df51710811f","Type":"ContainerStarted","Data":"5bd24a40f2da6377b479ef4d714df7f7675bbc69a6bce06502dcb1b02f3ac73d"} Jun 09 10:57:52.529842 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.529775 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"14da75ba-9dd9-48bc-aa46-9df51710811f","Type":"ContainerStarted","Data":"5b313e691462b2b43e8cd7f7ef74028981becf284baa3119db77c47a108f0f59"} Jun 09 10:57:52.532168 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.532135 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-644ff788bd-ddt69" event={"ID":"62b2d026-aef3-4f2b-9f95-d66c52905d07","Type":"ContainerStarted","Data":"c1009553bea62cef3cf45f184128582b210f7722de476088d20a61f3a7509771"} Jun 09 10:57:52.532284 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.532216 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-644ff788bd-ddt69" event={"ID":"62b2d026-aef3-4f2b-9f95-d66c52905d07","Type":"ContainerStarted","Data":"5a36315e46740a34026cb47881925cdaba7e8dbd3fe906993c81a4a6a0281fbe"} Jun 09 10:57:52.532284 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.532261 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-644ff788bd-ddt69" event={"ID":"62b2d026-aef3-4f2b-9f95-d66c52905d07","Type":"ContainerStarted","Data":"b873dae3036a309dd1e7fb5fba260b1f236a6b687603db63d46f87b0d9c58fca"} Jun 09 10:57:52.793885 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.793855 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2734ba1-7317-4180-b1cd-90852a899fb2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:52.794755 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:52.794736 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2734ba1-7317-4180-b1cd-90852a899fb2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:53.082006 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:53.081924 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:53.219353 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:53.219320 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 10:57:53.219751 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:57:53.219677 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2734ba1_7317_4180_b1cd_90852a899fb2.slice/crio-6646f568680952af5569715eb35fdfcf8408877d99a3974b1e24e394e12ee4a0 WatchSource:0}: Error finding container 6646f568680952af5569715eb35fdfcf8408877d99a3974b1e24e394e12ee4a0: Status 404 returned error can't find the container with id 6646f568680952af5569715eb35fdfcf8408877d99a3974b1e24e394e12ee4a0 Jun 09 10:57:53.544716 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:53.544680 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"14da75ba-9dd9-48bc-aa46-9df51710811f","Type":"ContainerStarted","Data":"5283d7add2ea18eb3b3dab2a1bc9be0cb95708144e5438e57f02bf9b28755f47"} Jun 09 10:57:53.547479 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:53.547454 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-644ff788bd-ddt69" event={"ID":"62b2d026-aef3-4f2b-9f95-d66c52905d07","Type":"ContainerStarted","Data":"4ace6e716eab4171e3bde40b7b65e442f3565acd32256a9768a218042a914211"} Jun 09 10:57:53.547612 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:53.547503 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-644ff788bd-ddt69" event={"ID":"62b2d026-aef3-4f2b-9f95-d66c52905d07","Type":"ContainerStarted","Data":"b70ec46a23a6c4bf9c467aaf19c1ddcbfc681a27810fd8a482d4fdfb4390a2b6"} Jun 09 10:57:53.547612 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:53.547528 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-644ff788bd-ddt69" event={"ID":"62b2d026-aef3-4f2b-9f95-d66c52905d07","Type":"ContainerStarted","Data":"209a197d71b6bb9dba1b283178a9ffda34dd130496be1c16cfcded14956edfa8"} Jun 09 10:57:53.547612 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:53.547557 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-644ff788bd-ddt69" Jun 09 10:57:53.548921 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:53.548901 2562 generic.go:356] "Generic (PLEG): container finished" podID="c2734ba1-7317-4180-b1cd-90852a899fb2" containerID="b8fcc1699c067f374aeb01f22bd59f86101a8a78d34cc063e10d7906a4bcbd80" exitCode=0 Jun 09 10:57:53.548988 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:53.548953 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c2734ba1-7317-4180-b1cd-90852a899fb2","Type":"ContainerDied","Data":"b8fcc1699c067f374aeb01f22bd59f86101a8a78d34cc063e10d7906a4bcbd80"} Jun 09 10:57:53.549023 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:53.548993 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c2734ba1-7317-4180-b1cd-90852a899fb2","Type":"ContainerStarted","Data":"6646f568680952af5569715eb35fdfcf8408877d99a3974b1e24e394e12ee4a0"} Jun 09 10:57:53.574804 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:53.574770 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.058575658 podStartE2EDuration="6.574757943s" totalImagesPullingTime="4.489139173s" totalInitContainerRuntime="27.043112ms" isStatefulPod=false podCreationTimestamp="2026-06-09 10:57:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:57:53.574027441 +0000 UTC m=+263.438267280" watchObservedRunningTime="2026-06-09 10:57:53.574757943 +0000 UTC m=+263.438997771" Jun 09 10:57:53.598501 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:53.598455 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-644ff788bd-ddt69" podStartSLOduration=2.690687198 podStartE2EDuration="5.598437578s" totalImagesPullingTime="2.90775038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 10:57:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:57:53.598267545 +0000 UTC m=+263.462507375" watchObservedRunningTime="2026-06-09 10:57:53.598437578 +0000 UTC m=+263.462677407" Jun 09 10:57:57.570350 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:57.570269 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c2734ba1-7317-4180-b1cd-90852a899fb2","Type":"ContainerStarted","Data":"055131e834e7d40444e68327b756f224461688a8024808b8ed297ac918963324"} Jun 09 10:57:57.570803 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:57.570357 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c2734ba1-7317-4180-b1cd-90852a899fb2","Type":"ContainerStarted","Data":"8ae2095ae439de9b4f7fd9f95fbcda69171cad378ca7505707b740fb2a294efa"} Jun 09 10:57:57.570803 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:57.570384 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c2734ba1-7317-4180-b1cd-90852a899fb2","Type":"ContainerStarted","Data":"9234378d23f3daf34aa9e2e556d1e60432eef029ffa13d5f7ee655559db919b1"} Jun 09 10:57:57.570803 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:57.570410 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c2734ba1-7317-4180-b1cd-90852a899fb2","Type":"ContainerStarted","Data":"c07c7a53fa65a5a20319905bd53c9acd764912684e84a74d1978165f96512b0e"} Jun 09 10:57:57.570803 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:57.570434 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c2734ba1-7317-4180-b1cd-90852a899fb2","Type":"ContainerStarted","Data":"7935fe0c09b32ae5cf3ab020bcd7da41c7bbced5679e59195369bd25e0661c0f"} Jun 09 10:57:57.570803 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:57.570457 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c2734ba1-7317-4180-b1cd-90852a899fb2","Type":"ContainerStarted","Data":"8aded8c22bdc3695b0ea56f1214c3fa755b390d1f77e26a94e7c0990e804261b"} Jun 09 10:57:57.601599 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:57.601533 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.118108058 podStartE2EDuration="5.601512643s" totalImagesPullingTime="3.461848535s" totalInitContainerRuntime="21.55605ms" isStatefulPod=false podCreationTimestamp="2026-06-09 10:57:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:57:57.599419685 +0000 UTC m=+267.463659551" watchObservedRunningTime="2026-06-09 10:57:57.601512643 +0000 UTC m=+267.465752471" Jun 09 10:57:58.082986 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:58.082957 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:57:59.559734 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:57:59.559706 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-644ff788bd-ddt69" Jun 09 10:58:01.592665 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:58:01.592635 2562 scope.go:117] "RemoveContainer" containerID="dfd721fb902a86e1e9d8f46d944e563e26e2c4852165c3917db5ce6745d34b89" Jun 09 10:58:02.592717 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:58:02.592693 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-ph2xt_56eeb8e9-a748-4e99-b04a-6d998c6aad8b/console-operator/2.log" Jun 09 10:58:02.596482 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:58:02.596456 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-ph2xt" event={"ID":"56eeb8e9-a748-4e99-b04a-6d998c6aad8b","Type":"ContainerStarted","Data":"9345f994588b50bd1adebe896c99683c56b6ac10cb0058ee2f73971bf26d10af"} Jun 09 10:58:02.596786 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:58:02.596758 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-ph2xt" Jun 09 10:58:02.601383 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:58:02.601363 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-ph2xt" Jun 09 10:58:02.616408 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:58:02.616370 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-ph2xt" podStartSLOduration=56.160416427 podStartE2EDuration="59.616356985s" totalImagesPullingTime="3.455940558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 10:57:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:58:02.615275635 +0000 UTC m=+272.479515466" watchObservedRunningTime="2026-06-09 10:58:02.616356985 +0000 UTC m=+272.480596812" Jun 09 10:58:11.143647 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:58:11.143568 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6ddd8f7d48-bv2x5" podUID="07db5071-a553-482a-8d61-beccf9aa2f34" Jun 09 10:58:11.144039 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:58:11.143609 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-rjjhk" podUID="27fb5ab9-ed22-433a-90cd-bfb7577f9ee8" Jun 09 10:58:11.626891 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:58:11.626862 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rjjhk" Jun 09 10:58:11.627050 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:58:11.626863 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6ddd8f7d48-bv2x5" Jun 09 10:58:13.636308 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:58:13.636244 2562 generic.go:356] "Generic (PLEG): container finished" podID="707cf306-5509-4d46-b1da-f16e4d4aebc8" containerID="4583039a677dce1cb106b70738b7925afde78fa7f0b1ec0a4064744005b60d38" exitCode=0 Jun 09 10:58:13.636711 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:58:13.636314 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-44tjq" event={"ID":"707cf306-5509-4d46-b1da-f16e4d4aebc8","Type":"ContainerDied","Data":"4583039a677dce1cb106b70738b7925afde78fa7f0b1ec0a4064744005b60d38"} Jun 09 10:58:13.636711 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:58:13.636670 2562 scope.go:117] "RemoveContainer" containerID="4583039a677dce1cb106b70738b7925afde78fa7f0b1ec0a4064744005b60d38" Jun 09 10:58:13.637902 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:58:13.637881 2562 generic.go:356] "Generic (PLEG): container finished" podID="c97d3b6d-c1d6-4b6d-83e8-957727e59f9a" containerID="a64ebd2f919d3c41349ebdb31856279106f8b8260866b8e18a6a5c823b90fd28" exitCode=0 Jun 09 10:58:13.638007 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:58:13.637911 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-m22jj" event={"ID":"c97d3b6d-c1d6-4b6d-83e8-957727e59f9a","Type":"ContainerDied","Data":"a64ebd2f919d3c41349ebdb31856279106f8b8260866b8e18a6a5c823b90fd28"} Jun 09 10:58:13.638231 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:58:13.638215 2562 scope.go:117] "RemoveContainer" containerID="a64ebd2f919d3c41349ebdb31856279106f8b8260866b8e18a6a5c823b90fd28" Jun 09 10:58:14.389629 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:58:14.389580 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/07db5071-a553-482a-8d61-beccf9aa2f34-registry-tls\") pod \"image-registry-6ddd8f7d48-bv2x5\" (UID: \"07db5071-a553-482a-8d61-beccf9aa2f34\") " pod="openshift-image-registry/image-registry-6ddd8f7d48-bv2x5" Jun 09 10:58:14.389817 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:58:14.389659 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27fb5ab9-ed22-433a-90cd-bfb7577f9ee8-metrics-tls\") pod \"dns-default-rjjhk\" (UID: \"27fb5ab9-ed22-433a-90cd-bfb7577f9ee8\") " pod="openshift-dns/dns-default-rjjhk" Jun 09 10:58:14.391881 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:58:14.391858 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27fb5ab9-ed22-433a-90cd-bfb7577f9ee8-metrics-tls\") pod \"dns-default-rjjhk\" (UID: \"27fb5ab9-ed22-433a-90cd-bfb7577f9ee8\") " pod="openshift-dns/dns-default-rjjhk" Jun 09 10:58:14.391975 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:58:14.391940 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/07db5071-a553-482a-8d61-beccf9aa2f34-registry-tls\") pod \"image-registry-6ddd8f7d48-bv2x5\" (UID: \"07db5071-a553-482a-8d61-beccf9aa2f34\") " pod="openshift-image-registry/image-registry-6ddd8f7d48-bv2x5" Jun 09 10:58:14.632026 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:58:14.631998 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-k9trm\"" Jun 09 10:58:14.632026 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:58:14.631999 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vv4rr\"" Jun 09 10:58:14.638326 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:58:14.638305 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6ddd8f7d48-bv2x5" Jun 09 10:58:14.638675 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:58:14.638339 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rjjhk" Jun 09 10:58:14.643778 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:58:14.643753 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-44tjq" event={"ID":"707cf306-5509-4d46-b1da-f16e4d4aebc8","Type":"ContainerStarted","Data":"dcaebeeab1c1ebf59a54921d92b9379542b000432b6e508202272f97c10f5a24"} Jun 09 10:58:14.645430 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:58:14.645411 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-m22jj" event={"ID":"c97d3b6d-c1d6-4b6d-83e8-957727e59f9a","Type":"ContainerStarted","Data":"5e6d0f6d22aab1c9ba82fe1e3c1f8e76f2dfae5a8a40d687f9b6f6fbf028f98a"} Jun 09 10:58:14.791904 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:58:14.791878 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rjjhk"] Jun 09 10:58:14.794808 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:58:14.794778 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27fb5ab9_ed22_433a_90cd_bfb7577f9ee8.slice/crio-852a73f8e9f6c55c270c27d65cff54762c036482aa9a0c82c347e71cfe19cd01 WatchSource:0}: Error finding container 852a73f8e9f6c55c270c27d65cff54762c036482aa9a0c82c347e71cfe19cd01: Status 404 returned error can't find the container with id 852a73f8e9f6c55c270c27d65cff54762c036482aa9a0c82c347e71cfe19cd01 Jun 09 10:58:14.816929 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:58:14.816902 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6ddd8f7d48-bv2x5"] Jun 09 10:58:14.819087 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:58:14.819060 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07db5071_a553_482a_8d61_beccf9aa2f34.slice/crio-8c438a660f949c605f55291542fd74c22e4e739ae28acff0855bce97e6333448 WatchSource:0}: Error finding container 8c438a660f949c605f55291542fd74c22e4e739ae28acff0855bce97e6333448: Status 404 returned error can't find the container with id 8c438a660f949c605f55291542fd74c22e4e739ae28acff0855bce97e6333448 Jun 09 10:58:15.651551 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:58:15.651496 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6ddd8f7d48-bv2x5" event={"ID":"07db5071-a553-482a-8d61-beccf9aa2f34","Type":"ContainerStarted","Data":"7d3ca623531d6ca89b4ad327cbd3825a9603a7fed57cc9cdff21543aa7ba2032"} Jun 09 10:58:15.652002 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:58:15.651599 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6ddd8f7d48-bv2x5" Jun 09 10:58:15.652002 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:58:15.651622 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6ddd8f7d48-bv2x5" event={"ID":"07db5071-a553-482a-8d61-beccf9aa2f34","Type":"ContainerStarted","Data":"8c438a660f949c605f55291542fd74c22e4e739ae28acff0855bce97e6333448"} Jun 09 10:58:15.652917 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:58:15.652887 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rjjhk" event={"ID":"27fb5ab9-ed22-433a-90cd-bfb7577f9ee8","Type":"ContainerStarted","Data":"852a73f8e9f6c55c270c27d65cff54762c036482aa9a0c82c347e71cfe19cd01"} Jun 09 10:58:15.681220 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:58:15.681176 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6ddd8f7d48-bv2x5" podStartSLOduration=285.681164122 podStartE2EDuration="4m45.681164122s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 10:53:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:58:15.678950862 +0000 UTC m=+285.543190691" watchObservedRunningTime="2026-06-09 10:58:15.681164122 +0000 UTC m=+285.545403972" Jun 09 10:58:16.658870 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:58:16.658843 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rjjhk" event={"ID":"27fb5ab9-ed22-433a-90cd-bfb7577f9ee8","Type":"ContainerStarted","Data":"2f35a9189007c9b77a7e37fd758b871766ba9f703c09c5466ddc4f2dd5065b38"} Jun 09 10:58:17.665536 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:58:17.665498 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rjjhk" event={"ID":"27fb5ab9-ed22-433a-90cd-bfb7577f9ee8","Type":"ContainerStarted","Data":"32d0a78148ad6025899e36e68320252c4c5af6425887294099f77b8681a40ad8"} Jun 09 10:58:17.666002 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:58:17.665709 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rjjhk" Jun 09 10:58:17.685293 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:58:17.685247 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rjjhk" podStartSLOduration=251.97181369 podStartE2EDuration="4m13.685231737s" totalImagesPullingTime="1.713418047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 10:54:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:58:17.683804868 +0000 UTC m=+287.548044696" watchObservedRunningTime="2026-06-09 10:58:17.685231737 +0000 UTC m=+287.549471565" Jun 09 10:58:27.671881 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:58:27.671850 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rjjhk" Jun 09 10:58:30.537825 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:58:30.537795 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-ph2xt_56eeb8e9-a748-4e99-b04a-6d998c6aad8b/console-operator/2.log" Jun 09 10:58:30.545385 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:58:30.545358 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-ph2xt_56eeb8e9-a748-4e99-b04a-6d998c6aad8b/console-operator/2.log" Jun 09 10:58:30.552319 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:58:30.552295 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vjfd2_1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070/ovn-acl-logging/0.log" Jun 09 10:58:30.553900 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:58:30.553881 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vjfd2_1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070/ovn-acl-logging/0.log" Jun 09 10:58:30.556877 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:58:30.556860 2562 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 10:58:34.643061 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:58:34.643021 2562 patch_prober.go:28] interesting pod/image-registry-6ddd8f7d48-bv2x5 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 10:58:34.644556 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:58:34.643082 2562 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6ddd8f7d48-bv2x5" podUID="07db5071-a553-482a-8d61-beccf9aa2f34" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 10:58:36.663199 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:58:36.663172 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6ddd8f7d48-bv2x5" Jun 09 10:58:38.755656 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:58:38.755625 2562 generic.go:356] "Generic (PLEG): container finished" podID="59478af7-0fe0-48e9-a4d8-e6cf1aa02aa9" containerID="80e4eb1a31f72e6e7a4a047c7dd78e6bf7b06f4e744b2ec1115c870b1caf46a2" exitCode=0 Jun 09 10:58:38.756020 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:58:38.755693 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-btx7z" event={"ID":"59478af7-0fe0-48e9-a4d8-e6cf1aa02aa9","Type":"ContainerDied","Data":"80e4eb1a31f72e6e7a4a047c7dd78e6bf7b06f4e744b2ec1115c870b1caf46a2"} Jun 09 10:58:38.756020 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:58:38.756014 2562 scope.go:117] "RemoveContainer" containerID="80e4eb1a31f72e6e7a4a047c7dd78e6bf7b06f4e744b2ec1115c870b1caf46a2" Jun 09 10:58:39.537287 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:58:39.537218 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jwgsk_40572faa-ff5a-4e83-a728-7e356e6feb69/serve-healthcheck-canary/0.log" Jun 09 10:58:39.761604 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:58:39.761553 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-btx7z" event={"ID":"59478af7-0fe0-48e9-a4d8-e6cf1aa02aa9","Type":"ContainerStarted","Data":"1fd2baa5903cbdea39e5abf47b2591ac540b01cfc5bdaa73bb2c11e3aa508a6f"} Jun 09 10:58:53.082968 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:58:53.082932 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:58:53.108689 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:58:53.108653 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:58:53.841533 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:58:53.841505 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:00.963739 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:00.963704 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6ddd8f7d48-bv2x5"] Jun 09 10:59:06.293408 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:06.293372 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 10:59:06.293781 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:06.293661 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="14da75ba-9dd9-48bc-aa46-9df51710811f" containerName="alertmanager" containerID="cri-o://5b313e691462b2b43e8cd7f7ef74028981becf284baa3119db77c47a108f0f59" gracePeriod=120 Jun 09 10:59:06.293781 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:06.293716 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="14da75ba-9dd9-48bc-aa46-9df51710811f" containerName="kube-rbac-proxy-metric" containerID="cri-o://c76211f83d52ab264b4db46ee03f3af0191b21358d92f366785e74da90ffa710" gracePeriod=120 Jun 09 10:59:06.293914 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:06.293767 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="14da75ba-9dd9-48bc-aa46-9df51710811f" containerName="prom-label-proxy" containerID="cri-o://5283d7add2ea18eb3b3dab2a1bc9be0cb95708144e5438e57f02bf9b28755f47" gracePeriod=120 Jun 09 10:59:06.293914 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:06.293773 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="14da75ba-9dd9-48bc-aa46-9df51710811f" containerName="kube-rbac-proxy-web" containerID="cri-o://9a474ae0283233a58fbcf548d985d9c04dbb26c9a559d9be9ed12e9c87d3518a" gracePeriod=120 Jun 09 10:59:06.293914 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:06.293812 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="14da75ba-9dd9-48bc-aa46-9df51710811f" containerName="config-reloader" containerID="cri-o://5bd24a40f2da6377b479ef4d714df7f7675bbc69a6bce06502dcb1b02f3ac73d" gracePeriod=120 Jun 09 10:59:06.293914 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:06.293773 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="14da75ba-9dd9-48bc-aa46-9df51710811f" containerName="kube-rbac-proxy" containerID="cri-o://678e4c69e5cab5bd22878a1aecab3fd61744018825c08021fa684764ea82cb06" gracePeriod=120 Jun 09 10:59:06.880980 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:06.880947 2562 generic.go:356] "Generic (PLEG): container finished" podID="14da75ba-9dd9-48bc-aa46-9df51710811f" containerID="5283d7add2ea18eb3b3dab2a1bc9be0cb95708144e5438e57f02bf9b28755f47" exitCode=0 Jun 09 10:59:06.880980 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:06.880972 2562 generic.go:356] "Generic (PLEG): container finished" podID="14da75ba-9dd9-48bc-aa46-9df51710811f" containerID="678e4c69e5cab5bd22878a1aecab3fd61744018825c08021fa684764ea82cb06" exitCode=0 Jun 09 10:59:06.880980 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:06.880980 2562 generic.go:356] "Generic (PLEG): container finished" podID="14da75ba-9dd9-48bc-aa46-9df51710811f" containerID="5bd24a40f2da6377b479ef4d714df7f7675bbc69a6bce06502dcb1b02f3ac73d" exitCode=0 Jun 09 10:59:06.880980 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:06.880987 2562 generic.go:356] "Generic (PLEG): container finished" podID="14da75ba-9dd9-48bc-aa46-9df51710811f" containerID="5b313e691462b2b43e8cd7f7ef74028981becf284baa3119db77c47a108f0f59" exitCode=0 Jun 09 10:59:06.881228 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:06.881015 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"14da75ba-9dd9-48bc-aa46-9df51710811f","Type":"ContainerDied","Data":"5283d7add2ea18eb3b3dab2a1bc9be0cb95708144e5438e57f02bf9b28755f47"} Jun 09 10:59:06.881228 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:06.881080 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"14da75ba-9dd9-48bc-aa46-9df51710811f","Type":"ContainerDied","Data":"678e4c69e5cab5bd22878a1aecab3fd61744018825c08021fa684764ea82cb06"} Jun 09 10:59:06.881228 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:06.881107 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"14da75ba-9dd9-48bc-aa46-9df51710811f","Type":"ContainerDied","Data":"5bd24a40f2da6377b479ef4d714df7f7675bbc69a6bce06502dcb1b02f3ac73d"} Jun 09 10:59:06.881228 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:06.881132 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"14da75ba-9dd9-48bc-aa46-9df51710811f","Type":"ContainerDied","Data":"5b313e691462b2b43e8cd7f7ef74028981becf284baa3119db77c47a108f0f59"} Jun 09 10:59:07.536780 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.536758 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 10:59:07.657100 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.657033 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/14da75ba-9dd9-48bc-aa46-9df51710811f-config-volume\") pod \"14da75ba-9dd9-48bc-aa46-9df51710811f\" (UID: \"14da75ba-9dd9-48bc-aa46-9df51710811f\") " Jun 09 10:59:07.657100 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.657065 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/14da75ba-9dd9-48bc-aa46-9df51710811f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"14da75ba-9dd9-48bc-aa46-9df51710811f\" (UID: \"14da75ba-9dd9-48bc-aa46-9df51710811f\") " Jun 09 10:59:07.657100 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.657091 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/14da75ba-9dd9-48bc-aa46-9df51710811f-secret-alertmanager-kube-rbac-proxy\") pod \"14da75ba-9dd9-48bc-aa46-9df51710811f\" (UID: \"14da75ba-9dd9-48bc-aa46-9df51710811f\") " Jun 09 10:59:07.657370 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.657110 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/14da75ba-9dd9-48bc-aa46-9df51710811f-cluster-tls-config\") pod \"14da75ba-9dd9-48bc-aa46-9df51710811f\" (UID: \"14da75ba-9dd9-48bc-aa46-9df51710811f\") " Jun 09 10:59:07.657370 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.657138 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmvxk\" (UniqueName: \"kubernetes.io/projected/14da75ba-9dd9-48bc-aa46-9df51710811f-kube-api-access-gmvxk\") pod \"14da75ba-9dd9-48bc-aa46-9df51710811f\" (UID: \"14da75ba-9dd9-48bc-aa46-9df51710811f\") " Jun 09 10:59:07.657370 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.657183 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/14da75ba-9dd9-48bc-aa46-9df51710811f-secret-alertmanager-kube-rbac-proxy-web\") pod \"14da75ba-9dd9-48bc-aa46-9df51710811f\" (UID: \"14da75ba-9dd9-48bc-aa46-9df51710811f\") " Jun 09 10:59:07.657370 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.657215 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/14da75ba-9dd9-48bc-aa46-9df51710811f-alertmanager-main-db\") pod \"14da75ba-9dd9-48bc-aa46-9df51710811f\" (UID: \"14da75ba-9dd9-48bc-aa46-9df51710811f\") " Jun 09 10:59:07.657370 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.657239 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/14da75ba-9dd9-48bc-aa46-9df51710811f-secret-alertmanager-main-tls\") pod \"14da75ba-9dd9-48bc-aa46-9df51710811f\" (UID: \"14da75ba-9dd9-48bc-aa46-9df51710811f\") " Jun 09 10:59:07.657370 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.657278 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14da75ba-9dd9-48bc-aa46-9df51710811f-metrics-client-ca\") pod \"14da75ba-9dd9-48bc-aa46-9df51710811f\" (UID: \"14da75ba-9dd9-48bc-aa46-9df51710811f\") " Jun 09 10:59:07.657370 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.657357 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/14da75ba-9dd9-48bc-aa46-9df51710811f-tls-assets\") pod \"14da75ba-9dd9-48bc-aa46-9df51710811f\" (UID: \"14da75ba-9dd9-48bc-aa46-9df51710811f\") " Jun 09 10:59:07.657750 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.657412 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14da75ba-9dd9-48bc-aa46-9df51710811f-alertmanager-trusted-ca-bundle\") pod \"14da75ba-9dd9-48bc-aa46-9df51710811f\" (UID: \"14da75ba-9dd9-48bc-aa46-9df51710811f\") " Jun 09 10:59:07.657750 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.657443 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/14da75ba-9dd9-48bc-aa46-9df51710811f-web-config\") pod \"14da75ba-9dd9-48bc-aa46-9df51710811f\" (UID: \"14da75ba-9dd9-48bc-aa46-9df51710811f\") " Jun 09 10:59:07.657750 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.657485 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/14da75ba-9dd9-48bc-aa46-9df51710811f-config-out\") pod \"14da75ba-9dd9-48bc-aa46-9df51710811f\" (UID: \"14da75ba-9dd9-48bc-aa46-9df51710811f\") " Jun 09 10:59:07.657976 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.657897 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14da75ba-9dd9-48bc-aa46-9df51710811f-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "14da75ba-9dd9-48bc-aa46-9df51710811f" (UID: "14da75ba-9dd9-48bc-aa46-9df51710811f"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 10:59:07.658526 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.658262 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14da75ba-9dd9-48bc-aa46-9df51710811f-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "14da75ba-9dd9-48bc-aa46-9df51710811f" (UID: "14da75ba-9dd9-48bc-aa46-9df51710811f"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 10:59:07.660080 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.660049 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14da75ba-9dd9-48bc-aa46-9df51710811f-kube-api-access-gmvxk" (OuterVolumeSpecName: "kube-api-access-gmvxk") pod "14da75ba-9dd9-48bc-aa46-9df51710811f" (UID: "14da75ba-9dd9-48bc-aa46-9df51710811f"). InnerVolumeSpecName "kube-api-access-gmvxk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 10:59:07.660260 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.660233 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14da75ba-9dd9-48bc-aa46-9df51710811f-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "14da75ba-9dd9-48bc-aa46-9df51710811f" (UID: "14da75ba-9dd9-48bc-aa46-9df51710811f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 10:59:07.660340 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.660301 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14da75ba-9dd9-48bc-aa46-9df51710811f-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "14da75ba-9dd9-48bc-aa46-9df51710811f" (UID: "14da75ba-9dd9-48bc-aa46-9df51710811f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 10:59:07.660340 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.660319 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14da75ba-9dd9-48bc-aa46-9df51710811f-config-volume" (OuterVolumeSpecName: "config-volume") pod "14da75ba-9dd9-48bc-aa46-9df51710811f" (UID: "14da75ba-9dd9-48bc-aa46-9df51710811f"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 10:59:07.660507 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.660468 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14da75ba-9dd9-48bc-aa46-9df51710811f-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "14da75ba-9dd9-48bc-aa46-9df51710811f" (UID: "14da75ba-9dd9-48bc-aa46-9df51710811f"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 10:59:07.660643 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.660558 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14da75ba-9dd9-48bc-aa46-9df51710811f-config-out" (OuterVolumeSpecName: "config-out") pod "14da75ba-9dd9-48bc-aa46-9df51710811f" (UID: "14da75ba-9dd9-48bc-aa46-9df51710811f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 10:59:07.660796 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.660762 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14da75ba-9dd9-48bc-aa46-9df51710811f-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "14da75ba-9dd9-48bc-aa46-9df51710811f" (UID: "14da75ba-9dd9-48bc-aa46-9df51710811f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 10:59:07.660861 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.660817 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14da75ba-9dd9-48bc-aa46-9df51710811f-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "14da75ba-9dd9-48bc-aa46-9df51710811f" (UID: "14da75ba-9dd9-48bc-aa46-9df51710811f"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 10:59:07.662062 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.662041 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14da75ba-9dd9-48bc-aa46-9df51710811f-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "14da75ba-9dd9-48bc-aa46-9df51710811f" (UID: "14da75ba-9dd9-48bc-aa46-9df51710811f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 10:59:07.665027 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.665000 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14da75ba-9dd9-48bc-aa46-9df51710811f-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "14da75ba-9dd9-48bc-aa46-9df51710811f" (UID: "14da75ba-9dd9-48bc-aa46-9df51710811f"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 10:59:07.672232 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.672209 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14da75ba-9dd9-48bc-aa46-9df51710811f-web-config" (OuterVolumeSpecName: "web-config") pod "14da75ba-9dd9-48bc-aa46-9df51710811f" (UID: "14da75ba-9dd9-48bc-aa46-9df51710811f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 10:59:07.758262 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.758238 2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/14da75ba-9dd9-48bc-aa46-9df51710811f-tls-assets\") on node \"ip-10-0-136-7.ec2.internal\" DevicePath \"\"" Jun 09 10:59:07.758262 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.758261 2562 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14da75ba-9dd9-48bc-aa46-9df51710811f-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-136-7.ec2.internal\" DevicePath \"\"" Jun 09 10:59:07.758387 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.758272 2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/14da75ba-9dd9-48bc-aa46-9df51710811f-web-config\") on node \"ip-10-0-136-7.ec2.internal\" DevicePath \"\"" Jun 09 10:59:07.758387 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.758281 2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/14da75ba-9dd9-48bc-aa46-9df51710811f-config-out\") on node \"ip-10-0-136-7.ec2.internal\" DevicePath \"\"" Jun 09 10:59:07.758387 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.758288 2562 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/14da75ba-9dd9-48bc-aa46-9df51710811f-config-volume\") on node \"ip-10-0-136-7.ec2.internal\" DevicePath \"\"" Jun 09 10:59:07.758387 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.758296 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/14da75ba-9dd9-48bc-aa46-9df51710811f-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-136-7.ec2.internal\" DevicePath \"\"" Jun 09 10:59:07.758387 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.758305 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/14da75ba-9dd9-48bc-aa46-9df51710811f-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-136-7.ec2.internal\" DevicePath \"\"" Jun 09 10:59:07.758387 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.758313 2562 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/14da75ba-9dd9-48bc-aa46-9df51710811f-cluster-tls-config\") on node \"ip-10-0-136-7.ec2.internal\" DevicePath \"\"" Jun 09 10:59:07.758387 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.758322 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmvxk\" (UniqueName: \"kubernetes.io/projected/14da75ba-9dd9-48bc-aa46-9df51710811f-kube-api-access-gmvxk\") on node \"ip-10-0-136-7.ec2.internal\" DevicePath \"\"" Jun 09 10:59:07.758387 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.758330 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/14da75ba-9dd9-48bc-aa46-9df51710811f-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-136-7.ec2.internal\" DevicePath \"\"" Jun 09 10:59:07.758387 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.758338 2562 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/14da75ba-9dd9-48bc-aa46-9df51710811f-alertmanager-main-db\") on node \"ip-10-0-136-7.ec2.internal\" DevicePath \"\"" Jun 09 10:59:07.758387 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.758346 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/14da75ba-9dd9-48bc-aa46-9df51710811f-secret-alertmanager-main-tls\") on node \"ip-10-0-136-7.ec2.internal\" DevicePath \"\"" Jun 09 10:59:07.758387 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.758355 2562 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14da75ba-9dd9-48bc-aa46-9df51710811f-metrics-client-ca\") on node \"ip-10-0-136-7.ec2.internal\" DevicePath \"\"" Jun 09 10:59:07.887543 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.887510 2562 generic.go:356] "Generic (PLEG): container finished" podID="14da75ba-9dd9-48bc-aa46-9df51710811f" containerID="c76211f83d52ab264b4db46ee03f3af0191b21358d92f366785e74da90ffa710" exitCode=0 Jun 09 10:59:07.887543 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.887536 2562 generic.go:356] "Generic (PLEG): container finished" podID="14da75ba-9dd9-48bc-aa46-9df51710811f" containerID="9a474ae0283233a58fbcf548d985d9c04dbb26c9a559d9be9ed12e9c87d3518a" exitCode=0 Jun 09 10:59:07.887796 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.887561 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"14da75ba-9dd9-48bc-aa46-9df51710811f","Type":"ContainerDied","Data":"c76211f83d52ab264b4db46ee03f3af0191b21358d92f366785e74da90ffa710"} Jun 09 10:59:07.887796 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.887616 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 10:59:07.887796 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.887647 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"14da75ba-9dd9-48bc-aa46-9df51710811f","Type":"ContainerDied","Data":"9a474ae0283233a58fbcf548d985d9c04dbb26c9a559d9be9ed12e9c87d3518a"} Jun 09 10:59:07.887796 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.887677 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"14da75ba-9dd9-48bc-aa46-9df51710811f","Type":"ContainerDied","Data":"77203946968fb53a9708565f933853a327867dd990a3f6a1bb76c8ec36bdf7a7"} Jun 09 10:59:07.887796 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.887712 2562 scope.go:117] "RemoveContainer" containerID="5283d7add2ea18eb3b3dab2a1bc9be0cb95708144e5438e57f02bf9b28755f47" Jun 09 10:59:07.895311 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.895287 2562 scope.go:117] "RemoveContainer" containerID="c76211f83d52ab264b4db46ee03f3af0191b21358d92f366785e74da90ffa710" Jun 09 10:59:07.902413 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.902396 2562 scope.go:117] "RemoveContainer" containerID="678e4c69e5cab5bd22878a1aecab3fd61744018825c08021fa684764ea82cb06" Jun 09 10:59:07.909547 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.909529 2562 scope.go:117] "RemoveContainer" containerID="9a474ae0283233a58fbcf548d985d9c04dbb26c9a559d9be9ed12e9c87d3518a" Jun 09 10:59:07.911340 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.911318 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 10:59:07.915666 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.915643 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 10:59:07.917543 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.917521 2562 scope.go:117] "RemoveContainer" containerID="5bd24a40f2da6377b479ef4d714df7f7675bbc69a6bce06502dcb1b02f3ac73d" Jun 09 10:59:07.924314 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.924294 2562 scope.go:117] "RemoveContainer" containerID="5b313e691462b2b43e8cd7f7ef74028981becf284baa3119db77c47a108f0f59" Jun 09 10:59:07.931171 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.931155 2562 scope.go:117] "RemoveContainer" containerID="0345a74f02fa4d3a112edd8e13e358579f871be71177a67531443808d647377b" Jun 09 10:59:07.938117 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.938096 2562 scope.go:117] "RemoveContainer" containerID="5283d7add2ea18eb3b3dab2a1bc9be0cb95708144e5438e57f02bf9b28755f47" Jun 09 10:59:07.938359 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:59:07.938338 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5283d7add2ea18eb3b3dab2a1bc9be0cb95708144e5438e57f02bf9b28755f47\": container with ID starting with 5283d7add2ea18eb3b3dab2a1bc9be0cb95708144e5438e57f02bf9b28755f47 not found: ID does not exist" containerID="5283d7add2ea18eb3b3dab2a1bc9be0cb95708144e5438e57f02bf9b28755f47" Jun 09 10:59:07.938403 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.938371 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5283d7add2ea18eb3b3dab2a1bc9be0cb95708144e5438e57f02bf9b28755f47"} err="failed to get container status \"5283d7add2ea18eb3b3dab2a1bc9be0cb95708144e5438e57f02bf9b28755f47\": rpc error: code = NotFound desc = could not find container \"5283d7add2ea18eb3b3dab2a1bc9be0cb95708144e5438e57f02bf9b28755f47\": container with ID starting with 5283d7add2ea18eb3b3dab2a1bc9be0cb95708144e5438e57f02bf9b28755f47 not found: ID does not exist" Jun 09 10:59:07.938446 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.938404 2562 scope.go:117] "RemoveContainer" containerID="c76211f83d52ab264b4db46ee03f3af0191b21358d92f366785e74da90ffa710" Jun 09 10:59:07.938665 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:59:07.938647 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c76211f83d52ab264b4db46ee03f3af0191b21358d92f366785e74da90ffa710\": container with ID starting with c76211f83d52ab264b4db46ee03f3af0191b21358d92f366785e74da90ffa710 not found: ID does not exist" containerID="c76211f83d52ab264b4db46ee03f3af0191b21358d92f366785e74da90ffa710" Jun 09 10:59:07.938727 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.938670 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c76211f83d52ab264b4db46ee03f3af0191b21358d92f366785e74da90ffa710"} err="failed to get container status \"c76211f83d52ab264b4db46ee03f3af0191b21358d92f366785e74da90ffa710\": rpc error: code = NotFound desc = could not find container \"c76211f83d52ab264b4db46ee03f3af0191b21358d92f366785e74da90ffa710\": container with ID starting with c76211f83d52ab264b4db46ee03f3af0191b21358d92f366785e74da90ffa710 not found: ID does not exist" Jun 09 10:59:07.938727 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.938687 2562 scope.go:117] "RemoveContainer" containerID="678e4c69e5cab5bd22878a1aecab3fd61744018825c08021fa684764ea82cb06" Jun 09 10:59:07.938896 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:59:07.938875 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"678e4c69e5cab5bd22878a1aecab3fd61744018825c08021fa684764ea82cb06\": container with ID starting with 678e4c69e5cab5bd22878a1aecab3fd61744018825c08021fa684764ea82cb06 not found: ID does not exist" containerID="678e4c69e5cab5bd22878a1aecab3fd61744018825c08021fa684764ea82cb06" Jun 09 10:59:07.938941 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.938902 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"678e4c69e5cab5bd22878a1aecab3fd61744018825c08021fa684764ea82cb06"} err="failed to get container status \"678e4c69e5cab5bd22878a1aecab3fd61744018825c08021fa684764ea82cb06\": rpc error: code = NotFound desc = could not find container \"678e4c69e5cab5bd22878a1aecab3fd61744018825c08021fa684764ea82cb06\": container with ID starting with 678e4c69e5cab5bd22878a1aecab3fd61744018825c08021fa684764ea82cb06 not found: ID does not exist" Jun 09 10:59:07.938941 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.938917 2562 scope.go:117] "RemoveContainer" containerID="9a474ae0283233a58fbcf548d985d9c04dbb26c9a559d9be9ed12e9c87d3518a" Jun 09 10:59:07.939113 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:59:07.939096 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a474ae0283233a58fbcf548d985d9c04dbb26c9a559d9be9ed12e9c87d3518a\": container with ID starting with 9a474ae0283233a58fbcf548d985d9c04dbb26c9a559d9be9ed12e9c87d3518a not found: ID does not exist" containerID="9a474ae0283233a58fbcf548d985d9c04dbb26c9a559d9be9ed12e9c87d3518a" Jun 09 10:59:07.939151 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.939118 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a474ae0283233a58fbcf548d985d9c04dbb26c9a559d9be9ed12e9c87d3518a"} err="failed to get container status \"9a474ae0283233a58fbcf548d985d9c04dbb26c9a559d9be9ed12e9c87d3518a\": rpc error: code = NotFound desc = could not find container \"9a474ae0283233a58fbcf548d985d9c04dbb26c9a559d9be9ed12e9c87d3518a\": container with ID starting with 9a474ae0283233a58fbcf548d985d9c04dbb26c9a559d9be9ed12e9c87d3518a not found: ID does not exist" Jun 09 10:59:07.939151 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.939130 2562 scope.go:117] "RemoveContainer" containerID="5bd24a40f2da6377b479ef4d714df7f7675bbc69a6bce06502dcb1b02f3ac73d" Jun 09 10:59:07.939317 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:59:07.939302 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5bd24a40f2da6377b479ef4d714df7f7675bbc69a6bce06502dcb1b02f3ac73d\": container with ID starting with 5bd24a40f2da6377b479ef4d714df7f7675bbc69a6bce06502dcb1b02f3ac73d not found: ID does not exist" containerID="5bd24a40f2da6377b479ef4d714df7f7675bbc69a6bce06502dcb1b02f3ac73d" Jun 09 10:59:07.939357 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.939320 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bd24a40f2da6377b479ef4d714df7f7675bbc69a6bce06502dcb1b02f3ac73d"} err="failed to get container status \"5bd24a40f2da6377b479ef4d714df7f7675bbc69a6bce06502dcb1b02f3ac73d\": rpc error: code = NotFound desc = could not find container \"5bd24a40f2da6377b479ef4d714df7f7675bbc69a6bce06502dcb1b02f3ac73d\": container with ID starting with 5bd24a40f2da6377b479ef4d714df7f7675bbc69a6bce06502dcb1b02f3ac73d not found: ID does not exist" Jun 09 10:59:07.939357 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.939332 2562 scope.go:117] "RemoveContainer" containerID="5b313e691462b2b43e8cd7f7ef74028981becf284baa3119db77c47a108f0f59" Jun 09 10:59:07.939519 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:59:07.939504 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b313e691462b2b43e8cd7f7ef74028981becf284baa3119db77c47a108f0f59\": container with ID starting with 5b313e691462b2b43e8cd7f7ef74028981becf284baa3119db77c47a108f0f59 not found: ID does not exist" containerID="5b313e691462b2b43e8cd7f7ef74028981becf284baa3119db77c47a108f0f59" Jun 09 10:59:07.939554 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.939524 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b313e691462b2b43e8cd7f7ef74028981becf284baa3119db77c47a108f0f59"} err="failed to get container status \"5b313e691462b2b43e8cd7f7ef74028981becf284baa3119db77c47a108f0f59\": rpc error: code = NotFound desc = could not find container \"5b313e691462b2b43e8cd7f7ef74028981becf284baa3119db77c47a108f0f59\": container with ID starting with 5b313e691462b2b43e8cd7f7ef74028981becf284baa3119db77c47a108f0f59 not found: ID does not exist" Jun 09 10:59:07.939554 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.939541 2562 scope.go:117] "RemoveContainer" containerID="0345a74f02fa4d3a112edd8e13e358579f871be71177a67531443808d647377b" Jun 09 10:59:07.939779 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:59:07.939764 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0345a74f02fa4d3a112edd8e13e358579f871be71177a67531443808d647377b\": container with ID starting with 0345a74f02fa4d3a112edd8e13e358579f871be71177a67531443808d647377b not found: ID does not exist" containerID="0345a74f02fa4d3a112edd8e13e358579f871be71177a67531443808d647377b" Jun 09 10:59:07.939829 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.939782 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0345a74f02fa4d3a112edd8e13e358579f871be71177a67531443808d647377b"} err="failed to get container status \"0345a74f02fa4d3a112edd8e13e358579f871be71177a67531443808d647377b\": rpc error: code = NotFound desc = could not find container \"0345a74f02fa4d3a112edd8e13e358579f871be71177a67531443808d647377b\": container with ID starting with 0345a74f02fa4d3a112edd8e13e358579f871be71177a67531443808d647377b not found: ID does not exist" Jun 09 10:59:07.939829 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.939793 2562 scope.go:117] "RemoveContainer" containerID="5283d7add2ea18eb3b3dab2a1bc9be0cb95708144e5438e57f02bf9b28755f47" Jun 09 10:59:07.939988 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.939970 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5283d7add2ea18eb3b3dab2a1bc9be0cb95708144e5438e57f02bf9b28755f47"} err="failed to get container status \"5283d7add2ea18eb3b3dab2a1bc9be0cb95708144e5438e57f02bf9b28755f47\": rpc error: code = NotFound desc = could not find container \"5283d7add2ea18eb3b3dab2a1bc9be0cb95708144e5438e57f02bf9b28755f47\": container with ID starting with 5283d7add2ea18eb3b3dab2a1bc9be0cb95708144e5438e57f02bf9b28755f47 not found: ID does not exist" Jun 09 10:59:07.940035 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.939990 2562 scope.go:117] "RemoveContainer" containerID="c76211f83d52ab264b4db46ee03f3af0191b21358d92f366785e74da90ffa710" Jun 09 10:59:07.940229 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.940212 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c76211f83d52ab264b4db46ee03f3af0191b21358d92f366785e74da90ffa710"} err="failed to get container status \"c76211f83d52ab264b4db46ee03f3af0191b21358d92f366785e74da90ffa710\": rpc error: code = NotFound desc = could not find container \"c76211f83d52ab264b4db46ee03f3af0191b21358d92f366785e74da90ffa710\": container with ID starting with c76211f83d52ab264b4db46ee03f3af0191b21358d92f366785e74da90ffa710 not found: ID does not exist" Jun 09 10:59:07.940267 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.940230 2562 scope.go:117] "RemoveContainer" containerID="678e4c69e5cab5bd22878a1aecab3fd61744018825c08021fa684764ea82cb06" Jun 09 10:59:07.940432 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.940416 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"678e4c69e5cab5bd22878a1aecab3fd61744018825c08021fa684764ea82cb06"} err="failed to get container status \"678e4c69e5cab5bd22878a1aecab3fd61744018825c08021fa684764ea82cb06\": rpc error: code = NotFound desc = could not find container \"678e4c69e5cab5bd22878a1aecab3fd61744018825c08021fa684764ea82cb06\": container with ID starting with 678e4c69e5cab5bd22878a1aecab3fd61744018825c08021fa684764ea82cb06 not found: ID does not exist" Jun 09 10:59:07.940432 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.940431 2562 scope.go:117] "RemoveContainer" containerID="9a474ae0283233a58fbcf548d985d9c04dbb26c9a559d9be9ed12e9c87d3518a" Jun 09 10:59:07.940679 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.940659 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a474ae0283233a58fbcf548d985d9c04dbb26c9a559d9be9ed12e9c87d3518a"} err="failed to get container status \"9a474ae0283233a58fbcf548d985d9c04dbb26c9a559d9be9ed12e9c87d3518a\": rpc error: code = NotFound desc = could not find container \"9a474ae0283233a58fbcf548d985d9c04dbb26c9a559d9be9ed12e9c87d3518a\": container with ID starting with 9a474ae0283233a58fbcf548d985d9c04dbb26c9a559d9be9ed12e9c87d3518a not found: ID does not exist" Jun 09 10:59:07.940740 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.940682 2562 scope.go:117] "RemoveContainer" containerID="5bd24a40f2da6377b479ef4d714df7f7675bbc69a6bce06502dcb1b02f3ac73d" Jun 09 10:59:07.941011 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.940910 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bd24a40f2da6377b479ef4d714df7f7675bbc69a6bce06502dcb1b02f3ac73d"} err="failed to get container status \"5bd24a40f2da6377b479ef4d714df7f7675bbc69a6bce06502dcb1b02f3ac73d\": rpc error: code = NotFound desc = could not find container \"5bd24a40f2da6377b479ef4d714df7f7675bbc69a6bce06502dcb1b02f3ac73d\": container with ID starting with 5bd24a40f2da6377b479ef4d714df7f7675bbc69a6bce06502dcb1b02f3ac73d not found: ID does not exist" Jun 09 10:59:07.941011 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.940938 2562 scope.go:117] "RemoveContainer" containerID="5b313e691462b2b43e8cd7f7ef74028981becf284baa3119db77c47a108f0f59" Jun 09 10:59:07.941261 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.941229 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b313e691462b2b43e8cd7f7ef74028981becf284baa3119db77c47a108f0f59"} err="failed to get container status \"5b313e691462b2b43e8cd7f7ef74028981becf284baa3119db77c47a108f0f59\": rpc error: code = NotFound desc = could not find container \"5b313e691462b2b43e8cd7f7ef74028981becf284baa3119db77c47a108f0f59\": container with ID starting with 5b313e691462b2b43e8cd7f7ef74028981becf284baa3119db77c47a108f0f59 not found: ID does not exist" Jun 09 10:59:07.941261 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.941255 2562 scope.go:117] "RemoveContainer" containerID="0345a74f02fa4d3a112edd8e13e358579f871be71177a67531443808d647377b" Jun 09 10:59:07.941532 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:07.941504 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0345a74f02fa4d3a112edd8e13e358579f871be71177a67531443808d647377b"} err="failed to get container status \"0345a74f02fa4d3a112edd8e13e358579f871be71177a67531443808d647377b\": rpc error: code = NotFound desc = could not find container \"0345a74f02fa4d3a112edd8e13e358579f871be71177a67531443808d647377b\": container with ID starting with 0345a74f02fa4d3a112edd8e13e358579f871be71177a67531443808d647377b not found: ID does not exist" Jun 09 10:59:08.597492 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:08.597461 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14da75ba-9dd9-48bc-aa46-9df51710811f" path="/var/lib/kubelet/pods/14da75ba-9dd9-48bc-aa46-9df51710811f/volumes" Jun 09 10:59:10.509801 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:10.509768 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 10:59:10.510273 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:10.510125 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c2734ba1-7317-4180-b1cd-90852a899fb2" containerName="prometheus" containerID="cri-o://8aded8c22bdc3695b0ea56f1214c3fa755b390d1f77e26a94e7c0990e804261b" gracePeriod=600 Jun 09 10:59:10.510273 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:10.510142 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c2734ba1-7317-4180-b1cd-90852a899fb2" containerName="kube-rbac-proxy" containerID="cri-o://8ae2095ae439de9b4f7fd9f95fbcda69171cad378ca7505707b740fb2a294efa" gracePeriod=600 Jun 09 10:59:10.510273 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:10.510174 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c2734ba1-7317-4180-b1cd-90852a899fb2" containerName="thanos-sidecar" containerID="cri-o://c07c7a53fa65a5a20319905bd53c9acd764912684e84a74d1978165f96512b0e" gracePeriod=600 Jun 09 10:59:10.510273 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:10.510198 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c2734ba1-7317-4180-b1cd-90852a899fb2" containerName="kube-rbac-proxy-web" containerID="cri-o://9234378d23f3daf34aa9e2e556d1e60432eef029ffa13d5f7ee655559db919b1" gracePeriod=600 Jun 09 10:59:10.510273 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:10.510158 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c2734ba1-7317-4180-b1cd-90852a899fb2" containerName="kube-rbac-proxy-thanos" containerID="cri-o://055131e834e7d40444e68327b756f224461688a8024808b8ed297ac918963324" gracePeriod=600 Jun 09 10:59:10.510521 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:10.510179 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c2734ba1-7317-4180-b1cd-90852a899fb2" containerName="config-reloader" containerID="cri-o://7935fe0c09b32ae5cf3ab020bcd7da41c7bbced5679e59195369bd25e0661c0f" gracePeriod=600 Jun 09 10:59:10.904358 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:10.904275 2562 generic.go:356] "Generic (PLEG): container finished" podID="c2734ba1-7317-4180-b1cd-90852a899fb2" containerID="055131e834e7d40444e68327b756f224461688a8024808b8ed297ac918963324" exitCode=0 Jun 09 10:59:10.904358 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:10.904300 2562 generic.go:356] "Generic (PLEG): container finished" podID="c2734ba1-7317-4180-b1cd-90852a899fb2" containerID="8ae2095ae439de9b4f7fd9f95fbcda69171cad378ca7505707b740fb2a294efa" exitCode=0 Jun 09 10:59:10.904358 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:10.904307 2562 generic.go:356] "Generic (PLEG): container finished" podID="c2734ba1-7317-4180-b1cd-90852a899fb2" containerID="c07c7a53fa65a5a20319905bd53c9acd764912684e84a74d1978165f96512b0e" exitCode=0 Jun 09 10:59:10.904358 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:10.904315 2562 generic.go:356] "Generic (PLEG): container finished" podID="c2734ba1-7317-4180-b1cd-90852a899fb2" containerID="7935fe0c09b32ae5cf3ab020bcd7da41c7bbced5679e59195369bd25e0661c0f" exitCode=0 Jun 09 10:59:10.904358 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:10.904321 2562 generic.go:356] "Generic (PLEG): container finished" podID="c2734ba1-7317-4180-b1cd-90852a899fb2" containerID="8aded8c22bdc3695b0ea56f1214c3fa755b390d1f77e26a94e7c0990e804261b" exitCode=0 Jun 09 10:59:10.904358 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:10.904350 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c2734ba1-7317-4180-b1cd-90852a899fb2","Type":"ContainerDied","Data":"055131e834e7d40444e68327b756f224461688a8024808b8ed297ac918963324"} Jun 09 10:59:10.904655 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:10.904416 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c2734ba1-7317-4180-b1cd-90852a899fb2","Type":"ContainerDied","Data":"8ae2095ae439de9b4f7fd9f95fbcda69171cad378ca7505707b740fb2a294efa"} Jun 09 10:59:10.904655 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:10.904441 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c2734ba1-7317-4180-b1cd-90852a899fb2","Type":"ContainerDied","Data":"c07c7a53fa65a5a20319905bd53c9acd764912684e84a74d1978165f96512b0e"} Jun 09 10:59:10.904655 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:10.904466 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c2734ba1-7317-4180-b1cd-90852a899fb2","Type":"ContainerDied","Data":"7935fe0c09b32ae5cf3ab020bcd7da41c7bbced5679e59195369bd25e0661c0f"} Jun 09 10:59:10.904655 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:10.904491 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c2734ba1-7317-4180-b1cd-90852a899fb2","Type":"ContainerDied","Data":"8aded8c22bdc3695b0ea56f1214c3fa755b390d1f77e26a94e7c0990e804261b"} Jun 09 10:59:11.754736 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.754715 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:11.786415 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.786397 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c2734ba1-7317-4180-b1cd-90852a899fb2-web-config\") pod \"c2734ba1-7317-4180-b1cd-90852a899fb2\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " Jun 09 10:59:11.786539 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.786452 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c2734ba1-7317-4180-b1cd-90852a899fb2-prometheus-k8s-rulefiles-2\") pod \"c2734ba1-7317-4180-b1cd-90852a899fb2\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " Jun 09 10:59:11.786539 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.786477 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c2734ba1-7317-4180-b1cd-90852a899fb2-secret-grpc-tls\") pod \"c2734ba1-7317-4180-b1cd-90852a899fb2\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " Jun 09 10:59:11.786539 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.786505 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c2734ba1-7317-4180-b1cd-90852a899fb2-prometheus-k8s-rulefiles-0\") pod \"c2734ba1-7317-4180-b1cd-90852a899fb2\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " Jun 09 10:59:11.786764 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.786557 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2734ba1-7317-4180-b1cd-90852a899fb2-configmap-metrics-client-ca\") pod \"c2734ba1-7317-4180-b1cd-90852a899fb2\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " Jun 09 10:59:11.786764 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.786582 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2734ba1-7317-4180-b1cd-90852a899fb2-configmap-serving-certs-ca-bundle\") pod \"c2734ba1-7317-4180-b1cd-90852a899fb2\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " Jun 09 10:59:11.786764 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.786625 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c2734ba1-7317-4180-b1cd-90852a899fb2-config\") pod \"c2734ba1-7317-4180-b1cd-90852a899fb2\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " Jun 09 10:59:11.786764 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.786653 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2734ba1-7317-4180-b1cd-90852a899fb2-prometheus-trusted-ca-bundle\") pod \"c2734ba1-7317-4180-b1cd-90852a899fb2\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " Jun 09 10:59:11.786764 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.786687 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c2734ba1-7317-4180-b1cd-90852a899fb2-prometheus-k8s-db\") pod \"c2734ba1-7317-4180-b1cd-90852a899fb2\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " Jun 09 10:59:11.786764 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.786714 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c2734ba1-7317-4180-b1cd-90852a899fb2-secret-kube-rbac-proxy\") pod \"c2734ba1-7317-4180-b1cd-90852a899fb2\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " Jun 09 10:59:11.786764 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.786743 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c2734ba1-7317-4180-b1cd-90852a899fb2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"c2734ba1-7317-4180-b1cd-90852a899fb2\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " Jun 09 10:59:11.787113 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.786779 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2bzgj\" (UniqueName: \"kubernetes.io/projected/c2734ba1-7317-4180-b1cd-90852a899fb2-kube-api-access-2bzgj\") pod \"c2734ba1-7317-4180-b1cd-90852a899fb2\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " Jun 09 10:59:11.787113 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.786804 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c2734ba1-7317-4180-b1cd-90852a899fb2-thanos-prometheus-http-client-file\") pod \"c2734ba1-7317-4180-b1cd-90852a899fb2\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " Jun 09 10:59:11.787113 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.786802 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2734ba1-7317-4180-b1cd-90852a899fb2-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "c2734ba1-7317-4180-b1cd-90852a899fb2" (UID: "c2734ba1-7317-4180-b1cd-90852a899fb2"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 10:59:11.787113 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.786837 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c2734ba1-7317-4180-b1cd-90852a899fb2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"c2734ba1-7317-4180-b1cd-90852a899fb2\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " Jun 09 10:59:11.787113 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.786861 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c2734ba1-7317-4180-b1cd-90852a899fb2-config-out\") pod \"c2734ba1-7317-4180-b1cd-90852a899fb2\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " Jun 09 10:59:11.787113 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.786897 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c2734ba1-7317-4180-b1cd-90852a899fb2-prometheus-k8s-rulefiles-1\") pod \"c2734ba1-7317-4180-b1cd-90852a899fb2\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " Jun 09 10:59:11.787113 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.786930 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2734ba1-7317-4180-b1cd-90852a899fb2-configmap-kubelet-serving-ca-bundle\") pod \"c2734ba1-7317-4180-b1cd-90852a899fb2\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " Jun 09 10:59:11.787113 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.786956 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c2734ba1-7317-4180-b1cd-90852a899fb2-secret-prometheus-k8s-tls\") pod \"c2734ba1-7317-4180-b1cd-90852a899fb2\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " Jun 09 10:59:11.787113 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.786997 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c2734ba1-7317-4180-b1cd-90852a899fb2-tls-assets\") pod \"c2734ba1-7317-4180-b1cd-90852a899fb2\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " Jun 09 10:59:11.787113 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.787024 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c2734ba1-7317-4180-b1cd-90852a899fb2-secret-metrics-client-certs\") pod \"c2734ba1-7317-4180-b1cd-90852a899fb2\" (UID: \"c2734ba1-7317-4180-b1cd-90852a899fb2\") " Jun 09 10:59:11.787599 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.787263 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c2734ba1-7317-4180-b1cd-90852a899fb2-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-136-7.ec2.internal\" DevicePath \"\"" Jun 09 10:59:11.789634 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.787932 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2734ba1-7317-4180-b1cd-90852a899fb2-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "c2734ba1-7317-4180-b1cd-90852a899fb2" (UID: "c2734ba1-7317-4180-b1cd-90852a899fb2"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 10:59:11.789634 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.788161 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2734ba1-7317-4180-b1cd-90852a899fb2-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "c2734ba1-7317-4180-b1cd-90852a899fb2" (UID: "c2734ba1-7317-4180-b1cd-90852a899fb2"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 10:59:11.789634 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.789277 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2734ba1-7317-4180-b1cd-90852a899fb2-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "c2734ba1-7317-4180-b1cd-90852a899fb2" (UID: "c2734ba1-7317-4180-b1cd-90852a899fb2"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 10:59:11.789634 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.789500 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2734ba1-7317-4180-b1cd-90852a899fb2-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "c2734ba1-7317-4180-b1cd-90852a899fb2" (UID: "c2734ba1-7317-4180-b1cd-90852a899fb2"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 10:59:11.789634 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.789529 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2734ba1-7317-4180-b1cd-90852a899fb2-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "c2734ba1-7317-4180-b1cd-90852a899fb2" (UID: "c2734ba1-7317-4180-b1cd-90852a899fb2"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 10:59:11.789634 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.789580 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2734ba1-7317-4180-b1cd-90852a899fb2-config" (OuterVolumeSpecName: "config") pod "c2734ba1-7317-4180-b1cd-90852a899fb2" (UID: "c2734ba1-7317-4180-b1cd-90852a899fb2"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 10:59:11.790680 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.790386 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2734ba1-7317-4180-b1cd-90852a899fb2-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "c2734ba1-7317-4180-b1cd-90852a899fb2" (UID: "c2734ba1-7317-4180-b1cd-90852a899fb2"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 10:59:11.790680 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.790423 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2734ba1-7317-4180-b1cd-90852a899fb2-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "c2734ba1-7317-4180-b1cd-90852a899fb2" (UID: "c2734ba1-7317-4180-b1cd-90852a899fb2"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 10:59:11.791467 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.791178 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2734ba1-7317-4180-b1cd-90852a899fb2-config-out" (OuterVolumeSpecName: "config-out") pod "c2734ba1-7317-4180-b1cd-90852a899fb2" (UID: "c2734ba1-7317-4180-b1cd-90852a899fb2"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 10:59:11.792995 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.791828 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2734ba1-7317-4180-b1cd-90852a899fb2-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "c2734ba1-7317-4180-b1cd-90852a899fb2" (UID: "c2734ba1-7317-4180-b1cd-90852a899fb2"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 10:59:11.793118 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.793032 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2734ba1-7317-4180-b1cd-90852a899fb2-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "c2734ba1-7317-4180-b1cd-90852a899fb2" (UID: "c2734ba1-7317-4180-b1cd-90852a899fb2"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 10:59:11.793457 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.793434 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2734ba1-7317-4180-b1cd-90852a899fb2-kube-api-access-2bzgj" (OuterVolumeSpecName: "kube-api-access-2bzgj") pod "c2734ba1-7317-4180-b1cd-90852a899fb2" (UID: "c2734ba1-7317-4180-b1cd-90852a899fb2"). InnerVolumeSpecName "kube-api-access-2bzgj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 10:59:11.794080 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.794043 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2734ba1-7317-4180-b1cd-90852a899fb2-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "c2734ba1-7317-4180-b1cd-90852a899fb2" (UID: "c2734ba1-7317-4180-b1cd-90852a899fb2"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 10:59:11.794387 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.794355 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2734ba1-7317-4180-b1cd-90852a899fb2-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "c2734ba1-7317-4180-b1cd-90852a899fb2" (UID: "c2734ba1-7317-4180-b1cd-90852a899fb2"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 10:59:11.795567 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.795537 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2734ba1-7317-4180-b1cd-90852a899fb2-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "c2734ba1-7317-4180-b1cd-90852a899fb2" (UID: "c2734ba1-7317-4180-b1cd-90852a899fb2"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 10:59:11.795966 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.795939 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2734ba1-7317-4180-b1cd-90852a899fb2-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "c2734ba1-7317-4180-b1cd-90852a899fb2" (UID: "c2734ba1-7317-4180-b1cd-90852a899fb2"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 10:59:11.796096 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.796046 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2734ba1-7317-4180-b1cd-90852a899fb2-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "c2734ba1-7317-4180-b1cd-90852a899fb2" (UID: "c2734ba1-7317-4180-b1cd-90852a899fb2"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 10:59:11.796158 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.796123 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2734ba1-7317-4180-b1cd-90852a899fb2-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "c2734ba1-7317-4180-b1cd-90852a899fb2" (UID: "c2734ba1-7317-4180-b1cd-90852a899fb2"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 10:59:11.806939 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.806907 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2734ba1-7317-4180-b1cd-90852a899fb2-web-config" (OuterVolumeSpecName: "web-config") pod "c2734ba1-7317-4180-b1cd-90852a899fb2" (UID: "c2734ba1-7317-4180-b1cd-90852a899fb2"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 10:59:11.887998 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.887946 2562 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2734ba1-7317-4180-b1cd-90852a899fb2-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-136-7.ec2.internal\" DevicePath \"\"" Jun 09 10:59:11.887998 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.887968 2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c2734ba1-7317-4180-b1cd-90852a899fb2-secret-prometheus-k8s-tls\") on node \"ip-10-0-136-7.ec2.internal\" DevicePath \"\"" Jun 09 10:59:11.887998 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.887979 2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c2734ba1-7317-4180-b1cd-90852a899fb2-tls-assets\") on node \"ip-10-0-136-7.ec2.internal\" DevicePath \"\"" Jun 09 10:59:11.887998 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.887987 2562 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c2734ba1-7317-4180-b1cd-90852a899fb2-secret-metrics-client-certs\") on node \"ip-10-0-136-7.ec2.internal\" DevicePath \"\"" Jun 09 10:59:11.887998 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.887996 2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c2734ba1-7317-4180-b1cd-90852a899fb2-web-config\") on node \"ip-10-0-136-7.ec2.internal\" DevicePath \"\"" Jun 09 10:59:11.888193 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.888003 2562 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c2734ba1-7317-4180-b1cd-90852a899fb2-secret-grpc-tls\") on node \"ip-10-0-136-7.ec2.internal\" DevicePath \"\"" Jun 09 10:59:11.888193 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.888011 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c2734ba1-7317-4180-b1cd-90852a899fb2-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-136-7.ec2.internal\" DevicePath \"\"" Jun 09 10:59:11.888193 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.888019 2562 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2734ba1-7317-4180-b1cd-90852a899fb2-configmap-metrics-client-ca\") on node \"ip-10-0-136-7.ec2.internal\" DevicePath \"\"" Jun 09 10:59:11.888193 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.888029 2562 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2734ba1-7317-4180-b1cd-90852a899fb2-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-136-7.ec2.internal\" DevicePath \"\"" Jun 09 10:59:11.888193 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.888037 2562 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/c2734ba1-7317-4180-b1cd-90852a899fb2-config\") on node \"ip-10-0-136-7.ec2.internal\" DevicePath \"\"" Jun 09 10:59:11.888193 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.888045 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2734ba1-7317-4180-b1cd-90852a899fb2-prometheus-trusted-ca-bundle\") on node \"ip-10-0-136-7.ec2.internal\" DevicePath \"\"" Jun 09 10:59:11.888193 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.888053 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c2734ba1-7317-4180-b1cd-90852a899fb2-prometheus-k8s-db\") on node \"ip-10-0-136-7.ec2.internal\" DevicePath \"\"" Jun 09 10:59:11.888193 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.888061 2562 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c2734ba1-7317-4180-b1cd-90852a899fb2-secret-kube-rbac-proxy\") on node \"ip-10-0-136-7.ec2.internal\" DevicePath \"\"" Jun 09 10:59:11.888193 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.888070 2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c2734ba1-7317-4180-b1cd-90852a899fb2-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-136-7.ec2.internal\" DevicePath \"\"" Jun 09 10:59:11.888193 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.888078 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2bzgj\" (UniqueName: \"kubernetes.io/projected/c2734ba1-7317-4180-b1cd-90852a899fb2-kube-api-access-2bzgj\") on node \"ip-10-0-136-7.ec2.internal\" DevicePath \"\"" Jun 09 10:59:11.888193 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.888086 2562 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c2734ba1-7317-4180-b1cd-90852a899fb2-thanos-prometheus-http-client-file\") on node \"ip-10-0-136-7.ec2.internal\" DevicePath \"\"" Jun 09 10:59:11.888193 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.888095 2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c2734ba1-7317-4180-b1cd-90852a899fb2-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-136-7.ec2.internal\" DevicePath \"\"" Jun 09 10:59:11.888193 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.888103 2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c2734ba1-7317-4180-b1cd-90852a899fb2-config-out\") on node \"ip-10-0-136-7.ec2.internal\" DevicePath \"\"" Jun 09 10:59:11.888193 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.888110 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c2734ba1-7317-4180-b1cd-90852a899fb2-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-136-7.ec2.internal\" DevicePath \"\"" Jun 09 10:59:11.911256 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.911232 2562 generic.go:356] "Generic (PLEG): container finished" podID="c2734ba1-7317-4180-b1cd-90852a899fb2" containerID="9234378d23f3daf34aa9e2e556d1e60432eef029ffa13d5f7ee655559db919b1" exitCode=0 Jun 09 10:59:11.911337 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.911310 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c2734ba1-7317-4180-b1cd-90852a899fb2","Type":"ContainerDied","Data":"9234378d23f3daf34aa9e2e556d1e60432eef029ffa13d5f7ee655559db919b1"} Jun 09 10:59:11.911374 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.911362 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:11.911407 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.911375 2562 scope.go:117] "RemoveContainer" containerID="055131e834e7d40444e68327b756f224461688a8024808b8ed297ac918963324" Jun 09 10:59:11.911535 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.911365 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c2734ba1-7317-4180-b1cd-90852a899fb2","Type":"ContainerDied","Data":"6646f568680952af5569715eb35fdfcf8408877d99a3974b1e24e394e12ee4a0"} Jun 09 10:59:11.918826 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.918792 2562 scope.go:117] "RemoveContainer" containerID="8ae2095ae439de9b4f7fd9f95fbcda69171cad378ca7505707b740fb2a294efa" Jun 09 10:59:11.925535 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.925520 2562 scope.go:117] "RemoveContainer" containerID="9234378d23f3daf34aa9e2e556d1e60432eef029ffa13d5f7ee655559db919b1" Jun 09 10:59:11.932005 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.931986 2562 scope.go:117] "RemoveContainer" containerID="c07c7a53fa65a5a20319905bd53c9acd764912684e84a74d1978165f96512b0e" Jun 09 10:59:11.935774 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.935755 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 10:59:11.939812 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.939764 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 10:59:11.939865 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.939835 2562 scope.go:117] "RemoveContainer" containerID="7935fe0c09b32ae5cf3ab020bcd7da41c7bbced5679e59195369bd25e0661c0f" Jun 09 10:59:11.946368 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.946353 2562 scope.go:117] "RemoveContainer" containerID="8aded8c22bdc3695b0ea56f1214c3fa755b390d1f77e26a94e7c0990e804261b" Jun 09 10:59:11.953236 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.953221 2562 scope.go:117] "RemoveContainer" containerID="b8fcc1699c067f374aeb01f22bd59f86101a8a78d34cc063e10d7906a4bcbd80" Jun 09 10:59:11.959694 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.959674 2562 scope.go:117] "RemoveContainer" containerID="055131e834e7d40444e68327b756f224461688a8024808b8ed297ac918963324" Jun 09 10:59:11.959926 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:59:11.959908 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"055131e834e7d40444e68327b756f224461688a8024808b8ed297ac918963324\": container with ID starting with 055131e834e7d40444e68327b756f224461688a8024808b8ed297ac918963324 not found: ID does not exist" containerID="055131e834e7d40444e68327b756f224461688a8024808b8ed297ac918963324" Jun 09 10:59:11.959976 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.959934 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"055131e834e7d40444e68327b756f224461688a8024808b8ed297ac918963324"} err="failed to get container status \"055131e834e7d40444e68327b756f224461688a8024808b8ed297ac918963324\": rpc error: code = NotFound desc = could not find container \"055131e834e7d40444e68327b756f224461688a8024808b8ed297ac918963324\": container with ID starting with 055131e834e7d40444e68327b756f224461688a8024808b8ed297ac918963324 not found: ID does not exist" Jun 09 10:59:11.959976 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.959951 2562 scope.go:117] "RemoveContainer" containerID="8ae2095ae439de9b4f7fd9f95fbcda69171cad378ca7505707b740fb2a294efa" Jun 09 10:59:11.960159 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:59:11.960144 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ae2095ae439de9b4f7fd9f95fbcda69171cad378ca7505707b740fb2a294efa\": container with ID starting with 8ae2095ae439de9b4f7fd9f95fbcda69171cad378ca7505707b740fb2a294efa not found: ID does not exist" containerID="8ae2095ae439de9b4f7fd9f95fbcda69171cad378ca7505707b740fb2a294efa" Jun 09 10:59:11.960204 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.960162 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ae2095ae439de9b4f7fd9f95fbcda69171cad378ca7505707b740fb2a294efa"} err="failed to get container status \"8ae2095ae439de9b4f7fd9f95fbcda69171cad378ca7505707b740fb2a294efa\": rpc error: code = NotFound desc = could not find container \"8ae2095ae439de9b4f7fd9f95fbcda69171cad378ca7505707b740fb2a294efa\": container with ID starting with 8ae2095ae439de9b4f7fd9f95fbcda69171cad378ca7505707b740fb2a294efa not found: ID does not exist" Jun 09 10:59:11.960204 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.960175 2562 scope.go:117] "RemoveContainer" containerID="9234378d23f3daf34aa9e2e556d1e60432eef029ffa13d5f7ee655559db919b1" Jun 09 10:59:11.960357 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:59:11.960342 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9234378d23f3daf34aa9e2e556d1e60432eef029ffa13d5f7ee655559db919b1\": container with ID starting with 9234378d23f3daf34aa9e2e556d1e60432eef029ffa13d5f7ee655559db919b1 not found: ID does not exist" containerID="9234378d23f3daf34aa9e2e556d1e60432eef029ffa13d5f7ee655559db919b1" Jun 09 10:59:11.960391 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.960359 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9234378d23f3daf34aa9e2e556d1e60432eef029ffa13d5f7ee655559db919b1"} err="failed to get container status \"9234378d23f3daf34aa9e2e556d1e60432eef029ffa13d5f7ee655559db919b1\": rpc error: code = NotFound desc = could not find container \"9234378d23f3daf34aa9e2e556d1e60432eef029ffa13d5f7ee655559db919b1\": container with ID starting with 9234378d23f3daf34aa9e2e556d1e60432eef029ffa13d5f7ee655559db919b1 not found: ID does not exist" Jun 09 10:59:11.960391 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.960371 2562 scope.go:117] "RemoveContainer" containerID="c07c7a53fa65a5a20319905bd53c9acd764912684e84a74d1978165f96512b0e" Jun 09 10:59:11.960626 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:59:11.960578 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c07c7a53fa65a5a20319905bd53c9acd764912684e84a74d1978165f96512b0e\": container with ID starting with c07c7a53fa65a5a20319905bd53c9acd764912684e84a74d1978165f96512b0e not found: ID does not exist" containerID="c07c7a53fa65a5a20319905bd53c9acd764912684e84a74d1978165f96512b0e" Jun 09 10:59:11.960722 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.960626 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c07c7a53fa65a5a20319905bd53c9acd764912684e84a74d1978165f96512b0e"} err="failed to get container status \"c07c7a53fa65a5a20319905bd53c9acd764912684e84a74d1978165f96512b0e\": rpc error: code = NotFound desc = could not find container \"c07c7a53fa65a5a20319905bd53c9acd764912684e84a74d1978165f96512b0e\": container with ID starting with c07c7a53fa65a5a20319905bd53c9acd764912684e84a74d1978165f96512b0e not found: ID does not exist" Jun 09 10:59:11.960722 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.960643 2562 scope.go:117] "RemoveContainer" containerID="7935fe0c09b32ae5cf3ab020bcd7da41c7bbced5679e59195369bd25e0661c0f" Jun 09 10:59:11.960899 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:59:11.960884 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7935fe0c09b32ae5cf3ab020bcd7da41c7bbced5679e59195369bd25e0661c0f\": container with ID starting with 7935fe0c09b32ae5cf3ab020bcd7da41c7bbced5679e59195369bd25e0661c0f not found: ID does not exist" containerID="7935fe0c09b32ae5cf3ab020bcd7da41c7bbced5679e59195369bd25e0661c0f" Jun 09 10:59:11.960962 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.960906 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7935fe0c09b32ae5cf3ab020bcd7da41c7bbced5679e59195369bd25e0661c0f"} err="failed to get container status \"7935fe0c09b32ae5cf3ab020bcd7da41c7bbced5679e59195369bd25e0661c0f\": rpc error: code = NotFound desc = could not find container \"7935fe0c09b32ae5cf3ab020bcd7da41c7bbced5679e59195369bd25e0661c0f\": container with ID starting with 7935fe0c09b32ae5cf3ab020bcd7da41c7bbced5679e59195369bd25e0661c0f not found: ID does not exist" Jun 09 10:59:11.960962 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.960924 2562 scope.go:117] "RemoveContainer" containerID="8aded8c22bdc3695b0ea56f1214c3fa755b390d1f77e26a94e7c0990e804261b" Jun 09 10:59:11.961148 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:59:11.961133 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8aded8c22bdc3695b0ea56f1214c3fa755b390d1f77e26a94e7c0990e804261b\": container with ID starting with 8aded8c22bdc3695b0ea56f1214c3fa755b390d1f77e26a94e7c0990e804261b not found: ID does not exist" containerID="8aded8c22bdc3695b0ea56f1214c3fa755b390d1f77e26a94e7c0990e804261b" Jun 09 10:59:11.961209 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.961154 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8aded8c22bdc3695b0ea56f1214c3fa755b390d1f77e26a94e7c0990e804261b"} err="failed to get container status \"8aded8c22bdc3695b0ea56f1214c3fa755b390d1f77e26a94e7c0990e804261b\": rpc error: code = NotFound desc = could not find container \"8aded8c22bdc3695b0ea56f1214c3fa755b390d1f77e26a94e7c0990e804261b\": container with ID starting with 8aded8c22bdc3695b0ea56f1214c3fa755b390d1f77e26a94e7c0990e804261b not found: ID does not exist" Jun 09 10:59:11.961209 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.961171 2562 scope.go:117] "RemoveContainer" containerID="b8fcc1699c067f374aeb01f22bd59f86101a8a78d34cc063e10d7906a4bcbd80" Jun 09 10:59:11.961393 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:59:11.961377 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8fcc1699c067f374aeb01f22bd59f86101a8a78d34cc063e10d7906a4bcbd80\": container with ID starting with b8fcc1699c067f374aeb01f22bd59f86101a8a78d34cc063e10d7906a4bcbd80 not found: ID does not exist" containerID="b8fcc1699c067f374aeb01f22bd59f86101a8a78d34cc063e10d7906a4bcbd80" Jun 09 10:59:11.961431 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.961400 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8fcc1699c067f374aeb01f22bd59f86101a8a78d34cc063e10d7906a4bcbd80"} err="failed to get container status \"b8fcc1699c067f374aeb01f22bd59f86101a8a78d34cc063e10d7906a4bcbd80\": rpc error: code = NotFound desc = could not find container \"b8fcc1699c067f374aeb01f22bd59f86101a8a78d34cc063e10d7906a4bcbd80\": container with ID starting with b8fcc1699c067f374aeb01f22bd59f86101a8a78d34cc063e10d7906a4bcbd80 not found: ID does not exist" Jun 09 10:59:11.966339 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.966319 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 10:59:11.966617 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.966605 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14da75ba-9dd9-48bc-aa46-9df51710811f" containerName="kube-rbac-proxy-metric" Jun 09 10:59:11.966661 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.966618 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="14da75ba-9dd9-48bc-aa46-9df51710811f" containerName="kube-rbac-proxy-metric" Jun 09 10:59:11.966661 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.966627 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14da75ba-9dd9-48bc-aa46-9df51710811f" containerName="prom-label-proxy" Jun 09 10:59:11.966661 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.966633 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="14da75ba-9dd9-48bc-aa46-9df51710811f" containerName="prom-label-proxy" Jun 09 10:59:11.966661 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.966640 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14da75ba-9dd9-48bc-aa46-9df51710811f" containerName="init-config-reloader" Jun 09 10:59:11.966661 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.966645 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="14da75ba-9dd9-48bc-aa46-9df51710811f" containerName="init-config-reloader" Jun 09 10:59:11.966661 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.966652 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2734ba1-7317-4180-b1cd-90852a899fb2" containerName="prometheus" Jun 09 10:59:11.966661 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.966657 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2734ba1-7317-4180-b1cd-90852a899fb2" containerName="prometheus" Jun 09 10:59:11.966842 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.966664 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2734ba1-7317-4180-b1cd-90852a899fb2" containerName="thanos-sidecar" Jun 09 10:59:11.966842 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.966669 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2734ba1-7317-4180-b1cd-90852a899fb2" containerName="thanos-sidecar" Jun 09 10:59:11.966842 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.966675 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14da75ba-9dd9-48bc-aa46-9df51710811f" containerName="config-reloader" Jun 09 10:59:11.966842 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.966680 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="14da75ba-9dd9-48bc-aa46-9df51710811f" containerName="config-reloader" Jun 09 10:59:11.966842 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.966685 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2734ba1-7317-4180-b1cd-90852a899fb2" containerName="kube-rbac-proxy-web" Jun 09 10:59:11.966842 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.966691 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2734ba1-7317-4180-b1cd-90852a899fb2" containerName="kube-rbac-proxy-web" Jun 09 10:59:11.966842 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.966697 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2734ba1-7317-4180-b1cd-90852a899fb2" containerName="init-config-reloader" Jun 09 10:59:11.966842 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.966703 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2734ba1-7317-4180-b1cd-90852a899fb2" containerName="init-config-reloader" Jun 09 10:59:11.966842 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.966712 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2734ba1-7317-4180-b1cd-90852a899fb2" containerName="kube-rbac-proxy" Jun 09 10:59:11.966842 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.966716 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2734ba1-7317-4180-b1cd-90852a899fb2" containerName="kube-rbac-proxy" Jun 09 10:59:11.966842 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.966722 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14da75ba-9dd9-48bc-aa46-9df51710811f" containerName="kube-rbac-proxy" Jun 09 10:59:11.966842 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.966727 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="14da75ba-9dd9-48bc-aa46-9df51710811f" containerName="kube-rbac-proxy" Jun 09 10:59:11.966842 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.966737 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14da75ba-9dd9-48bc-aa46-9df51710811f" containerName="kube-rbac-proxy-web" Jun 09 10:59:11.966842 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.966743 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="14da75ba-9dd9-48bc-aa46-9df51710811f" containerName="kube-rbac-proxy-web" Jun 09 10:59:11.966842 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.966754 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14da75ba-9dd9-48bc-aa46-9df51710811f" containerName="alertmanager" Jun 09 10:59:11.966842 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.966759 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="14da75ba-9dd9-48bc-aa46-9df51710811f" containerName="alertmanager" Jun 09 10:59:11.966842 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.966764 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2734ba1-7317-4180-b1cd-90852a899fb2" containerName="config-reloader" Jun 09 10:59:11.966842 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.966769 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2734ba1-7317-4180-b1cd-90852a899fb2" containerName="config-reloader" Jun 09 10:59:11.966842 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.966775 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2734ba1-7317-4180-b1cd-90852a899fb2" containerName="kube-rbac-proxy-thanos" Jun 09 10:59:11.966842 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.966780 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2734ba1-7317-4180-b1cd-90852a899fb2" containerName="kube-rbac-proxy-thanos" Jun 09 10:59:11.966842 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.966826 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="14da75ba-9dd9-48bc-aa46-9df51710811f" containerName="kube-rbac-proxy-metric" Jun 09 10:59:11.966842 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.966833 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="14da75ba-9dd9-48bc-aa46-9df51710811f" containerName="alertmanager" Jun 09 10:59:11.966842 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.966840 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2734ba1-7317-4180-b1cd-90852a899fb2" containerName="prometheus" Jun 09 10:59:11.966842 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.966845 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2734ba1-7317-4180-b1cd-90852a899fb2" containerName="kube-rbac-proxy-web" Jun 09 10:59:11.966842 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.966850 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2734ba1-7317-4180-b1cd-90852a899fb2" containerName="kube-rbac-proxy" Jun 09 10:59:11.967492 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.966856 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="14da75ba-9dd9-48bc-aa46-9df51710811f" containerName="kube-rbac-proxy" Jun 09 10:59:11.967492 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.966864 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="14da75ba-9dd9-48bc-aa46-9df51710811f" containerName="prom-label-proxy" Jun 09 10:59:11.967492 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.966869 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2734ba1-7317-4180-b1cd-90852a899fb2" containerName="thanos-sidecar" Jun 09 10:59:11.967492 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.966874 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="14da75ba-9dd9-48bc-aa46-9df51710811f" containerName="kube-rbac-proxy-web" Jun 09 10:59:11.967492 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.966880 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2734ba1-7317-4180-b1cd-90852a899fb2" containerName="config-reloader" Jun 09 10:59:11.967492 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.966885 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="14da75ba-9dd9-48bc-aa46-9df51710811f" containerName="config-reloader" Jun 09 10:59:11.967492 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.966891 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2734ba1-7317-4180-b1cd-90852a899fb2" containerName="kube-rbac-proxy-thanos" Jun 09 10:59:11.970081 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.970051 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:11.972772 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.972752 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 09 10:59:11.972992 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.972975 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 09 10:59:11.973075 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.973043 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 09 10:59:11.973127 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.973113 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rk57d\"" Jun 09 10:59:11.973210 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.973192 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 09 10:59:11.973313 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.973230 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 09 10:59:11.973313 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.973270 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 09 10:59:11.973686 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.973482 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 09 10:59:11.973686 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.973501 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 09 10:59:11.973686 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.973550 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 09 10:59:11.973686 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.973558 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 09 10:59:11.973686 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.973555 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 09 10:59:11.973686 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.973618 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 09 10:59:11.973686 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.973631 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-efm4l8b3f57hn\"" Jun 09 10:59:11.973945 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.973767 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 09 10:59:11.977675 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.977657 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 09 10:59:11.979047 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.979028 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 09 10:59:11.988512 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.988489 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:11.988622 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.988517 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-config-out\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:11.988622 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.988534 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:11.988622 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.988555 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:11.988749 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.988655 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 10:59:11.988749 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.988653 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:11.988749 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.988729 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk8l7\" (UniqueName: \"kubernetes.io/projected/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-kube-api-access-nk8l7\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:11.988857 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.988748 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:11.988857 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.988767 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:11.988857 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.988790 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:11.988857 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.988837 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:11.988857 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.988853 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-web-config\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:11.989028 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.988888 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:11.989028 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.988953 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:11.989028 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.988982 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:11.989028 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.989009 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:11.989169 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.989068 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:11.989169 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.989092 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:11.989169 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.989138 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:11.989169 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.989158 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:11.989320 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:11.989185 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-config\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:12.089946 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:12.089913 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:12.089946 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:12.089947 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:12.090178 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:12.089965 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:12.090178 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:12.089988 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:12.090178 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:12.090010 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:12.090178 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:12.090034 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:12.090178 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:12.090050 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:12.090178 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:12.090071 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-config\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:12.090178 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:12.090100 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:12.090178 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:12.090126 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-config-out\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:12.090178 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:12.090149 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:12.090621 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:12.090185 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:12.090621 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:12.090211 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:12.090621 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:12.090236 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nk8l7\" (UniqueName: \"kubernetes.io/projected/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-kube-api-access-nk8l7\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:12.090621 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:12.090261 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:12.090621 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:12.090282 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:12.090621 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:12.090320 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:12.090621 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:12.090359 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:12.090621 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:12.090383 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-web-config\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:12.090621 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:12.090418 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:12.091113 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:12.090796 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:12.091113 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:12.090839 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:12.091342 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:12.091274 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:12.092248 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:12.091543 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:12.092248 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:12.092059 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:12.092248 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:12.092181 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:12.092522 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:12.092497 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:12.092951 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:12.092928 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-config-out\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:12.093049 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:12.092956 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:12.093320 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:12.093110 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:12.093430 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:12.093403 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:12.094318 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:12.094294 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:12.094776 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:12.094753 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:12.095451 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:12.095426 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:12.095549 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:12.095527 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-config\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:12.095645 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:12.095551 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:12.095710 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:12.095643 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:12.095765 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:12.095727 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:12.095903 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:12.095887 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-web-config\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:12.100943 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:12.100924 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk8l7\" (UniqueName: \"kubernetes.io/projected/6a1521bc-6b6c-4ed7-b0d6-76097aae4495-kube-api-access-nk8l7\") pod \"prometheus-k8s-0\" (UID: \"6a1521bc-6b6c-4ed7-b0d6-76097aae4495\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:12.282323 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:12.282284 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:12.415354 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:12.415318 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 10:59:12.423653 ip-10-0-136-7 kubenswrapper[2562]: W0609 10:59:12.423619 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a1521bc_6b6c_4ed7_b0d6_76097aae4495.slice/crio-b2a41161781277eb1cbd08cedd9ff469d49f8d186f7e9305849df5cdb9e1a76b WatchSource:0}: Error finding container b2a41161781277eb1cbd08cedd9ff469d49f8d186f7e9305849df5cdb9e1a76b: Status 404 returned error can't find the container with id b2a41161781277eb1cbd08cedd9ff469d49f8d186f7e9305849df5cdb9e1a76b Jun 09 10:59:12.597461 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:12.597401 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2734ba1-7317-4180-b1cd-90852a899fb2" path="/var/lib/kubelet/pods/c2734ba1-7317-4180-b1cd-90852a899fb2/volumes" Jun 09 10:59:12.918163 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:12.918093 2562 generic.go:356] "Generic (PLEG): container finished" podID="6a1521bc-6b6c-4ed7-b0d6-76097aae4495" containerID="67e6928157df389a1db0632bfa6f9446ad588d09e494dfbcb33eb281af679710" exitCode=0 Jun 09 10:59:12.918163 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:12.918144 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6a1521bc-6b6c-4ed7-b0d6-76097aae4495","Type":"ContainerDied","Data":"67e6928157df389a1db0632bfa6f9446ad588d09e494dfbcb33eb281af679710"} Jun 09 10:59:12.918512 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:12.918208 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6a1521bc-6b6c-4ed7-b0d6-76097aae4495","Type":"ContainerStarted","Data":"b2a41161781277eb1cbd08cedd9ff469d49f8d186f7e9305849df5cdb9e1a76b"} Jun 09 10:59:13.925904 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:13.925866 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6a1521bc-6b6c-4ed7-b0d6-76097aae4495","Type":"ContainerStarted","Data":"a7246de1290c083376a12bebc661ecde6009137edd34f2ca47f419d5be0b81a7"} Jun 09 10:59:13.926315 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:13.925929 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6a1521bc-6b6c-4ed7-b0d6-76097aae4495","Type":"ContainerStarted","Data":"05c47668b793e0c86a927d61eb6ba12142c0f388b518dafa90fe0aae6344d6c1"} Jun 09 10:59:13.926315 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:13.925956 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6a1521bc-6b6c-4ed7-b0d6-76097aae4495","Type":"ContainerStarted","Data":"ca23293b418cdc5c11ed8f134a07d5d6e52b6c899cf83421068fb9c1787fa0f6"} Jun 09 10:59:13.926315 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:13.925986 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6a1521bc-6b6c-4ed7-b0d6-76097aae4495","Type":"ContainerStarted","Data":"2033400b5130e33722589ea39c9b06e66a389c6e467879d9171147cc98178fab"} Jun 09 10:59:13.926315 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:13.926011 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6a1521bc-6b6c-4ed7-b0d6-76097aae4495","Type":"ContainerStarted","Data":"fa927c6004e77462b6f3f353b436a5e378c0c0483ead4b0f5fb21322c00b1498"} Jun 09 10:59:13.926315 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:13.926032 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6a1521bc-6b6c-4ed7-b0d6-76097aae4495","Type":"ContainerStarted","Data":"018da904c805c9dc4c0dd2eb68523777908e573ed727c4646a9af5a79b530115"} Jun 09 10:59:13.962239 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:13.962155 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.940329149 podStartE2EDuration="2.962140748s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.811599ms" isStatefulPod=false podCreationTimestamp="2026-06-09 10:59:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:59:13.959965729 +0000 UTC m=+343.824205556" watchObservedRunningTime="2026-06-09 10:59:13.962140748 +0000 UTC m=+343.826380575" Jun 09 10:59:17.282936 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:17.282905 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 10:59:25.982976 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:25.982914 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6ddd8f7d48-bv2x5" podUID="07db5071-a553-482a-8d61-beccf9aa2f34" containerName="registry" containerID="cri-o://7d3ca623531d6ca89b4ad327cbd3825a9603a7fed57cc9cdff21543aa7ba2032" gracePeriod=30 Jun 09 10:59:26.227185 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:26.227163 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6ddd8f7d48-bv2x5" Jun 09 10:59:26.296949 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:26.296871 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/07db5071-a553-482a-8d61-beccf9aa2f34-ca-trust-extracted\") pod \"07db5071-a553-482a-8d61-beccf9aa2f34\" (UID: \"07db5071-a553-482a-8d61-beccf9aa2f34\") " Jun 09 10:59:26.296949 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:26.296920 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkwr9\" (UniqueName: \"kubernetes.io/projected/07db5071-a553-482a-8d61-beccf9aa2f34-kube-api-access-pkwr9\") pod \"07db5071-a553-482a-8d61-beccf9aa2f34\" (UID: \"07db5071-a553-482a-8d61-beccf9aa2f34\") " Jun 09 10:59:26.296949 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:26.296937 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/07db5071-a553-482a-8d61-beccf9aa2f34-bound-sa-token\") pod \"07db5071-a553-482a-8d61-beccf9aa2f34\" (UID: \"07db5071-a553-482a-8d61-beccf9aa2f34\") " Jun 09 10:59:26.297223 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:26.296963 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/07db5071-a553-482a-8d61-beccf9aa2f34-registry-certificates\") pod \"07db5071-a553-482a-8d61-beccf9aa2f34\" (UID: \"07db5071-a553-482a-8d61-beccf9aa2f34\") " Jun 09 10:59:26.297223 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:26.296979 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/07db5071-a553-482a-8d61-beccf9aa2f34-installation-pull-secrets\") pod \"07db5071-a553-482a-8d61-beccf9aa2f34\" (UID: \"07db5071-a553-482a-8d61-beccf9aa2f34\") " Jun 09 10:59:26.297223 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:26.297017 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/07db5071-a553-482a-8d61-beccf9aa2f34-registry-tls\") pod \"07db5071-a553-482a-8d61-beccf9aa2f34\" (UID: \"07db5071-a553-482a-8d61-beccf9aa2f34\") " Jun 09 10:59:26.297223 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:26.297061 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/07db5071-a553-482a-8d61-beccf9aa2f34-image-registry-private-configuration\") pod \"07db5071-a553-482a-8d61-beccf9aa2f34\" (UID: \"07db5071-a553-482a-8d61-beccf9aa2f34\") " Jun 09 10:59:26.297223 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:26.297093 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/07db5071-a553-482a-8d61-beccf9aa2f34-trusted-ca\") pod \"07db5071-a553-482a-8d61-beccf9aa2f34\" (UID: \"07db5071-a553-482a-8d61-beccf9aa2f34\") " Jun 09 10:59:26.297573 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:26.297456 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07db5071-a553-482a-8d61-beccf9aa2f34-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "07db5071-a553-482a-8d61-beccf9aa2f34" (UID: "07db5071-a553-482a-8d61-beccf9aa2f34"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 10:59:26.297748 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:26.297678 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07db5071-a553-482a-8d61-beccf9aa2f34-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "07db5071-a553-482a-8d61-beccf9aa2f34" (UID: "07db5071-a553-482a-8d61-beccf9aa2f34"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 10:59:26.299690 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:26.299663 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07db5071-a553-482a-8d61-beccf9aa2f34-kube-api-access-pkwr9" (OuterVolumeSpecName: "kube-api-access-pkwr9") pod "07db5071-a553-482a-8d61-beccf9aa2f34" (UID: "07db5071-a553-482a-8d61-beccf9aa2f34"). InnerVolumeSpecName "kube-api-access-pkwr9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 10:59:26.299807 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:26.299794 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07db5071-a553-482a-8d61-beccf9aa2f34-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "07db5071-a553-482a-8d61-beccf9aa2f34" (UID: "07db5071-a553-482a-8d61-beccf9aa2f34"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 10:59:26.299866 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:26.299817 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07db5071-a553-482a-8d61-beccf9aa2f34-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "07db5071-a553-482a-8d61-beccf9aa2f34" (UID: "07db5071-a553-482a-8d61-beccf9aa2f34"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 10:59:26.299930 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:26.299907 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07db5071-a553-482a-8d61-beccf9aa2f34-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "07db5071-a553-482a-8d61-beccf9aa2f34" (UID: "07db5071-a553-482a-8d61-beccf9aa2f34"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 10:59:26.299989 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:26.299954 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07db5071-a553-482a-8d61-beccf9aa2f34-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "07db5071-a553-482a-8d61-beccf9aa2f34" (UID: "07db5071-a553-482a-8d61-beccf9aa2f34"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 10:59:26.305501 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:26.305480 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07db5071-a553-482a-8d61-beccf9aa2f34-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "07db5071-a553-482a-8d61-beccf9aa2f34" (UID: "07db5071-a553-482a-8d61-beccf9aa2f34"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 10:59:26.398246 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:26.398219 2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/07db5071-a553-482a-8d61-beccf9aa2f34-ca-trust-extracted\") on node \"ip-10-0-136-7.ec2.internal\" DevicePath \"\"" Jun 09 10:59:26.398246 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:26.398242 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkwr9\" (UniqueName: \"kubernetes.io/projected/07db5071-a553-482a-8d61-beccf9aa2f34-kube-api-access-pkwr9\") on node \"ip-10-0-136-7.ec2.internal\" DevicePath \"\"" Jun 09 10:59:26.398385 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:26.398253 2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/07db5071-a553-482a-8d61-beccf9aa2f34-bound-sa-token\") on node \"ip-10-0-136-7.ec2.internal\" DevicePath \"\"" Jun 09 10:59:26.398385 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:26.398262 2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/07db5071-a553-482a-8d61-beccf9aa2f34-registry-certificates\") on node \"ip-10-0-136-7.ec2.internal\" DevicePath \"\"" Jun 09 10:59:26.398385 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:26.398270 2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/07db5071-a553-482a-8d61-beccf9aa2f34-installation-pull-secrets\") on node \"ip-10-0-136-7.ec2.internal\" DevicePath \"\"" Jun 09 10:59:26.398385 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:26.398278 2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/07db5071-a553-482a-8d61-beccf9aa2f34-registry-tls\") on node \"ip-10-0-136-7.ec2.internal\" DevicePath \"\"" Jun 09 10:59:26.398385 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:26.398288 2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/07db5071-a553-482a-8d61-beccf9aa2f34-image-registry-private-configuration\") on node \"ip-10-0-136-7.ec2.internal\" DevicePath \"\"" Jun 09 10:59:26.398385 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:26.398296 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/07db5071-a553-482a-8d61-beccf9aa2f34-trusted-ca\") on node \"ip-10-0-136-7.ec2.internal\" DevicePath \"\"" Jun 09 10:59:26.979495 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:26.979456 2562 generic.go:356] "Generic (PLEG): container finished" podID="07db5071-a553-482a-8d61-beccf9aa2f34" containerID="7d3ca623531d6ca89b4ad327cbd3825a9603a7fed57cc9cdff21543aa7ba2032" exitCode=0 Jun 09 10:59:26.979645 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:26.979516 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6ddd8f7d48-bv2x5" Jun 09 10:59:26.979645 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:26.979545 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6ddd8f7d48-bv2x5" event={"ID":"07db5071-a553-482a-8d61-beccf9aa2f34","Type":"ContainerDied","Data":"7d3ca623531d6ca89b4ad327cbd3825a9603a7fed57cc9cdff21543aa7ba2032"} Jun 09 10:59:26.979645 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:26.979612 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6ddd8f7d48-bv2x5" event={"ID":"07db5071-a553-482a-8d61-beccf9aa2f34","Type":"ContainerDied","Data":"8c438a660f949c605f55291542fd74c22e4e739ae28acff0855bce97e6333448"} Jun 09 10:59:26.979645 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:26.979636 2562 scope.go:117] "RemoveContainer" containerID="7d3ca623531d6ca89b4ad327cbd3825a9603a7fed57cc9cdff21543aa7ba2032" Jun 09 10:59:26.987982 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:26.987829 2562 scope.go:117] "RemoveContainer" containerID="7d3ca623531d6ca89b4ad327cbd3825a9603a7fed57cc9cdff21543aa7ba2032" Jun 09 10:59:26.988190 ip-10-0-136-7 kubenswrapper[2562]: E0609 10:59:26.988087 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d3ca623531d6ca89b4ad327cbd3825a9603a7fed57cc9cdff21543aa7ba2032\": container with ID starting with 7d3ca623531d6ca89b4ad327cbd3825a9603a7fed57cc9cdff21543aa7ba2032 not found: ID does not exist" containerID="7d3ca623531d6ca89b4ad327cbd3825a9603a7fed57cc9cdff21543aa7ba2032" Jun 09 10:59:26.988190 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:26.988117 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d3ca623531d6ca89b4ad327cbd3825a9603a7fed57cc9cdff21543aa7ba2032"} err="failed to get container status \"7d3ca623531d6ca89b4ad327cbd3825a9603a7fed57cc9cdff21543aa7ba2032\": rpc error: code = NotFound desc = could not find container \"7d3ca623531d6ca89b4ad327cbd3825a9603a7fed57cc9cdff21543aa7ba2032\": container with ID starting with 7d3ca623531d6ca89b4ad327cbd3825a9603a7fed57cc9cdff21543aa7ba2032 not found: ID does not exist" Jun 09 10:59:26.998798 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:26.998778 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6ddd8f7d48-bv2x5"] Jun 09 10:59:27.002563 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:27.002542 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6ddd8f7d48-bv2x5"] Jun 09 10:59:28.598067 ip-10-0-136-7 kubenswrapper[2562]: I0609 10:59:28.598033 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07db5071-a553-482a-8d61-beccf9aa2f34" path="/var/lib/kubelet/pods/07db5071-a553-482a-8d61-beccf9aa2f34/volumes" Jun 09 11:00:12.282752 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:00:12.282721 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:00:12.297403 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:00:12.297378 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:00:13.180360 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:00:13.180329 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:00:58.903239 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:00:58.903167 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c6g5j"] Jun 09 11:00:58.903694 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:00:58.903477 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07db5071-a553-482a-8d61-beccf9aa2f34" containerName="registry" Jun 09 11:00:58.903694 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:00:58.903487 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="07db5071-a553-482a-8d61-beccf9aa2f34" containerName="registry" Jun 09 11:00:58.903694 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:00:58.903550 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="07db5071-a553-482a-8d61-beccf9aa2f34" containerName="registry" Jun 09 11:00:58.905713 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:00:58.905695 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c6g5j" Jun 09 11:00:58.908743 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:00:58.908726 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 09 11:00:58.909746 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:00:58.909729 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 09 11:00:58.909809 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:00:58.909740 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-vs5p9\"" Jun 09 11:00:58.917635 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:00:58.917615 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c6g5j"] Jun 09 11:00:59.012866 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:00:59.012842 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/add2df87-c6ea-4d07-a463-f0d795cfbb01-tmp\") pod \"openshift-lws-operator-fd8ccff4c-c6g5j\" (UID: \"add2df87-c6ea-4d07-a463-f0d795cfbb01\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c6g5j" Jun 09 11:00:59.012979 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:00:59.012884 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp2cw\" (UniqueName: \"kubernetes.io/projected/add2df87-c6ea-4d07-a463-f0d795cfbb01-kube-api-access-tp2cw\") pod \"openshift-lws-operator-fd8ccff4c-c6g5j\" (UID: \"add2df87-c6ea-4d07-a463-f0d795cfbb01\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c6g5j" Jun 09 11:00:59.113521 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:00:59.113487 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/add2df87-c6ea-4d07-a463-f0d795cfbb01-tmp\") pod \"openshift-lws-operator-fd8ccff4c-c6g5j\" (UID: \"add2df87-c6ea-4d07-a463-f0d795cfbb01\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c6g5j" Jun 09 11:00:59.113628 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:00:59.113536 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tp2cw\" (UniqueName: \"kubernetes.io/projected/add2df87-c6ea-4d07-a463-f0d795cfbb01-kube-api-access-tp2cw\") pod \"openshift-lws-operator-fd8ccff4c-c6g5j\" (UID: \"add2df87-c6ea-4d07-a463-f0d795cfbb01\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c6g5j" Jun 09 11:00:59.113854 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:00:59.113837 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/add2df87-c6ea-4d07-a463-f0d795cfbb01-tmp\") pod \"openshift-lws-operator-fd8ccff4c-c6g5j\" (UID: \"add2df87-c6ea-4d07-a463-f0d795cfbb01\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c6g5j" Jun 09 11:00:59.122410 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:00:59.122388 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp2cw\" (UniqueName: \"kubernetes.io/projected/add2df87-c6ea-4d07-a463-f0d795cfbb01-kube-api-access-tp2cw\") pod \"openshift-lws-operator-fd8ccff4c-c6g5j\" (UID: \"add2df87-c6ea-4d07-a463-f0d795cfbb01\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c6g5j" Jun 09 11:00:59.237614 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:00:59.237580 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c6g5j" Jun 09 11:00:59.360923 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:00:59.360901 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c6g5j"] Jun 09 11:00:59.363228 ip-10-0-136-7 kubenswrapper[2562]: W0609 11:00:59.363197 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podadd2df87_c6ea_4d07_a463_f0d795cfbb01.slice/crio-6c0104e58ef979da7d7746eecf745968f03f5266b86b515220f4d0ccc5eeac22 WatchSource:0}: Error finding container 6c0104e58ef979da7d7746eecf745968f03f5266b86b515220f4d0ccc5eeac22: Status 404 returned error can't find the container with id 6c0104e58ef979da7d7746eecf745968f03f5266b86b515220f4d0ccc5eeac22 Jun 09 11:00:59.364602 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:00:59.364567 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 11:01:00.351763 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:00.351726 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c6g5j" event={"ID":"add2df87-c6ea-4d07-a463-f0d795cfbb01","Type":"ContainerStarted","Data":"6c0104e58ef979da7d7746eecf745968f03f5266b86b515220f4d0ccc5eeac22"} Jun 09 11:01:03.367105 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:03.367067 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c6g5j" event={"ID":"add2df87-c6ea-4d07-a463-f0d795cfbb01","Type":"ContainerStarted","Data":"4378a48c285e55ba2f20bf61bdfe7c43f2efd5fb7c30e66f3e2cc08f8c56e067"} Jun 09 11:01:03.385278 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:03.385229 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c6g5j" podStartSLOduration=2.255538401 podStartE2EDuration="5.385215043s" totalImagesPullingTime="3.129676642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:00:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:01:03.383803437 +0000 UTC m=+453.248043269" watchObservedRunningTime="2026-06-09 11:01:03.385215043 +0000 UTC m=+453.249454871" Jun 09 11:01:19.687315 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:19.687282 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d4c99d649-qktjc"] Jun 09 11:01:19.689981 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:19.689963 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d4c99d649-qktjc" Jun 09 11:01:19.693419 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:19.693380 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 09 11:01:19.693745 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:19.693711 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 09 11:01:19.693862 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:19.693451 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 09 11:01:19.693862 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:19.693536 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 09 11:01:19.693994 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:19.693499 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-f88ll\"" Jun 09 11:01:19.714949 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:19.714924 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d4c99d649-qktjc"] Jun 09 11:01:19.771264 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:19.771237 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/16d44d87-1e76-4f09-b227-9af81cce6ae0-manifests\") pod \"opendatahub-operator-controller-manager-d4c99d649-qktjc\" (UID: \"16d44d87-1e76-4f09-b227-9af81cce6ae0\") " pod="opendatahub/opendatahub-operator-controller-manager-d4c99d649-qktjc" Jun 09 11:01:19.771418 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:19.771273 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/16d44d87-1e76-4f09-b227-9af81cce6ae0-tmp\") pod \"opendatahub-operator-controller-manager-d4c99d649-qktjc\" (UID: \"16d44d87-1e76-4f09-b227-9af81cce6ae0\") " pod="opendatahub/opendatahub-operator-controller-manager-d4c99d649-qktjc" Jun 09 11:01:19.771418 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:19.771314 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mqlw\" (UniqueName: \"kubernetes.io/projected/16d44d87-1e76-4f09-b227-9af81cce6ae0-kube-api-access-8mqlw\") pod \"opendatahub-operator-controller-manager-d4c99d649-qktjc\" (UID: \"16d44d87-1e76-4f09-b227-9af81cce6ae0\") " pod="opendatahub/opendatahub-operator-controller-manager-d4c99d649-qktjc" Jun 09 11:01:19.771418 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:19.771408 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/16d44d87-1e76-4f09-b227-9af81cce6ae0-webhook-cert\") pod \"opendatahub-operator-controller-manager-d4c99d649-qktjc\" (UID: \"16d44d87-1e76-4f09-b227-9af81cce6ae0\") " pod="opendatahub/opendatahub-operator-controller-manager-d4c99d649-qktjc" Jun 09 11:01:19.771560 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:19.771454 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/16d44d87-1e76-4f09-b227-9af81cce6ae0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d4c99d649-qktjc\" (UID: \"16d44d87-1e76-4f09-b227-9af81cce6ae0\") " pod="opendatahub/opendatahub-operator-controller-manager-d4c99d649-qktjc" Jun 09 11:01:19.872737 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:19.872710 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mqlw\" (UniqueName: \"kubernetes.io/projected/16d44d87-1e76-4f09-b227-9af81cce6ae0-kube-api-access-8mqlw\") pod \"opendatahub-operator-controller-manager-d4c99d649-qktjc\" (UID: \"16d44d87-1e76-4f09-b227-9af81cce6ae0\") " pod="opendatahub/opendatahub-operator-controller-manager-d4c99d649-qktjc" Jun 09 11:01:19.872874 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:19.872752 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/16d44d87-1e76-4f09-b227-9af81cce6ae0-webhook-cert\") pod \"opendatahub-operator-controller-manager-d4c99d649-qktjc\" (UID: \"16d44d87-1e76-4f09-b227-9af81cce6ae0\") " pod="opendatahub/opendatahub-operator-controller-manager-d4c99d649-qktjc" Jun 09 11:01:19.872874 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:19.872772 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/16d44d87-1e76-4f09-b227-9af81cce6ae0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d4c99d649-qktjc\" (UID: \"16d44d87-1e76-4f09-b227-9af81cce6ae0\") " pod="opendatahub/opendatahub-operator-controller-manager-d4c99d649-qktjc" Jun 09 11:01:19.872874 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:19.872804 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/16d44d87-1e76-4f09-b227-9af81cce6ae0-manifests\") pod \"opendatahub-operator-controller-manager-d4c99d649-qktjc\" (UID: \"16d44d87-1e76-4f09-b227-9af81cce6ae0\") " pod="opendatahub/opendatahub-operator-controller-manager-d4c99d649-qktjc" Jun 09 11:01:19.872874 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:19.872823 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/16d44d87-1e76-4f09-b227-9af81cce6ae0-tmp\") pod \"opendatahub-operator-controller-manager-d4c99d649-qktjc\" (UID: \"16d44d87-1e76-4f09-b227-9af81cce6ae0\") " pod="opendatahub/opendatahub-operator-controller-manager-d4c99d649-qktjc" Jun 09 11:01:19.873156 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:19.873137 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/16d44d87-1e76-4f09-b227-9af81cce6ae0-manifests\") pod \"opendatahub-operator-controller-manager-d4c99d649-qktjc\" (UID: \"16d44d87-1e76-4f09-b227-9af81cce6ae0\") " pod="opendatahub/opendatahub-operator-controller-manager-d4c99d649-qktjc" Jun 09 11:01:19.875177 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:19.875144 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/16d44d87-1e76-4f09-b227-9af81cce6ae0-tmp\") pod \"opendatahub-operator-controller-manager-d4c99d649-qktjc\" (UID: \"16d44d87-1e76-4f09-b227-9af81cce6ae0\") " pod="opendatahub/opendatahub-operator-controller-manager-d4c99d649-qktjc" Jun 09 11:01:19.875289 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:19.875156 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/16d44d87-1e76-4f09-b227-9af81cce6ae0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d4c99d649-qktjc\" (UID: \"16d44d87-1e76-4f09-b227-9af81cce6ae0\") " pod="opendatahub/opendatahub-operator-controller-manager-d4c99d649-qktjc" Jun 09 11:01:19.875355 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:19.875344 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/16d44d87-1e76-4f09-b227-9af81cce6ae0-webhook-cert\") pod \"opendatahub-operator-controller-manager-d4c99d649-qktjc\" (UID: \"16d44d87-1e76-4f09-b227-9af81cce6ae0\") " pod="opendatahub/opendatahub-operator-controller-manager-d4c99d649-qktjc" Jun 09 11:01:19.888456 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:19.888430 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mqlw\" (UniqueName: \"kubernetes.io/projected/16d44d87-1e76-4f09-b227-9af81cce6ae0-kube-api-access-8mqlw\") pod \"opendatahub-operator-controller-manager-d4c99d649-qktjc\" (UID: \"16d44d87-1e76-4f09-b227-9af81cce6ae0\") " pod="opendatahub/opendatahub-operator-controller-manager-d4c99d649-qktjc" Jun 09 11:01:20.002764 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:20.002738 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d4c99d649-qktjc" Jun 09 11:01:20.135389 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:20.135361 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d4c99d649-qktjc"] Jun 09 11:01:20.138764 ip-10-0-136-7 kubenswrapper[2562]: W0609 11:01:20.138737 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16d44d87_1e76_4f09_b227_9af81cce6ae0.slice/crio-df526404028567af6dfce734179e93dc81c9b8091641e7388af2967790c694e9 WatchSource:0}: Error finding container df526404028567af6dfce734179e93dc81c9b8091641e7388af2967790c694e9: Status 404 returned error can't find the container with id df526404028567af6dfce734179e93dc81c9b8091641e7388af2967790c694e9 Jun 09 11:01:20.433695 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:20.433614 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d4c99d649-qktjc" event={"ID":"16d44d87-1e76-4f09-b227-9af81cce6ae0","Type":"ContainerStarted","Data":"df526404028567af6dfce734179e93dc81c9b8091641e7388af2967790c694e9"} Jun 09 11:01:23.449046 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:23.449012 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d4c99d649-qktjc" event={"ID":"16d44d87-1e76-4f09-b227-9af81cce6ae0","Type":"ContainerStarted","Data":"8407884fb70fe38bb3cfc74c87b5234aad97c6523a42876509b8d7db3bccd4f0"} Jun 09 11:01:24.455232 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:24.455200 2562 generic.go:356] "Generic (PLEG): container finished" podID="16d44d87-1e76-4f09-b227-9af81cce6ae0" containerID="8407884fb70fe38bb3cfc74c87b5234aad97c6523a42876509b8d7db3bccd4f0" exitCode=0 Jun 09 11:01:24.455637 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:24.455273 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d4c99d649-qktjc" event={"ID":"16d44d87-1e76-4f09-b227-9af81cce6ae0","Type":"ContainerDied","Data":"8407884fb70fe38bb3cfc74c87b5234aad97c6523a42876509b8d7db3bccd4f0"} Jun 09 11:01:25.461452 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:25.461420 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d4c99d649-qktjc" event={"ID":"16d44d87-1e76-4f09-b227-9af81cce6ae0","Type":"ContainerStarted","Data":"b1c7a666a90d143b9546632697ffab388634d5b9f7c86d3b9532926833b5e11d"} Jun 09 11:01:25.461844 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:25.461640 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-d4c99d649-qktjc" Jun 09 11:01:25.490010 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:25.489962 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-d4c99d649-qktjc" podStartSLOduration=2.306403369 podStartE2EDuration="6.489948467s" totalImagesPullingTime="3.212609273s" totalInitContainerRuntime="970.935825ms" isStatefulPod=false podCreationTimestamp="2026-06-09 11:01:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:01:25.488798471 +0000 UTC m=+475.353038334" watchObservedRunningTime="2026-06-09 11:01:25.489948467 +0000 UTC m=+475.354188296" Jun 09 11:01:36.467661 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:36.467630 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-d4c99d649-qktjc" Jun 09 11:01:40.451388 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:40.451357 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7fd99f789d-krnfb"] Jun 09 11:01:40.472507 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:40.472475 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7fd99f789d-krnfb" Jun 09 11:01:40.483561 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:40.483538 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-shjnt\"" Jun 09 11:01:40.490136 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:40.490116 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 09 11:01:40.494501 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:40.494469 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 09 11:01:40.494696 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:40.494509 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 09 11:01:40.510960 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:40.510933 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7fd99f789d-krnfb"] Jun 09 11:01:40.536695 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:40.536663 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e3c223d1-ccc4-4bf1-83d9-fbfe3612c9b5-metrics-cert\") pod \"lws-controller-manager-7fd99f789d-krnfb\" (UID: \"e3c223d1-ccc4-4bf1-83d9-fbfe3612c9b5\") " pod="openshift-lws-operator/lws-controller-manager-7fd99f789d-krnfb" Jun 09 11:01:40.536846 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:40.536721 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e3c223d1-ccc4-4bf1-83d9-fbfe3612c9b5-manager-config\") pod \"lws-controller-manager-7fd99f789d-krnfb\" (UID: \"e3c223d1-ccc4-4bf1-83d9-fbfe3612c9b5\") " pod="openshift-lws-operator/lws-controller-manager-7fd99f789d-krnfb" Jun 09 11:01:40.536846 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:40.536745 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wngm\" (UniqueName: \"kubernetes.io/projected/e3c223d1-ccc4-4bf1-83d9-fbfe3612c9b5-kube-api-access-4wngm\") pod \"lws-controller-manager-7fd99f789d-krnfb\" (UID: \"e3c223d1-ccc4-4bf1-83d9-fbfe3612c9b5\") " pod="openshift-lws-operator/lws-controller-manager-7fd99f789d-krnfb" Jun 09 11:01:40.536846 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:40.536771 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e3c223d1-ccc4-4bf1-83d9-fbfe3612c9b5-cert\") pod \"lws-controller-manager-7fd99f789d-krnfb\" (UID: \"e3c223d1-ccc4-4bf1-83d9-fbfe3612c9b5\") " pod="openshift-lws-operator/lws-controller-manager-7fd99f789d-krnfb" Jun 09 11:01:40.637606 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:40.637564 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e3c223d1-ccc4-4bf1-83d9-fbfe3612c9b5-metrics-cert\") pod \"lws-controller-manager-7fd99f789d-krnfb\" (UID: \"e3c223d1-ccc4-4bf1-83d9-fbfe3612c9b5\") " pod="openshift-lws-operator/lws-controller-manager-7fd99f789d-krnfb" Jun 09 11:01:40.637794 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:40.637715 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e3c223d1-ccc4-4bf1-83d9-fbfe3612c9b5-manager-config\") pod \"lws-controller-manager-7fd99f789d-krnfb\" (UID: \"e3c223d1-ccc4-4bf1-83d9-fbfe3612c9b5\") " pod="openshift-lws-operator/lws-controller-manager-7fd99f789d-krnfb" Jun 09 11:01:40.637794 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:40.637745 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wngm\" (UniqueName: \"kubernetes.io/projected/e3c223d1-ccc4-4bf1-83d9-fbfe3612c9b5-kube-api-access-4wngm\") pod \"lws-controller-manager-7fd99f789d-krnfb\" (UID: \"e3c223d1-ccc4-4bf1-83d9-fbfe3612c9b5\") " pod="openshift-lws-operator/lws-controller-manager-7fd99f789d-krnfb" Jun 09 11:01:40.637794 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:40.637766 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e3c223d1-ccc4-4bf1-83d9-fbfe3612c9b5-cert\") pod \"lws-controller-manager-7fd99f789d-krnfb\" (UID: \"e3c223d1-ccc4-4bf1-83d9-fbfe3612c9b5\") " pod="openshift-lws-operator/lws-controller-manager-7fd99f789d-krnfb" Jun 09 11:01:40.639047 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:40.639020 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e3c223d1-ccc4-4bf1-83d9-fbfe3612c9b5-manager-config\") pod \"lws-controller-manager-7fd99f789d-krnfb\" (UID: \"e3c223d1-ccc4-4bf1-83d9-fbfe3612c9b5\") " pod="openshift-lws-operator/lws-controller-manager-7fd99f789d-krnfb" Jun 09 11:01:40.641042 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:40.641018 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e3c223d1-ccc4-4bf1-83d9-fbfe3612c9b5-metrics-cert\") pod \"lws-controller-manager-7fd99f789d-krnfb\" (UID: \"e3c223d1-ccc4-4bf1-83d9-fbfe3612c9b5\") " pod="openshift-lws-operator/lws-controller-manager-7fd99f789d-krnfb" Jun 09 11:01:40.642258 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:40.642234 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e3c223d1-ccc4-4bf1-83d9-fbfe3612c9b5-cert\") pod \"lws-controller-manager-7fd99f789d-krnfb\" (UID: \"e3c223d1-ccc4-4bf1-83d9-fbfe3612c9b5\") " pod="openshift-lws-operator/lws-controller-manager-7fd99f789d-krnfb" Jun 09 11:01:40.652289 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:40.652265 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wngm\" (UniqueName: \"kubernetes.io/projected/e3c223d1-ccc4-4bf1-83d9-fbfe3612c9b5-kube-api-access-4wngm\") pod \"lws-controller-manager-7fd99f789d-krnfb\" (UID: \"e3c223d1-ccc4-4bf1-83d9-fbfe3612c9b5\") " pod="openshift-lws-operator/lws-controller-manager-7fd99f789d-krnfb" Jun 09 11:01:40.782071 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:40.781970 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7fd99f789d-krnfb" Jun 09 11:01:40.915351 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:40.915322 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7fd99f789d-krnfb"] Jun 09 11:01:40.916800 ip-10-0-136-7 kubenswrapper[2562]: W0609 11:01:40.916779 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3c223d1_ccc4_4bf1_83d9_fbfe3612c9b5.slice/crio-1b7f1912822189f7b41c33db6b1ee1d2ae252dc76eb6c04478aada8890dd235b WatchSource:0}: Error finding container 1b7f1912822189f7b41c33db6b1ee1d2ae252dc76eb6c04478aada8890dd235b: Status 404 returned error can't find the container with id 1b7f1912822189f7b41c33db6b1ee1d2ae252dc76eb6c04478aada8890dd235b Jun 09 11:01:41.544265 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:41.544229 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7fd99f789d-krnfb" event={"ID":"e3c223d1-ccc4-4bf1-83d9-fbfe3612c9b5","Type":"ContainerStarted","Data":"1b7f1912822189f7b41c33db6b1ee1d2ae252dc76eb6c04478aada8890dd235b"} Jun 09 11:01:44.561436 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:44.561404 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7fd99f789d-krnfb" event={"ID":"e3c223d1-ccc4-4bf1-83d9-fbfe3612c9b5","Type":"ContainerStarted","Data":"c082173693bab2af761cd7102d85b19c04f98d030d6bb435290de6f685a1845d"} Jun 09 11:01:44.561809 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:44.561477 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7fd99f789d-krnfb" Jun 09 11:01:44.578252 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:44.578209 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7fd99f789d-krnfb" podStartSLOduration=1.76277262 podStartE2EDuration="4.578195126s" totalImagesPullingTime="2.815422506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:01:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:01:44.578102232 +0000 UTC m=+494.442342061" watchObservedRunningTime="2026-06-09 11:01:44.578195126 +0000 UTC m=+494.442434954" Jun 09 11:01:44.603074 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:44.603044 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-d8974c464-j5lmz"] Jun 09 11:01:44.606033 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:44.606011 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-d8974c464-j5lmz" Jun 09 11:01:44.608841 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:44.608814 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 09 11:01:44.608841 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:44.608828 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 09 11:01:44.609026 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:44.608893 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 09 11:01:44.609026 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:44.608975 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 09 11:01:44.609165 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:44.609110 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-h2zjf\"" Jun 09 11:01:44.616907 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:44.616885 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-d8974c464-j5lmz"] Jun 09 11:01:44.673112 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:44.673076 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a554f71-59db-4456-8337-fc56018017ad-tmp\") pod \"kube-auth-proxy-d8974c464-j5lmz\" (UID: \"3a554f71-59db-4456-8337-fc56018017ad\") " pod="openshift-ingress/kube-auth-proxy-d8974c464-j5lmz" Jun 09 11:01:44.673281 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:44.673138 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x82w\" (UniqueName: \"kubernetes.io/projected/3a554f71-59db-4456-8337-fc56018017ad-kube-api-access-9x82w\") pod \"kube-auth-proxy-d8974c464-j5lmz\" (UID: \"3a554f71-59db-4456-8337-fc56018017ad\") " pod="openshift-ingress/kube-auth-proxy-d8974c464-j5lmz" Jun 09 11:01:44.673352 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:44.673311 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a554f71-59db-4456-8337-fc56018017ad-tls-certs\") pod \"kube-auth-proxy-d8974c464-j5lmz\" (UID: \"3a554f71-59db-4456-8337-fc56018017ad\") " pod="openshift-ingress/kube-auth-proxy-d8974c464-j5lmz" Jun 09 11:01:44.774362 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:44.774325 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a554f71-59db-4456-8337-fc56018017ad-tmp\") pod \"kube-auth-proxy-d8974c464-j5lmz\" (UID: \"3a554f71-59db-4456-8337-fc56018017ad\") " pod="openshift-ingress/kube-auth-proxy-d8974c464-j5lmz" Jun 09 11:01:44.774544 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:44.774373 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9x82w\" (UniqueName: \"kubernetes.io/projected/3a554f71-59db-4456-8337-fc56018017ad-kube-api-access-9x82w\") pod \"kube-auth-proxy-d8974c464-j5lmz\" (UID: \"3a554f71-59db-4456-8337-fc56018017ad\") " pod="openshift-ingress/kube-auth-proxy-d8974c464-j5lmz" Jun 09 11:01:44.774544 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:44.774417 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a554f71-59db-4456-8337-fc56018017ad-tls-certs\") pod \"kube-auth-proxy-d8974c464-j5lmz\" (UID: \"3a554f71-59db-4456-8337-fc56018017ad\") " pod="openshift-ingress/kube-auth-proxy-d8974c464-j5lmz" Jun 09 11:01:44.774687 ip-10-0-136-7 kubenswrapper[2562]: E0609 11:01:44.774626 2562 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 09 11:01:44.774736 ip-10-0-136-7 kubenswrapper[2562]: E0609 11:01:44.774689 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a554f71-59db-4456-8337-fc56018017ad-tls-certs podName:3a554f71-59db-4456-8337-fc56018017ad nodeName:}" failed. No retries permitted until 2026-06-09 11:01:45.274667783 +0000 UTC m=+495.138907604 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/3a554f71-59db-4456-8337-fc56018017ad-tls-certs") pod "kube-auth-proxy-d8974c464-j5lmz" (UID: "3a554f71-59db-4456-8337-fc56018017ad") : secret "kube-auth-proxy-tls" not found Jun 09 11:01:44.776597 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:44.776562 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a554f71-59db-4456-8337-fc56018017ad-tmp\") pod \"kube-auth-proxy-d8974c464-j5lmz\" (UID: \"3a554f71-59db-4456-8337-fc56018017ad\") " pod="openshift-ingress/kube-auth-proxy-d8974c464-j5lmz" Jun 09 11:01:44.783036 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:44.783008 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x82w\" (UniqueName: \"kubernetes.io/projected/3a554f71-59db-4456-8337-fc56018017ad-kube-api-access-9x82w\") pod \"kube-auth-proxy-d8974c464-j5lmz\" (UID: \"3a554f71-59db-4456-8337-fc56018017ad\") " pod="openshift-ingress/kube-auth-proxy-d8974c464-j5lmz" Jun 09 11:01:45.279324 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:45.279288 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a554f71-59db-4456-8337-fc56018017ad-tls-certs\") pod \"kube-auth-proxy-d8974c464-j5lmz\" (UID: \"3a554f71-59db-4456-8337-fc56018017ad\") " pod="openshift-ingress/kube-auth-proxy-d8974c464-j5lmz" Jun 09 11:01:45.281574 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:45.281552 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a554f71-59db-4456-8337-fc56018017ad-tls-certs\") pod \"kube-auth-proxy-d8974c464-j5lmz\" (UID: \"3a554f71-59db-4456-8337-fc56018017ad\") " pod="openshift-ingress/kube-auth-proxy-d8974c464-j5lmz" Jun 09 11:01:45.518754 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:45.518723 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-d8974c464-j5lmz" Jun 09 11:01:45.649647 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:45.649622 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-d8974c464-j5lmz"] Jun 09 11:01:45.651346 ip-10-0-136-7 kubenswrapper[2562]: W0609 11:01:45.651321 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a554f71_59db_4456_8337_fc56018017ad.slice/crio-0f8b6cee48e3bf59d542452f66b851f15fdafdbd6a707ae7f7039912baf098c5 WatchSource:0}: Error finding container 0f8b6cee48e3bf59d542452f66b851f15fdafdbd6a707ae7f7039912baf098c5: Status 404 returned error can't find the container with id 0f8b6cee48e3bf59d542452f66b851f15fdafdbd6a707ae7f7039912baf098c5 Jun 09 11:01:46.590293 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:46.590247 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-d8974c464-j5lmz" event={"ID":"3a554f71-59db-4456-8337-fc56018017ad","Type":"ContainerStarted","Data":"0f8b6cee48e3bf59d542452f66b851f15fdafdbd6a707ae7f7039912baf098c5"} Jun 09 11:01:49.607574 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:49.607538 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-d8974c464-j5lmz" event={"ID":"3a554f71-59db-4456-8337-fc56018017ad","Type":"ContainerStarted","Data":"2fe395adbfed430b6cc393d2f299e6f0e3fdfbf177b1a7425efc4e99771c1938"} Jun 09 11:01:49.628581 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:49.628537 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-d8974c464-j5lmz" podStartSLOduration=2.698374645 podStartE2EDuration="5.628523563s" totalImagesPullingTime="2.930148918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:01:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:01:49.626840757 +0000 UTC m=+499.491080616" watchObservedRunningTime="2026-06-09 11:01:49.628523563 +0000 UTC m=+499.492763390" Jun 09 11:01:55.569369 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:01:55.569339 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7fd99f789d-krnfb" Jun 09 11:03:21.955943 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:21.955911 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-xhh2p"] Jun 09 11:03:21.958391 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:21.958374 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xhh2p" Jun 09 11:03:21.963315 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:21.963295 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 11:03:21.963429 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:21.963297 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 09 11:03:21.963429 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:21.963295 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-r8bcr\"" Jun 09 11:03:21.963429 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:21.963295 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 11:03:21.975402 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:21.975382 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-xhh2p"] Jun 09 11:03:22.059896 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:22.059869 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdz7x\" (UniqueName: \"kubernetes.io/projected/b7fc3506-24ae-4d1e-9c91-348c7d787db4-kube-api-access-zdz7x\") pod \"dns-operator-controller-manager-864dd78c4c-xhh2p\" (UID: \"b7fc3506-24ae-4d1e-9c91-348c7d787db4\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xhh2p" Jun 09 11:03:22.160685 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:22.160650 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdz7x\" (UniqueName: \"kubernetes.io/projected/b7fc3506-24ae-4d1e-9c91-348c7d787db4-kube-api-access-zdz7x\") pod \"dns-operator-controller-manager-864dd78c4c-xhh2p\" (UID: \"b7fc3506-24ae-4d1e-9c91-348c7d787db4\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xhh2p" Jun 09 11:03:22.170277 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:22.170253 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdz7x\" (UniqueName: \"kubernetes.io/projected/b7fc3506-24ae-4d1e-9c91-348c7d787db4-kube-api-access-zdz7x\") pod \"dns-operator-controller-manager-864dd78c4c-xhh2p\" (UID: \"b7fc3506-24ae-4d1e-9c91-348c7d787db4\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xhh2p" Jun 09 11:03:22.269094 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:22.269034 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xhh2p" Jun 09 11:03:22.403427 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:22.403400 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-xhh2p"] Jun 09 11:03:22.405233 ip-10-0-136-7 kubenswrapper[2562]: W0609 11:03:22.405203 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7fc3506_24ae_4d1e_9c91_348c7d787db4.slice/crio-0947cdfcf8b81f60b36788af3c50a6edad3a61ebd0e37d3494ddb8903a033eee WatchSource:0}: Error finding container 0947cdfcf8b81f60b36788af3c50a6edad3a61ebd0e37d3494ddb8903a033eee: Status 404 returned error can't find the container with id 0947cdfcf8b81f60b36788af3c50a6edad3a61ebd0e37d3494ddb8903a033eee Jun 09 11:03:23.009097 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:23.009063 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xhh2p" event={"ID":"b7fc3506-24ae-4d1e-9c91-348c7d787db4","Type":"ContainerStarted","Data":"0947cdfcf8b81f60b36788af3c50a6edad3a61ebd0e37d3494ddb8903a033eee"} Jun 09 11:03:25.023385 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:25.023359 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xhh2p" event={"ID":"b7fc3506-24ae-4d1e-9c91-348c7d787db4","Type":"ContainerStarted","Data":"70381ef7e56fbd5794b8bd928ec770c67ee5fafbf60c447cce503a1d5b304799"} Jun 09 11:03:25.023702 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:25.023628 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xhh2p" Jun 09 11:03:25.822766 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:25.822710 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xhh2p" podStartSLOduration=2.301572425 podStartE2EDuration="4.822694429s" totalImagesPullingTime="2.521122004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:03:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:03:25.04193967 +0000 UTC m=+594.906179498" watchObservedRunningTime="2026-06-09 11:03:25.822694429 +0000 UTC m=+595.686934258" Jun 09 11:03:25.823902 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:25.823883 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-sj4l9"] Jun 09 11:03:25.826738 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:25.826720 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sj4l9" Jun 09 11:03:25.830178 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:25.830158 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 09 11:03:25.830331 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:25.830317 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vhwwk\"" Jun 09 11:03:25.830563 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:25.830551 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 09 11:03:25.839968 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:25.839950 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-sj4l9"] Jun 09 11:03:25.996068 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:25.996040 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1db749d-e0c3-4f2d-a952-3417bbb9e290-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-sj4l9\" (UID: \"a1db749d-e0c3-4f2d-a952-3417bbb9e290\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sj4l9" Jun 09 11:03:25.996234 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:25.996097 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a1db749d-e0c3-4f2d-a952-3417bbb9e290-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-sj4l9\" (UID: \"a1db749d-e0c3-4f2d-a952-3417bbb9e290\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sj4l9" Jun 09 11:03:25.996234 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:25.996178 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plgwg\" (UniqueName: \"kubernetes.io/projected/a1db749d-e0c3-4f2d-a952-3417bbb9e290-kube-api-access-plgwg\") pod \"kuadrant-console-plugin-66b5774985-sj4l9\" (UID: \"a1db749d-e0c3-4f2d-a952-3417bbb9e290\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sj4l9" Jun 09 11:03:26.097300 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:26.097226 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plgwg\" (UniqueName: \"kubernetes.io/projected/a1db749d-e0c3-4f2d-a952-3417bbb9e290-kube-api-access-plgwg\") pod \"kuadrant-console-plugin-66b5774985-sj4l9\" (UID: \"a1db749d-e0c3-4f2d-a952-3417bbb9e290\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sj4l9" Jun 09 11:03:26.097300 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:26.097279 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1db749d-e0c3-4f2d-a952-3417bbb9e290-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-sj4l9\" (UID: \"a1db749d-e0c3-4f2d-a952-3417bbb9e290\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sj4l9" Jun 09 11:03:26.097720 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:26.097333 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a1db749d-e0c3-4f2d-a952-3417bbb9e290-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-sj4l9\" (UID: \"a1db749d-e0c3-4f2d-a952-3417bbb9e290\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sj4l9" Jun 09 11:03:26.098031 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:26.098014 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a1db749d-e0c3-4f2d-a952-3417bbb9e290-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-sj4l9\" (UID: \"a1db749d-e0c3-4f2d-a952-3417bbb9e290\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sj4l9" Jun 09 11:03:26.099706 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:26.099679 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1db749d-e0c3-4f2d-a952-3417bbb9e290-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-sj4l9\" (UID: \"a1db749d-e0c3-4f2d-a952-3417bbb9e290\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sj4l9" Jun 09 11:03:26.124889 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:26.124865 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plgwg\" (UniqueName: \"kubernetes.io/projected/a1db749d-e0c3-4f2d-a952-3417bbb9e290-kube-api-access-plgwg\") pod \"kuadrant-console-plugin-66b5774985-sj4l9\" (UID: \"a1db749d-e0c3-4f2d-a952-3417bbb9e290\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sj4l9" Jun 09 11:03:26.135626 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:26.135605 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sj4l9" Jun 09 11:03:26.264650 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:26.264625 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-sj4l9"] Jun 09 11:03:26.266898 ip-10-0-136-7 kubenswrapper[2562]: W0609 11:03:26.266856 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda1db749d_e0c3_4f2d_a952_3417bbb9e290.slice/crio-f1a2c4a2a77316777e6e3e906dc1e99e404f8a69311361df7a6611729a95803f WatchSource:0}: Error finding container f1a2c4a2a77316777e6e3e906dc1e99e404f8a69311361df7a6611729a95803f: Status 404 returned error can't find the container with id f1a2c4a2a77316777e6e3e906dc1e99e404f8a69311361df7a6611729a95803f Jun 09 11:03:27.033604 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:27.033554 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sj4l9" event={"ID":"a1db749d-e0c3-4f2d-a952-3417bbb9e290","Type":"ContainerStarted","Data":"f1a2c4a2a77316777e6e3e906dc1e99e404f8a69311361df7a6611729a95803f"} Jun 09 11:03:30.579135 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:30.579105 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-ph2xt_56eeb8e9-a748-4e99-b04a-6d998c6aad8b/console-operator/2.log" Jun 09 11:03:30.579684 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:30.579664 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-ph2xt_56eeb8e9-a748-4e99-b04a-6d998c6aad8b/console-operator/2.log" Jun 09 11:03:30.586629 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:30.586608 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vjfd2_1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070/ovn-acl-logging/0.log" Jun 09 11:03:30.587129 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:30.587104 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vjfd2_1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070/ovn-acl-logging/0.log" Jun 09 11:03:36.029831 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:36.029794 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xhh2p" Jun 09 11:03:36.257972 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:36.257938 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fwps7"] Jun 09 11:03:36.260927 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:36.260908 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fwps7" Jun 09 11:03:36.264138 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:36.264111 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-fst65\"" Jun 09 11:03:36.278492 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:36.278470 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fwps7"] Jun 09 11:03:36.286679 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:36.286624 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2zlb\" (UniqueName: \"kubernetes.io/projected/1b3f4a8b-4b46-432b-be7d-bf193da1e328-kube-api-access-x2zlb\") pod \"kuadrant-operator-controller-manager-86878c769f-fwps7\" (UID: \"1b3f4a8b-4b46-432b-be7d-bf193da1e328\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fwps7" Jun 09 11:03:36.286772 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:36.286682 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b3f4a8b-4b46-432b-be7d-bf193da1e328-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fwps7\" (UID: \"1b3f4a8b-4b46-432b-be7d-bf193da1e328\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fwps7" Jun 09 11:03:36.387305 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:36.387282 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2zlb\" (UniqueName: \"kubernetes.io/projected/1b3f4a8b-4b46-432b-be7d-bf193da1e328-kube-api-access-x2zlb\") pod \"kuadrant-operator-controller-manager-86878c769f-fwps7\" (UID: \"1b3f4a8b-4b46-432b-be7d-bf193da1e328\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fwps7" Jun 09 11:03:36.387423 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:36.387323 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b3f4a8b-4b46-432b-be7d-bf193da1e328-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fwps7\" (UID: \"1b3f4a8b-4b46-432b-be7d-bf193da1e328\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fwps7" Jun 09 11:03:36.387693 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:36.387673 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b3f4a8b-4b46-432b-be7d-bf193da1e328-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fwps7\" (UID: \"1b3f4a8b-4b46-432b-be7d-bf193da1e328\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fwps7" Jun 09 11:03:36.403044 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:36.403018 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2zlb\" (UniqueName: \"kubernetes.io/projected/1b3f4a8b-4b46-432b-be7d-bf193da1e328-kube-api-access-x2zlb\") pod \"kuadrant-operator-controller-manager-86878c769f-fwps7\" (UID: \"1b3f4a8b-4b46-432b-be7d-bf193da1e328\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fwps7" Jun 09 11:03:36.573866 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:36.573793 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fwps7" Jun 09 11:03:36.735790 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:36.735745 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fwps7"] Jun 09 11:03:36.737487 ip-10-0-136-7 kubenswrapper[2562]: W0609 11:03:36.737459 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b3f4a8b_4b46_432b_be7d_bf193da1e328.slice/crio-2149091489f4038cd4d8893bb86786a8116bf419b281f13be614092d37a8acdf WatchSource:0}: Error finding container 2149091489f4038cd4d8893bb86786a8116bf419b281f13be614092d37a8acdf: Status 404 returned error can't find the container with id 2149091489f4038cd4d8893bb86786a8116bf419b281f13be614092d37a8acdf Jun 09 11:03:37.090091 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:37.090054 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fwps7" event={"ID":"1b3f4a8b-4b46-432b-be7d-bf193da1e328","Type":"ContainerStarted","Data":"2149091489f4038cd4d8893bb86786a8116bf419b281f13be614092d37a8acdf"} Jun 09 11:03:52.170606 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:52.170515 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sj4l9" event={"ID":"a1db749d-e0c3-4f2d-a952-3417bbb9e290","Type":"ContainerStarted","Data":"62c2bd15fd6e08b2c841e354fecba77661959a65d30dab8038a519e147ba24cb"} Jun 09 11:03:52.186942 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:52.186899 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sj4l9" podStartSLOduration=1.7152245339999999 podStartE2EDuration="27.186884309s" totalImagesPullingTime="25.471659775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:03:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:03:52.185871841 +0000 UTC m=+622.050111675" watchObservedRunningTime="2026-06-09 11:03:52.186884309 +0000 UTC m=+622.051124140" Jun 09 11:03:59.206979 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:59.206943 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fwps7" event={"ID":"1b3f4a8b-4b46-432b-be7d-bf193da1e328","Type":"ContainerStarted","Data":"89b53b82f4dd17064e557d9dea62df0985408b02b898de28c71edd0b2df6d697"} Jun 09 11:03:59.207392 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:59.207021 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fwps7" Jun 09 11:03:59.229066 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:03:59.229024 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fwps7" podStartSLOduration=0.963737244 podStartE2EDuration="23.229010488s" totalImagesPullingTime="22.265273244s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:03:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:03:59.226550354 +0000 UTC m=+629.090790216" watchObservedRunningTime="2026-06-09 11:03:59.229010488 +0000 UTC m=+629.093250377" Jun 09 11:04:10.213734 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:04:10.213701 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fwps7" Jun 09 11:04:31.685623 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:04:31.685569 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-9hqxb"] Jun 09 11:04:31.690379 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:04:31.690363 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-9hqxb" Jun 09 11:04:31.693135 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:04:31.693107 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-dqz64\"" Jun 09 11:04:31.695314 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:04:31.695293 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-9hqxb"] Jun 09 11:04:31.769541 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:04:31.769521 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hr56r\" (UniqueName: \"kubernetes.io/projected/486b1f72-4c73-41eb-8262-e75d17e7a16f-kube-api-access-hr56r\") pod \"authorino-75d556bd77-9hqxb\" (UID: \"486b1f72-4c73-41eb-8262-e75d17e7a16f\") " pod="kuadrant-system/authorino-75d556bd77-9hqxb" Jun 09 11:04:31.870221 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:04:31.870200 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hr56r\" (UniqueName: \"kubernetes.io/projected/486b1f72-4c73-41eb-8262-e75d17e7a16f-kube-api-access-hr56r\") pod \"authorino-75d556bd77-9hqxb\" (UID: \"486b1f72-4c73-41eb-8262-e75d17e7a16f\") " pod="kuadrant-system/authorino-75d556bd77-9hqxb" Jun 09 11:04:31.879100 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:04:31.879080 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hr56r\" (UniqueName: \"kubernetes.io/projected/486b1f72-4c73-41eb-8262-e75d17e7a16f-kube-api-access-hr56r\") pod \"authorino-75d556bd77-9hqxb\" (UID: \"486b1f72-4c73-41eb-8262-e75d17e7a16f\") " pod="kuadrant-system/authorino-75d556bd77-9hqxb" Jun 09 11:04:32.000683 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:04:32.000648 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-9hqxb" Jun 09 11:04:32.129280 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:04:32.129248 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-9hqxb"] Jun 09 11:04:32.132011 ip-10-0-136-7 kubenswrapper[2562]: W0609 11:04:32.131978 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod486b1f72_4c73_41eb_8262_e75d17e7a16f.slice/crio-3d4ff17f8a54ffcefeb2f4338dbb038b94f78683f016aac97299849517e6aba2 WatchSource:0}: Error finding container 3d4ff17f8a54ffcefeb2f4338dbb038b94f78683f016aac97299849517e6aba2: Status 404 returned error can't find the container with id 3d4ff17f8a54ffcefeb2f4338dbb038b94f78683f016aac97299849517e6aba2 Jun 09 11:04:32.367733 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:04:32.367640 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-9hqxb" event={"ID":"486b1f72-4c73-41eb-8262-e75d17e7a16f","Type":"ContainerStarted","Data":"3d4ff17f8a54ffcefeb2f4338dbb038b94f78683f016aac97299849517e6aba2"} Jun 09 11:04:36.389561 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:04:36.389526 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-9hqxb" event={"ID":"486b1f72-4c73-41eb-8262-e75d17e7a16f","Type":"ContainerStarted","Data":"3e09e04407341f2e28b6c2522adfd1b6c51422bffd43453328fb98f951f7b1b5"} Jun 09 11:04:36.405076 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:04:36.405035 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-9hqxb" podStartSLOduration=2.157368657 podStartE2EDuration="5.40502346s" totalImagesPullingTime="3.247654803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:04:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:04:36.404278888 +0000 UTC m=+666.268518729" watchObservedRunningTime="2026-06-09 11:04:36.40502346 +0000 UTC m=+666.269263287" Jun 09 11:05:27.322529 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:05:27.322502 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 11:05:27.325112 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:05:27.325092 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 11:05:27.328071 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:05:27.328052 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 09 11:05:27.328154 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:05:27.328091 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 09 11:05:27.328154 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:05:27.328112 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 09 11:05:27.329254 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:05:27.329237 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-7phd6\"" Jun 09 11:05:27.338079 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:05:27.338057 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 11:05:27.420892 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:05:27.420869 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mlxt\" (UniqueName: \"kubernetes.io/projected/28b7f06c-4549-4eb3-9233-79b7fb22ef58-kube-api-access-7mlxt\") pod \"maas-keycloak-0\" (UID: \"28b7f06c-4549-4eb3-9233-79b7fb22ef58\") " pod="keycloak-system/maas-keycloak-0" Jun 09 11:05:27.521415 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:05:27.521393 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mlxt\" (UniqueName: \"kubernetes.io/projected/28b7f06c-4549-4eb3-9233-79b7fb22ef58-kube-api-access-7mlxt\") pod \"maas-keycloak-0\" (UID: \"28b7f06c-4549-4eb3-9233-79b7fb22ef58\") " pod="keycloak-system/maas-keycloak-0" Jun 09 11:05:27.530342 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:05:27.530320 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mlxt\" (UniqueName: \"kubernetes.io/projected/28b7f06c-4549-4eb3-9233-79b7fb22ef58-kube-api-access-7mlxt\") pod \"maas-keycloak-0\" (UID: \"28b7f06c-4549-4eb3-9233-79b7fb22ef58\") " pod="keycloak-system/maas-keycloak-0" Jun 09 11:05:27.634275 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:05:27.634209 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 11:05:27.760088 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:05:27.760065 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 11:05:27.762278 ip-10-0-136-7 kubenswrapper[2562]: W0609 11:05:27.762251 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28b7f06c_4549_4eb3_9233_79b7fb22ef58.slice/crio-2cf08edef68ce4fe805b5725274a77567588b326d8e636063ee5b327a6cefb9d WatchSource:0}: Error finding container 2cf08edef68ce4fe805b5725274a77567588b326d8e636063ee5b327a6cefb9d: Status 404 returned error can't find the container with id 2cf08edef68ce4fe805b5725274a77567588b326d8e636063ee5b327a6cefb9d Jun 09 11:05:28.639007 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:05:28.638957 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"28b7f06c-4549-4eb3-9233-79b7fb22ef58","Type":"ContainerStarted","Data":"2cf08edef68ce4fe805b5725274a77567588b326d8e636063ee5b327a6cefb9d"} Jun 09 11:05:32.618740 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:05:32.618721 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 09 11:05:33.668403 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:05:33.668359 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"28b7f06c-4549-4eb3-9233-79b7fb22ef58","Type":"ContainerStarted","Data":"43001d76ac62c753b2592176e323b41e8d2b663b0b60b8bc94913ae9287146c9"} Jun 09 11:05:33.691250 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:05:33.691190 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.83898041 podStartE2EDuration="6.691169374s" totalImagesPullingTime="4.852188964s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:05:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:05:33.688344925 +0000 UTC m=+723.552584780" watchObservedRunningTime="2026-06-09 11:05:33.691169374 +0000 UTC m=+723.555409203" Jun 09 11:05:34.634891 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:05:34.634851 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 09 11:05:34.636730 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:05:34.636688 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="28b7f06c-4549-4eb3-9233-79b7fb22ef58" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 09 11:05:35.635174 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:05:35.635112 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="28b7f06c-4549-4eb3-9233-79b7fb22ef58" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 09 11:05:36.635533 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:05:36.635478 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="28b7f06c-4549-4eb3-9233-79b7fb22ef58" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 09 11:05:37.635173 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:05:37.635139 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 09 11:05:37.635620 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:05:37.635566 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="28b7f06c-4549-4eb3-9233-79b7fb22ef58" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 09 11:05:38.634876 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:05:38.634835 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="28b7f06c-4549-4eb3-9233-79b7fb22ef58" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 09 11:05:39.634890 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:05:39.634847 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="28b7f06c-4549-4eb3-9233-79b7fb22ef58" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 09 11:05:40.635269 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:05:40.635229 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="28b7f06c-4549-4eb3-9233-79b7fb22ef58" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 09 11:05:41.634797 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:05:41.634755 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="28b7f06c-4549-4eb3-9233-79b7fb22ef58" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 09 11:05:42.634931 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:05:42.634884 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="28b7f06c-4549-4eb3-9233-79b7fb22ef58" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 09 11:05:43.634564 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:05:43.634524 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="28b7f06c-4549-4eb3-9233-79b7fb22ef58" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 09 11:05:44.635016 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:05:44.634974 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="28b7f06c-4549-4eb3-9233-79b7fb22ef58" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 09 11:05:45.722201 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:05:45.722164 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 09 11:05:45.736229 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:05:45.736178 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="28b7f06c-4549-4eb3-9233-79b7fb22ef58" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 11:05:55.728200 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:05:55.728167 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 09 11:05:58.250164 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:05:58.250133 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-9hqxb"] Jun 09 11:05:58.250520 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:05:58.250306 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-9hqxb" podUID="486b1f72-4c73-41eb-8262-e75d17e7a16f" containerName="authorino" containerID="cri-o://3e09e04407341f2e28b6c2522adfd1b6c51422bffd43453328fb98f951f7b1b5" gracePeriod=30 Jun 09 11:05:58.496265 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:05:58.496242 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-9hqxb" Jun 09 11:05:58.531725 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:05:58.531651 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hr56r\" (UniqueName: \"kubernetes.io/projected/486b1f72-4c73-41eb-8262-e75d17e7a16f-kube-api-access-hr56r\") pod \"486b1f72-4c73-41eb-8262-e75d17e7a16f\" (UID: \"486b1f72-4c73-41eb-8262-e75d17e7a16f\") " Jun 09 11:05:58.533928 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:05:58.533887 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/486b1f72-4c73-41eb-8262-e75d17e7a16f-kube-api-access-hr56r" (OuterVolumeSpecName: "kube-api-access-hr56r") pod "486b1f72-4c73-41eb-8262-e75d17e7a16f" (UID: "486b1f72-4c73-41eb-8262-e75d17e7a16f"). InnerVolumeSpecName "kube-api-access-hr56r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:05:58.632799 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:05:58.632774 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hr56r\" (UniqueName: \"kubernetes.io/projected/486b1f72-4c73-41eb-8262-e75d17e7a16f-kube-api-access-hr56r\") on node \"ip-10-0-136-7.ec2.internal\" DevicePath \"\"" Jun 09 11:05:58.827325 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:05:58.827258 2562 generic.go:356] "Generic (PLEG): container finished" podID="486b1f72-4c73-41eb-8262-e75d17e7a16f" containerID="3e09e04407341f2e28b6c2522adfd1b6c51422bffd43453328fb98f951f7b1b5" exitCode=0 Jun 09 11:05:58.827325 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:05:58.827290 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-9hqxb" Jun 09 11:05:58.827325 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:05:58.827298 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-9hqxb" event={"ID":"486b1f72-4c73-41eb-8262-e75d17e7a16f","Type":"ContainerDied","Data":"3e09e04407341f2e28b6c2522adfd1b6c51422bffd43453328fb98f951f7b1b5"} Jun 09 11:05:58.827325 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:05:58.827326 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-9hqxb" event={"ID":"486b1f72-4c73-41eb-8262-e75d17e7a16f","Type":"ContainerDied","Data":"3d4ff17f8a54ffcefeb2f4338dbb038b94f78683f016aac97299849517e6aba2"} Jun 09 11:05:58.827577 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:05:58.827342 2562 scope.go:117] "RemoveContainer" containerID="3e09e04407341f2e28b6c2522adfd1b6c51422bffd43453328fb98f951f7b1b5" Jun 09 11:05:58.835628 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:05:58.835611 2562 scope.go:117] "RemoveContainer" containerID="3e09e04407341f2e28b6c2522adfd1b6c51422bffd43453328fb98f951f7b1b5" Jun 09 11:05:58.835887 ip-10-0-136-7 kubenswrapper[2562]: E0609 11:05:58.835863 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e09e04407341f2e28b6c2522adfd1b6c51422bffd43453328fb98f951f7b1b5\": container with ID starting with 3e09e04407341f2e28b6c2522adfd1b6c51422bffd43453328fb98f951f7b1b5 not found: ID does not exist" containerID="3e09e04407341f2e28b6c2522adfd1b6c51422bffd43453328fb98f951f7b1b5" Jun 09 11:05:58.835925 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:05:58.835900 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e09e04407341f2e28b6c2522adfd1b6c51422bffd43453328fb98f951f7b1b5"} err="failed to get container status \"3e09e04407341f2e28b6c2522adfd1b6c51422bffd43453328fb98f951f7b1b5\": rpc error: code = NotFound desc = could not find container \"3e09e04407341f2e28b6c2522adfd1b6c51422bffd43453328fb98f951f7b1b5\": container with ID starting with 3e09e04407341f2e28b6c2522adfd1b6c51422bffd43453328fb98f951f7b1b5 not found: ID does not exist" Jun 09 11:05:58.845873 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:05:58.845852 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-9hqxb"] Jun 09 11:05:58.852446 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:05:58.852427 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-9hqxb"] Jun 09 11:06:00.598990 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:00.598956 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="486b1f72-4c73-41eb-8262-e75d17e7a16f" path="/var/lib/kubelet/pods/486b1f72-4c73-41eb-8262-e75d17e7a16f/volumes" Jun 09 11:06:01.816060 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:01.816031 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-69c588f7f7-fcm7s"] Jun 09 11:06:01.816412 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:01.816406 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="486b1f72-4c73-41eb-8262-e75d17e7a16f" containerName="authorino" Jun 09 11:06:01.816454 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:01.816416 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="486b1f72-4c73-41eb-8262-e75d17e7a16f" containerName="authorino" Jun 09 11:06:01.816487 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:01.816476 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="486b1f72-4c73-41eb-8262-e75d17e7a16f" containerName="authorino" Jun 09 11:06:01.819362 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:01.819347 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69c588f7f7-fcm7s" Jun 09 11:06:01.822272 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:01.822248 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 09 11:06:01.822474 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:01.822460 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-vmhvj\"" Jun 09 11:06:01.823468 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:01.823451 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 09 11:06:01.831069 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:01.831048 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69c588f7f7-fcm7s"] Jun 09 11:06:01.858855 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:01.858835 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85dqx\" (UniqueName: \"kubernetes.io/projected/ed90be61-e5f7-4573-9ce1-c3f4dc176936-kube-api-access-85dqx\") pod \"maas-controller-69c588f7f7-fcm7s\" (UID: \"ed90be61-e5f7-4573-9ce1-c3f4dc176936\") " pod="opendatahub/maas-controller-69c588f7f7-fcm7s" Jun 09 11:06:01.858963 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:01.858902 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ed90be61-e5f7-4573-9ce1-c3f4dc176936-webhook-cert\") pod \"maas-controller-69c588f7f7-fcm7s\" (UID: \"ed90be61-e5f7-4573-9ce1-c3f4dc176936\") " pod="opendatahub/maas-controller-69c588f7f7-fcm7s" Jun 09 11:06:01.960140 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:01.960116 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ed90be61-e5f7-4573-9ce1-c3f4dc176936-webhook-cert\") pod \"maas-controller-69c588f7f7-fcm7s\" (UID: \"ed90be61-e5f7-4573-9ce1-c3f4dc176936\") " pod="opendatahub/maas-controller-69c588f7f7-fcm7s" Jun 09 11:06:01.960260 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:01.960162 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85dqx\" (UniqueName: \"kubernetes.io/projected/ed90be61-e5f7-4573-9ce1-c3f4dc176936-kube-api-access-85dqx\") pod \"maas-controller-69c588f7f7-fcm7s\" (UID: \"ed90be61-e5f7-4573-9ce1-c3f4dc176936\") " pod="opendatahub/maas-controller-69c588f7f7-fcm7s" Jun 09 11:06:01.962483 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:01.962460 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ed90be61-e5f7-4573-9ce1-c3f4dc176936-webhook-cert\") pod \"maas-controller-69c588f7f7-fcm7s\" (UID: \"ed90be61-e5f7-4573-9ce1-c3f4dc176936\") " pod="opendatahub/maas-controller-69c588f7f7-fcm7s" Jun 09 11:06:01.968542 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:01.968525 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85dqx\" (UniqueName: \"kubernetes.io/projected/ed90be61-e5f7-4573-9ce1-c3f4dc176936-kube-api-access-85dqx\") pod \"maas-controller-69c588f7f7-fcm7s\" (UID: \"ed90be61-e5f7-4573-9ce1-c3f4dc176936\") " pod="opendatahub/maas-controller-69c588f7f7-fcm7s" Jun 09 11:06:02.006298 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:02.006276 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-69b588cdd-s66jw"] Jun 09 11:06:02.008840 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:02.008821 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69b588cdd-s66jw" Jun 09 11:06:02.017935 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:02.017913 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69b588cdd-s66jw"] Jun 09 11:06:02.061274 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:02.061249 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a3d6c3e7-6909-45fe-b4a6-e60cb236e1bc-webhook-cert\") pod \"maas-controller-69b588cdd-s66jw\" (UID: \"a3d6c3e7-6909-45fe-b4a6-e60cb236e1bc\") " pod="opendatahub/maas-controller-69b588cdd-s66jw" Jun 09 11:06:02.061414 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:02.061302 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfdpb\" (UniqueName: \"kubernetes.io/projected/a3d6c3e7-6909-45fe-b4a6-e60cb236e1bc-kube-api-access-wfdpb\") pod \"maas-controller-69b588cdd-s66jw\" (UID: \"a3d6c3e7-6909-45fe-b4a6-e60cb236e1bc\") " pod="opendatahub/maas-controller-69b588cdd-s66jw" Jun 09 11:06:02.129336 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:02.129272 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69c588f7f7-fcm7s" Jun 09 11:06:02.162841 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:02.162814 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a3d6c3e7-6909-45fe-b4a6-e60cb236e1bc-webhook-cert\") pod \"maas-controller-69b588cdd-s66jw\" (UID: \"a3d6c3e7-6909-45fe-b4a6-e60cb236e1bc\") " pod="opendatahub/maas-controller-69b588cdd-s66jw" Jun 09 11:06:02.162967 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:02.162854 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfdpb\" (UniqueName: \"kubernetes.io/projected/a3d6c3e7-6909-45fe-b4a6-e60cb236e1bc-kube-api-access-wfdpb\") pod \"maas-controller-69b588cdd-s66jw\" (UID: \"a3d6c3e7-6909-45fe-b4a6-e60cb236e1bc\") " pod="opendatahub/maas-controller-69b588cdd-s66jw" Jun 09 11:06:02.165231 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:02.165202 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a3d6c3e7-6909-45fe-b4a6-e60cb236e1bc-webhook-cert\") pod \"maas-controller-69b588cdd-s66jw\" (UID: \"a3d6c3e7-6909-45fe-b4a6-e60cb236e1bc\") " pod="opendatahub/maas-controller-69b588cdd-s66jw" Jun 09 11:06:02.171643 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:02.171619 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfdpb\" (UniqueName: \"kubernetes.io/projected/a3d6c3e7-6909-45fe-b4a6-e60cb236e1bc-kube-api-access-wfdpb\") pod \"maas-controller-69b588cdd-s66jw\" (UID: \"a3d6c3e7-6909-45fe-b4a6-e60cb236e1bc\") " pod="opendatahub/maas-controller-69b588cdd-s66jw" Jun 09 11:06:02.262808 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:02.262780 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69c588f7f7-fcm7s"] Jun 09 11:06:02.264707 ip-10-0-136-7 kubenswrapper[2562]: W0609 11:06:02.264671 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded90be61_e5f7_4573_9ce1_c3f4dc176936.slice/crio-2f4c65748fd6ecbcf5391a2985442b32521b44cc19c103efe8067f83168701e2 WatchSource:0}: Error finding container 2f4c65748fd6ecbcf5391a2985442b32521b44cc19c103efe8067f83168701e2: Status 404 returned error can't find the container with id 2f4c65748fd6ecbcf5391a2985442b32521b44cc19c103efe8067f83168701e2 Jun 09 11:06:02.265972 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:02.265951 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 11:06:02.320005 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:02.319981 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69b588cdd-s66jw" Jun 09 11:06:02.447671 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:02.447646 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69b588cdd-s66jw"] Jun 09 11:06:02.449119 ip-10-0-136-7 kubenswrapper[2562]: W0609 11:06:02.449096 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3d6c3e7_6909_45fe_b4a6_e60cb236e1bc.slice/crio-f638b79221aed9b1f10f8f2df7d82bfbd9ac83a01f0454e1fdfefeccb1e34685 WatchSource:0}: Error finding container f638b79221aed9b1f10f8f2df7d82bfbd9ac83a01f0454e1fdfefeccb1e34685: Status 404 returned error can't find the container with id f638b79221aed9b1f10f8f2df7d82bfbd9ac83a01f0454e1fdfefeccb1e34685 Jun 09 11:06:02.850974 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:02.850935 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69b588cdd-s66jw" event={"ID":"a3d6c3e7-6909-45fe-b4a6-e60cb236e1bc","Type":"ContainerStarted","Data":"f638b79221aed9b1f10f8f2df7d82bfbd9ac83a01f0454e1fdfefeccb1e34685"} Jun 09 11:06:02.852532 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:02.852507 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69c588f7f7-fcm7s" event={"ID":"ed90be61-e5f7-4573-9ce1-c3f4dc176936","Type":"ContainerStarted","Data":"2f4c65748fd6ecbcf5391a2985442b32521b44cc19c103efe8067f83168701e2"} Jun 09 11:06:05.874142 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:05.874102 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69b588cdd-s66jw" event={"ID":"a3d6c3e7-6909-45fe-b4a6-e60cb236e1bc","Type":"ContainerStarted","Data":"512da8998cc221405aaa78fc7d8dcc20e6cbf29869e153b6ad27102bcf26449c"} Jun 09 11:06:05.874623 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:05.874220 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-69b588cdd-s66jw" Jun 09 11:06:05.875539 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:05.875519 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69c588f7f7-fcm7s" event={"ID":"ed90be61-e5f7-4573-9ce1-c3f4dc176936","Type":"ContainerStarted","Data":"9985c49cb4d2a647a0df6e2096f739821787e0492faa0f53d620a9fb5aad42c4"} Jun 09 11:06:05.875669 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:05.875614 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-69c588f7f7-fcm7s" Jun 09 11:06:05.892613 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:05.892559 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-69b588cdd-s66jw" podStartSLOduration=2.4347095899999998 podStartE2EDuration="4.892546583s" totalImagesPullingTime="2.457836993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:06:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:06:05.890298538 +0000 UTC m=+755.754538363" watchObservedRunningTime="2026-06-09 11:06:05.892546583 +0000 UTC m=+755.756786425" Jun 09 11:06:05.907379 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:05.907345 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-69c588f7f7-fcm7s" podStartSLOduration=2.274782707 podStartE2EDuration="4.907333432s" totalImagesPullingTime="2.632550725s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:06:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:06:05.906853663 +0000 UTC m=+755.771093513" watchObservedRunningTime="2026-06-09 11:06:05.907333432 +0000 UTC m=+755.771573260" Jun 09 11:06:16.885970 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:16.885944 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-69b588cdd-s66jw" Jun 09 11:06:16.886425 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:16.886204 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-69c588f7f7-fcm7s" Jun 09 11:06:16.944973 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:16.944942 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-69c588f7f7-fcm7s"] Jun 09 11:06:16.945161 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:16.945120 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-69c588f7f7-fcm7s" podUID="ed90be61-e5f7-4573-9ce1-c3f4dc176936" containerName="manager" containerID="cri-o://9985c49cb4d2a647a0df6e2096f739821787e0492faa0f53d620a9fb5aad42c4" gracePeriod=30 Jun 09 11:06:17.189964 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:17.189938 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69c588f7f7-fcm7s" Jun 09 11:06:17.285851 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:17.285824 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ed90be61-e5f7-4573-9ce1-c3f4dc176936-webhook-cert\") pod \"ed90be61-e5f7-4573-9ce1-c3f4dc176936\" (UID: \"ed90be61-e5f7-4573-9ce1-c3f4dc176936\") " Jun 09 11:06:17.285999 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:17.285935 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-85dqx\" (UniqueName: \"kubernetes.io/projected/ed90be61-e5f7-4573-9ce1-c3f4dc176936-kube-api-access-85dqx\") pod \"ed90be61-e5f7-4573-9ce1-c3f4dc176936\" (UID: \"ed90be61-e5f7-4573-9ce1-c3f4dc176936\") " Jun 09 11:06:17.288007 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:17.287979 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed90be61-e5f7-4573-9ce1-c3f4dc176936-kube-api-access-85dqx" (OuterVolumeSpecName: "kube-api-access-85dqx") pod "ed90be61-e5f7-4573-9ce1-c3f4dc176936" (UID: "ed90be61-e5f7-4573-9ce1-c3f4dc176936"). InnerVolumeSpecName "kube-api-access-85dqx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:06:17.288007 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:17.287979 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed90be61-e5f7-4573-9ce1-c3f4dc176936-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ed90be61-e5f7-4573-9ce1-c3f4dc176936" (UID: "ed90be61-e5f7-4573-9ce1-c3f4dc176936"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:06:17.386560 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:17.386534 2562 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ed90be61-e5f7-4573-9ce1-c3f4dc176936-webhook-cert\") on node \"ip-10-0-136-7.ec2.internal\" DevicePath \"\"" Jun 09 11:06:17.386560 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:17.386557 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85dqx\" (UniqueName: \"kubernetes.io/projected/ed90be61-e5f7-4573-9ce1-c3f4dc176936-kube-api-access-85dqx\") on node \"ip-10-0-136-7.ec2.internal\" DevicePath \"\"" Jun 09 11:06:17.941676 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:17.941647 2562 generic.go:356] "Generic (PLEG): container finished" podID="ed90be61-e5f7-4573-9ce1-c3f4dc176936" containerID="9985c49cb4d2a647a0df6e2096f739821787e0492faa0f53d620a9fb5aad42c4" exitCode=0 Jun 09 11:06:17.942073 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:17.941682 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69c588f7f7-fcm7s" event={"ID":"ed90be61-e5f7-4573-9ce1-c3f4dc176936","Type":"ContainerDied","Data":"9985c49cb4d2a647a0df6e2096f739821787e0492faa0f53d620a9fb5aad42c4"} Jun 09 11:06:17.942073 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:17.941691 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69c588f7f7-fcm7s" Jun 09 11:06:17.942073 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:17.941723 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69c588f7f7-fcm7s" event={"ID":"ed90be61-e5f7-4573-9ce1-c3f4dc176936","Type":"ContainerDied","Data":"2f4c65748fd6ecbcf5391a2985442b32521b44cc19c103efe8067f83168701e2"} Jun 09 11:06:17.942073 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:17.941746 2562 scope.go:117] "RemoveContainer" containerID="9985c49cb4d2a647a0df6e2096f739821787e0492faa0f53d620a9fb5aad42c4" Jun 09 11:06:17.950379 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:17.950208 2562 scope.go:117] "RemoveContainer" containerID="9985c49cb4d2a647a0df6e2096f739821787e0492faa0f53d620a9fb5aad42c4" Jun 09 11:06:17.950491 ip-10-0-136-7 kubenswrapper[2562]: E0609 11:06:17.950471 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9985c49cb4d2a647a0df6e2096f739821787e0492faa0f53d620a9fb5aad42c4\": container with ID starting with 9985c49cb4d2a647a0df6e2096f739821787e0492faa0f53d620a9fb5aad42c4 not found: ID does not exist" containerID="9985c49cb4d2a647a0df6e2096f739821787e0492faa0f53d620a9fb5aad42c4" Jun 09 11:06:17.950548 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:17.950504 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9985c49cb4d2a647a0df6e2096f739821787e0492faa0f53d620a9fb5aad42c4"} err="failed to get container status \"9985c49cb4d2a647a0df6e2096f739821787e0492faa0f53d620a9fb5aad42c4\": rpc error: code = NotFound desc = could not find container \"9985c49cb4d2a647a0df6e2096f739821787e0492faa0f53d620a9fb5aad42c4\": container with ID starting with 9985c49cb4d2a647a0df6e2096f739821787e0492faa0f53d620a9fb5aad42c4 not found: ID does not exist" Jun 09 11:06:17.965651 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:17.965629 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-69c588f7f7-fcm7s"] Jun 09 11:06:17.971482 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:17.971462 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-69c588f7f7-fcm7s"] Jun 09 11:06:18.598066 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:18.598039 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed90be61-e5f7-4573-9ce1-c3f4dc176936" path="/var/lib/kubelet/pods/ed90be61-e5f7-4573-9ce1-c3f4dc176936/volumes" Jun 09 11:06:36.124476 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:36.124444 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-7795997cf4-xdwfq"] Jun 09 11:06:36.124843 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:36.124833 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed90be61-e5f7-4573-9ce1-c3f4dc176936" containerName="manager" Jun 09 11:06:36.124888 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:36.124845 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed90be61-e5f7-4573-9ce1-c3f4dc176936" containerName="manager" Jun 09 11:06:36.124932 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:36.124922 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed90be61-e5f7-4573-9ce1-c3f4dc176936" containerName="manager" Jun 09 11:06:36.129774 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:36.129759 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7795997cf4-xdwfq" Jun 09 11:06:36.134129 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:36.134109 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-pmrsd\"" Jun 09 11:06:36.134683 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:36.134666 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 09 11:06:36.140668 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:36.140649 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7795997cf4-xdwfq"] Jun 09 11:06:36.245079 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:36.245049 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8757d6d3-ab09-4eab-a587-0fb017ddda4a-maas-api-tls\") pod \"maas-api-7795997cf4-xdwfq\" (UID: \"8757d6d3-ab09-4eab-a587-0fb017ddda4a\") " pod="opendatahub/maas-api-7795997cf4-xdwfq" Jun 09 11:06:36.245224 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:36.245098 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6x7gp\" (UniqueName: \"kubernetes.io/projected/8757d6d3-ab09-4eab-a587-0fb017ddda4a-kube-api-access-6x7gp\") pod \"maas-api-7795997cf4-xdwfq\" (UID: \"8757d6d3-ab09-4eab-a587-0fb017ddda4a\") " pod="opendatahub/maas-api-7795997cf4-xdwfq" Jun 09 11:06:36.346538 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:36.346510 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8757d6d3-ab09-4eab-a587-0fb017ddda4a-maas-api-tls\") pod \"maas-api-7795997cf4-xdwfq\" (UID: \"8757d6d3-ab09-4eab-a587-0fb017ddda4a\") " pod="opendatahub/maas-api-7795997cf4-xdwfq" Jun 09 11:06:36.346696 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:36.346553 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6x7gp\" (UniqueName: \"kubernetes.io/projected/8757d6d3-ab09-4eab-a587-0fb017ddda4a-kube-api-access-6x7gp\") pod \"maas-api-7795997cf4-xdwfq\" (UID: \"8757d6d3-ab09-4eab-a587-0fb017ddda4a\") " pod="opendatahub/maas-api-7795997cf4-xdwfq" Jun 09 11:06:36.349032 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:36.349009 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8757d6d3-ab09-4eab-a587-0fb017ddda4a-maas-api-tls\") pod \"maas-api-7795997cf4-xdwfq\" (UID: \"8757d6d3-ab09-4eab-a587-0fb017ddda4a\") " pod="opendatahub/maas-api-7795997cf4-xdwfq" Jun 09 11:06:36.358144 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:36.358113 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6x7gp\" (UniqueName: \"kubernetes.io/projected/8757d6d3-ab09-4eab-a587-0fb017ddda4a-kube-api-access-6x7gp\") pod \"maas-api-7795997cf4-xdwfq\" (UID: \"8757d6d3-ab09-4eab-a587-0fb017ddda4a\") " pod="opendatahub/maas-api-7795997cf4-xdwfq" Jun 09 11:06:36.441044 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:36.440974 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7795997cf4-xdwfq" Jun 09 11:06:36.586817 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:36.586788 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7795997cf4-xdwfq"] Jun 09 11:06:36.588447 ip-10-0-136-7 kubenswrapper[2562]: W0609 11:06:36.588419 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8757d6d3_ab09_4eab_a587_0fb017ddda4a.slice/crio-16c10e79eeecbe5f88457e4fd3b37aa318ec3f65ec30cda4bb0166a763e38101 WatchSource:0}: Error finding container 16c10e79eeecbe5f88457e4fd3b37aa318ec3f65ec30cda4bb0166a763e38101: Status 404 returned error can't find the container with id 16c10e79eeecbe5f88457e4fd3b37aa318ec3f65ec30cda4bb0166a763e38101 Jun 09 11:06:36.655238 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:36.655211 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-2hwhl"] Jun 09 11:06:36.658451 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:36.658435 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" Jun 09 11:06:36.661245 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:36.661229 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 09 11:06:36.661321 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:36.661248 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-ckdv9\"" Jun 09 11:06:36.668254 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:36.668231 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-2hwhl"] Jun 09 11:06:36.749913 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:36.749884 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwwdj\" (UniqueName: \"kubernetes.io/projected/749b98a3-d487-4905-b172-653386a26242-kube-api-access-hwwdj\") pod \"payload-processing-7c6c859784-2hwhl\" (UID: \"749b98a3-d487-4905-b172-653386a26242\") " pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" Jun 09 11:06:36.850966 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:36.850933 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwwdj\" (UniqueName: \"kubernetes.io/projected/749b98a3-d487-4905-b172-653386a26242-kube-api-access-hwwdj\") pod \"payload-processing-7c6c859784-2hwhl\" (UID: \"749b98a3-d487-4905-b172-653386a26242\") " pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" Jun 09 11:06:36.859121 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:36.859098 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwwdj\" (UniqueName: \"kubernetes.io/projected/749b98a3-d487-4905-b172-653386a26242-kube-api-access-hwwdj\") pod \"payload-processing-7c6c859784-2hwhl\" (UID: \"749b98a3-d487-4905-b172-653386a26242\") " pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" Jun 09 11:06:36.970673 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:36.970639 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" Jun 09 11:06:37.035340 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:37.035310 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7795997cf4-xdwfq" event={"ID":"8757d6d3-ab09-4eab-a587-0fb017ddda4a","Type":"ContainerStarted","Data":"16c10e79eeecbe5f88457e4fd3b37aa318ec3f65ec30cda4bb0166a763e38101"} Jun 09 11:06:37.103745 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:37.103722 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-2hwhl"] Jun 09 11:06:37.105269 ip-10-0-136-7 kubenswrapper[2562]: W0609 11:06:37.105239 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod749b98a3_d487_4905_b172_653386a26242.slice/crio-b80ff138db2a2f4d866677fce7f7c80e1e2482e8558b11591137d3be0dc5c083 WatchSource:0}: Error finding container b80ff138db2a2f4d866677fce7f7c80e1e2482e8558b11591137d3be0dc5c083: Status 404 returned error can't find the container with id b80ff138db2a2f4d866677fce7f7c80e1e2482e8558b11591137d3be0dc5c083 Jun 09 11:06:38.042656 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:38.042619 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" event={"ID":"749b98a3-d487-4905-b172-653386a26242","Type":"ContainerStarted","Data":"b80ff138db2a2f4d866677fce7f7c80e1e2482e8558b11591137d3be0dc5c083"} Jun 09 11:06:39.049541 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:39.049501 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7795997cf4-xdwfq" event={"ID":"8757d6d3-ab09-4eab-a587-0fb017ddda4a","Type":"ContainerStarted","Data":"52f72722ebab4dcc34e7a7e460a42ee781c1a9d56fe63caadc82b4b86ebfcacc"} Jun 09 11:06:39.049999 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:39.049630 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-7795997cf4-xdwfq" Jun 09 11:06:39.051032 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:39.051007 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" event={"ID":"749b98a3-d487-4905-b172-653386a26242","Type":"ContainerStarted","Data":"1f0a76ca747e40f196d0584640feee14f1f82cd3d48c02a3f15e657908142459"} Jun 09 11:06:39.051165 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:39.051078 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" Jun 09 11:06:39.067382 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:39.067341 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-7795997cf4-xdwfq" podStartSLOduration=1.032554659 podStartE2EDuration="3.067328946s" totalImagesPullingTime="2.034774287s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:06:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:06:39.066440982 +0000 UTC m=+788.930680811" watchObservedRunningTime="2026-06-09 11:06:39.067328946 +0000 UTC m=+788.931568773" Jun 09 11:06:39.085453 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:39.085410 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" podStartSLOduration=1.566099119 podStartE2EDuration="3.085392943s" totalImagesPullingTime="1.519293824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:06:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:06:39.083133799 +0000 UTC m=+788.947373632" watchObservedRunningTime="2026-06-09 11:06:39.085392943 +0000 UTC m=+788.949632775" Jun 09 11:06:45.060832 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:45.060803 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-7795997cf4-xdwfq" Jun 09 11:06:46.934959 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:46.934926 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 11:06:46.935386 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:46.935105 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="28b7f06c-4549-4eb3-9233-79b7fb22ef58" containerName="keycloak" containerID="cri-o://43001d76ac62c753b2592176e323b41e8d2b663b0b60b8bc94913ae9287146c9" gracePeriod=30 Jun 09 11:06:48.581118 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:48.581091 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 11:06:48.647512 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:48.647449 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mlxt\" (UniqueName: \"kubernetes.io/projected/28b7f06c-4549-4eb3-9233-79b7fb22ef58-kube-api-access-7mlxt\") pod \"28b7f06c-4549-4eb3-9233-79b7fb22ef58\" (UID: \"28b7f06c-4549-4eb3-9233-79b7fb22ef58\") " Jun 09 11:06:48.649415 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:48.649382 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28b7f06c-4549-4eb3-9233-79b7fb22ef58-kube-api-access-7mlxt" (OuterVolumeSpecName: "kube-api-access-7mlxt") pod "28b7f06c-4549-4eb3-9233-79b7fb22ef58" (UID: "28b7f06c-4549-4eb3-9233-79b7fb22ef58"). InnerVolumeSpecName "kube-api-access-7mlxt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:06:48.747958 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:48.747936 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7mlxt\" (UniqueName: \"kubernetes.io/projected/28b7f06c-4549-4eb3-9233-79b7fb22ef58-kube-api-access-7mlxt\") on node \"ip-10-0-136-7.ec2.internal\" DevicePath \"\"" Jun 09 11:06:49.102437 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:49.102402 2562 generic.go:356] "Generic (PLEG): container finished" podID="28b7f06c-4549-4eb3-9233-79b7fb22ef58" containerID="43001d76ac62c753b2592176e323b41e8d2b663b0b60b8bc94913ae9287146c9" exitCode=143 Jun 09 11:06:49.102646 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:49.102444 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 11:06:49.102646 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:49.102488 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"28b7f06c-4549-4eb3-9233-79b7fb22ef58","Type":"ContainerDied","Data":"43001d76ac62c753b2592176e323b41e8d2b663b0b60b8bc94913ae9287146c9"} Jun 09 11:06:49.102646 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:49.102549 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"28b7f06c-4549-4eb3-9233-79b7fb22ef58","Type":"ContainerDied","Data":"2cf08edef68ce4fe805b5725274a77567588b326d8e636063ee5b327a6cefb9d"} Jun 09 11:06:49.102646 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:49.102577 2562 scope.go:117] "RemoveContainer" containerID="43001d76ac62c753b2592176e323b41e8d2b663b0b60b8bc94913ae9287146c9" Jun 09 11:06:49.116005 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:49.115984 2562 scope.go:117] "RemoveContainer" containerID="43001d76ac62c753b2592176e323b41e8d2b663b0b60b8bc94913ae9287146c9" Jun 09 11:06:49.116314 ip-10-0-136-7 kubenswrapper[2562]: E0609 11:06:49.116290 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43001d76ac62c753b2592176e323b41e8d2b663b0b60b8bc94913ae9287146c9\": container with ID starting with 43001d76ac62c753b2592176e323b41e8d2b663b0b60b8bc94913ae9287146c9 not found: ID does not exist" containerID="43001d76ac62c753b2592176e323b41e8d2b663b0b60b8bc94913ae9287146c9" Jun 09 11:06:49.116370 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:49.116324 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43001d76ac62c753b2592176e323b41e8d2b663b0b60b8bc94913ae9287146c9"} err="failed to get container status \"43001d76ac62c753b2592176e323b41e8d2b663b0b60b8bc94913ae9287146c9\": rpc error: code = NotFound desc = could not find container \"43001d76ac62c753b2592176e323b41e8d2b663b0b60b8bc94913ae9287146c9\": container with ID starting with 43001d76ac62c753b2592176e323b41e8d2b663b0b60b8bc94913ae9287146c9 not found: ID does not exist" Jun 09 11:06:49.129462 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:49.129433 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 11:06:49.133484 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:49.133459 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 11:06:49.154859 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:49.154839 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 11:06:49.155217 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:49.155205 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28b7f06c-4549-4eb3-9233-79b7fb22ef58" containerName="keycloak" Jun 09 11:06:49.155275 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:49.155219 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="28b7f06c-4549-4eb3-9233-79b7fb22ef58" containerName="keycloak" Jun 09 11:06:49.155311 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:49.155274 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="28b7f06c-4549-4eb3-9233-79b7fb22ef58" containerName="keycloak" Jun 09 11:06:49.158181 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:49.158166 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 11:06:49.160989 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:49.160970 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 09 11:06:49.161096 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:49.161009 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 09 11:06:49.161096 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:49.160977 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 09 11:06:49.161096 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:49.160970 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 09 11:06:49.161096 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:49.161059 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-7phd6\"" Jun 09 11:06:49.168021 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:49.168002 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 11:06:49.251787 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:49.251766 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/8bb74ac1-a60e-490e-bcd1-113496997a5c-test-realms\") pod \"maas-keycloak-0\" (UID: \"8bb74ac1-a60e-490e-bcd1-113496997a5c\") " pod="keycloak-system/maas-keycloak-0" Jun 09 11:06:49.251889 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:49.251815 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlg5r\" (UniqueName: \"kubernetes.io/projected/8bb74ac1-a60e-490e-bcd1-113496997a5c-kube-api-access-rlg5r\") pod \"maas-keycloak-0\" (UID: \"8bb74ac1-a60e-490e-bcd1-113496997a5c\") " pod="keycloak-system/maas-keycloak-0" Jun 09 11:06:49.352719 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:49.352665 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/8bb74ac1-a60e-490e-bcd1-113496997a5c-test-realms\") pod \"maas-keycloak-0\" (UID: \"8bb74ac1-a60e-490e-bcd1-113496997a5c\") " pod="keycloak-system/maas-keycloak-0" Jun 09 11:06:49.352719 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:49.352710 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlg5r\" (UniqueName: \"kubernetes.io/projected/8bb74ac1-a60e-490e-bcd1-113496997a5c-kube-api-access-rlg5r\") pod \"maas-keycloak-0\" (UID: \"8bb74ac1-a60e-490e-bcd1-113496997a5c\") " pod="keycloak-system/maas-keycloak-0" Jun 09 11:06:49.353312 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:49.353289 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/8bb74ac1-a60e-490e-bcd1-113496997a5c-test-realms\") pod \"maas-keycloak-0\" (UID: \"8bb74ac1-a60e-490e-bcd1-113496997a5c\") " pod="keycloak-system/maas-keycloak-0" Jun 09 11:06:49.361708 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:49.361693 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlg5r\" (UniqueName: \"kubernetes.io/projected/8bb74ac1-a60e-490e-bcd1-113496997a5c-kube-api-access-rlg5r\") pod \"maas-keycloak-0\" (UID: \"8bb74ac1-a60e-490e-bcd1-113496997a5c\") " pod="keycloak-system/maas-keycloak-0" Jun 09 11:06:49.467995 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:49.467973 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 11:06:49.600311 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:49.600146 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 11:06:49.602869 ip-10-0-136-7 kubenswrapper[2562]: W0609 11:06:49.602809 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bb74ac1_a60e_490e_bcd1_113496997a5c.slice/crio-bb293485b99d41049a42972030ea5bfbed147dbc7fa16e7137564ecc86aee8c3 WatchSource:0}: Error finding container bb293485b99d41049a42972030ea5bfbed147dbc7fa16e7137564ecc86aee8c3: Status 404 returned error can't find the container with id bb293485b99d41049a42972030ea5bfbed147dbc7fa16e7137564ecc86aee8c3 Jun 09 11:06:50.057419 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:50.057353 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" Jun 09 11:06:50.109608 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:50.109546 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"8bb74ac1-a60e-490e-bcd1-113496997a5c","Type":"ContainerStarted","Data":"b96bd432663b26797d2d7e2222f83729f14de9f88834c169790a4bfbaecd578e"} Jun 09 11:06:50.109759 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:50.109631 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"8bb74ac1-a60e-490e-bcd1-113496997a5c","Type":"ContainerStarted","Data":"bb293485b99d41049a42972030ea5bfbed147dbc7fa16e7137564ecc86aee8c3"} Jun 09 11:06:50.131483 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:50.131434 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.777112991 podStartE2EDuration="1.131419377s" totalImagesPullingTime="354.306386ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:06:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:06:50.129499333 +0000 UTC m=+799.993739162" watchObservedRunningTime="2026-06-09 11:06:50.131419377 +0000 UTC m=+799.995659205" Jun 09 11:06:50.469043 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:50.469009 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 09 11:06:50.470545 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:50.470506 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8bb74ac1-a60e-490e-bcd1-113496997a5c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jun 09 11:06:50.598670 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:50.598632 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28b7f06c-4549-4eb3-9233-79b7fb22ef58" path="/var/lib/kubelet/pods/28b7f06c-4549-4eb3-9233-79b7fb22ef58/volumes" Jun 09 11:06:51.469391 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:51.469343 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8bb74ac1-a60e-490e-bcd1-113496997a5c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jun 09 11:06:52.469244 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:52.469202 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8bb74ac1-a60e-490e-bcd1-113496997a5c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jun 09 11:06:53.469358 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:53.469295 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8bb74ac1-a60e-490e-bcd1-113496997a5c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jun 09 11:06:54.469306 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:54.469253 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8bb74ac1-a60e-490e-bcd1-113496997a5c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jun 09 11:06:55.468615 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:55.468552 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8bb74ac1-a60e-490e-bcd1-113496997a5c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jun 09 11:06:56.468744 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:56.468699 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8bb74ac1-a60e-490e-bcd1-113496997a5c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jun 09 11:06:57.468888 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:57.468846 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8bb74ac1-a60e-490e-bcd1-113496997a5c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jun 09 11:06:58.469208 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:58.469169 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8bb74ac1-a60e-490e-bcd1-113496997a5c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jun 09 11:06:59.468129 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:59.468088 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 09 11:06:59.468396 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:06:59.468356 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8bb74ac1-a60e-490e-bcd1-113496997a5c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jun 09 11:07:00.469008 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:07:00.468970 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8bb74ac1-a60e-490e-bcd1-113496997a5c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jun 09 11:07:01.469354 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:07:01.469300 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8bb74ac1-a60e-490e-bcd1-113496997a5c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jun 09 11:07:02.468822 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:07:02.468770 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8bb74ac1-a60e-490e-bcd1-113496997a5c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jun 09 11:07:03.591385 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:07:03.591342 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 09 11:07:03.608412 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:07:03.608347 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="8bb74ac1-a60e-490e-bcd1-113496997a5c" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 11:07:13.597370 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:07:13.597336 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 09 11:07:43.311221 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:07:43.311192 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gk9k7"] Jun 09 11:07:43.316135 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:07:43.316119 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gk9k7" Jun 09 11:07:43.319047 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:07:43.319023 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 09 11:07:43.319155 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:07:43.319098 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 09 11:07:43.320178 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:07:43.320157 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 09 11:07:43.320178 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:07:43.320172 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-zgwvs\"" Jun 09 11:07:43.326915 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:07:43.326892 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gk9k7"] Jun 09 11:07:43.457715 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:07:43.457674 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6529292-aac7-499b-a491-5c7b2c2eb18f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-gk9k7\" (UID: \"f6529292-aac7-499b-a491-5c7b2c2eb18f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gk9k7" Jun 09 11:07:43.458042 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:07:43.458023 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6529292-aac7-499b-a491-5c7b2c2eb18f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-gk9k7\" (UID: \"f6529292-aac7-499b-a491-5c7b2c2eb18f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gk9k7" Jun 09 11:07:43.458135 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:07:43.458062 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwwf5\" (UniqueName: \"kubernetes.io/projected/f6529292-aac7-499b-a491-5c7b2c2eb18f-kube-api-access-nwwf5\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-gk9k7\" (UID: \"f6529292-aac7-499b-a491-5c7b2c2eb18f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gk9k7" Jun 09 11:07:43.458135 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:07:43.458112 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6529292-aac7-499b-a491-5c7b2c2eb18f-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-gk9k7\" (UID: \"f6529292-aac7-499b-a491-5c7b2c2eb18f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gk9k7" Jun 09 11:07:43.458377 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:07:43.458354 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6529292-aac7-499b-a491-5c7b2c2eb18f-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-gk9k7\" (UID: \"f6529292-aac7-499b-a491-5c7b2c2eb18f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gk9k7" Jun 09 11:07:43.458447 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:07:43.458401 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f6529292-aac7-499b-a491-5c7b2c2eb18f-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-gk9k7\" (UID: \"f6529292-aac7-499b-a491-5c7b2c2eb18f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gk9k7" Jun 09 11:07:43.559577 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:07:43.559537 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6529292-aac7-499b-a491-5c7b2c2eb18f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-gk9k7\" (UID: \"f6529292-aac7-499b-a491-5c7b2c2eb18f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gk9k7" Jun 09 11:07:43.559762 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:07:43.559636 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6529292-aac7-499b-a491-5c7b2c2eb18f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-gk9k7\" (UID: \"f6529292-aac7-499b-a491-5c7b2c2eb18f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gk9k7" Jun 09 11:07:43.559762 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:07:43.559667 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwwf5\" (UniqueName: \"kubernetes.io/projected/f6529292-aac7-499b-a491-5c7b2c2eb18f-kube-api-access-nwwf5\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-gk9k7\" (UID: \"f6529292-aac7-499b-a491-5c7b2c2eb18f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gk9k7" Jun 09 11:07:43.559762 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:07:43.559696 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6529292-aac7-499b-a491-5c7b2c2eb18f-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-gk9k7\" (UID: \"f6529292-aac7-499b-a491-5c7b2c2eb18f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gk9k7" Jun 09 11:07:43.559908 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:07:43.559871 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6529292-aac7-499b-a491-5c7b2c2eb18f-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-gk9k7\" (UID: \"f6529292-aac7-499b-a491-5c7b2c2eb18f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gk9k7" Jun 09 11:07:43.559959 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:07:43.559933 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f6529292-aac7-499b-a491-5c7b2c2eb18f-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-gk9k7\" (UID: \"f6529292-aac7-499b-a491-5c7b2c2eb18f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gk9k7" Jun 09 11:07:43.560029 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:07:43.559997 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6529292-aac7-499b-a491-5c7b2c2eb18f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-gk9k7\" (UID: \"f6529292-aac7-499b-a491-5c7b2c2eb18f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gk9k7" Jun 09 11:07:43.560091 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:07:43.560025 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6529292-aac7-499b-a491-5c7b2c2eb18f-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-gk9k7\" (UID: \"f6529292-aac7-499b-a491-5c7b2c2eb18f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gk9k7" Jun 09 11:07:43.560209 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:07:43.560190 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f6529292-aac7-499b-a491-5c7b2c2eb18f-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-gk9k7\" (UID: \"f6529292-aac7-499b-a491-5c7b2c2eb18f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gk9k7" Jun 09 11:07:43.562096 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:07:43.562034 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6529292-aac7-499b-a491-5c7b2c2eb18f-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-gk9k7\" (UID: \"f6529292-aac7-499b-a491-5c7b2c2eb18f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gk9k7" Jun 09 11:07:43.562236 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:07:43.562218 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6529292-aac7-499b-a491-5c7b2c2eb18f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-gk9k7\" (UID: \"f6529292-aac7-499b-a491-5c7b2c2eb18f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gk9k7" Jun 09 11:07:43.567578 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:07:43.567556 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwwf5\" (UniqueName: \"kubernetes.io/projected/f6529292-aac7-499b-a491-5c7b2c2eb18f-kube-api-access-nwwf5\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-gk9k7\" (UID: \"f6529292-aac7-499b-a491-5c7b2c2eb18f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gk9k7" Jun 09 11:07:43.626932 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:07:43.626898 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gk9k7" Jun 09 11:07:43.764204 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:07:43.764176 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gk9k7"] Jun 09 11:07:43.766495 ip-10-0-136-7 kubenswrapper[2562]: W0609 11:07:43.766448 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6529292_aac7_499b_a491_5c7b2c2eb18f.slice/crio-c3a35f4679f299bdb96a4a52d9433cb41cdff36d3f50f755b97b27189326d06c WatchSource:0}: Error finding container c3a35f4679f299bdb96a4a52d9433cb41cdff36d3f50f755b97b27189326d06c: Status 404 returned error can't find the container with id c3a35f4679f299bdb96a4a52d9433cb41cdff36d3f50f755b97b27189326d06c Jun 09 11:07:44.410665 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:07:44.410626 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gk9k7" event={"ID":"f6529292-aac7-499b-a491-5c7b2c2eb18f","Type":"ContainerStarted","Data":"c3a35f4679f299bdb96a4a52d9433cb41cdff36d3f50f755b97b27189326d06c"} Jun 09 11:07:48.433068 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:07:48.433032 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gk9k7" event={"ID":"f6529292-aac7-499b-a491-5c7b2c2eb18f","Type":"ContainerStarted","Data":"28d8dc13078d2dbf5d616a3a42fd33b0512781725ad2b76e41b11c8cd3012a64"} Jun 09 11:07:50.443969 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:07:50.443936 2562 generic.go:356] "Generic (PLEG): container finished" podID="f6529292-aac7-499b-a491-5c7b2c2eb18f" containerID="28d8dc13078d2dbf5d616a3a42fd33b0512781725ad2b76e41b11c8cd3012a64" exitCode=0 Jun 09 11:07:50.444344 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:07:50.444009 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gk9k7" event={"ID":"f6529292-aac7-499b-a491-5c7b2c2eb18f","Type":"ContainerDied","Data":"28d8dc13078d2dbf5d616a3a42fd33b0512781725ad2b76e41b11c8cd3012a64"} Jun 09 11:07:52.457169 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:07:52.457129 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gk9k7" event={"ID":"f6529292-aac7-499b-a491-5c7b2c2eb18f","Type":"ContainerStarted","Data":"1ca4ba1ee9e2ee14cf54fe45bbfe4848b537c2a330682d7b65db276acc708314"} Jun 09 11:07:52.477614 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:07:52.477550 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gk9k7" podStartSLOduration=2.634068145 podStartE2EDuration="9.477535597s" totalImagesPullingTime="5.638933446s" totalInitContainerRuntime="1.204534006s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:07:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:07:52.476167585 +0000 UTC m=+862.340407414" watchObservedRunningTime="2026-06-09 11:07:52.477535597 +0000 UTC m=+862.341775425" Jun 09 11:07:53.627002 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:07:53.626969 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gk9k7" Jun 09 11:07:53.627385 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:07:53.627025 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gk9k7" Jun 09 11:07:53.639370 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:07:53.639343 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gk9k7" Jun 09 11:07:54.478533 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:07:54.478502 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gk9k7" Jun 09 11:08:28.979737 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:08:28.979699 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-mv8cp"] Jun 09 11:08:28.983026 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:08:28.983004 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mv8cp" Jun 09 11:08:28.985878 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:08:28.985856 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 09 11:08:28.995214 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:08:28.995193 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-mv8cp"] Jun 09 11:08:29.050453 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:08:29.050425 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a2c9765-0cae-4415-ad4b-47a4b1fe88f8-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mv8cp\" (UID: \"3a2c9765-0cae-4415-ad4b-47a4b1fe88f8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mv8cp" Jun 09 11:08:29.050612 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:08:29.050467 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3a2c9765-0cae-4415-ad4b-47a4b1fe88f8-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mv8cp\" (UID: \"3a2c9765-0cae-4415-ad4b-47a4b1fe88f8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mv8cp" Jun 09 11:08:29.050612 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:08:29.050495 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a2c9765-0cae-4415-ad4b-47a4b1fe88f8-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mv8cp\" (UID: \"3a2c9765-0cae-4415-ad4b-47a4b1fe88f8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mv8cp" Jun 09 11:08:29.050612 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:08:29.050551 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn8kb\" (UniqueName: \"kubernetes.io/projected/3a2c9765-0cae-4415-ad4b-47a4b1fe88f8-kube-api-access-gn8kb\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mv8cp\" (UID: \"3a2c9765-0cae-4415-ad4b-47a4b1fe88f8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mv8cp" Jun 09 11:08:29.050612 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:08:29.050578 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a2c9765-0cae-4415-ad4b-47a4b1fe88f8-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mv8cp\" (UID: \"3a2c9765-0cae-4415-ad4b-47a4b1fe88f8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mv8cp" Jun 09 11:08:29.050807 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:08:29.050674 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a2c9765-0cae-4415-ad4b-47a4b1fe88f8-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mv8cp\" (UID: \"3a2c9765-0cae-4415-ad4b-47a4b1fe88f8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mv8cp" Jun 09 11:08:29.151466 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:08:29.151439 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3a2c9765-0cae-4415-ad4b-47a4b1fe88f8-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mv8cp\" (UID: \"3a2c9765-0cae-4415-ad4b-47a4b1fe88f8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mv8cp" Jun 09 11:08:29.151635 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:08:29.151479 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a2c9765-0cae-4415-ad4b-47a4b1fe88f8-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mv8cp\" (UID: \"3a2c9765-0cae-4415-ad4b-47a4b1fe88f8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mv8cp" Jun 09 11:08:29.151635 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:08:29.151507 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn8kb\" (UniqueName: \"kubernetes.io/projected/3a2c9765-0cae-4415-ad4b-47a4b1fe88f8-kube-api-access-gn8kb\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mv8cp\" (UID: \"3a2c9765-0cae-4415-ad4b-47a4b1fe88f8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mv8cp" Jun 09 11:08:29.151753 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:08:29.151704 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a2c9765-0cae-4415-ad4b-47a4b1fe88f8-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mv8cp\" (UID: \"3a2c9765-0cae-4415-ad4b-47a4b1fe88f8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mv8cp" Jun 09 11:08:29.151811 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:08:29.151796 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a2c9765-0cae-4415-ad4b-47a4b1fe88f8-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mv8cp\" (UID: \"3a2c9765-0cae-4415-ad4b-47a4b1fe88f8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mv8cp" Jun 09 11:08:29.151869 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:08:29.151851 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a2c9765-0cae-4415-ad4b-47a4b1fe88f8-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mv8cp\" (UID: \"3a2c9765-0cae-4415-ad4b-47a4b1fe88f8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mv8cp" Jun 09 11:08:29.151994 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:08:29.151973 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3a2c9765-0cae-4415-ad4b-47a4b1fe88f8-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mv8cp\" (UID: \"3a2c9765-0cae-4415-ad4b-47a4b1fe88f8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mv8cp" Jun 09 11:08:29.152049 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:08:29.152029 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a2c9765-0cae-4415-ad4b-47a4b1fe88f8-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mv8cp\" (UID: \"3a2c9765-0cae-4415-ad4b-47a4b1fe88f8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mv8cp" Jun 09 11:08:29.152197 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:08:29.152173 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a2c9765-0cae-4415-ad4b-47a4b1fe88f8-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mv8cp\" (UID: \"3a2c9765-0cae-4415-ad4b-47a4b1fe88f8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mv8cp" Jun 09 11:08:29.153801 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:08:29.153781 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a2c9765-0cae-4415-ad4b-47a4b1fe88f8-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mv8cp\" (UID: \"3a2c9765-0cae-4415-ad4b-47a4b1fe88f8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mv8cp" Jun 09 11:08:29.154039 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:08:29.154020 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a2c9765-0cae-4415-ad4b-47a4b1fe88f8-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mv8cp\" (UID: \"3a2c9765-0cae-4415-ad4b-47a4b1fe88f8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mv8cp" Jun 09 11:08:29.160071 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:08:29.160048 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn8kb\" (UniqueName: \"kubernetes.io/projected/3a2c9765-0cae-4415-ad4b-47a4b1fe88f8-kube-api-access-gn8kb\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mv8cp\" (UID: \"3a2c9765-0cae-4415-ad4b-47a4b1fe88f8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mv8cp" Jun 09 11:08:29.294490 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:08:29.294429 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mv8cp" Jun 09 11:08:29.426971 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:08:29.426899 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-mv8cp"] Jun 09 11:08:29.429240 ip-10-0-136-7 kubenswrapper[2562]: W0609 11:08:29.429216 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a2c9765_0cae_4415_ad4b_47a4b1fe88f8.slice/crio-a9804b1bdaba8d3b87bc16625f05b5dd5114c96485073cacc20a415de9379522 WatchSource:0}: Error finding container a9804b1bdaba8d3b87bc16625f05b5dd5114c96485073cacc20a415de9379522: Status 404 returned error can't find the container with id a9804b1bdaba8d3b87bc16625f05b5dd5114c96485073cacc20a415de9379522 Jun 09 11:08:29.637313 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:08:29.637227 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mv8cp" event={"ID":"3a2c9765-0cae-4415-ad4b-47a4b1fe88f8","Type":"ContainerStarted","Data":"93d1ad2df2a3e9146219fce34ea004d7ebfcb599a9e657209771d3c0549453a0"} Jun 09 11:08:29.637313 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:08:29.637288 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mv8cp" event={"ID":"3a2c9765-0cae-4415-ad4b-47a4b1fe88f8","Type":"ContainerStarted","Data":"a9804b1bdaba8d3b87bc16625f05b5dd5114c96485073cacc20a415de9379522"} Jun 09 11:08:30.617215 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:08:30.617189 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-ph2xt_56eeb8e9-a748-4e99-b04a-6d998c6aad8b/console-operator/2.log" Jun 09 11:08:30.617673 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:08:30.617524 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-ph2xt_56eeb8e9-a748-4e99-b04a-6d998c6aad8b/console-operator/2.log" Jun 09 11:08:30.625702 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:08:30.625679 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vjfd2_1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070/ovn-acl-logging/0.log" Jun 09 11:08:30.626197 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:08:30.626180 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vjfd2_1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070/ovn-acl-logging/0.log" Jun 09 11:08:32.652612 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:08:32.652558 2562 generic.go:356] "Generic (PLEG): container finished" podID="3a2c9765-0cae-4415-ad4b-47a4b1fe88f8" containerID="93d1ad2df2a3e9146219fce34ea004d7ebfcb599a9e657209771d3c0549453a0" exitCode=0 Jun 09 11:08:32.653068 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:08:32.652633 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mv8cp" event={"ID":"3a2c9765-0cae-4415-ad4b-47a4b1fe88f8","Type":"ContainerDied","Data":"93d1ad2df2a3e9146219fce34ea004d7ebfcb599a9e657209771d3c0549453a0"} Jun 09 11:08:33.659312 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:08:33.659278 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mv8cp" event={"ID":"3a2c9765-0cae-4415-ad4b-47a4b1fe88f8","Type":"ContainerStarted","Data":"90dcad747f44b60107ca4f5f3e587b0a4f68b7d44a50633d0b79f1aca3ad3daf"} Jun 09 11:08:33.680619 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:08:33.680558 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mv8cp" podStartSLOduration=3.138617362 podStartE2EDuration="5.680543402s" totalImagesPullingTime="266.745143ms" totalInitContainerRuntime="2.275180897s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:08:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:08:33.679389586 +0000 UTC m=+903.543629416" watchObservedRunningTime="2026-06-09 11:08:33.680543402 +0000 UTC m=+903.544783230" Jun 09 11:08:39.294527 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:08:39.294497 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mv8cp" Jun 09 11:08:39.294985 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:08:39.294553 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mv8cp" Jun 09 11:08:39.307249 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:08:39.307227 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mv8cp" Jun 09 11:08:39.690065 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:08:39.689983 2562 generic.go:356] "Generic (PLEG): container finished" podID="749b98a3-d487-4905-b172-653386a26242" containerID="1f0a76ca747e40f196d0584640feee14f1f82cd3d48c02a3f15e657908142459" exitCode=1 Jun 09 11:08:39.690065 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:08:39.690055 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" event={"ID":"749b98a3-d487-4905-b172-653386a26242","Type":"ContainerDied","Data":"1f0a76ca747e40f196d0584640feee14f1f82cd3d48c02a3f15e657908142459"} Jun 09 11:08:39.690480 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:08:39.690457 2562 scope.go:117] "RemoveContainer" containerID="1f0a76ca747e40f196d0584640feee14f1f82cd3d48c02a3f15e657908142459" Jun 09 11:08:39.702063 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:08:39.702046 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mv8cp" Jun 09 11:08:40.056269 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:08:40.056237 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" Jun 09 11:08:40.697492 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:08:40.697455 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" event={"ID":"749b98a3-d487-4905-b172-653386a26242","Type":"ContainerStarted","Data":"3b16ae7f75d31654973d22d0480eae03fab5d4859393b2f265f54542e396841b"} Jun 09 11:08:40.697979 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:08:40.697688 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" Jun 09 11:08:51.705293 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:08:51.705265 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" Jun 09 11:10:40.301238 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:10:40.301205 2562 generic.go:356] "Generic (PLEG): container finished" podID="749b98a3-d487-4905-b172-653386a26242" containerID="3b16ae7f75d31654973d22d0480eae03fab5d4859393b2f265f54542e396841b" exitCode=1 Jun 09 11:10:40.301750 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:10:40.301277 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" event={"ID":"749b98a3-d487-4905-b172-653386a26242","Type":"ContainerDied","Data":"3b16ae7f75d31654973d22d0480eae03fab5d4859393b2f265f54542e396841b"} Jun 09 11:10:40.301750 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:10:40.301343 2562 scope.go:117] "RemoveContainer" containerID="1f0a76ca747e40f196d0584640feee14f1f82cd3d48c02a3f15e657908142459" Jun 09 11:10:40.301920 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:10:40.301779 2562 scope.go:117] "RemoveContainer" containerID="3b16ae7f75d31654973d22d0480eae03fab5d4859393b2f265f54542e396841b" Jun 09 11:10:40.302024 ip-10-0-136-7 kubenswrapper[2562]: E0609 11:10:40.302005 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7c6c859784-2hwhl_openshift-ingress(749b98a3-d487-4905-b172-653386a26242)\"" pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" podUID="749b98a3-d487-4905-b172-653386a26242" Jun 09 11:10:41.704332 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:10:41.704299 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" Jun 09 11:10:41.704734 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:10:41.704626 2562 scope.go:117] "RemoveContainer" containerID="3b16ae7f75d31654973d22d0480eae03fab5d4859393b2f265f54542e396841b" Jun 09 11:10:41.704811 ip-10-0-136-7 kubenswrapper[2562]: E0609 11:10:41.704792 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7c6c859784-2hwhl_openshift-ingress(749b98a3-d487-4905-b172-653386a26242)\"" pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" podUID="749b98a3-d487-4905-b172-653386a26242" Jun 09 11:10:55.593118 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:10:55.593083 2562 scope.go:117] "RemoveContainer" containerID="3b16ae7f75d31654973d22d0480eae03fab5d4859393b2f265f54542e396841b" Jun 09 11:10:56.385114 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:10:56.385083 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" event={"ID":"749b98a3-d487-4905-b172-653386a26242","Type":"ContainerStarted","Data":"de7aa5fe76ec048c84cd53545efe9389025083ac213ba46d49bf1ab34f3127fd"} Jun 09 11:10:56.385304 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:10:56.385291 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" Jun 09 11:11:07.392145 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:11:07.392117 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" Jun 09 11:11:17.798997 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:11:17.798964 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-69b588cdd-s66jw"] Jun 09 11:11:17.799572 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:11:17.799170 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-69b588cdd-s66jw" podUID="a3d6c3e7-6909-45fe-b4a6-e60cb236e1bc" containerName="manager" containerID="cri-o://512da8998cc221405aaa78fc7d8dcc20e6cbf29869e153b6ad27102bcf26449c" gracePeriod=30 Jun 09 11:11:18.048663 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:11:18.048634 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69b588cdd-s66jw" Jun 09 11:11:18.167810 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:11:18.167714 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a3d6c3e7-6909-45fe-b4a6-e60cb236e1bc-webhook-cert\") pod \"a3d6c3e7-6909-45fe-b4a6-e60cb236e1bc\" (UID: \"a3d6c3e7-6909-45fe-b4a6-e60cb236e1bc\") " Jun 09 11:11:18.167946 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:11:18.167838 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wfdpb\" (UniqueName: \"kubernetes.io/projected/a3d6c3e7-6909-45fe-b4a6-e60cb236e1bc-kube-api-access-wfdpb\") pod \"a3d6c3e7-6909-45fe-b4a6-e60cb236e1bc\" (UID: \"a3d6c3e7-6909-45fe-b4a6-e60cb236e1bc\") " Jun 09 11:11:18.169780 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:11:18.169754 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3d6c3e7-6909-45fe-b4a6-e60cb236e1bc-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "a3d6c3e7-6909-45fe-b4a6-e60cb236e1bc" (UID: "a3d6c3e7-6909-45fe-b4a6-e60cb236e1bc"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:11:18.169909 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:11:18.169822 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3d6c3e7-6909-45fe-b4a6-e60cb236e1bc-kube-api-access-wfdpb" (OuterVolumeSpecName: "kube-api-access-wfdpb") pod "a3d6c3e7-6909-45fe-b4a6-e60cb236e1bc" (UID: "a3d6c3e7-6909-45fe-b4a6-e60cb236e1bc"). InnerVolumeSpecName "kube-api-access-wfdpb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:11:18.269268 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:11:18.269230 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wfdpb\" (UniqueName: \"kubernetes.io/projected/a3d6c3e7-6909-45fe-b4a6-e60cb236e1bc-kube-api-access-wfdpb\") on node \"ip-10-0-136-7.ec2.internal\" DevicePath \"\"" Jun 09 11:11:18.269268 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:11:18.269262 2562 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a3d6c3e7-6909-45fe-b4a6-e60cb236e1bc-webhook-cert\") on node \"ip-10-0-136-7.ec2.internal\" DevicePath \"\"" Jun 09 11:11:18.495278 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:11:18.495246 2562 generic.go:356] "Generic (PLEG): container finished" podID="a3d6c3e7-6909-45fe-b4a6-e60cb236e1bc" containerID="512da8998cc221405aaa78fc7d8dcc20e6cbf29869e153b6ad27102bcf26449c" exitCode=0 Jun 09 11:11:18.495479 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:11:18.495287 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69b588cdd-s66jw" Jun 09 11:11:18.495479 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:11:18.495345 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69b588cdd-s66jw" event={"ID":"a3d6c3e7-6909-45fe-b4a6-e60cb236e1bc","Type":"ContainerDied","Data":"512da8998cc221405aaa78fc7d8dcc20e6cbf29869e153b6ad27102bcf26449c"} Jun 09 11:11:18.495479 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:11:18.495407 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69b588cdd-s66jw" event={"ID":"a3d6c3e7-6909-45fe-b4a6-e60cb236e1bc","Type":"ContainerDied","Data":"f638b79221aed9b1f10f8f2df7d82bfbd9ac83a01f0454e1fdfefeccb1e34685"} Jun 09 11:11:18.495479 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:11:18.495439 2562 scope.go:117] "RemoveContainer" containerID="512da8998cc221405aaa78fc7d8dcc20e6cbf29869e153b6ad27102bcf26449c" Jun 09 11:11:18.507111 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:11:18.507044 2562 scope.go:117] "RemoveContainer" containerID="512da8998cc221405aaa78fc7d8dcc20e6cbf29869e153b6ad27102bcf26449c" Jun 09 11:11:18.507413 ip-10-0-136-7 kubenswrapper[2562]: E0609 11:11:18.507368 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"512da8998cc221405aaa78fc7d8dcc20e6cbf29869e153b6ad27102bcf26449c\": container with ID starting with 512da8998cc221405aaa78fc7d8dcc20e6cbf29869e153b6ad27102bcf26449c not found: ID does not exist" containerID="512da8998cc221405aaa78fc7d8dcc20e6cbf29869e153b6ad27102bcf26449c" Jun 09 11:11:18.507563 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:11:18.507539 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"512da8998cc221405aaa78fc7d8dcc20e6cbf29869e153b6ad27102bcf26449c"} err="failed to get container status \"512da8998cc221405aaa78fc7d8dcc20e6cbf29869e153b6ad27102bcf26449c\": rpc error: code = NotFound desc = could not find container \"512da8998cc221405aaa78fc7d8dcc20e6cbf29869e153b6ad27102bcf26449c\": container with ID starting with 512da8998cc221405aaa78fc7d8dcc20e6cbf29869e153b6ad27102bcf26449c not found: ID does not exist" Jun 09 11:11:18.524946 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:11:18.524921 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-69b588cdd-s66jw"] Jun 09 11:11:18.528943 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:11:18.528923 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-69b588cdd-s66jw"] Jun 09 11:11:18.597955 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:11:18.597929 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3d6c3e7-6909-45fe-b4a6-e60cb236e1bc" path="/var/lib/kubelet/pods/a3d6c3e7-6909-45fe-b4a6-e60cb236e1bc/volumes" Jun 09 11:12:55.974721 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:12:55.974691 2562 generic.go:356] "Generic (PLEG): container finished" podID="749b98a3-d487-4905-b172-653386a26242" containerID="de7aa5fe76ec048c84cd53545efe9389025083ac213ba46d49bf1ab34f3127fd" exitCode=1 Jun 09 11:12:55.975164 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:12:55.974772 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" event={"ID":"749b98a3-d487-4905-b172-653386a26242","Type":"ContainerDied","Data":"de7aa5fe76ec048c84cd53545efe9389025083ac213ba46d49bf1ab34f3127fd"} Jun 09 11:12:55.975164 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:12:55.974859 2562 scope.go:117] "RemoveContainer" containerID="3b16ae7f75d31654973d22d0480eae03fab5d4859393b2f265f54542e396841b" Jun 09 11:12:55.975164 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:12:55.975133 2562 scope.go:117] "RemoveContainer" containerID="de7aa5fe76ec048c84cd53545efe9389025083ac213ba46d49bf1ab34f3127fd" Jun 09 11:12:55.975425 ip-10-0-136-7 kubenswrapper[2562]: E0609 11:12:55.975401 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-2hwhl_openshift-ingress(749b98a3-d487-4905-b172-653386a26242)\"" pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" podUID="749b98a3-d487-4905-b172-653386a26242" Jun 09 11:12:56.970782 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:12:56.970755 2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" Jun 09 11:12:56.981499 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:12:56.981471 2562 scope.go:117] "RemoveContainer" containerID="de7aa5fe76ec048c84cd53545efe9389025083ac213ba46d49bf1ab34f3127fd" Jun 09 11:12:56.981909 ip-10-0-136-7 kubenswrapper[2562]: E0609 11:12:56.981673 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-2hwhl_openshift-ingress(749b98a3-d487-4905-b172-653386a26242)\"" pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" podUID="749b98a3-d487-4905-b172-653386a26242" Jun 09 11:12:57.391020 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:12:57.390939 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" Jun 09 11:12:57.986139 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:12:57.986111 2562 scope.go:117] "RemoveContainer" containerID="de7aa5fe76ec048c84cd53545efe9389025083ac213ba46d49bf1ab34f3127fd" Jun 09 11:12:57.986525 ip-10-0-136-7 kubenswrapper[2562]: E0609 11:12:57.986343 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-2hwhl_openshift-ingress(749b98a3-d487-4905-b172-653386a26242)\"" pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" podUID="749b98a3-d487-4905-b172-653386a26242" Jun 09 11:13:12.592739 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:13:12.592705 2562 scope.go:117] "RemoveContainer" containerID="de7aa5fe76ec048c84cd53545efe9389025083ac213ba46d49bf1ab34f3127fd" Jun 09 11:13:12.593179 ip-10-0-136-7 kubenswrapper[2562]: E0609 11:13:12.592973 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-2hwhl_openshift-ingress(749b98a3-d487-4905-b172-653386a26242)\"" pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" podUID="749b98a3-d487-4905-b172-653386a26242" Jun 09 11:13:24.599176 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:13:24.599147 2562 scope.go:117] "RemoveContainer" containerID="de7aa5fe76ec048c84cd53545efe9389025083ac213ba46d49bf1ab34f3127fd" Jun 09 11:13:25.124776 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:13:25.124741 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" event={"ID":"749b98a3-d487-4905-b172-653386a26242","Type":"ContainerStarted","Data":"369bf1c9a8eacd1bfc90f8aeccdf7aa2353d8d2dc0b80efef3ac179b3f507e33"} Jun 09 11:13:25.124985 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:13:25.124964 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" Jun 09 11:13:30.649233 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:13:30.649207 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-ph2xt_56eeb8e9-a748-4e99-b04a-6d998c6aad8b/console-operator/2.log" Jun 09 11:13:30.650600 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:13:30.650570 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-ph2xt_56eeb8e9-a748-4e99-b04a-6d998c6aad8b/console-operator/2.log" Jun 09 11:13:30.656541 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:13:30.656515 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vjfd2_1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070/ovn-acl-logging/0.log" Jun 09 11:13:30.657709 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:13:30.657691 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vjfd2_1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070/ovn-acl-logging/0.log" Jun 09 11:13:36.131721 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:13:36.131690 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" Jun 09 11:15:24.737233 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:15:24.737200 2562 generic.go:356] "Generic (PLEG): container finished" podID="749b98a3-d487-4905-b172-653386a26242" containerID="369bf1c9a8eacd1bfc90f8aeccdf7aa2353d8d2dc0b80efef3ac179b3f507e33" exitCode=1 Jun 09 11:15:24.737675 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:15:24.737272 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" event={"ID":"749b98a3-d487-4905-b172-653386a26242","Type":"ContainerDied","Data":"369bf1c9a8eacd1bfc90f8aeccdf7aa2353d8d2dc0b80efef3ac179b3f507e33"} Jun 09 11:15:24.737675 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:15:24.737352 2562 scope.go:117] "RemoveContainer" containerID="de7aa5fe76ec048c84cd53545efe9389025083ac213ba46d49bf1ab34f3127fd" Jun 09 11:15:24.737780 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:15:24.737727 2562 scope.go:117] "RemoveContainer" containerID="369bf1c9a8eacd1bfc90f8aeccdf7aa2353d8d2dc0b80efef3ac179b3f507e33" Jun 09 11:15:24.737964 ip-10-0-136-7 kubenswrapper[2562]: E0609 11:15:24.737945 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 40s restarting failed container=payload-processing pod=payload-processing-7c6c859784-2hwhl_openshift-ingress(749b98a3-d487-4905-b172-653386a26242)\"" pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" podUID="749b98a3-d487-4905-b172-653386a26242" Jun 09 11:15:26.130050 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:15:26.129997 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" Jun 09 11:15:26.130459 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:15:26.130393 2562 scope.go:117] "RemoveContainer" containerID="369bf1c9a8eacd1bfc90f8aeccdf7aa2353d8d2dc0b80efef3ac179b3f507e33" Jun 09 11:15:26.130637 ip-10-0-136-7 kubenswrapper[2562]: E0609 11:15:26.130616 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 40s restarting failed container=payload-processing pod=payload-processing-7c6c859784-2hwhl_openshift-ingress(749b98a3-d487-4905-b172-653386a26242)\"" pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" podUID="749b98a3-d487-4905-b172-653386a26242" Jun 09 11:15:36.971778 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:15:36.971737 2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" Jun 09 11:15:36.972182 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:15:36.972128 2562 scope.go:117] "RemoveContainer" containerID="369bf1c9a8eacd1bfc90f8aeccdf7aa2353d8d2dc0b80efef3ac179b3f507e33" Jun 09 11:15:36.972329 ip-10-0-136-7 kubenswrapper[2562]: E0609 11:15:36.972306 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 40s restarting failed container=payload-processing pod=payload-processing-7c6c859784-2hwhl_openshift-ingress(749b98a3-d487-4905-b172-653386a26242)\"" pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" podUID="749b98a3-d487-4905-b172-653386a26242" Jun 09 11:15:47.592704 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:15:47.592664 2562 scope.go:117] "RemoveContainer" containerID="369bf1c9a8eacd1bfc90f8aeccdf7aa2353d8d2dc0b80efef3ac179b3f507e33" Jun 09 11:15:47.593184 ip-10-0-136-7 kubenswrapper[2562]: E0609 11:15:47.592970 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 40s restarting failed container=payload-processing pod=payload-processing-7c6c859784-2hwhl_openshift-ingress(749b98a3-d487-4905-b172-653386a26242)\"" pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" podUID="749b98a3-d487-4905-b172-653386a26242" Jun 09 11:15:59.592473 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:15:59.592397 2562 scope.go:117] "RemoveContainer" containerID="369bf1c9a8eacd1bfc90f8aeccdf7aa2353d8d2dc0b80efef3ac179b3f507e33" Jun 09 11:15:59.592870 ip-10-0-136-7 kubenswrapper[2562]: E0609 11:15:59.592668 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 40s restarting failed container=payload-processing pod=payload-processing-7c6c859784-2hwhl_openshift-ingress(749b98a3-d487-4905-b172-653386a26242)\"" pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" podUID="749b98a3-d487-4905-b172-653386a26242" Jun 09 11:16:10.596534 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:16:10.596507 2562 scope.go:117] "RemoveContainer" containerID="369bf1c9a8eacd1bfc90f8aeccdf7aa2353d8d2dc0b80efef3ac179b3f507e33" Jun 09 11:16:10.984195 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:16:10.984162 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" event={"ID":"749b98a3-d487-4905-b172-653386a26242","Type":"ContainerStarted","Data":"a59324eb6552c41da83e1e961bf242ab871e2f1ebd60c610de41de761fbbdf06"} Jun 09 11:16:10.984389 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:16:10.984373 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" Jun 09 11:16:21.990231 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:16:21.990201 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" Jun 09 11:18:11.569711 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:18:11.569670 2562 generic.go:356] "Generic (PLEG): container finished" podID="749b98a3-d487-4905-b172-653386a26242" containerID="a59324eb6552c41da83e1e961bf242ab871e2f1ebd60c610de41de761fbbdf06" exitCode=1 Jun 09 11:18:11.570243 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:18:11.569742 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" event={"ID":"749b98a3-d487-4905-b172-653386a26242","Type":"ContainerDied","Data":"a59324eb6552c41da83e1e961bf242ab871e2f1ebd60c610de41de761fbbdf06"} Jun 09 11:18:11.570243 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:18:11.569827 2562 scope.go:117] "RemoveContainer" containerID="369bf1c9a8eacd1bfc90f8aeccdf7aa2353d8d2dc0b80efef3ac179b3f507e33" Jun 09 11:18:11.570243 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:18:11.570151 2562 scope.go:117] "RemoveContainer" containerID="a59324eb6552c41da83e1e961bf242ab871e2f1ebd60c610de41de761fbbdf06" Jun 09 11:18:11.570420 ip-10-0-136-7 kubenswrapper[2562]: E0609 11:18:11.570364 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-2hwhl_openshift-ingress(749b98a3-d487-4905-b172-653386a26242)\"" pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" podUID="749b98a3-d487-4905-b172-653386a26242" Jun 09 11:18:11.989859 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:18:11.989825 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" Jun 09 11:18:12.577284 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:18:12.577261 2562 scope.go:117] "RemoveContainer" containerID="a59324eb6552c41da83e1e961bf242ab871e2f1ebd60c610de41de761fbbdf06" Jun 09 11:18:12.577678 ip-10-0-136-7 kubenswrapper[2562]: E0609 11:18:12.577441 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-2hwhl_openshift-ingress(749b98a3-d487-4905-b172-653386a26242)\"" pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" podUID="749b98a3-d487-4905-b172-653386a26242" Jun 09 11:18:16.971711 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:18:16.971679 2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" Jun 09 11:18:16.972061 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:18:16.971989 2562 scope.go:117] "RemoveContainer" containerID="a59324eb6552c41da83e1e961bf242ab871e2f1ebd60c610de41de761fbbdf06" Jun 09 11:18:16.972163 ip-10-0-136-7 kubenswrapper[2562]: E0609 11:18:16.972144 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-2hwhl_openshift-ingress(749b98a3-d487-4905-b172-653386a26242)\"" pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" podUID="749b98a3-d487-4905-b172-653386a26242" Jun 09 11:18:30.680883 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:18:30.680857 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-ph2xt_56eeb8e9-a748-4e99-b04a-6d998c6aad8b/console-operator/2.log" Jun 09 11:18:30.683506 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:18:30.683479 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-ph2xt_56eeb8e9-a748-4e99-b04a-6d998c6aad8b/console-operator/2.log" Jun 09 11:18:30.688780 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:18:30.688761 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vjfd2_1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070/ovn-acl-logging/0.log" Jun 09 11:18:30.691258 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:18:30.691243 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vjfd2_1ef9b0dc-b26a-43e6-b0bf-0b72c22c3070/ovn-acl-logging/0.log" Jun 09 11:18:31.592870 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:18:31.592844 2562 scope.go:117] "RemoveContainer" containerID="a59324eb6552c41da83e1e961bf242ab871e2f1ebd60c610de41de761fbbdf06" Jun 09 11:18:31.593028 ip-10-0-136-7 kubenswrapper[2562]: E0609 11:18:31.593002 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-2hwhl_openshift-ingress(749b98a3-d487-4905-b172-653386a26242)\"" pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" podUID="749b98a3-d487-4905-b172-653386a26242" Jun 09 11:18:46.598640 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:18:46.598609 2562 scope.go:117] "RemoveContainer" containerID="a59324eb6552c41da83e1e961bf242ab871e2f1ebd60c610de41de761fbbdf06" Jun 09 11:18:46.599111 ip-10-0-136-7 kubenswrapper[2562]: E0609 11:18:46.598782 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-2hwhl_openshift-ingress(749b98a3-d487-4905-b172-653386a26242)\"" pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" podUID="749b98a3-d487-4905-b172-653386a26242" Jun 09 11:19:00.595645 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:00.595565 2562 scope.go:117] "RemoveContainer" containerID="a59324eb6552c41da83e1e961bf242ab871e2f1ebd60c610de41de761fbbdf06" Jun 09 11:19:00.595990 ip-10-0-136-7 kubenswrapper[2562]: E0609 11:19:00.595758 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-2hwhl_openshift-ingress(749b98a3-d487-4905-b172-653386a26242)\"" pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" podUID="749b98a3-d487-4905-b172-653386a26242" Jun 09 11:19:11.593219 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:11.593190 2562 scope.go:117] "RemoveContainer" containerID="a59324eb6552c41da83e1e961bf242ab871e2f1ebd60c610de41de761fbbdf06" Jun 09 11:19:11.593616 ip-10-0-136-7 kubenswrapper[2562]: E0609 11:19:11.593339 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-2hwhl_openshift-ingress(749b98a3-d487-4905-b172-653386a26242)\"" pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" podUID="749b98a3-d487-4905-b172-653386a26242" Jun 09 11:19:23.113195 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:23.113162 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7795997cf4-xdwfq_8757d6d3-ab09-4eab-a587-0fb017ddda4a/maas-api/0.log" Jun 09 11:19:23.802976 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:23.802952 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d4c99d649-qktjc_16d44d87-1e76-4f09-b227-9af81cce6ae0/copy-manifests/0.log" Jun 09 11:19:23.816426 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:23.816402 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d4c99d649-qktjc_16d44d87-1e76-4f09-b227-9af81cce6ae0/manager/0.log" Jun 09 11:19:25.545067 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:25.545040 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-xhh2p_b7fc3506-24ae-4d1e-9c91-348c7d787db4/manager/0.log" Jun 09 11:19:25.592454 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:25.592430 2562 scope.go:117] "RemoveContainer" containerID="a59324eb6552c41da83e1e961bf242ab871e2f1ebd60c610de41de761fbbdf06" Jun 09 11:19:25.592620 ip-10-0-136-7 kubenswrapper[2562]: E0609 11:19:25.592579 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-2hwhl_openshift-ingress(749b98a3-d487-4905-b172-653386a26242)\"" pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" podUID="749b98a3-d487-4905-b172-653386a26242" Jun 09 11:19:25.671909 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:25.671887 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-sj4l9_a1db749d-e0c3-4f2d-a952-3417bbb9e290/kuadrant-console-plugin/0.log" Jun 09 11:19:25.907617 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:25.907518 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-fwps7_1b3f4a8b-4b46-432b-be7d-bf193da1e328/manager/0.log" Jun 09 11:19:26.706263 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:26.706232 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d8974c464-j5lmz_3a554f71-59db-4456-8337-fc56018017ad/kube-auth-proxy/0.log" Jun 09 11:19:27.160217 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:27.160133 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-2hwhl_749b98a3-d487-4905-b172-653386a26242/payload-processing/4.log" Jun 09 11:19:27.613336 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:27.613308 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-gk9k7_f6529292-aac7-499b-a491-5c7b2c2eb18f/storage-initializer/0.log" Jun 09 11:19:27.621113 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:27.621094 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-gk9k7_f6529292-aac7-499b-a491-5c7b2c2eb18f/main/0.log" Jun 09 11:19:28.100610 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:28.095426 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-mv8cp_3a2c9765-0cae-4415-ad4b-47a4b1fe88f8/storage-initializer/0.log" Jun 09 11:19:28.103282 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:28.103258 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-mv8cp_3a2c9765-0cae-4415-ad4b-47a4b1fe88f8/main/0.log" Jun 09 11:19:35.431469 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:35.431437 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dk56m_a4c9995b-4dc8-4453-b83f-db2d253332d2/global-pull-secret-syncer/0.log" Jun 09 11:19:35.597048 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:35.597021 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-k99tl_031e0407-4688-4603-ac78-f2e099c8aecd/konnectivity-agent/0.log" Jun 09 11:19:35.669944 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:35.669922 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-7.ec2.internal_b71c0eeb3993825aeeedafbff58d9a16/haproxy/0.log" Jun 09 11:19:40.321871 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:40.321835 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-xhh2p_b7fc3506-24ae-4d1e-9c91-348c7d787db4/manager/0.log" Jun 09 11:19:40.356085 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:40.356061 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-sj4l9_a1db749d-e0c3-4f2d-a952-3417bbb9e290/kuadrant-console-plugin/0.log" Jun 09 11:19:40.491880 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:40.491857 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-fwps7_1b3f4a8b-4b46-432b-be7d-bf193da1e328/manager/0.log" Jun 09 11:19:40.598640 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:40.598616 2562 scope.go:117] "RemoveContainer" containerID="a59324eb6552c41da83e1e961bf242ab871e2f1ebd60c610de41de761fbbdf06" Jun 09 11:19:40.994910 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:40.994874 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" event={"ID":"749b98a3-d487-4905-b172-653386a26242","Type":"ContainerStarted","Data":"e66bcb77f41b4d76ccd872bfdacebc7bcd2f1a3bc56b5ac34738e639a98e55ca"} Jun 09 11:19:40.995103 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:40.995086 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" Jun 09 11:19:42.727406 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:42.727384 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-g4tcz_eaebd996-a743-4487-8700-221b2b9cb45c/cluster-monitoring-operator/0.log" Jun 09 11:19:42.758373 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:42.758347 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-c42qn_beec5f6e-1e29-4ab0-a7f1-014aed6a6643/kube-state-metrics/0.log" Jun 09 11:19:42.779162 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:42.779141 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-c42qn_beec5f6e-1e29-4ab0-a7f1-014aed6a6643/kube-rbac-proxy-main/0.log" Jun 09 11:19:42.810028 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:42.810009 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-c42qn_beec5f6e-1e29-4ab0-a7f1-014aed6a6643/kube-rbac-proxy-self/0.log" Jun 09 11:19:43.169818 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:43.169791 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qhsrm_bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0/node-exporter/0.log" Jun 09 11:19:43.224809 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:43.224789 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qhsrm_bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0/kube-rbac-proxy/0.log" Jun 09 11:19:43.274102 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:43.274039 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qhsrm_bae45bd2-ed2b-4dd0-aeb4-7b609a9aaea0/init-textfile/0.log" Jun 09 11:19:43.480658 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:43.480636 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6a1521bc-6b6c-4ed7-b0d6-76097aae4495/prometheus/0.log" Jun 09 11:19:43.535644 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:43.535565 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6a1521bc-6b6c-4ed7-b0d6-76097aae4495/config-reloader/0.log" Jun 09 11:19:43.574673 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:43.574656 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6a1521bc-6b6c-4ed7-b0d6-76097aae4495/thanos-sidecar/0.log" Jun 09 11:19:43.606734 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:43.606716 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6a1521bc-6b6c-4ed7-b0d6-76097aae4495/kube-rbac-proxy-web/0.log" Jun 09 11:19:43.637131 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:43.637111 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6a1521bc-6b6c-4ed7-b0d6-76097aae4495/kube-rbac-proxy/0.log" Jun 09 11:19:43.675534 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:43.675502 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6a1521bc-6b6c-4ed7-b0d6-76097aae4495/kube-rbac-proxy-thanos/0.log" Jun 09 11:19:43.707423 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:43.707406 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6a1521bc-6b6c-4ed7-b0d6-76097aae4495/init-config-reloader/0.log" Jun 09 11:19:43.742437 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:43.742420 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-stgj5_840b1856-69b6-4ba4-b37c-abfde7119744/prometheus-operator/0.log" Jun 09 11:19:43.767550 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:43.767531 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-stgj5_840b1856-69b6-4ba4-b37c-abfde7119744/kube-rbac-proxy/0.log" Jun 09 11:19:43.797083 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:43.797029 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-p9njf_525075d5-d7fc-4dd7-af95-b5defbc74a88/prometheus-operator-admission-webhook/0.log" Jun 09 11:19:43.934463 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:43.934434 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-644ff788bd-ddt69_62b2d026-aef3-4f2b-9f95-d66c52905d07/thanos-query/0.log" Jun 09 11:19:43.967090 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:43.967069 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-644ff788bd-ddt69_62b2d026-aef3-4f2b-9f95-d66c52905d07/kube-rbac-proxy-web/0.log" Jun 09 11:19:43.998301 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:43.998279 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-644ff788bd-ddt69_62b2d026-aef3-4f2b-9f95-d66c52905d07/kube-rbac-proxy/0.log" Jun 09 11:19:44.030177 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:44.030153 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-644ff788bd-ddt69_62b2d026-aef3-4f2b-9f95-d66c52905d07/prom-label-proxy/0.log" Jun 09 11:19:44.058544 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:44.058471 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-644ff788bd-ddt69_62b2d026-aef3-4f2b-9f95-d66c52905d07/kube-rbac-proxy-rules/0.log" Jun 09 11:19:44.089259 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:44.089239 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-644ff788bd-ddt69_62b2d026-aef3-4f2b-9f95-d66c52905d07/kube-rbac-proxy-metrics/0.log" Jun 09 11:19:46.118097 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:46.118058 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-ph2xt_56eeb8e9-a748-4e99-b04a-6d998c6aad8b/console-operator/2.log" Jun 09 11:19:46.121993 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:46.121970 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-ph2xt_56eeb8e9-a748-4e99-b04a-6d998c6aad8b/console-operator/3.log" Jun 09 11:19:46.805891 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:46.805844 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8zbsl/perf-node-gather-daemonset-f45sj"] Jun 09 11:19:46.806444 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:46.806420 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3d6c3e7-6909-45fe-b4a6-e60cb236e1bc" containerName="manager" Jun 09 11:19:46.806444 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:46.806441 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3d6c3e7-6909-45fe-b4a6-e60cb236e1bc" containerName="manager" Jun 09 11:19:46.806616 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:46.806525 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3d6c3e7-6909-45fe-b4a6-e60cb236e1bc" containerName="manager" Jun 09 11:19:46.809826 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:46.809806 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8zbsl/perf-node-gather-daemonset-f45sj" Jun 09 11:19:46.812896 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:46.812876 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8zbsl\"/\"openshift-service-ca.crt\"" Jun 09 11:19:46.813995 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:46.813974 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8zbsl\"/\"default-dockercfg-whb2r\"" Jun 09 11:19:46.813995 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:46.813988 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8zbsl\"/\"kube-root-ca.crt\"" Jun 09 11:19:46.822563 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:46.822537 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8zbsl/perf-node-gather-daemonset-f45sj"] Jun 09 11:19:46.881630 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:46.881565 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcg9q\" (UniqueName: \"kubernetes.io/projected/fb2ddfb0-c516-4b5f-986f-0e14699c03bb-kube-api-access-qcg9q\") pod \"perf-node-gather-daemonset-f45sj\" (UID: \"fb2ddfb0-c516-4b5f-986f-0e14699c03bb\") " pod="openshift-must-gather-8zbsl/perf-node-gather-daemonset-f45sj" Jun 09 11:19:46.881815 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:46.881675 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fb2ddfb0-c516-4b5f-986f-0e14699c03bb-sys\") pod \"perf-node-gather-daemonset-f45sj\" (UID: \"fb2ddfb0-c516-4b5f-986f-0e14699c03bb\") " pod="openshift-must-gather-8zbsl/perf-node-gather-daemonset-f45sj" Jun 09 11:19:46.881815 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:46.881692 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fb2ddfb0-c516-4b5f-986f-0e14699c03bb-lib-modules\") pod \"perf-node-gather-daemonset-f45sj\" (UID: \"fb2ddfb0-c516-4b5f-986f-0e14699c03bb\") " pod="openshift-must-gather-8zbsl/perf-node-gather-daemonset-f45sj" Jun 09 11:19:46.881815 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:46.881781 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fb2ddfb0-c516-4b5f-986f-0e14699c03bb-proc\") pod \"perf-node-gather-daemonset-f45sj\" (UID: \"fb2ddfb0-c516-4b5f-986f-0e14699c03bb\") " pod="openshift-must-gather-8zbsl/perf-node-gather-daemonset-f45sj" Jun 09 11:19:46.881815 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:46.881810 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fb2ddfb0-c516-4b5f-986f-0e14699c03bb-podres\") pod \"perf-node-gather-daemonset-f45sj\" (UID: \"fb2ddfb0-c516-4b5f-986f-0e14699c03bb\") " pod="openshift-must-gather-8zbsl/perf-node-gather-daemonset-f45sj" Jun 09 11:19:46.982653 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:46.982572 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcg9q\" (UniqueName: \"kubernetes.io/projected/fb2ddfb0-c516-4b5f-986f-0e14699c03bb-kube-api-access-qcg9q\") pod \"perf-node-gather-daemonset-f45sj\" (UID: \"fb2ddfb0-c516-4b5f-986f-0e14699c03bb\") " pod="openshift-must-gather-8zbsl/perf-node-gather-daemonset-f45sj" Jun 09 11:19:46.982883 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:46.982708 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fb2ddfb0-c516-4b5f-986f-0e14699c03bb-sys\") pod \"perf-node-gather-daemonset-f45sj\" (UID: \"fb2ddfb0-c516-4b5f-986f-0e14699c03bb\") " pod="openshift-must-gather-8zbsl/perf-node-gather-daemonset-f45sj" Jun 09 11:19:46.982883 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:46.982736 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fb2ddfb0-c516-4b5f-986f-0e14699c03bb-lib-modules\") pod \"perf-node-gather-daemonset-f45sj\" (UID: \"fb2ddfb0-c516-4b5f-986f-0e14699c03bb\") " pod="openshift-must-gather-8zbsl/perf-node-gather-daemonset-f45sj" Jun 09 11:19:46.982883 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:46.982806 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fb2ddfb0-c516-4b5f-986f-0e14699c03bb-proc\") pod \"perf-node-gather-daemonset-f45sj\" (UID: \"fb2ddfb0-c516-4b5f-986f-0e14699c03bb\") " pod="openshift-must-gather-8zbsl/perf-node-gather-daemonset-f45sj" Jun 09 11:19:46.982883 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:46.982830 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fb2ddfb0-c516-4b5f-986f-0e14699c03bb-podres\") pod \"perf-node-gather-daemonset-f45sj\" (UID: \"fb2ddfb0-c516-4b5f-986f-0e14699c03bb\") " pod="openshift-must-gather-8zbsl/perf-node-gather-daemonset-f45sj" Jun 09 11:19:46.982883 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:46.982835 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fb2ddfb0-c516-4b5f-986f-0e14699c03bb-sys\") pod \"perf-node-gather-daemonset-f45sj\" (UID: \"fb2ddfb0-c516-4b5f-986f-0e14699c03bb\") " pod="openshift-must-gather-8zbsl/perf-node-gather-daemonset-f45sj" Jun 09 11:19:46.983133 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:46.982914 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fb2ddfb0-c516-4b5f-986f-0e14699c03bb-proc\") pod \"perf-node-gather-daemonset-f45sj\" (UID: \"fb2ddfb0-c516-4b5f-986f-0e14699c03bb\") " pod="openshift-must-gather-8zbsl/perf-node-gather-daemonset-f45sj" Jun 09 11:19:46.983133 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:46.982961 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fb2ddfb0-c516-4b5f-986f-0e14699c03bb-podres\") pod \"perf-node-gather-daemonset-f45sj\" (UID: \"fb2ddfb0-c516-4b5f-986f-0e14699c03bb\") " pod="openshift-must-gather-8zbsl/perf-node-gather-daemonset-f45sj" Jun 09 11:19:46.983133 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:46.982961 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fb2ddfb0-c516-4b5f-986f-0e14699c03bb-lib-modules\") pod \"perf-node-gather-daemonset-f45sj\" (UID: \"fb2ddfb0-c516-4b5f-986f-0e14699c03bb\") " pod="openshift-must-gather-8zbsl/perf-node-gather-daemonset-f45sj" Jun 09 11:19:46.991339 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:46.991312 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcg9q\" (UniqueName: \"kubernetes.io/projected/fb2ddfb0-c516-4b5f-986f-0e14699c03bb-kube-api-access-qcg9q\") pod \"perf-node-gather-daemonset-f45sj\" (UID: \"fb2ddfb0-c516-4b5f-986f-0e14699c03bb\") " pod="openshift-must-gather-8zbsl/perf-node-gather-daemonset-f45sj" Jun 09 11:19:47.121026 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:47.120933 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8zbsl/perf-node-gather-daemonset-f45sj" Jun 09 11:19:47.264003 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:47.263969 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8zbsl/perf-node-gather-daemonset-f45sj"] Jun 09 11:19:47.266523 ip-10-0-136-7 kubenswrapper[2562]: W0609 11:19:47.266491 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfb2ddfb0_c516_4b5f_986f_0e14699c03bb.slice/crio-9a1d8784bd8287c44db611652d6b0fa8c91079e99d0e7fb0ef081363876d8797 WatchSource:0}: Error finding container 9a1d8784bd8287c44db611652d6b0fa8c91079e99d0e7fb0ef081363876d8797: Status 404 returned error can't find the container with id 9a1d8784bd8287c44db611652d6b0fa8c91079e99d0e7fb0ef081363876d8797 Jun 09 11:19:48.030872 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:48.030836 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8zbsl/perf-node-gather-daemonset-f45sj" event={"ID":"fb2ddfb0-c516-4b5f-986f-0e14699c03bb","Type":"ContainerStarted","Data":"bba188e832597c590631a91728fb537ead330ebb49af49642c13c51ad97fc24e"} Jun 09 11:19:48.031051 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:48.030888 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8zbsl/perf-node-gather-daemonset-f45sj" event={"ID":"fb2ddfb0-c516-4b5f-986f-0e14699c03bb","Type":"ContainerStarted","Data":"9a1d8784bd8287c44db611652d6b0fa8c91079e99d0e7fb0ef081363876d8797"} Jun 09 11:19:48.031051 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:48.030926 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8zbsl/perf-node-gather-daemonset-f45sj" Jun 09 11:19:48.714096 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:48.714070 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rjjhk_27fb5ab9-ed22-433a-90cd-bfb7577f9ee8/dns/0.log" Jun 09 11:19:48.739245 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:48.739221 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rjjhk_27fb5ab9-ed22-433a-90cd-bfb7577f9ee8/kube-rbac-proxy/0.log" Jun 09 11:19:48.791679 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:48.791654 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dgc6w_d88d356c-48a2-4f25-b063-c322959af6da/dns-node-resolver/0.log" Jun 09 11:19:49.451230 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:49.451207 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qp2c7_47e4d25a-0728-4e43-83ac-673201e1647a/node-ca/0.log" Jun 09 11:19:50.526909 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:50.526885 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d8974c464-j5lmz_3a554f71-59db-4456-8337-fc56018017ad/kube-auth-proxy/0.log" Jun 09 11:19:50.677360 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:50.677326 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-2hwhl_749b98a3-d487-4905-b172-653386a26242/payload-processing/5.log" Jun 09 11:19:50.679672 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:50.679646 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-2hwhl_749b98a3-d487-4905-b172-653386a26242/payload-processing/4.log" Jun 09 11:19:51.363796 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:51.363769 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jwgsk_40572faa-ff5a-4e83-a728-7e356e6feb69/serve-healthcheck-canary/0.log" Jun 09 11:19:51.882332 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:51.882300 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-btx7z_59478af7-0fe0-48e9-a4d8-e6cf1aa02aa9/insights-operator/0.log" Jun 09 11:19:51.882809 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:51.882618 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-btx7z_59478af7-0fe0-48e9-a4d8-e6cf1aa02aa9/insights-operator/1.log" Jun 09 11:19:51.986882 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:51.986857 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-chjlb_3b12fa03-7b45-45ec-a0e4-5e104fe34e5b/kube-rbac-proxy/0.log" Jun 09 11:19:52.002551 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:52.002531 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-2hwhl" Jun 09 11:19:52.009546 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:52.009525 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-chjlb_3b12fa03-7b45-45ec-a0e4-5e104fe34e5b/exporter/0.log" Jun 09 11:19:52.020494 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:52.020451 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8zbsl/perf-node-gather-daemonset-f45sj" podStartSLOduration=6.020435616 podStartE2EDuration="6.020435616s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:19:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:19:48.048560567 +0000 UTC m=+1577.912800394" watchObservedRunningTime="2026-06-09 11:19:52.020435616 +0000 UTC m=+1581.884675443" Jun 09 11:19:52.034107 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:52.034087 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-chjlb_3b12fa03-7b45-45ec-a0e4-5e104fe34e5b/extractor/0.log" Jun 09 11:19:54.045922 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:54.045894 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8zbsl/perf-node-gather-daemonset-f45sj" Jun 09 11:19:54.556206 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:54.556181 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7795997cf4-xdwfq_8757d6d3-ab09-4eab-a587-0fb017ddda4a/maas-api/0.log" Jun 09 11:19:54.837552 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:54.837472 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d4c99d649-qktjc_16d44d87-1e76-4f09-b227-9af81cce6ae0/manager/0.log" Jun 09 11:19:54.857452 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:54.857425 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d4c99d649-qktjc_16d44d87-1e76-4f09-b227-9af81cce6ae0/copy-manifests/0.log" Jun 09 11:19:56.749164 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:56.749125 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7fd99f789d-krnfb_e3c223d1-ccc4-4bf1-83d9-fbfe3612c9b5/manager/0.log" Jun 09 11:19:56.777812 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:19:56.777758 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-c6g5j_add2df87-c6ea-4d07-a463-f0d795cfbb01/openshift-lws-operator/0.log" Jun 09 11:20:01.590013 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:20:01.589985 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d8974c464-j5lmz_3a554f71-59db-4456-8337-fc56018017ad/kube-auth-proxy/0.log" Jun 09 11:20:01.701713 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:20:01.701682 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-2hwhl_749b98a3-d487-4905-b172-653386a26242/payload-processing/5.log" Jun 09 11:20:01.703288 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:20:01.703270 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-2hwhl_749b98a3-d487-4905-b172-653386a26242/payload-processing/4.log" Jun 09 11:20:02.223760 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:20:02.223733 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-64v5t_e3ef5abe-3382-4a11-af17-4e0fb08427bc/migrator/0.log" Jun 09 11:20:02.288471 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:20:02.288442 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-64v5t_e3ef5abe-3382-4a11-af17-4e0fb08427bc/graceful-termination/0.log" Jun 09 11:20:02.754784 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:20:02.754755 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-44tjq_707cf306-5509-4d46-b1da-f16e4d4aebc8/kube-storage-version-migrator-operator/1.log" Jun 09 11:20:02.755570 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:20:02.755552 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-44tjq_707cf306-5509-4d46-b1da-f16e4d4aebc8/kube-storage-version-migrator-operator/0.log" Jun 09 11:20:02.973658 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:20:02.973636 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d8974c464-j5lmz_3a554f71-59db-4456-8337-fc56018017ad/kube-auth-proxy/0.log" Jun 09 11:20:03.113729 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:20:03.113691 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-2hwhl_749b98a3-d487-4905-b172-653386a26242/payload-processing/5.log" Jun 09 11:20:03.115633 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:20:03.115616 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-2hwhl_749b98a3-d487-4905-b172-653386a26242/payload-processing/4.log" Jun 09 11:20:04.411794 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:20:04.411763 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c9slb_80f79584-5814-4878-a7cf-06e728baf7dc/kube-multus-additional-cni-plugins/0.log" Jun 09 11:20:04.435655 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:20:04.435623 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c9slb_80f79584-5814-4878-a7cf-06e728baf7dc/egress-router-binary-copy/0.log" Jun 09 11:20:04.460176 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:20:04.460142 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c9slb_80f79584-5814-4878-a7cf-06e728baf7dc/cni-plugins/0.log" Jun 09 11:20:04.481974 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:20:04.481944 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c9slb_80f79584-5814-4878-a7cf-06e728baf7dc/bond-cni-plugin/0.log" Jun 09 11:20:04.506240 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:20:04.506214 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c9slb_80f79584-5814-4878-a7cf-06e728baf7dc/routeoverride-cni/0.log" Jun 09 11:20:04.526491 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:20:04.526461 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c9slb_80f79584-5814-4878-a7cf-06e728baf7dc/whereabouts-cni-bincopy/0.log" Jun 09 11:20:04.547525 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:20:04.547504 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c9slb_80f79584-5814-4878-a7cf-06e728baf7dc/whereabouts-cni/0.log" Jun 09 11:20:04.752856 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:20:04.752832 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-cbbvr_5ae97496-aa59-402a-b6c0-9fa21935f6bd/kube-multus/0.log" Jun 09 11:20:04.809131 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:20:04.809114 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d8974c464-j5lmz_3a554f71-59db-4456-8337-fc56018017ad/kube-auth-proxy/0.log" Jun 09 11:20:04.915747 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:20:04.915730 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-2hwhl_749b98a3-d487-4905-b172-653386a26242/payload-processing/5.log" Jun 09 11:20:04.917732 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:20:04.917718 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-2hwhl_749b98a3-d487-4905-b172-653386a26242/payload-processing/4.log" Jun 09 11:20:04.948097 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:20:04.948077 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-c8zc8_09719c2f-d21f-4f27-a982-3595ee62c857/network-metrics-daemon/0.log" Jun 09 11:20:04.969672 ip-10-0-136-7 kubenswrapper[2562]: I0609 11:20:04.969656 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-c8zc8_09719c2f-d21f-4f27-a982-3595ee62c857/kube-rbac-proxy/0.log"