Jun 09 11:52:24.328723 ip-10-0-133-80 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 09 11:52:24.328736 ip-10-0-133-80 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 09 11:52:24.328746 ip-10-0-133-80 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 09 11:52:24.328972 ip-10-0-133-80 systemd[1]: Failed to start Kubernetes Kubelet. Jun 09 11:52:34.443503 ip-10-0-133-80 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 09 11:52:34.443521 ip-10-0-133-80 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 70282514436e4e309aa20bd436bb0da0 -- Jun 09 11:55:03.466915 ip-10-0-133-80 systemd[1]: Starting Kubernetes Kubelet... Jun 09 11:55:03.875696 ip-10-0-133-80 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 11:55:03.875696 ip-10-0-133-80 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 09 11:55:03.875696 ip-10-0-133-80 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 11:55:03.875696 ip-10-0-133-80 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 09 11:55:03.875696 ip-10-0-133-80 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 11:55:03.878148 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.878050 2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 09 11:55:03.882988 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.882956 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 11:55:03.882988 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.882984 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 11:55:03.882988 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.882989 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 11:55:03.882988 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.882993 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 11:55:03.883127 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.882996 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 11:55:03.883127 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883000 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 11:55:03.883127 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883003 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 11:55:03.883127 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883005 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 09 11:55:03.883127 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883009 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 11:55:03.883127 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883011 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 11:55:03.883127 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883014 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 11:55:03.883127 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883017 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 11:55:03.883127 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883020 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 11:55:03.883127 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883023 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 11:55:03.883127 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883025 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 11:55:03.883127 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883030 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 11:55:03.883127 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883032 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 11:55:03.883127 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883035 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 11:55:03.883127 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883038 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 11:55:03.883127 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883041 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 11:55:03.883127 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883044 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 11:55:03.883127 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883046 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 11:55:03.883127 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883049 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 11:55:03.883127 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883051 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 11:55:03.883605 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883054 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 11:55:03.883605 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883057 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 11:55:03.883605 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883059 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 11:55:03.883605 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883061 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 11:55:03.883605 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883064 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 11:55:03.883605 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883067 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 11:55:03.883605 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883070 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 11:55:03.883605 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883072 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 11:55:03.883605 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883075 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 11:55:03.883605 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883078 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 11:55:03.883605 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883080 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 11:55:03.883605 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883083 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 11:55:03.883605 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883085 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 11:55:03.883605 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883089 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 11:55:03.883605 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883092 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 11:55:03.883605 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883097 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 11:55:03.883605 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883101 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 11:55:03.883605 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883105 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 11:55:03.883605 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883107 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 11:55:03.883605 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883110 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 11:55:03.884179 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883114 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 11:55:03.884179 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883116 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 11:55:03.884179 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883119 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 11:55:03.884179 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883121 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 11:55:03.884179 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883124 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 11:55:03.884179 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883127 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 11:55:03.884179 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883130 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 11:55:03.884179 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883132 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 11:55:03.884179 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883135 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 11:55:03.884179 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883138 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 11:55:03.884179 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883141 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 11:55:03.884179 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883144 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 11:55:03.884179 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883146 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 11:55:03.884179 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883149 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 11:55:03.884179 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883153 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 11:55:03.884179 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883157 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 11:55:03.884179 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883160 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 11:55:03.884179 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883163 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 11:55:03.884179 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883165 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 11:55:03.884179 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883168 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 11:55:03.884694 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883171 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 11:55:03.884694 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883174 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 11:55:03.884694 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883176 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 11:55:03.884694 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883179 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 11:55:03.884694 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883182 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 11:55:03.884694 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883187 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 11:55:03.884694 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883190 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 11:55:03.884694 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883194 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 11:55:03.884694 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883197 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 11:55:03.884694 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883199 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 11:55:03.884694 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883202 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 11:55:03.884694 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883205 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 11:55:03.884694 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883207 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 11:55:03.884694 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883210 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 11:55:03.884694 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883212 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 11:55:03.884694 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883215 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 11:55:03.884694 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883218 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 11:55:03.884694 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883220 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 11:55:03.884694 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883222 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 11:55:03.884694 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883225 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 11:55:03.885211 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883229 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 11:55:03.885211 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883233 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 11:55:03.885211 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883236 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 11:55:03.885211 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883239 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 11:55:03.885211 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883242 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 11:55:03.885211 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883245 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 11:55:03.885211 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883248 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 11:55:03.885211 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883250 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 11:55:03.885211 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883253 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 11:55:03.885211 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883255 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 11:55:03.885211 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883258 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 11:55:03.885211 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883260 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 11:55:03.885211 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883263 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 11:55:03.885211 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883266 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 11:55:03.885211 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.883268 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 11:55:03.885211 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884088 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 11:55:03.885211 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884096 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 11:55:03.885211 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884100 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 11:55:03.885211 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884103 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 11:55:03.885767 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884106 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 11:55:03.885767 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884109 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 11:55:03.885767 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884112 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 11:55:03.885767 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884115 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 11:55:03.885767 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884118 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 11:55:03.885767 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884120 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 11:55:03.885767 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884123 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 11:55:03.885767 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884125 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 11:55:03.885767 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884128 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 11:55:03.885767 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884130 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 11:55:03.885767 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884133 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 11:55:03.885767 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884135 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 11:55:03.885767 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884138 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 11:55:03.885767 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884140 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 11:55:03.885767 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884143 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 11:55:03.885767 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884146 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 11:55:03.885767 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884148 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 11:55:03.885767 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884150 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 11:55:03.885767 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884154 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 11:55:03.885767 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884156 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 11:55:03.886310 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884159 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 11:55:03.886310 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884162 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 11:55:03.886310 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884165 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 11:55:03.886310 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884167 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 11:55:03.886310 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884170 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 11:55:03.886310 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884173 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 11:55:03.886310 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884175 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 11:55:03.886310 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884178 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 11:55:03.886310 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884181 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 11:55:03.886310 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884184 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 11:55:03.886310 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884188 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 11:55:03.886310 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884192 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 11:55:03.886310 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884194 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 11:55:03.886310 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884197 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 11:55:03.886310 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884200 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 11:55:03.886310 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884203 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 11:55:03.886310 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884206 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 11:55:03.886310 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884208 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 11:55:03.886310 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884211 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 11:55:03.886310 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884213 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 11:55:03.886845 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884216 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 11:55:03.886845 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884219 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 11:55:03.886845 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884223 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 11:55:03.886845 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884227 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 11:55:03.886845 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884230 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 11:55:03.886845 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884235 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 11:55:03.886845 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884238 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 11:55:03.886845 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884241 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 11:55:03.886845 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884244 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 11:55:03.886845 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884247 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 11:55:03.886845 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884249 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 09 11:55:03.886845 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884252 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 11:55:03.886845 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884255 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 11:55:03.886845 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884258 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 11:55:03.886845 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884260 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 11:55:03.886845 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884263 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 11:55:03.886845 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884266 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 11:55:03.886845 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884268 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 11:55:03.886845 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884271 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 11:55:03.887327 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884274 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 11:55:03.887327 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884277 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 11:55:03.887327 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884280 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 11:55:03.887327 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884284 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 11:55:03.887327 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884286 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 11:55:03.887327 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884289 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 11:55:03.887327 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884292 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 11:55:03.887327 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884296 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 11:55:03.887327 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884301 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 11:55:03.887327 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884304 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 11:55:03.887327 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884307 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 11:55:03.887327 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884310 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 11:55:03.887327 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884312 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 11:55:03.887327 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884315 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 11:55:03.887327 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884318 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 11:55:03.887327 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884321 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 11:55:03.887327 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884324 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 11:55:03.887327 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884327 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 11:55:03.887327 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884329 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 11:55:03.887327 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884332 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 11:55:03.887883 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884334 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 11:55:03.887883 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884337 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 11:55:03.887883 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884339 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 11:55:03.887883 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884342 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 11:55:03.887883 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884344 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 11:55:03.887883 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884347 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 11:55:03.887883 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884349 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 11:55:03.887883 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884352 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 11:55:03.887883 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884355 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 11:55:03.887883 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884357 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 11:55:03.887883 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884360 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 11:55:03.887883 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884362 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 11:55:03.887883 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884365 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 11:55:03.887883 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884369 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 11:55:03.887883 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884372 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 11:55:03.887883 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884375 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 11:55:03.887883 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884814 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 11:55:03.887883 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884820 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 11:55:03.887883 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884825 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 11:55:03.888372 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884829 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 11:55:03.888372 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884833 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 11:55:03.888372 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884836 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 11:55:03.888372 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884839 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 11:55:03.888372 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884842 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 11:55:03.888372 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884845 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 11:55:03.888372 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884848 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 11:55:03.888372 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884852 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 11:55:03.888372 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884856 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 11:55:03.888372 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884859 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 11:55:03.888372 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884862 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 11:55:03.888372 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884864 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 11:55:03.888372 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884867 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 11:55:03.888372 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884870 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 11:55:03.888372 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884872 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 11:55:03.888372 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884875 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 11:55:03.888372 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884878 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 11:55:03.888372 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884881 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 11:55:03.888372 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884883 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 11:55:03.888858 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884886 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 11:55:03.888858 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884889 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 11:55:03.888858 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884892 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 11:55:03.888858 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884895 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 11:55:03.888858 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884897 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 11:55:03.888858 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884900 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 11:55:03.888858 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884903 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 11:55:03.888858 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884907 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 11:55:03.888858 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884910 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 11:55:03.888858 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884912 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 11:55:03.888858 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884915 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 11:55:03.888858 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884917 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 11:55:03.888858 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884920 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 11:55:03.888858 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884923 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 11:55:03.888858 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884925 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 11:55:03.888858 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884936 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 11:55:03.888858 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884939 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 11:55:03.888858 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884942 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 11:55:03.888858 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884945 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 11:55:03.888858 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884947 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 11:55:03.889352 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884950 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 11:55:03.889352 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884952 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 11:55:03.889352 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884955 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 11:55:03.889352 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884958 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 11:55:03.889352 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884960 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 11:55:03.889352 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884963 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 11:55:03.889352 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884966 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 11:55:03.889352 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884968 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 11:55:03.889352 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884971 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 11:55:03.889352 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884975 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 11:55:03.889352 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884978 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 11:55:03.889352 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884980 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 11:55:03.889352 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884983 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 11:55:03.889352 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884986 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 11:55:03.889352 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884989 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 11:55:03.889352 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884991 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 11:55:03.889352 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884994 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 11:55:03.889352 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.884997 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 11:55:03.889352 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885000 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 11:55:03.889352 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885002 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 11:55:03.889877 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885005 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 11:55:03.889877 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885007 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 11:55:03.889877 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885010 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 11:55:03.889877 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885013 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 11:55:03.889877 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885015 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 11:55:03.889877 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885017 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 11:55:03.889877 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885020 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 11:55:03.889877 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885023 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 11:55:03.889877 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885026 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 11:55:03.889877 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885032 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 11:55:03.889877 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885035 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 11:55:03.889877 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885039 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 11:55:03.889877 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885043 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 09 11:55:03.889877 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885045 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 11:55:03.889877 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885048 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 11:55:03.889877 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885051 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 11:55:03.889877 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885053 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 11:55:03.889877 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885056 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 11:55:03.889877 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885058 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 11:55:03.890349 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885061 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 11:55:03.890349 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885063 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 11:55:03.890349 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885068 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 11:55:03.890349 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885071 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 11:55:03.890349 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885073 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 11:55:03.890349 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885076 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 11:55:03.890349 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885078 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 11:55:03.890349 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885081 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 11:55:03.890349 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885084 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 11:55:03.890349 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885086 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 11:55:03.890349 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885089 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 11:55:03.890349 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885092 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 11:55:03.890349 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885095 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 11:55:03.890349 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885097 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 11:55:03.890349 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885100 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 11:55:03.890349 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885102 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 11:55:03.890349 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885105 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 11:55:03.890349 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885107 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 11:55:03.890349 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885196 2577 flags.go:64] FLAG: --address="0.0.0.0" Jun 09 11:55:03.890349 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885205 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 09 11:55:03.890349 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885214 2577 flags.go:64] FLAG: --anonymous-auth="true" Jun 09 11:55:03.890913 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885219 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 09 11:55:03.890913 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885226 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 09 11:55:03.890913 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885229 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 09 11:55:03.890913 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885234 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 09 11:55:03.890913 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885239 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 09 11:55:03.890913 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885242 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 09 11:55:03.890913 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885246 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 09 11:55:03.890913 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885249 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 09 11:55:03.890913 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885254 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 09 11:55:03.890913 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885257 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 09 11:55:03.890913 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885260 2577 flags.go:64] FLAG: --cgroup-root="" Jun 09 11:55:03.890913 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885263 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 09 11:55:03.890913 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885266 2577 flags.go:64] FLAG: --client-ca-file="" Jun 09 11:55:03.890913 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885271 2577 flags.go:64] FLAG: --cloud-provider="external" Jun 09 11:55:03.890913 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885274 2577 flags.go:64] FLAG: --cluster-dns="[]" Jun 09 11:55:03.890913 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885278 2577 flags.go:64] FLAG: --cluster-domain="" Jun 09 11:55:03.890913 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885282 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 09 11:55:03.890913 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885285 2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 09 11:55:03.890913 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885288 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 09 11:55:03.890913 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885292 2577 flags.go:64] FLAG: --container-log-max-files="5" Jun 09 11:55:03.890913 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885296 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 09 11:55:03.890913 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885299 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 09 11:55:03.890913 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885302 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 09 11:55:03.891484 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885306 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 09 11:55:03.891484 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885309 2577 flags.go:64] FLAG: --contention-profiling="false" Jun 09 11:55:03.891484 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885312 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 09 11:55:03.891484 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885316 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 09 11:55:03.891484 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885319 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 09 11:55:03.891484 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885322 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 09 11:55:03.891484 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885326 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 09 11:55:03.891484 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885329 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 09 11:55:03.891484 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885332 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 09 11:55:03.891484 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885336 2577 flags.go:64] FLAG: --enable-load-reader="false" Jun 09 11:55:03.891484 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885340 2577 flags.go:64] FLAG: --enable-server="true" Jun 09 11:55:03.891484 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885344 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 09 11:55:03.891484 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885349 2577 flags.go:64] FLAG: --event-burst="100" Jun 09 11:55:03.891484 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885352 2577 flags.go:64] FLAG: --event-qps="50" Jun 09 11:55:03.891484 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885356 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 09 11:55:03.891484 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885359 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 09 11:55:03.891484 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885362 2577 flags.go:64] FLAG: --eviction-hard="" Jun 09 11:55:03.891484 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885366 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 09 11:55:03.891484 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885369 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 09 11:55:03.891484 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885372 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 09 11:55:03.891484 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885376 2577 flags.go:64] FLAG: --eviction-soft="" Jun 09 11:55:03.891484 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885379 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 09 11:55:03.891484 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885383 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 09 11:55:03.891484 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885386 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 09 11:55:03.891484 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885389 2577 flags.go:64] FLAG: --experimental-mounter-path="" Jun 09 11:55:03.892232 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885393 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 09 11:55:03.892232 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885395 2577 flags.go:64] FLAG: --fail-swap-on="true" Jun 09 11:55:03.892232 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885398 2577 flags.go:64] FLAG: --feature-gates="" Jun 09 11:55:03.892232 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885402 2577 flags.go:64] FLAG: --file-check-frequency="20s" Jun 09 11:55:03.892232 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885406 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 09 11:55:03.892232 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885409 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 09 11:55:03.892232 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885412 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 09 11:55:03.892232 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885415 2577 flags.go:64] FLAG: --healthz-port="10248" Jun 09 11:55:03.892232 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885418 2577 flags.go:64] FLAG: --help="false" Jun 09 11:55:03.892232 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885421 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-133-80.ec2.internal" Jun 09 11:55:03.892232 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885424 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 09 11:55:03.892232 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885427 2577 flags.go:64] FLAG: --http-check-frequency="20s" Jun 09 11:55:03.892232 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885430 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 09 11:55:03.892232 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885434 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 09 11:55:03.892232 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885437 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 09 11:55:03.892232 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885440 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 09 11:55:03.892232 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885443 2577 flags.go:64] FLAG: --image-service-endpoint="" Jun 09 11:55:03.892232 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885447 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 09 11:55:03.892232 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885450 2577 flags.go:64] FLAG: --kube-api-burst="100" Jun 09 11:55:03.892232 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885453 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 09 11:55:03.892232 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885457 2577 flags.go:64] FLAG: --kube-api-qps="50" Jun 09 11:55:03.892232 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885460 2577 flags.go:64] FLAG: --kube-reserved="" Jun 09 11:55:03.892232 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885463 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 09 11:55:03.892232 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885466 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 09 11:55:03.892908 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885469 2577 flags.go:64] FLAG: --kubelet-cgroups="" Jun 09 11:55:03.892908 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885472 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 09 11:55:03.892908 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885475 2577 flags.go:64] FLAG: --lock-file="" Jun 09 11:55:03.892908 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885478 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 09 11:55:03.892908 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885481 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 09 11:55:03.892908 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885486 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 09 11:55:03.892908 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885493 2577 flags.go:64] FLAG: --log-json-split-stream="false" Jun 09 11:55:03.892908 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885495 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 09 11:55:03.892908 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885499 2577 flags.go:64] FLAG: --log-text-split-stream="false" Jun 09 11:55:03.892908 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885501 2577 flags.go:64] FLAG: --logging-format="text" Jun 09 11:55:03.892908 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885504 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 09 11:55:03.892908 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885508 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 09 11:55:03.892908 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885511 2577 flags.go:64] FLAG: --manifest-url="" Jun 09 11:55:03.892908 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885514 2577 flags.go:64] FLAG: --manifest-url-header="" Jun 09 11:55:03.892908 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885519 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 09 11:55:03.892908 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885522 2577 flags.go:64] FLAG: --max-open-files="1000000" Jun 09 11:55:03.892908 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885526 2577 flags.go:64] FLAG: --max-pods="110" Jun 09 11:55:03.892908 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885530 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 09 11:55:03.892908 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885533 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 09 11:55:03.892908 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885536 2577 flags.go:64] FLAG: --memory-manager-policy="None" Jun 09 11:55:03.892908 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885539 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 09 11:55:03.892908 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885542 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 09 11:55:03.892908 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885545 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 09 11:55:03.892908 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885549 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 09 11:55:03.892908 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885556 2577 flags.go:64] FLAG: --node-status-max-images="50" Jun 09 11:55:03.893581 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885560 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 09 11:55:03.893581 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885564 2577 flags.go:64] FLAG: --oom-score-adj="-999" Jun 09 11:55:03.893581 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885567 2577 flags.go:64] FLAG: --pod-cidr="" Jun 09 11:55:03.893581 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885571 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 09 11:55:03.893581 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885578 2577 flags.go:64] FLAG: --pod-manifest-path="" Jun 09 11:55:03.893581 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885582 2577 flags.go:64] FLAG: --pod-max-pids="-1" Jun 09 11:55:03.893581 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885585 2577 flags.go:64] FLAG: --pods-per-core="0" Jun 09 11:55:03.893581 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885588 2577 flags.go:64] FLAG: --port="10250" Jun 09 11:55:03.893581 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885591 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 09 11:55:03.893581 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885594 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a3943e73162b94cf" Jun 09 11:55:03.893581 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885598 2577 flags.go:64] FLAG: --qos-reserved="" Jun 09 11:55:03.893581 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885601 2577 flags.go:64] FLAG: --read-only-port="10255" Jun 09 11:55:03.893581 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885604 2577 flags.go:64] FLAG: --register-node="true" Jun 09 11:55:03.893581 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885624 2577 flags.go:64] FLAG: --register-with-taints="" Jun 09 11:55:03.893581 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885629 2577 flags.go:64] FLAG: --registry-burst="10" Jun 09 11:55:03.893581 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885632 2577 flags.go:64] FLAG: --registry-qps="5" Jun 09 11:55:03.893581 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885636 2577 flags.go:64] FLAG: --reserved-cpus="" Jun 09 11:55:03.893581 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885639 2577 flags.go:64] FLAG: --reserved-memory="" Jun 09 11:55:03.893581 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885643 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 09 11:55:03.893581 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885646 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 09 11:55:03.893581 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885650 2577 flags.go:64] FLAG: --rotate-certificates="false" Jun 09 11:55:03.893581 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885653 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 09 11:55:03.893581 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885657 2577 flags.go:64] FLAG: --runonce="false" Jun 09 11:55:03.893581 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885660 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 09 11:55:03.893581 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885663 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 09 11:55:03.894226 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885666 2577 flags.go:64] FLAG: --seccomp-default="false" Jun 09 11:55:03.894226 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885669 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 09 11:55:03.894226 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885672 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 09 11:55:03.894226 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885676 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 09 11:55:03.894226 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885679 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 09 11:55:03.894226 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885682 2577 flags.go:64] FLAG: --storage-driver-password="root" Jun 09 11:55:03.894226 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885685 2577 flags.go:64] FLAG: --storage-driver-secure="false" Jun 09 11:55:03.894226 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885689 2577 flags.go:64] FLAG: --storage-driver-table="stats" Jun 09 11:55:03.894226 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885692 2577 flags.go:64] FLAG: --storage-driver-user="root" Jun 09 11:55:03.894226 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885695 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 09 11:55:03.894226 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885698 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 09 11:55:03.894226 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885702 2577 flags.go:64] FLAG: --system-cgroups="" Jun 09 11:55:03.894226 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885705 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 09 11:55:03.894226 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885711 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 09 11:55:03.894226 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885714 2577 flags.go:64] FLAG: --tls-cert-file="" Jun 09 11:55:03.894226 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885717 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 09 11:55:03.894226 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885721 2577 flags.go:64] FLAG: --tls-min-version="" Jun 09 11:55:03.894226 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885724 2577 flags.go:64] FLAG: --tls-private-key-file="" Jun 09 11:55:03.894226 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885727 2577 flags.go:64] FLAG: --topology-manager-policy="none" Jun 09 11:55:03.894226 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885730 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 09 11:55:03.894226 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885735 2577 flags.go:64] FLAG: --topology-manager-scope="container" Jun 09 11:55:03.894226 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885738 2577 flags.go:64] FLAG: --v="2" Jun 09 11:55:03.894226 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885742 2577 flags.go:64] FLAG: --version="false" Jun 09 11:55:03.894226 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885747 2577 flags.go:64] FLAG: --vmodule="" Jun 09 11:55:03.894226 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885751 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 09 11:55:03.894871 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.885754 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 09 11:55:03.894871 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885889 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 11:55:03.894871 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885894 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 09 11:55:03.894871 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885897 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 11:55:03.894871 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885900 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 11:55:03.894871 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885903 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 11:55:03.894871 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885907 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 11:55:03.894871 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885910 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 11:55:03.894871 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885912 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 11:55:03.894871 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885915 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 11:55:03.894871 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885918 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 11:55:03.894871 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885921 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 11:55:03.894871 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885923 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 11:55:03.894871 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885926 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 11:55:03.894871 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885930 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 11:55:03.894871 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885932 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 11:55:03.894871 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885935 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 11:55:03.894871 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885938 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 11:55:03.894871 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885942 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 11:55:03.895417 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885950 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 11:55:03.895417 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885953 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 11:55:03.895417 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885956 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 11:55:03.895417 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885959 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 11:55:03.895417 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885961 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 11:55:03.895417 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885964 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 11:55:03.895417 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885967 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 11:55:03.895417 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885970 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 11:55:03.895417 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885974 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 11:55:03.895417 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885977 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 11:55:03.895417 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885979 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 11:55:03.895417 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885982 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 11:55:03.895417 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885984 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 11:55:03.895417 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885988 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 11:55:03.895417 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885993 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 11:55:03.895417 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885995 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 11:55:03.895417 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.885998 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 11:55:03.895417 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886001 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 11:55:03.895417 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886003 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 11:55:03.895417 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886006 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 11:55:03.895947 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886009 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 11:55:03.895947 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886011 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 11:55:03.895947 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886014 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 11:55:03.895947 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886017 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 11:55:03.895947 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886019 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 11:55:03.895947 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886022 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 11:55:03.895947 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886024 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 11:55:03.895947 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886028 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 11:55:03.895947 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886031 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 11:55:03.895947 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886034 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 11:55:03.895947 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886036 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 11:55:03.895947 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886039 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 11:55:03.895947 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886042 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 11:55:03.895947 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886046 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 11:55:03.895947 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886050 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 11:55:03.895947 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886053 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 11:55:03.895947 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886056 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 11:55:03.895947 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886059 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 11:55:03.895947 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886062 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 11:55:03.896551 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886064 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 11:55:03.896551 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886068 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 11:55:03.896551 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886071 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 11:55:03.896551 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886074 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 11:55:03.896551 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886077 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 11:55:03.896551 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886079 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 11:55:03.896551 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886082 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 11:55:03.896551 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886085 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 11:55:03.896551 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886087 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 11:55:03.896551 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886090 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 11:55:03.896551 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886093 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 11:55:03.896551 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886095 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 11:55:03.896551 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886098 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 11:55:03.896551 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886100 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 11:55:03.896551 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886103 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 11:55:03.896551 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886106 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 11:55:03.896551 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886109 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 11:55:03.896551 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886112 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 11:55:03.896551 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886115 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 11:55:03.896551 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886118 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 11:55:03.897353 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886122 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 11:55:03.897353 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886124 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 11:55:03.897353 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886127 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 11:55:03.897353 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886129 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 11:55:03.897353 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886132 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 11:55:03.897353 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886135 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 11:55:03.897353 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886137 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 11:55:03.897353 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886140 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 11:55:03.897353 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886143 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 11:55:03.897353 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886145 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 11:55:03.897353 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886148 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 11:55:03.897353 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886151 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 11:55:03.897353 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886153 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 11:55:03.897353 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886157 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 11:55:03.897353 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886160 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 11:55:03.897353 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886164 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 11:55:03.897353 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886166 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 11:55:03.897353 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886169 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 11:55:03.897353 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886172 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 11:55:03.897353 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886174 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 11:55:03.897891 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886177 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 11:55:03.897891 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.886180 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 11:55:03.897891 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.886842 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 11:55:03.897891 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.894211 2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 09 11:55:03.897891 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.894237 2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 09 11:55:03.897891 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.895135 2577 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 09 11:55:03.897891 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.895144 2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 09 11:55:03.897891 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895208 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 11:55:03.897891 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895216 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 11:55:03.897891 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895221 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 11:55:03.897891 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895225 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 11:55:03.897891 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895228 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 11:55:03.897891 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895231 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 11:55:03.897891 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895235 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 11:55:03.898257 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895240 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 11:55:03.898257 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895243 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 11:55:03.898257 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895246 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 11:55:03.898257 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895250 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 11:55:03.898257 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895253 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 11:55:03.898257 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895255 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 11:55:03.898257 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895258 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 11:55:03.898257 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895261 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 11:55:03.898257 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895263 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 11:55:03.898257 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895266 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 11:55:03.898257 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895270 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 11:55:03.898257 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895272 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 11:55:03.898257 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895275 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 11:55:03.898257 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895277 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 11:55:03.898257 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895280 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 11:55:03.898257 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895283 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 11:55:03.898257 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895285 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 11:55:03.898257 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895288 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 11:55:03.898257 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895292 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 11:55:03.898257 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895294 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 11:55:03.898889 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895297 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 11:55:03.898889 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895300 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 11:55:03.898889 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895304 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 11:55:03.898889 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895307 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 11:55:03.898889 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895310 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 11:55:03.898889 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895312 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 11:55:03.898889 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895315 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 11:55:03.898889 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895318 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 11:55:03.898889 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895320 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 11:55:03.898889 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895323 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 11:55:03.898889 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895325 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 11:55:03.898889 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895328 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 11:55:03.898889 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895330 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 11:55:03.898889 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895333 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 11:55:03.898889 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895335 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 11:55:03.898889 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895338 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 11:55:03.898889 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895341 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 11:55:03.898889 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895343 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 11:55:03.898889 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895346 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 11:55:03.899359 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895349 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 11:55:03.899359 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895351 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 11:55:03.899359 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895354 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 11:55:03.899359 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895356 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 09 11:55:03.899359 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895359 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 11:55:03.899359 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895362 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 11:55:03.899359 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895366 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 11:55:03.899359 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895369 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 11:55:03.899359 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895372 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 11:55:03.899359 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895375 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 11:55:03.899359 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895378 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 11:55:03.899359 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895381 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 11:55:03.899359 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895383 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 11:55:03.899359 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895386 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 11:55:03.899359 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895388 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 11:55:03.899359 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895392 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 11:55:03.899359 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895396 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 11:55:03.899359 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895399 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 11:55:03.899359 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895402 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 11:55:03.899359 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895404 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 11:55:03.899963 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895407 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 11:55:03.899963 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895410 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 11:55:03.899963 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895412 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 11:55:03.899963 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895415 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 11:55:03.899963 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895417 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 11:55:03.899963 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895420 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 11:55:03.899963 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895423 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 11:55:03.899963 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895425 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 11:55:03.899963 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895428 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 11:55:03.899963 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895431 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 11:55:03.899963 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895434 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 11:55:03.899963 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895437 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 11:55:03.899963 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895440 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 11:55:03.899963 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895442 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 11:55:03.899963 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895445 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 11:55:03.899963 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895447 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 11:55:03.899963 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895450 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 11:55:03.899963 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895452 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 11:55:03.899963 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895455 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 11:55:03.899963 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895458 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 11:55:03.900479 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895460 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 11:55:03.900479 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895463 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 11:55:03.900479 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895466 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 11:55:03.900479 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895469 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 11:55:03.900479 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895471 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 11:55:03.900479 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895476 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 11:55:03.900479 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895479 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 11:55:03.900479 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895484 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 11:55:03.900479 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895487 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 11:55:03.900479 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895501 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 11:55:03.900479 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895504 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 11:55:03.900479 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895507 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 11:55:03.900479 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895510 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 11:55:03.900479 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.895517 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 11:55:03.900479 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895669 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 11:55:03.900896 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895676 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 11:55:03.900896 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895679 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 11:55:03.900896 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895682 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 11:55:03.900896 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895685 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 11:55:03.900896 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895688 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 11:55:03.900896 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895691 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 11:55:03.900896 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895694 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 11:55:03.900896 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895696 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 11:55:03.900896 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895699 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 11:55:03.900896 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895702 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 11:55:03.900896 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895704 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 11:55:03.900896 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895707 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 11:55:03.900896 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895710 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 11:55:03.900896 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895713 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 11:55:03.900896 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895715 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 11:55:03.900896 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895718 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 11:55:03.900896 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895722 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 11:55:03.900896 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895726 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 11:55:03.900896 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895729 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 11:55:03.900896 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895732 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 11:55:03.901400 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895735 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 11:55:03.901400 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895737 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 11:55:03.901400 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895740 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 11:55:03.901400 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895743 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 11:55:03.901400 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895746 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 11:55:03.901400 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895748 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 11:55:03.901400 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895751 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 11:55:03.901400 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895754 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 11:55:03.901400 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895757 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 11:55:03.901400 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895759 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 11:55:03.901400 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895762 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 11:55:03.901400 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895764 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 11:55:03.901400 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895767 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 11:55:03.901400 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895770 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 11:55:03.901400 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895772 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 11:55:03.901400 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895775 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 11:55:03.901400 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895778 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 11:55:03.901400 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895780 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 11:55:03.901400 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895783 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 11:55:03.901903 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895786 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 11:55:03.901903 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895788 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 11:55:03.901903 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895792 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 11:55:03.901903 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895794 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 11:55:03.901903 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895797 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 11:55:03.901903 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895799 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 11:55:03.901903 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895802 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 11:55:03.901903 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895805 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 11:55:03.901903 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895807 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 11:55:03.901903 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895810 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 11:55:03.901903 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895813 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 11:55:03.901903 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895816 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 11:55:03.901903 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895819 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 11:55:03.901903 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895821 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 11:55:03.901903 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895824 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 11:55:03.901903 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895826 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 11:55:03.901903 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895829 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 11:55:03.901903 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895832 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 11:55:03.901903 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895835 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 11:55:03.901903 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895837 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 11:55:03.902396 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895841 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 11:55:03.902396 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895845 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 11:55:03.902396 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895848 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 11:55:03.902396 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895851 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 11:55:03.902396 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895854 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 11:55:03.902396 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895856 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 11:55:03.902396 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895859 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 11:55:03.902396 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895861 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 11:55:03.902396 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895864 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 11:55:03.902396 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895866 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 11:55:03.902396 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895869 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 11:55:03.902396 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895872 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 11:55:03.902396 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895875 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 11:55:03.902396 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895877 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 11:55:03.902396 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895880 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 11:55:03.902396 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895883 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 11:55:03.902396 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895885 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 11:55:03.902396 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895887 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 11:55:03.902396 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895890 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 11:55:03.902396 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895893 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 11:55:03.902914 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895895 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 11:55:03.902914 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895899 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 11:55:03.902914 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895903 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 11:55:03.902914 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895906 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 11:55:03.902914 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895909 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 11:55:03.902914 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895912 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 11:55:03.902914 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895915 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 11:55:03.902914 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895918 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 11:55:03.902914 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895922 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 11:55:03.902914 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895925 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 11:55:03.902914 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895927 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 11:55:03.902914 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895930 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 09 11:55:03.902914 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895933 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 11:55:03.902914 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895935 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 11:55:03.902914 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895939 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 11:55:03.902914 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895941 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 11:55:03.902914 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895944 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 11:55:03.902914 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895946 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 11:55:03.902914 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:03.895949 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 11:55:03.903389 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.895955 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 11:55:03.903389 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.897584 2577 server.go:962] "Client rotation is on, will bootstrap in background" Jun 09 11:55:03.903389 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.899935 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 09 11:55:03.903389 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.901496 2577 server.go:1019] "Starting client certificate rotation" Jun 09 11:55:03.903389 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.901630 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 11:55:03.903389 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.901674 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 11:55:03.904328 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.904308 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 11:55:03.906720 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.906647 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 11:55:03.920046 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.920016 2577 log.go:25] "Validated CRI v1 runtime API" Jun 09 11:55:03.923219 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.923194 2577 log.go:25] "Validated CRI v1 image API" Jun 09 11:55:03.924199 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.924179 2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 09 11:55:03.928333 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.928296 2577 fs.go:135] Filesystem UUIDs: map[19997520-5769-4fdf-b17b-1df9a636d066:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c9931d65-769e-4ac9-b872-fd5bd49cf956:/dev/nvme0n1p3] Jun 09 11:55:03.928333 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.928324 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 09 11:55:03.934777 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.934742 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 11:55:03.935889 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.935749 2577 manager.go:216] Machine: {Timestamp:2026-06-09 11:55:03.933732098 +0000 UTC m=+0.356289891 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102381 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2731e1dc792bfbc1242e02f4120a18 SystemUUID:ec2731e1-dc79-2bfb-c124-2e02f4120a18 BootID:70282514-436e-4e30-9aa2-0bd436bb0da0 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a3:da:87:f2:55 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a3:da:87:f2:55 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:66:d3:0e:f5:de:73 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 09 11:55:03.935889 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.935881 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 09 11:55:03.936019 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.936003 2577 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 09 11:55:03.939693 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.939641 2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 09 11:55:03.939907 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.939698 2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-80.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 09 11:55:03.941219 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.941196 2577 topology_manager.go:138] "Creating topology manager with none policy" Jun 09 11:55:03.941297 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.941226 2577 container_manager_linux.go:309] "Creating device plugin manager" Jun 09 11:55:03.941297 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.941240 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 11:55:03.941895 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.941879 2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 11:55:03.942748 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.942728 2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 09 11:55:03.945724 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.945704 2577 state_mem.go:36] "Initialized new in-memory state store" Jun 09 11:55:03.945883 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.945873 2577 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 09 11:55:03.945916 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.945907 2577 kubelet.go:486] "Attempting to sync node with API server" Jun 09 11:55:03.945947 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.945920 2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 09 11:55:03.945947 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.945936 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 09 11:55:03.946003 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.945953 2577 kubelet.go:398] "Adding apiserver pod source" Jun 09 11:55:03.946003 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.945964 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 09 11:55:03.946384 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.946370 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 11:55:03.946432 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.946392 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 11:55:03.949519 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.949497 2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 09 11:55:03.951022 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.951004 2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 09 11:55:03.951099 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.951037 2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 09 11:55:03.952207 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.952187 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 09 11:55:03.952274 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.952218 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 09 11:55:03.952274 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.952232 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 09 11:55:03.952274 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.952241 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 09 11:55:03.952274 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.952250 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 09 11:55:03.952274 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.952256 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 09 11:55:03.952274 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.952264 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 09 11:55:03.952274 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.952269 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 09 11:55:03.952274 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.952276 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 09 11:55:03.952594 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.952282 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 09 11:55:03.952594 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.952298 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 09 11:55:03.952594 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.952304 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 09 11:55:03.953708 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.953693 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 09 11:55:03.953708 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.953705 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 09 11:55:03.957441 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:03.957405 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-80.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 09 11:55:03.957545 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:03.957429 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 09 11:55:03.957545 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.957504 2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-80.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 09 11:55:03.957901 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.957888 2577 server.go:1268] "Started kubelet" Jun 09 11:55:03.957993 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.957961 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 09 11:55:03.958058 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.957970 2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 09 11:55:03.958094 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.958087 2577 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 09 11:55:03.958955 ip-10-0-133-80 systemd[1]: Started Kubernetes Kubelet. Jun 09 11:55:03.959751 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.959733 2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 09 11:55:03.960791 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.960774 2577 server.go:310] "Adding debug handlers to kubelet server" Jun 09 11:55:03.965347 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:03.965322 2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 09 11:55:03.965953 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:03.964908 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-80.ec2.internal.18b7679d8935da64 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-80.ec2.internal,UID:ip-10-0-133-80.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-80.ec2.internal,},FirstTimestamp:2026-06-09 11:55:03.95785482 +0000 UTC m=+0.380412633,LastTimestamp:2026-06-09 11:55:03.95785482 +0000 UTC m=+0.380412633,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-80.ec2.internal,}" Jun 09 11:55:03.966977 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.966957 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 09 11:55:03.967037 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.966962 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 09 11:55:03.967161 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:03.967139 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-80.ec2.internal\" not found" Jun 09 11:55:03.968094 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.968067 2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 09 11:55:03.968094 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.968070 2577 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 09 11:55:03.968291 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.968104 2577 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 09 11:55:03.968291 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.968258 2577 reconstruct.go:97] "Volume reconstruction finished" Jun 09 11:55:03.968291 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.968269 2577 reconciler.go:29] "Reconciler: start to sync state" Jun 09 11:55:03.968419 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.968308 2577 factory.go:55] Registering systemd factory Jun 09 11:55:03.968419 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.968325 2577 factory.go:223] Registration of the systemd container factory successfully Jun 09 11:55:03.968551 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.968538 2577 factory.go:153] Registering CRI-O factory Jun 09 11:55:03.968595 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.968553 2577 factory.go:223] Registration of the crio container factory successfully Jun 09 11:55:03.968654 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.968608 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 09 11:55:03.968654 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.968643 2577 factory.go:103] Registering Raw factory Jun 09 11:55:03.968720 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.968656 2577 manager.go:1196] Started watching for new ooms in manager Jun 09 11:55:03.969410 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.969388 2577 manager.go:349] Starting recovery of all containers Jun 09 11:55:03.975570 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:03.975499 2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-80.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 09 11:55:03.976168 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:03.976133 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 09 11:55:03.982209 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.982050 2577 manager.go:354] Recovery completed Jun 09 11:55:03.986731 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.986713 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 11:55:03.988683 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.988653 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-80.ec2.internal" event="NodeHasSufficientMemory" Jun 09 11:55:03.988775 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.988701 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-80.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 11:55:03.988775 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.988713 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-80.ec2.internal" event="NodeHasSufficientPID" Jun 09 11:55:03.990179 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.990154 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 09 11:55:03.990179 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.990176 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 09 11:55:03.990369 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.990198 2577 state_mem.go:36] "Initialized new in-memory state store" Jun 09 11:55:03.990369 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.990250 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 11:55:03.991466 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.991445 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-80.ec2.internal" event="NodeHasSufficientMemory" Jun 09 11:55:03.991576 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.991482 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-80.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 11:55:03.991576 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.991514 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-80.ec2.internal" event="NodeHasSufficientPID" Jun 09 11:55:03.991772 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.991757 2577 policy_none.go:49] "None policy: Start" Jun 09 11:55:03.991803 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.991779 2577 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 09 11:55:03.991803 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.991791 2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 09 11:55:03.992336 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:03.992233 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-80.ec2.internal.18b7679d8b0c468a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-80.ec2.internal,UID:ip-10-0-133-80.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-80.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-80.ec2.internal,},FirstTimestamp:2026-06-09 11:55:03.988684426 +0000 UTC m=+0.411242191,LastTimestamp:2026-06-09 11:55:03.988684426 +0000 UTC m=+0.411242191,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-80.ec2.internal,}" Jun 09 11:55:03.992813 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.992798 2577 policy_none.go:47] "Start" Jun 09 11:55:03.996029 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:03.996007 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b25v2" Jun 09 11:55:04.001571 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:04.001485 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-80.ec2.internal.18b7679d8b0c9b6b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-80.ec2.internal,UID:ip-10-0-133-80.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-133-80.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-133-80.ec2.internal,},FirstTimestamp:2026-06-09 11:55:03.988706155 +0000 UTC m=+0.411263921,LastTimestamp:2026-06-09 11:55:03.988706155 +0000 UTC m=+0.411263921,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-80.ec2.internal,}" Jun 09 11:55:04.009829 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:04.009706 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-80.ec2.internal.18b7679d8b0cc457 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-80.ec2.internal,UID:ip-10-0-133-80.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-133-80.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-133-80.ec2.internal,},FirstTimestamp:2026-06-09 11:55:03.988716631 +0000 UTC m=+0.411274396,LastTimestamp:2026-06-09 11:55:03.988716631 +0000 UTC m=+0.411274396,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-80.ec2.internal,}" Jun 09 11:55:04.009977 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:04.009827 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b25v2" Jun 09 11:55:04.043973 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:04.029383 2577 manager.go:337] "Starting Device Plugin manager" Jun 09 11:55:04.043973 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:04.029424 2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 09 11:55:04.043973 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:04.029438 2577 server.go:87] "Starting device plugin registration server" Jun 09 11:55:04.043973 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:04.029758 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 09 11:55:04.043973 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:04.029770 2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 09 11:55:04.043973 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:04.029842 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 09 11:55:04.043973 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:04.029933 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 09 11:55:04.043973 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:04.029945 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 09 11:55:04.043973 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:04.030572 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 09 11:55:04.043973 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:04.030658 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-80.ec2.internal\" not found" Jun 09 11:55:04.043973 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:04.036469 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 09 11:55:04.043973 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:04.037672 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 09 11:55:04.043973 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:04.037706 2577 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 09 11:55:04.043973 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:04.037740 2577 kubelet.go:2448] "Starting kubelet main sync loop" Jun 09 11:55:04.043973 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:04.037775 2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 09 11:55:04.043973 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:04.040395 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 11:55:04.130232 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:04.130164 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 11:55:04.131405 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:04.131386 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-80.ec2.internal" event="NodeHasSufficientMemory" Jun 09 11:55:04.131529 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:04.131431 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-80.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 11:55:04.131529 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:04.131445 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-80.ec2.internal" event="NodeHasSufficientPID" Jun 09 11:55:04.131529 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:04.131466 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-80.ec2.internal" Jun 09 11:55:04.138250 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:04.138215 2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-133-80.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-80.ec2.internal"] Jun 09 11:55:04.138359 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:04.138304 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 11:55:04.139948 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:04.139933 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-80.ec2.internal" event="NodeHasSufficientMemory" Jun 09 11:55:04.140050 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:04.139965 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-80.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 11:55:04.140050 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:04.139979 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-80.ec2.internal" event="NodeHasSufficientPID" Jun 09 11:55:04.142415 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:04.142398 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 11:55:04.142511 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:04.142497 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-80.ec2.internal" Jun 09 11:55:04.142558 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:04.142526 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 11:55:04.143150 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:04.143128 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-80.ec2.internal" Jun 09 11:55:04.143150 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:04.143147 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-80.ec2.internal" event="NodeHasSufficientMemory" Jun 09 11:55:04.143299 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:04.143158 2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-80.ec2.internal\": node \"ip-10-0-133-80.ec2.internal\" not found" Jun 09 11:55:04.143299 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:04.143174 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-80.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 11:55:04.143299 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:04.143153 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-80.ec2.internal" event="NodeHasSufficientMemory" Jun 09 11:55:04.143299 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:04.143222 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-80.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 11:55:04.143299 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:04.143236 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-80.ec2.internal" event="NodeHasSufficientPID" Jun 09 11:55:04.143299 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:04.143192 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-80.ec2.internal" event="NodeHasSufficientPID" Jun 09 11:55:04.145528 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:04.145511 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-80.ec2.internal" Jun 09 11:55:04.145656 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:04.145537 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 11:55:04.148307 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:04.148287 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-80.ec2.internal" event="NodeHasSufficientMemory" Jun 09 11:55:04.148403 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:04.148326 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-80.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 11:55:04.148403 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:04.148342 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-80.ec2.internal" event="NodeHasSufficientPID" Jun 09 11:55:04.169889 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:04.169857 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/246a63a2537303c010a4ab50419f2e46-config\") pod \"kube-apiserver-proxy-ip-10-0-133-80.ec2.internal\" (UID: \"246a63a2537303c010a4ab50419f2e46\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-80.ec2.internal" Jun 09 11:55:04.169889 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:04.169892 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/39f6ad5cad04ca187e177396b47c6b2b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-80.ec2.internal\" (UID: \"39f6ad5cad04ca187e177396b47c6b2b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-80.ec2.internal" Jun 09 11:55:04.170090 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:04.169909 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/39f6ad5cad04ca187e177396b47c6b2b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-80.ec2.internal\" (UID: \"39f6ad5cad04ca187e177396b47c6b2b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-80.ec2.internal" Jun 09 11:55:04.177585 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:04.177552 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-80.ec2.internal\" not found" node="ip-10-0-133-80.ec2.internal" Jun 09 11:55:04.182147 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:04.182128 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-80.ec2.internal\" not found" node="ip-10-0-133-80.ec2.internal" Jun 09 11:55:04.200155 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:04.200126 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-80.ec2.internal\" not found" Jun 09 11:55:04.270335 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:04.270290 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/39f6ad5cad04ca187e177396b47c6b2b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-80.ec2.internal\" (UID: \"39f6ad5cad04ca187e177396b47c6b2b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-80.ec2.internal" Jun 09 11:55:04.270495 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:04.270360 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/39f6ad5cad04ca187e177396b47c6b2b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-80.ec2.internal\" (UID: \"39f6ad5cad04ca187e177396b47c6b2b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-80.ec2.internal" Jun 09 11:55:04.270495 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:04.270384 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/39f6ad5cad04ca187e177396b47c6b2b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-80.ec2.internal\" (UID: \"39f6ad5cad04ca187e177396b47c6b2b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-80.ec2.internal" Jun 09 11:55:04.270495 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:04.270437 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/39f6ad5cad04ca187e177396b47c6b2b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-80.ec2.internal\" (UID: \"39f6ad5cad04ca187e177396b47c6b2b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-80.ec2.internal" Jun 09 11:55:04.270495 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:04.270410 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/246a63a2537303c010a4ab50419f2e46-config\") pod \"kube-apiserver-proxy-ip-10-0-133-80.ec2.internal\" (UID: \"246a63a2537303c010a4ab50419f2e46\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-80.ec2.internal" Jun 09 11:55:04.270495 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:04.270476 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/246a63a2537303c010a4ab50419f2e46-config\") pod \"kube-apiserver-proxy-ip-10-0-133-80.ec2.internal\" (UID: \"246a63a2537303c010a4ab50419f2e46\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-80.ec2.internal" Jun 09 11:55:04.300760 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:04.300727 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-80.ec2.internal\" not found" Jun 09 11:55:04.401528 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:04.401447 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-80.ec2.internal\" not found" Jun 09 11:55:04.484146 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:04.484117 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-80.ec2.internal" Jun 09 11:55:04.488814 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:04.488560 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-80.ec2.internal" Jun 09 11:55:04.501966 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:04.501944 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-80.ec2.internal\" not found" Jun 09 11:55:04.602501 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:04.602454 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-80.ec2.internal\" not found" Jun 09 11:55:04.703129 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:04.703055 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-80.ec2.internal\" not found" Jun 09 11:55:04.803583 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:04.803551 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-80.ec2.internal\" not found" Jun 09 11:55:04.900372 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:04.900349 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 09 11:55:04.900958 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:04.900458 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 11:55:04.902435 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:04.902414 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 11:55:04.903887 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:04.903870 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-80.ec2.internal\" not found" Jun 09 11:55:05.004751 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:05.004678 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-80.ec2.internal\" not found" Jun 09 11:55:05.012898 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.012852 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 11:50:03 +0000 UTC" deadline="2027-12-25 14:53:55.69203746 +0000 UTC" Jun 09 11:55:05.012898 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.012895 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13538h58m50.679147247s" Jun 09 11:55:05.035173 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:05.035130 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39f6ad5cad04ca187e177396b47c6b2b.slice/crio-1416d2887907ac7a65001acaa00b180b3985e60412116359b28e73240ba6b298 WatchSource:0}: Error finding container 1416d2887907ac7a65001acaa00b180b3985e60412116359b28e73240ba6b298: Status 404 returned error can't find the container with id 1416d2887907ac7a65001acaa00b180b3985e60412116359b28e73240ba6b298 Jun 09 11:55:05.035439 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:05.035424 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod246a63a2537303c010a4ab50419f2e46.slice/crio-c3d323d0ac802e2ea716e5ed9afb626a3299e2c9d9ae75f1980d326028e07951 WatchSource:0}: Error finding container c3d323d0ac802e2ea716e5ed9afb626a3299e2c9d9ae75f1980d326028e07951: Status 404 returned error can't find the container with id c3d323d0ac802e2ea716e5ed9afb626a3299e2c9d9ae75f1980d326028e07951 Jun 09 11:55:05.041552 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.041475 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 11:55:05.042937 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.042895 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-80.ec2.internal" event={"ID":"39f6ad5cad04ca187e177396b47c6b2b","Type":"ContainerStarted","Data":"1416d2887907ac7a65001acaa00b180b3985e60412116359b28e73240ba6b298"} Jun 09 11:55:05.043842 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.043820 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-80.ec2.internal" event={"ID":"246a63a2537303c010a4ab50419f2e46","Type":"ContainerStarted","Data":"c3d323d0ac802e2ea716e5ed9afb626a3299e2c9d9ae75f1980d326028e07951"} Jun 09 11:55:05.061109 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.061087 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 11:55:05.105513 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:05.105484 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-80.ec2.internal\" not found" Jun 09 11:55:05.117688 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.117661 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 11:55:05.119158 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.119139 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-80.ec2.internal" event="NodeHasSufficientMemory" Jun 09 11:55:05.119233 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.119176 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-80.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 11:55:05.119233 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.119191 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-80.ec2.internal" event="NodeHasSufficientPID" Jun 09 11:55:05.205890 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:05.205850 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-80.ec2.internal\" not found" Jun 09 11:55:05.306517 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:05.306425 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-80.ec2.internal\" not found" Jun 09 11:55:05.407162 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:05.407130 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-80.ec2.internal\" not found" Jun 09 11:55:05.507891 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:05.507857 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-80.ec2.internal\" not found" Jun 09 11:55:05.559149 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.559067 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 11:55:05.568140 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.568115 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-80.ec2.internal" Jun 09 11:55:05.579661 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.579635 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 11:55:05.581104 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.581081 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-80.ec2.internal" Jun 09 11:55:05.589501 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.589479 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 11:55:05.947126 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.947100 2577 apiserver.go:52] "Watching apiserver" Jun 09 11:55:05.957461 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.957434 2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 09 11:55:05.958838 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.958815 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-6hkq6","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hz22","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-80.ec2.internal","openshift-multus/network-metrics-daemon-cvhwb","openshift-network-operator/iptables-alerter-ktt4d","openshift-ovn-kubernetes/ovnkube-node-g4ssk","kube-system/konnectivity-agent-nkhzs","kube-system/kube-apiserver-proxy-ip-10-0-133-80.ec2.internal","openshift-cluster-node-tuning-operator/tuned-qblqb","openshift-dns/node-resolver-z728s","openshift-image-registry/node-ca-vhxvf","openshift-multus/multus-97p2n","openshift-multus/multus-additional-cni-plugins-pfqql","openshift-network-diagnostics/network-check-target-ncsh5"] Jun 09 11:55:05.961225 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.961205 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nkhzs" Jun 09 11:55:05.963124 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.963102 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pfqql" Jun 09 11:55:05.965839 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.964416 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 09 11:55:05.965839 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.964708 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-78p8s\"" Jun 09 11:55:05.965839 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.964919 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 09 11:55:05.965839 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.965249 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 09 11:55:05.966171 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.966045 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncsh5" Jun 09 11:55:05.966171 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:05.966136 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncsh5" podUID="190991b2-0a7b-4f95-a21d-ed8ed4d549c1" Jun 09 11:55:05.966907 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.966852 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 09 11:55:05.966907 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.966877 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 09 11:55:05.967063 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.967004 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 09 11:55:05.967184 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.967165 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 09 11:55:05.967606 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.967585 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2jt7x\"" Jun 09 11:55:05.967710 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.967593 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 09 11:55:05.968274 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.968238 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvhwb" Jun 09 11:55:05.968370 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:05.968348 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvhwb" podUID="e14c077a-6021-4bf9-a3e7-ae5ca648b191" Jun 09 11:55:05.970346 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.970329 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ktt4d" Jun 09 11:55:05.972710 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.972667 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:05.973196 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.973176 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 09 11:55:05.973288 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.973234 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 09 11:55:05.973288 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.973181 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vqqgm\"" Jun 09 11:55:05.973288 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.973259 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 09 11:55:05.975005 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.974990 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qblqb" Jun 09 11:55:05.975124 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.975100 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 09 11:55:05.976352 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.976041 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 09 11:55:05.976352 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.976135 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 09 11:55:05.976352 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.976163 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 09 11:55:05.976352 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.976237 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 09 11:55:05.976352 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.976352 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 09 11:55:05.976656 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.976435 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-k7wwn\"" Jun 09 11:55:05.977236 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.977188 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 09 11:55:05.977338 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.977241 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hkq6" Jun 09 11:55:05.977338 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:05.977308 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hkq6" podUID="52890875-2219-4d5e-ae66-1b004a5c2cca" Jun 09 11:55:05.979632 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.979550 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hz22" Jun 09 11:55:05.979796 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.979776 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 09 11:55:05.979885 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.979859 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-89hq8\"" Jun 09 11:55:05.979885 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.979878 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3ef53ac3-35c1-47b3-902e-c34733bf2aa7-agent-certs\") pod \"konnectivity-agent-nkhzs\" (UID: \"3ef53ac3-35c1-47b3-902e-c34733bf2aa7\") " pod="kube-system/konnectivity-agent-nkhzs" Jun 09 11:55:05.979991 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.979924 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95e2cd86-14d8-4689-8d09-80d623678fab-system-cni-dir\") pod \"multus-additional-cni-plugins-pfqql\" (UID: \"95e2cd86-14d8-4689-8d09-80d623678fab\") " pod="openshift-multus/multus-additional-cni-plugins-pfqql" Jun 09 11:55:05.979991 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.979952 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/95e2cd86-14d8-4689-8d09-80d623678fab-cnibin\") pod \"multus-additional-cni-plugins-pfqql\" (UID: \"95e2cd86-14d8-4689-8d09-80d623678fab\") " pod="openshift-multus/multus-additional-cni-plugins-pfqql" Jun 09 11:55:05.979991 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.979974 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/95e2cd86-14d8-4689-8d09-80d623678fab-os-release\") pod \"multus-additional-cni-plugins-pfqql\" (UID: \"95e2cd86-14d8-4689-8d09-80d623678fab\") " pod="openshift-multus/multus-additional-cni-plugins-pfqql" Jun 09 11:55:05.980129 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.979998 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtghv\" (UniqueName: \"kubernetes.io/projected/e14c077a-6021-4bf9-a3e7-ae5ca648b191-kube-api-access-wtghv\") pod \"network-metrics-daemon-cvhwb\" (UID: \"e14c077a-6021-4bf9-a3e7-ae5ca648b191\") " pod="openshift-multus/network-metrics-daemon-cvhwb" Jun 09 11:55:05.980129 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.980022 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6b9182f2-a873-43c6-87d6-f43e10065979-host-slash\") pod \"iptables-alerter-ktt4d\" (UID: \"6b9182f2-a873-43c6-87d6-f43e10065979\") " pod="openshift-network-operator/iptables-alerter-ktt4d" Jun 09 11:55:05.980129 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.980061 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3ef53ac3-35c1-47b3-902e-c34733bf2aa7-konnectivity-ca\") pod \"konnectivity-agent-nkhzs\" (UID: \"3ef53ac3-35c1-47b3-902e-c34733bf2aa7\") " pod="kube-system/konnectivity-agent-nkhzs" Jun 09 11:55:05.980129 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.980100 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/95e2cd86-14d8-4689-8d09-80d623678fab-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pfqql\" (UID: \"95e2cd86-14d8-4689-8d09-80d623678fab\") " pod="openshift-multus/multus-additional-cni-plugins-pfqql" Jun 09 11:55:05.980288 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.980140 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tnf8\" (UniqueName: \"kubernetes.io/projected/95e2cd86-14d8-4689-8d09-80d623678fab-kube-api-access-2tnf8\") pod \"multus-additional-cni-plugins-pfqql\" (UID: \"95e2cd86-14d8-4689-8d09-80d623678fab\") " pod="openshift-multus/multus-additional-cni-plugins-pfqql" Jun 09 11:55:05.980288 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.980164 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b82bs\" (UniqueName: \"kubernetes.io/projected/190991b2-0a7b-4f95-a21d-ed8ed4d549c1-kube-api-access-b82bs\") pod \"network-check-target-ncsh5\" (UID: \"190991b2-0a7b-4f95-a21d-ed8ed4d549c1\") " pod="openshift-network-diagnostics/network-check-target-ncsh5" Jun 09 11:55:05.980288 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.980180 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-268xt\" (UniqueName: \"kubernetes.io/projected/6b9182f2-a873-43c6-87d6-f43e10065979-kube-api-access-268xt\") pod \"iptables-alerter-ktt4d\" (UID: \"6b9182f2-a873-43c6-87d6-f43e10065979\") " pod="openshift-network-operator/iptables-alerter-ktt4d" Jun 09 11:55:05.980288 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.980232 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/95e2cd86-14d8-4689-8d09-80d623678fab-cni-binary-copy\") pod \"multus-additional-cni-plugins-pfqql\" (UID: \"95e2cd86-14d8-4689-8d09-80d623678fab\") " pod="openshift-multus/multus-additional-cni-plugins-pfqql" Jun 09 11:55:05.980288 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.980261 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/95e2cd86-14d8-4689-8d09-80d623678fab-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pfqql\" (UID: \"95e2cd86-14d8-4689-8d09-80d623678fab\") " pod="openshift-multus/multus-additional-cni-plugins-pfqql" Jun 09 11:55:05.980288 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.980284 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/95e2cd86-14d8-4689-8d09-80d623678fab-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pfqql\" (UID: \"95e2cd86-14d8-4689-8d09-80d623678fab\") " pod="openshift-multus/multus-additional-cni-plugins-pfqql" Jun 09 11:55:05.980524 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.980308 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e14c077a-6021-4bf9-a3e7-ae5ca648b191-metrics-certs\") pod \"network-metrics-daemon-cvhwb\" (UID: \"e14c077a-6021-4bf9-a3e7-ae5ca648b191\") " pod="openshift-multus/network-metrics-daemon-cvhwb" Jun 09 11:55:05.980524 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.980334 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6b9182f2-a873-43c6-87d6-f43e10065979-iptables-alerter-script\") pod \"iptables-alerter-ktt4d\" (UID: \"6b9182f2-a873-43c6-87d6-f43e10065979\") " pod="openshift-network-operator/iptables-alerter-ktt4d" Jun 09 11:55:05.982106 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.982088 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z728s" Jun 09 11:55:05.984413 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.984394 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vhxvf" Jun 09 11:55:05.984546 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.984506 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8mzfd\"" Jun 09 11:55:05.984884 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.984865 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 09 11:55:05.984979 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.984963 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 09 11:55:05.985578 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.985263 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 09 11:55:05.985578 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.985364 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 09 11:55:05.985578 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.985468 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 09 11:55:05.985578 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.985478 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 11:55:05.985578 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.985481 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mcsvb\"" Jun 09 11:55:05.988121 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.988100 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-97p2n" Jun 09 11:55:05.997771 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.997754 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 09 11:55:05.997862 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.997848 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-zvfqq\"" Jun 09 11:55:05.999552 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.999535 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 09 11:55:05.999802 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.999786 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 09 11:55:05.999892 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:05.999839 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 09 11:55:06.000570 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.000553 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lzw46\"" Jun 09 11:55:06.051481 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.051451 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pdtr6" Jun 09 11:55:06.069016 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.068984 2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 09 11:55:06.069235 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.069218 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pdtr6" Jun 09 11:55:06.080523 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.080478 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7d76adfc-1b62-407e-9ce4-7300f09659c8-host-run-netns\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.080523 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.080522 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7d76adfc-1b62-407e-9ce4-7300f09659c8-run-openvswitch\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.080726 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.080544 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7d76adfc-1b62-407e-9ce4-7300f09659c8-ovnkube-config\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.080726 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.080570 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/95714450-2586-44d2-8146-bdbff71f4555-registration-dir\") pod \"aws-ebs-csi-driver-node-7hz22\" (UID: \"95714450-2586-44d2-8146-bdbff71f4555\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hz22" Jun 09 11:55:06.080726 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.080633 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f08417f2-9d8d-49a9-9853-cd362983ffec-os-release\") pod \"multus-97p2n\" (UID: \"f08417f2-9d8d-49a9-9853-cd362983ffec\") " pod="openshift-multus/multus-97p2n" Jun 09 11:55:06.080726 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.080685 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/95e2cd86-14d8-4689-8d09-80d623678fab-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pfqql\" (UID: \"95e2cd86-14d8-4689-8d09-80d623678fab\") " pod="openshift-multus/multus-additional-cni-plugins-pfqql" Jun 09 11:55:06.080924 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.080745 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6b9182f2-a873-43c6-87d6-f43e10065979-iptables-alerter-script\") pod \"iptables-alerter-ktt4d\" (UID: \"6b9182f2-a873-43c6-87d6-f43e10065979\") " pod="openshift-network-operator/iptables-alerter-ktt4d" Jun 09 11:55:06.080924 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.080797 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7d76adfc-1b62-407e-9ce4-7300f09659c8-var-lib-openvswitch\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.080924 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.080840 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/66015df4-1b51-400c-9870-d6de42d63c58-etc-sysctl-d\") pod \"tuned-qblqb\" (UID: \"66015df4-1b51-400c-9870-d6de42d63c58\") " pod="openshift-cluster-node-tuning-operator/tuned-qblqb" Jun 09 11:55:06.080924 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.080875 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nj7p\" (UniqueName: \"kubernetes.io/projected/01f9bafd-cb94-4a81-a033-1baef2ace912-kube-api-access-6nj7p\") pod \"node-resolver-z728s\" (UID: \"01f9bafd-cb94-4a81-a033-1baef2ace912\") " pod="openshift-dns/node-resolver-z728s" Jun 09 11:55:06.080924 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.080901 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7d76adfc-1b62-407e-9ce4-7300f09659c8-host-slash\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.081149 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.080939 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f08417f2-9d8d-49a9-9853-cd362983ffec-etc-kubernetes\") pod \"multus-97p2n\" (UID: \"f08417f2-9d8d-49a9-9853-cd362983ffec\") " pod="openshift-multus/multus-97p2n" Jun 09 11:55:06.081149 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.080970 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tnf8\" (UniqueName: \"kubernetes.io/projected/95e2cd86-14d8-4689-8d09-80d623678fab-kube-api-access-2tnf8\") pod \"multus-additional-cni-plugins-pfqql\" (UID: \"95e2cd86-14d8-4689-8d09-80d623678fab\") " pod="openshift-multus/multus-additional-cni-plugins-pfqql" Jun 09 11:55:06.081149 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.080996 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7d76adfc-1b62-407e-9ce4-7300f09659c8-run-systemd\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.081149 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.081065 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d76adfc-1b62-407e-9ce4-7300f09659c8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.081149 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.081091 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7d76adfc-1b62-407e-9ce4-7300f09659c8-env-overrides\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.081149 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.081114 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7d76adfc-1b62-407e-9ce4-7300f09659c8-ovn-node-metrics-cert\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.081418 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.081161 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7d76adfc-1b62-407e-9ce4-7300f09659c8-ovnkube-script-lib\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.081418 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.081197 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/66015df4-1b51-400c-9870-d6de42d63c58-var-lib-kubelet\") pod \"tuned-qblqb\" (UID: \"66015df4-1b51-400c-9870-d6de42d63c58\") " pod="openshift-cluster-node-tuning-operator/tuned-qblqb" Jun 09 11:55:06.081418 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.081221 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/52890875-2219-4d5e-ae66-1b004a5c2cca-kubelet-config\") pod \"global-pull-secret-syncer-6hkq6\" (UID: \"52890875-2219-4d5e-ae66-1b004a5c2cca\") " pod="kube-system/global-pull-secret-syncer-6hkq6" Jun 09 11:55:06.081418 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.081267 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6b9182f2-a873-43c6-87d6-f43e10065979-iptables-alerter-script\") pod \"iptables-alerter-ktt4d\" (UID: \"6b9182f2-a873-43c6-87d6-f43e10065979\") " pod="openshift-network-operator/iptables-alerter-ktt4d" Jun 09 11:55:06.081418 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.081283 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7d76adfc-1b62-407e-9ce4-7300f09659c8-systemd-units\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.081418 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.081291 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/95e2cd86-14d8-4689-8d09-80d623678fab-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pfqql\" (UID: \"95e2cd86-14d8-4689-8d09-80d623678fab\") " pod="openshift-multus/multus-additional-cni-plugins-pfqql" Jun 09 11:55:06.081418 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.081309 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/95714450-2586-44d2-8146-bdbff71f4555-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7hz22\" (UID: \"95714450-2586-44d2-8146-bdbff71f4555\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hz22" Jun 09 11:55:06.081418 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.081344 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpqjp\" (UniqueName: \"kubernetes.io/projected/95714450-2586-44d2-8146-bdbff71f4555-kube-api-access-bpqjp\") pod \"aws-ebs-csi-driver-node-7hz22\" (UID: \"95714450-2586-44d2-8146-bdbff71f4555\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hz22" Jun 09 11:55:06.081418 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.081381 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ab0c9312-14d5-40ed-9840-b89f7637bf85-serviceca\") pod \"node-ca-vhxvf\" (UID: \"ab0c9312-14d5-40ed-9840-b89f7637bf85\") " pod="openshift-image-registry/node-ca-vhxvf" Jun 09 11:55:06.081418 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.081409 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f08417f2-9d8d-49a9-9853-cd362983ffec-multus-conf-dir\") pod \"multus-97p2n\" (UID: \"f08417f2-9d8d-49a9-9853-cd362983ffec\") " pod="openshift-multus/multus-97p2n" Jun 09 11:55:06.081876 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.081439 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e14c077a-6021-4bf9-a3e7-ae5ca648b191-metrics-certs\") pod \"network-metrics-daemon-cvhwb\" (UID: \"e14c077a-6021-4bf9-a3e7-ae5ca648b191\") " pod="openshift-multus/network-metrics-daemon-cvhwb" Jun 09 11:55:06.081876 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.081462 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7d76adfc-1b62-407e-9ce4-7300f09659c8-host-cni-bin\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.081876 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.081483 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7d76adfc-1b62-407e-9ce4-7300f09659c8-host-cni-netd\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.081876 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.081506 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01f9bafd-cb94-4a81-a033-1baef2ace912-tmp-dir\") pod \"node-resolver-z728s\" (UID: \"01f9bafd-cb94-4a81-a033-1baef2ace912\") " pod="openshift-dns/node-resolver-z728s" Jun 09 11:55:06.081876 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.081586 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dldwp\" (UniqueName: \"kubernetes.io/projected/ab0c9312-14d5-40ed-9840-b89f7637bf85-kube-api-access-dldwp\") pod \"node-ca-vhxvf\" (UID: \"ab0c9312-14d5-40ed-9840-b89f7637bf85\") " pod="openshift-image-registry/node-ca-vhxvf" Jun 09 11:55:06.081876 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.081607 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f08417f2-9d8d-49a9-9853-cd362983ffec-cni-binary-copy\") pod \"multus-97p2n\" (UID: \"f08417f2-9d8d-49a9-9853-cd362983ffec\") " pod="openshift-multus/multus-97p2n" Jun 09 11:55:06.081876 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.081647 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f08417f2-9d8d-49a9-9853-cd362983ffec-multus-socket-dir-parent\") pod \"multus-97p2n\" (UID: \"f08417f2-9d8d-49a9-9853-cd362983ffec\") " pod="openshift-multus/multus-97p2n" Jun 09 11:55:06.081876 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:06.081656 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:55:06.081876 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.081688 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f08417f2-9d8d-49a9-9853-cd362983ffec-host-run-k8s-cni-cncf-io\") pod \"multus-97p2n\" (UID: \"f08417f2-9d8d-49a9-9853-cd362983ffec\") " pod="openshift-multus/multus-97p2n" Jun 09 11:55:06.081876 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:06.081773 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e14c077a-6021-4bf9-a3e7-ae5ca648b191-metrics-certs podName:e14c077a-6021-4bf9-a3e7-ae5ca648b191 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:06.581743008 +0000 UTC m=+3.004300782 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e14c077a-6021-4bf9-a3e7-ae5ca648b191-metrics-certs") pod "network-metrics-daemon-cvhwb" (UID: "e14c077a-6021-4bf9-a3e7-ae5ca648b191") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:55:06.081876 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.081825 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95e2cd86-14d8-4689-8d09-80d623678fab-system-cni-dir\") pod \"multus-additional-cni-plugins-pfqql\" (UID: \"95e2cd86-14d8-4689-8d09-80d623678fab\") " pod="openshift-multus/multus-additional-cni-plugins-pfqql" Jun 09 11:55:06.082481 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.081901 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/95e2cd86-14d8-4689-8d09-80d623678fab-cnibin\") pod \"multus-additional-cni-plugins-pfqql\" (UID: \"95e2cd86-14d8-4689-8d09-80d623678fab\") " pod="openshift-multus/multus-additional-cni-plugins-pfqql" Jun 09 11:55:06.082481 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.081943 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95e2cd86-14d8-4689-8d09-80d623678fab-system-cni-dir\") pod \"multus-additional-cni-plugins-pfqql\" (UID: \"95e2cd86-14d8-4689-8d09-80d623678fab\") " pod="openshift-multus/multus-additional-cni-plugins-pfqql" Jun 09 11:55:06.082481 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.082003 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/95e2cd86-14d8-4689-8d09-80d623678fab-os-release\") pod \"multus-additional-cni-plugins-pfqql\" (UID: \"95e2cd86-14d8-4689-8d09-80d623678fab\") " pod="openshift-multus/multus-additional-cni-plugins-pfqql" Jun 09 11:55:06.082481 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.082015 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/95e2cd86-14d8-4689-8d09-80d623678fab-cnibin\") pod \"multus-additional-cni-plugins-pfqql\" (UID: \"95e2cd86-14d8-4689-8d09-80d623678fab\") " pod="openshift-multus/multus-additional-cni-plugins-pfqql" Jun 09 11:55:06.082481 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.082064 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d76adfc-1b62-407e-9ce4-7300f09659c8-host-kubelet\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.082481 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.082134 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/95e2cd86-14d8-4689-8d09-80d623678fab-os-release\") pod \"multus-additional-cni-plugins-pfqql\" (UID: \"95e2cd86-14d8-4689-8d09-80d623678fab\") " pod="openshift-multus/multus-additional-cni-plugins-pfqql" Jun 09 11:55:06.082481 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.082166 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/66015df4-1b51-400c-9870-d6de42d63c58-etc-modprobe-d\") pod \"tuned-qblqb\" (UID: \"66015df4-1b51-400c-9870-d6de42d63c58\") " pod="openshift-cluster-node-tuning-operator/tuned-qblqb" Jun 09 11:55:06.082481 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.082202 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/66015df4-1b51-400c-9870-d6de42d63c58-run\") pod \"tuned-qblqb\" (UID: \"66015df4-1b51-400c-9870-d6de42d63c58\") " pod="openshift-cluster-node-tuning-operator/tuned-qblqb" Jun 09 11:55:06.082481 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.082232 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/01f9bafd-cb94-4a81-a033-1baef2ace912-hosts-file\") pod \"node-resolver-z728s\" (UID: \"01f9bafd-cb94-4a81-a033-1baef2ace912\") " pod="openshift-dns/node-resolver-z728s" Jun 09 11:55:06.082481 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.082262 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/95e2cd86-14d8-4689-8d09-80d623678fab-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pfqql\" (UID: \"95e2cd86-14d8-4689-8d09-80d623678fab\") " pod="openshift-multus/multus-additional-cni-plugins-pfqql" Jun 09 11:55:06.082481 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.082300 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b82bs\" (UniqueName: \"kubernetes.io/projected/190991b2-0a7b-4f95-a21d-ed8ed4d549c1-kube-api-access-b82bs\") pod \"network-check-target-ncsh5\" (UID: \"190991b2-0a7b-4f95-a21d-ed8ed4d549c1\") " pod="openshift-network-diagnostics/network-check-target-ncsh5" Jun 09 11:55:06.082481 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.082378 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-268xt\" (UniqueName: \"kubernetes.io/projected/6b9182f2-a873-43c6-87d6-f43e10065979-kube-api-access-268xt\") pod \"iptables-alerter-ktt4d\" (UID: \"6b9182f2-a873-43c6-87d6-f43e10065979\") " pod="openshift-network-operator/iptables-alerter-ktt4d" Jun 09 11:55:06.083047 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.082488 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7d76adfc-1b62-407e-9ce4-7300f09659c8-etc-openvswitch\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.083047 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.082518 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f08417f2-9d8d-49a9-9853-cd362983ffec-multus-cni-dir\") pod \"multus-97p2n\" (UID: \"f08417f2-9d8d-49a9-9853-cd362983ffec\") " pod="openshift-multus/multus-97p2n" Jun 09 11:55:06.083047 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.082553 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f08417f2-9d8d-49a9-9853-cd362983ffec-host-var-lib-cni-bin\") pod \"multus-97p2n\" (UID: \"f08417f2-9d8d-49a9-9853-cd362983ffec\") " pod="openshift-multus/multus-97p2n" Jun 09 11:55:06.083047 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.082663 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f08417f2-9d8d-49a9-9853-cd362983ffec-host-var-lib-kubelet\") pod \"multus-97p2n\" (UID: \"f08417f2-9d8d-49a9-9853-cd362983ffec\") " pod="openshift-multus/multus-97p2n" Jun 09 11:55:06.083047 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.082699 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f08417f2-9d8d-49a9-9853-cd362983ffec-multus-daemon-config\") pod \"multus-97p2n\" (UID: \"f08417f2-9d8d-49a9-9853-cd362983ffec\") " pod="openshift-multus/multus-97p2n" Jun 09 11:55:06.083047 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.082744 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/66015df4-1b51-400c-9870-d6de42d63c58-etc-tuned\") pod \"tuned-qblqb\" (UID: \"66015df4-1b51-400c-9870-d6de42d63c58\") " pod="openshift-cluster-node-tuning-operator/tuned-qblqb" Jun 09 11:55:06.083047 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.082770 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/52890875-2219-4d5e-ae66-1b004a5c2cca-dbus\") pod \"global-pull-secret-syncer-6hkq6\" (UID: \"52890875-2219-4d5e-ae66-1b004a5c2cca\") " pod="kube-system/global-pull-secret-syncer-6hkq6" Jun 09 11:55:06.083047 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.082784 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/95e2cd86-14d8-4689-8d09-80d623678fab-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pfqql\" (UID: \"95e2cd86-14d8-4689-8d09-80d623678fab\") " pod="openshift-multus/multus-additional-cni-plugins-pfqql" Jun 09 11:55:06.083047 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.082791 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f08417f2-9d8d-49a9-9853-cd362983ffec-cnibin\") pod \"multus-97p2n\" (UID: \"f08417f2-9d8d-49a9-9853-cd362983ffec\") " pod="openshift-multus/multus-97p2n" Jun 09 11:55:06.083047 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.082839 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3ef53ac3-35c1-47b3-902e-c34733bf2aa7-agent-certs\") pod \"konnectivity-agent-nkhzs\" (UID: \"3ef53ac3-35c1-47b3-902e-c34733bf2aa7\") " pod="kube-system/konnectivity-agent-nkhzs" Jun 09 11:55:06.083047 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.082858 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6b9182f2-a873-43c6-87d6-f43e10065979-host-slash\") pod \"iptables-alerter-ktt4d\" (UID: \"6b9182f2-a873-43c6-87d6-f43e10065979\") " pod="openshift-network-operator/iptables-alerter-ktt4d" Jun 09 11:55:06.083047 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.082884 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d76adfc-1b62-407e-9ce4-7300f09659c8-host-run-ovn-kubernetes\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.083047 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.082910 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tl7wv\" (UniqueName: \"kubernetes.io/projected/66015df4-1b51-400c-9870-d6de42d63c58-kube-api-access-tl7wv\") pod \"tuned-qblqb\" (UID: \"66015df4-1b51-400c-9870-d6de42d63c58\") " pod="openshift-cluster-node-tuning-operator/tuned-qblqb" Jun 09 11:55:06.083047 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.082932 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/95714450-2586-44d2-8146-bdbff71f4555-device-dir\") pod \"aws-ebs-csi-driver-node-7hz22\" (UID: \"95714450-2586-44d2-8146-bdbff71f4555\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hz22" Jun 09 11:55:06.083047 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.082953 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/95714450-2586-44d2-8146-bdbff71f4555-sys-fs\") pod \"aws-ebs-csi-driver-node-7hz22\" (UID: \"95714450-2586-44d2-8146-bdbff71f4555\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hz22" Jun 09 11:55:06.083047 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.082976 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f08417f2-9d8d-49a9-9853-cd362983ffec-system-cni-dir\") pod \"multus-97p2n\" (UID: \"f08417f2-9d8d-49a9-9853-cd362983ffec\") " pod="openshift-multus/multus-97p2n" Jun 09 11:55:06.083047 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.083002 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3ef53ac3-35c1-47b3-902e-c34733bf2aa7-konnectivity-ca\") pod \"konnectivity-agent-nkhzs\" (UID: \"3ef53ac3-35c1-47b3-902e-c34733bf2aa7\") " pod="kube-system/konnectivity-agent-nkhzs" Jun 09 11:55:06.083777 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.083025 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52890875-2219-4d5e-ae66-1b004a5c2cca-original-pull-secret\") pod \"global-pull-secret-syncer-6hkq6\" (UID: \"52890875-2219-4d5e-ae66-1b004a5c2cca\") " pod="kube-system/global-pull-secret-syncer-6hkq6" Jun 09 11:55:06.083777 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.083048 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f08417f2-9d8d-49a9-9853-cd362983ffec-host-run-netns\") pod \"multus-97p2n\" (UID: \"f08417f2-9d8d-49a9-9853-cd362983ffec\") " pod="openshift-multus/multus-97p2n" Jun 09 11:55:06.083777 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.083071 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f08417f2-9d8d-49a9-9853-cd362983ffec-host-var-lib-cni-multus\") pod \"multus-97p2n\" (UID: \"f08417f2-9d8d-49a9-9853-cd362983ffec\") " pod="openshift-multus/multus-97p2n" Jun 09 11:55:06.083777 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.083092 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f08417f2-9d8d-49a9-9853-cd362983ffec-hostroot\") pod \"multus-97p2n\" (UID: \"f08417f2-9d8d-49a9-9853-cd362983ffec\") " pod="openshift-multus/multus-97p2n" Jun 09 11:55:06.083777 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.083115 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkgqw\" (UniqueName: \"kubernetes.io/projected/7d76adfc-1b62-407e-9ce4-7300f09659c8-kube-api-access-qkgqw\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.083777 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.083136 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66015df4-1b51-400c-9870-d6de42d63c58-sys\") pod \"tuned-qblqb\" (UID: \"66015df4-1b51-400c-9870-d6de42d63c58\") " pod="openshift-cluster-node-tuning-operator/tuned-qblqb" Jun 09 11:55:06.083777 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.083179 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/95714450-2586-44d2-8146-bdbff71f4555-socket-dir\") pod \"aws-ebs-csi-driver-node-7hz22\" (UID: \"95714450-2586-44d2-8146-bdbff71f4555\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hz22" Jun 09 11:55:06.083777 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.083189 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 09 11:55:06.083777 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.083271 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ab0c9312-14d5-40ed-9840-b89f7637bf85-host\") pod \"node-ca-vhxvf\" (UID: \"ab0c9312-14d5-40ed-9840-b89f7637bf85\") " pod="openshift-image-registry/node-ca-vhxvf" Jun 09 11:55:06.083777 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.083298 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/95e2cd86-14d8-4689-8d09-80d623678fab-cni-binary-copy\") pod \"multus-additional-cni-plugins-pfqql\" (UID: \"95e2cd86-14d8-4689-8d09-80d623678fab\") " pod="openshift-multus/multus-additional-cni-plugins-pfqql" Jun 09 11:55:06.083777 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.083319 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/95e2cd86-14d8-4689-8d09-80d623678fab-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pfqql\" (UID: \"95e2cd86-14d8-4689-8d09-80d623678fab\") " pod="openshift-multus/multus-additional-cni-plugins-pfqql" Jun 09 11:55:06.083777 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.083342 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7d76adfc-1b62-407e-9ce4-7300f09659c8-log-socket\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.083777 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.083362 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6b9182f2-a873-43c6-87d6-f43e10065979-host-slash\") pod \"iptables-alerter-ktt4d\" (UID: \"6b9182f2-a873-43c6-87d6-f43e10065979\") " pod="openshift-network-operator/iptables-alerter-ktt4d" Jun 09 11:55:06.083777 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.083406 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/66015df4-1b51-400c-9870-d6de42d63c58-etc-kubernetes\") pod \"tuned-qblqb\" (UID: \"66015df4-1b51-400c-9870-d6de42d63c58\") " pod="openshift-cluster-node-tuning-operator/tuned-qblqb" Jun 09 11:55:06.083777 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.083435 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66015df4-1b51-400c-9870-d6de42d63c58-tmp\") pod \"tuned-qblqb\" (UID: \"66015df4-1b51-400c-9870-d6de42d63c58\") " pod="openshift-cluster-node-tuning-operator/tuned-qblqb" Jun 09 11:55:06.083777 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.083461 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtghv\" (UniqueName: \"kubernetes.io/projected/e14c077a-6021-4bf9-a3e7-ae5ca648b191-kube-api-access-wtghv\") pod \"network-metrics-daemon-cvhwb\" (UID: \"e14c077a-6021-4bf9-a3e7-ae5ca648b191\") " pod="openshift-multus/network-metrics-daemon-cvhwb" Jun 09 11:55:06.083777 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.083485 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7d76adfc-1b62-407e-9ce4-7300f09659c8-run-ovn\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.084951 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.083541 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7d76adfc-1b62-407e-9ce4-7300f09659c8-node-log\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.084951 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.083584 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/66015df4-1b51-400c-9870-d6de42d63c58-etc-sysctl-conf\") pod \"tuned-qblqb\" (UID: \"66015df4-1b51-400c-9870-d6de42d63c58\") " pod="openshift-cluster-node-tuning-operator/tuned-qblqb" Jun 09 11:55:06.084951 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.083595 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/95e2cd86-14d8-4689-8d09-80d623678fab-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pfqql\" (UID: \"95e2cd86-14d8-4689-8d09-80d623678fab\") " pod="openshift-multus/multus-additional-cni-plugins-pfqql" Jun 09 11:55:06.084951 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.083605 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/66015df4-1b51-400c-9870-d6de42d63c58-lib-modules\") pod \"tuned-qblqb\" (UID: \"66015df4-1b51-400c-9870-d6de42d63c58\") " pod="openshift-cluster-node-tuning-operator/tuned-qblqb" Jun 09 11:55:06.084951 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.083648 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/66015df4-1b51-400c-9870-d6de42d63c58-host\") pod \"tuned-qblqb\" (UID: \"66015df4-1b51-400c-9870-d6de42d63c58\") " pod="openshift-cluster-node-tuning-operator/tuned-qblqb" Jun 09 11:55:06.084951 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.083706 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3ef53ac3-35c1-47b3-902e-c34733bf2aa7-konnectivity-ca\") pod \"konnectivity-agent-nkhzs\" (UID: \"3ef53ac3-35c1-47b3-902e-c34733bf2aa7\") " pod="kube-system/konnectivity-agent-nkhzs" Jun 09 11:55:06.084951 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.083713 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrl6n\" (UniqueName: \"kubernetes.io/projected/f08417f2-9d8d-49a9-9853-cd362983ffec-kube-api-access-hrl6n\") pod \"multus-97p2n\" (UID: \"f08417f2-9d8d-49a9-9853-cd362983ffec\") " pod="openshift-multus/multus-97p2n" Jun 09 11:55:06.084951 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.083759 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/66015df4-1b51-400c-9870-d6de42d63c58-etc-sysconfig\") pod \"tuned-qblqb\" (UID: \"66015df4-1b51-400c-9870-d6de42d63c58\") " pod="openshift-cluster-node-tuning-operator/tuned-qblqb" Jun 09 11:55:06.084951 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.083784 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/66015df4-1b51-400c-9870-d6de42d63c58-etc-systemd\") pod \"tuned-qblqb\" (UID: \"66015df4-1b51-400c-9870-d6de42d63c58\") " pod="openshift-cluster-node-tuning-operator/tuned-qblqb" Jun 09 11:55:06.084951 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.083819 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/95714450-2586-44d2-8146-bdbff71f4555-etc-selinux\") pod \"aws-ebs-csi-driver-node-7hz22\" (UID: \"95714450-2586-44d2-8146-bdbff71f4555\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hz22" Jun 09 11:55:06.084951 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.083838 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/95e2cd86-14d8-4689-8d09-80d623678fab-cni-binary-copy\") pod \"multus-additional-cni-plugins-pfqql\" (UID: \"95e2cd86-14d8-4689-8d09-80d623678fab\") " pod="openshift-multus/multus-additional-cni-plugins-pfqql" Jun 09 11:55:06.084951 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.083847 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f08417f2-9d8d-49a9-9853-cd362983ffec-host-run-multus-certs\") pod \"multus-97p2n\" (UID: \"f08417f2-9d8d-49a9-9853-cd362983ffec\") " pod="openshift-multus/multus-97p2n" Jun 09 11:55:06.087055 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.087005 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3ef53ac3-35c1-47b3-902e-c34733bf2aa7-agent-certs\") pod \"konnectivity-agent-nkhzs\" (UID: \"3ef53ac3-35c1-47b3-902e-c34733bf2aa7\") " pod="kube-system/konnectivity-agent-nkhzs" Jun 09 11:55:06.107534 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:06.107503 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 11:55:06.107534 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:06.107533 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 11:55:06.107725 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:06.107547 2577 projected.go:196] Error preparing data for projected volume kube-api-access-b82bs for pod openshift-network-diagnostics/network-check-target-ncsh5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:55:06.107725 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:06.107636 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/190991b2-0a7b-4f95-a21d-ed8ed4d549c1-kube-api-access-b82bs podName:190991b2-0a7b-4f95-a21d-ed8ed4d549c1 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:06.607599939 +0000 UTC m=+3.030157698 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-b82bs" (UniqueName: "kubernetes.io/projected/190991b2-0a7b-4f95-a21d-ed8ed4d549c1-kube-api-access-b82bs") pod "network-check-target-ncsh5" (UID: "190991b2-0a7b-4f95-a21d-ed8ed4d549c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:55:06.110204 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.110175 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtghv\" (UniqueName: \"kubernetes.io/projected/e14c077a-6021-4bf9-a3e7-ae5ca648b191-kube-api-access-wtghv\") pod \"network-metrics-daemon-cvhwb\" (UID: \"e14c077a-6021-4bf9-a3e7-ae5ca648b191\") " pod="openshift-multus/network-metrics-daemon-cvhwb" Jun 09 11:55:06.111850 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.111825 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tnf8\" (UniqueName: \"kubernetes.io/projected/95e2cd86-14d8-4689-8d09-80d623678fab-kube-api-access-2tnf8\") pod \"multus-additional-cni-plugins-pfqql\" (UID: \"95e2cd86-14d8-4689-8d09-80d623678fab\") " pod="openshift-multus/multus-additional-cni-plugins-pfqql" Jun 09 11:55:06.114149 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.114126 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-268xt\" (UniqueName: \"kubernetes.io/projected/6b9182f2-a873-43c6-87d6-f43e10065979-kube-api-access-268xt\") pod \"iptables-alerter-ktt4d\" (UID: \"6b9182f2-a873-43c6-87d6-f43e10065979\") " pod="openshift-network-operator/iptables-alerter-ktt4d" Jun 09 11:55:06.184904 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.184869 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7d76adfc-1b62-407e-9ce4-7300f09659c8-etc-openvswitch\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.184904 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.184906 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f08417f2-9d8d-49a9-9853-cd362983ffec-multus-cni-dir\") pod \"multus-97p2n\" (UID: \"f08417f2-9d8d-49a9-9853-cd362983ffec\") " pod="openshift-multus/multus-97p2n" Jun 09 11:55:06.185131 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.184928 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f08417f2-9d8d-49a9-9853-cd362983ffec-host-var-lib-cni-bin\") pod \"multus-97p2n\" (UID: \"f08417f2-9d8d-49a9-9853-cd362983ffec\") " pod="openshift-multus/multus-97p2n" Jun 09 11:55:06.185131 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.184995 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7d76adfc-1b62-407e-9ce4-7300f09659c8-etc-openvswitch\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.185131 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.185076 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f08417f2-9d8d-49a9-9853-cd362983ffec-multus-cni-dir\") pod \"multus-97p2n\" (UID: \"f08417f2-9d8d-49a9-9853-cd362983ffec\") " pod="openshift-multus/multus-97p2n" Jun 09 11:55:06.185131 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.185074 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f08417f2-9d8d-49a9-9853-cd362983ffec-host-var-lib-cni-bin\") pod \"multus-97p2n\" (UID: \"f08417f2-9d8d-49a9-9853-cd362983ffec\") " pod="openshift-multus/multus-97p2n" Jun 09 11:55:06.185131 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.185120 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f08417f2-9d8d-49a9-9853-cd362983ffec-host-var-lib-kubelet\") pod \"multus-97p2n\" (UID: \"f08417f2-9d8d-49a9-9853-cd362983ffec\") " pod="openshift-multus/multus-97p2n" Jun 09 11:55:06.185307 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.185142 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f08417f2-9d8d-49a9-9853-cd362983ffec-multus-daemon-config\") pod \"multus-97p2n\" (UID: \"f08417f2-9d8d-49a9-9853-cd362983ffec\") " pod="openshift-multus/multus-97p2n" Jun 09 11:55:06.185307 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.185170 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/66015df4-1b51-400c-9870-d6de42d63c58-etc-tuned\") pod \"tuned-qblqb\" (UID: \"66015df4-1b51-400c-9870-d6de42d63c58\") " pod="openshift-cluster-node-tuning-operator/tuned-qblqb" Jun 09 11:55:06.185307 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.185189 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f08417f2-9d8d-49a9-9853-cd362983ffec-host-var-lib-kubelet\") pod \"multus-97p2n\" (UID: \"f08417f2-9d8d-49a9-9853-cd362983ffec\") " pod="openshift-multus/multus-97p2n" Jun 09 11:55:06.185307 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.185194 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/52890875-2219-4d5e-ae66-1b004a5c2cca-dbus\") pod \"global-pull-secret-syncer-6hkq6\" (UID: \"52890875-2219-4d5e-ae66-1b004a5c2cca\") " pod="kube-system/global-pull-secret-syncer-6hkq6" Jun 09 11:55:06.185307 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.185218 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f08417f2-9d8d-49a9-9853-cd362983ffec-cnibin\") pod \"multus-97p2n\" (UID: \"f08417f2-9d8d-49a9-9853-cd362983ffec\") " pod="openshift-multus/multus-97p2n" Jun 09 11:55:06.185307 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.185254 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d76adfc-1b62-407e-9ce4-7300f09659c8-host-run-ovn-kubernetes\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.185307 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.185280 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f08417f2-9d8d-49a9-9853-cd362983ffec-cnibin\") pod \"multus-97p2n\" (UID: \"f08417f2-9d8d-49a9-9853-cd362983ffec\") " pod="openshift-multus/multus-97p2n" Jun 09 11:55:06.185307 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.185281 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tl7wv\" (UniqueName: \"kubernetes.io/projected/66015df4-1b51-400c-9870-d6de42d63c58-kube-api-access-tl7wv\") pod \"tuned-qblqb\" (UID: \"66015df4-1b51-400c-9870-d6de42d63c58\") " pod="openshift-cluster-node-tuning-operator/tuned-qblqb" Jun 09 11:55:06.185697 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.185316 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/95714450-2586-44d2-8146-bdbff71f4555-device-dir\") pod \"aws-ebs-csi-driver-node-7hz22\" (UID: \"95714450-2586-44d2-8146-bdbff71f4555\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hz22" Jun 09 11:55:06.185697 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.185337 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/95714450-2586-44d2-8146-bdbff71f4555-sys-fs\") pod \"aws-ebs-csi-driver-node-7hz22\" (UID: \"95714450-2586-44d2-8146-bdbff71f4555\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hz22" Jun 09 11:55:06.185697 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.185359 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f08417f2-9d8d-49a9-9853-cd362983ffec-system-cni-dir\") pod \"multus-97p2n\" (UID: \"f08417f2-9d8d-49a9-9853-cd362983ffec\") " pod="openshift-multus/multus-97p2n" Jun 09 11:55:06.185697 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.185376 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/52890875-2219-4d5e-ae66-1b004a5c2cca-dbus\") pod \"global-pull-secret-syncer-6hkq6\" (UID: \"52890875-2219-4d5e-ae66-1b004a5c2cca\") " pod="kube-system/global-pull-secret-syncer-6hkq6" Jun 09 11:55:06.185697 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.185383 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52890875-2219-4d5e-ae66-1b004a5c2cca-original-pull-secret\") pod \"global-pull-secret-syncer-6hkq6\" (UID: \"52890875-2219-4d5e-ae66-1b004a5c2cca\") " pod="kube-system/global-pull-secret-syncer-6hkq6" Jun 09 11:55:06.185697 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.185410 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f08417f2-9d8d-49a9-9853-cd362983ffec-host-run-netns\") pod \"multus-97p2n\" (UID: \"f08417f2-9d8d-49a9-9853-cd362983ffec\") " pod="openshift-multus/multus-97p2n" Jun 09 11:55:06.185697 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.185427 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/95714450-2586-44d2-8146-bdbff71f4555-device-dir\") pod \"aws-ebs-csi-driver-node-7hz22\" (UID: \"95714450-2586-44d2-8146-bdbff71f4555\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hz22" Jun 09 11:55:06.185697 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.185435 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f08417f2-9d8d-49a9-9853-cd362983ffec-host-var-lib-cni-multus\") pod \"multus-97p2n\" (UID: \"f08417f2-9d8d-49a9-9853-cd362983ffec\") " pod="openshift-multus/multus-97p2n" Jun 09 11:55:06.185697 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.185463 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f08417f2-9d8d-49a9-9853-cd362983ffec-hostroot\") pod \"multus-97p2n\" (UID: \"f08417f2-9d8d-49a9-9853-cd362983ffec\") " pod="openshift-multus/multus-97p2n" Jun 09 11:55:06.185697 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.185486 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f08417f2-9d8d-49a9-9853-cd362983ffec-system-cni-dir\") pod \"multus-97p2n\" (UID: \"f08417f2-9d8d-49a9-9853-cd362983ffec\") " pod="openshift-multus/multus-97p2n" Jun 09 11:55:06.185697 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.185494 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkgqw\" (UniqueName: \"kubernetes.io/projected/7d76adfc-1b62-407e-9ce4-7300f09659c8-kube-api-access-qkgqw\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.185697 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.185504 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f08417f2-9d8d-49a9-9853-cd362983ffec-host-var-lib-cni-multus\") pod \"multus-97p2n\" (UID: \"f08417f2-9d8d-49a9-9853-cd362983ffec\") " pod="openshift-multus/multus-97p2n" Jun 09 11:55:06.185697 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:06.185512 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 11:55:06.185697 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.185517 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66015df4-1b51-400c-9870-d6de42d63c58-sys\") pod \"tuned-qblqb\" (UID: \"66015df4-1b51-400c-9870-d6de42d63c58\") " pod="openshift-cluster-node-tuning-operator/tuned-qblqb" Jun 09 11:55:06.185697 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.185528 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f08417f2-9d8d-49a9-9853-cd362983ffec-host-run-netns\") pod \"multus-97p2n\" (UID: \"f08417f2-9d8d-49a9-9853-cd362983ffec\") " pod="openshift-multus/multus-97p2n" Jun 09 11:55:06.185697 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.185435 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/95714450-2586-44d2-8146-bdbff71f4555-sys-fs\") pod \"aws-ebs-csi-driver-node-7hz22\" (UID: \"95714450-2586-44d2-8146-bdbff71f4555\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hz22" Jun 09 11:55:06.185697 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.185539 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/95714450-2586-44d2-8146-bdbff71f4555-socket-dir\") pod \"aws-ebs-csi-driver-node-7hz22\" (UID: \"95714450-2586-44d2-8146-bdbff71f4555\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hz22" Jun 09 11:55:06.185697 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.185554 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f08417f2-9d8d-49a9-9853-cd362983ffec-hostroot\") pod \"multus-97p2n\" (UID: \"f08417f2-9d8d-49a9-9853-cd362983ffec\") " pod="openshift-multus/multus-97p2n" Jun 09 11:55:06.186643 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:06.185566 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52890875-2219-4d5e-ae66-1b004a5c2cca-original-pull-secret podName:52890875-2219-4d5e-ae66-1b004a5c2cca nodeName:}" failed. No retries permitted until 2026-06-09 11:55:06.685548047 +0000 UTC m=+3.108105815 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/52890875-2219-4d5e-ae66-1b004a5c2cca-original-pull-secret") pod "global-pull-secret-syncer-6hkq6" (UID: "52890875-2219-4d5e-ae66-1b004a5c2cca") : object "kube-system"/"original-pull-secret" not registered Jun 09 11:55:06.186643 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.185378 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d76adfc-1b62-407e-9ce4-7300f09659c8-host-run-ovn-kubernetes\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.186643 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.185639 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66015df4-1b51-400c-9870-d6de42d63c58-sys\") pod \"tuned-qblqb\" (UID: \"66015df4-1b51-400c-9870-d6de42d63c58\") " pod="openshift-cluster-node-tuning-operator/tuned-qblqb" Jun 09 11:55:06.186643 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.185650 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ab0c9312-14d5-40ed-9840-b89f7637bf85-host\") pod \"node-ca-vhxvf\" (UID: \"ab0c9312-14d5-40ed-9840-b89f7637bf85\") " pod="openshift-image-registry/node-ca-vhxvf" Jun 09 11:55:06.186643 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.185685 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ab0c9312-14d5-40ed-9840-b89f7637bf85-host\") pod \"node-ca-vhxvf\" (UID: \"ab0c9312-14d5-40ed-9840-b89f7637bf85\") " pod="openshift-image-registry/node-ca-vhxvf" Jun 09 11:55:06.186643 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.185689 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7d76adfc-1b62-407e-9ce4-7300f09659c8-log-socket\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.186643 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.185680 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/95714450-2586-44d2-8146-bdbff71f4555-socket-dir\") pod \"aws-ebs-csi-driver-node-7hz22\" (UID: \"95714450-2586-44d2-8146-bdbff71f4555\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hz22" Jun 09 11:55:06.186643 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.185714 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/66015df4-1b51-400c-9870-d6de42d63c58-etc-kubernetes\") pod \"tuned-qblqb\" (UID: \"66015df4-1b51-400c-9870-d6de42d63c58\") " pod="openshift-cluster-node-tuning-operator/tuned-qblqb" Jun 09 11:55:06.186643 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.185745 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66015df4-1b51-400c-9870-d6de42d63c58-tmp\") pod \"tuned-qblqb\" (UID: \"66015df4-1b51-400c-9870-d6de42d63c58\") " pod="openshift-cluster-node-tuning-operator/tuned-qblqb" Jun 09 11:55:06.186643 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.185750 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7d76adfc-1b62-407e-9ce4-7300f09659c8-log-socket\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.186643 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.185764 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/66015df4-1b51-400c-9870-d6de42d63c58-etc-kubernetes\") pod \"tuned-qblqb\" (UID: \"66015df4-1b51-400c-9870-d6de42d63c58\") " pod="openshift-cluster-node-tuning-operator/tuned-qblqb" Jun 09 11:55:06.186643 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.185773 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7d76adfc-1b62-407e-9ce4-7300f09659c8-run-ovn\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.186643 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.185817 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7d76adfc-1b62-407e-9ce4-7300f09659c8-run-ovn\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.186643 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.185831 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f08417f2-9d8d-49a9-9853-cd362983ffec-multus-daemon-config\") pod \"multus-97p2n\" (UID: \"f08417f2-9d8d-49a9-9853-cd362983ffec\") " pod="openshift-multus/multus-97p2n" Jun 09 11:55:06.186643 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.185852 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7d76adfc-1b62-407e-9ce4-7300f09659c8-node-log\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.186643 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.185878 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/66015df4-1b51-400c-9870-d6de42d63c58-etc-sysctl-conf\") pod \"tuned-qblqb\" (UID: \"66015df4-1b51-400c-9870-d6de42d63c58\") " pod="openshift-cluster-node-tuning-operator/tuned-qblqb" Jun 09 11:55:06.186643 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.185887 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7d76adfc-1b62-407e-9ce4-7300f09659c8-node-log\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.187461 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.185902 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/66015df4-1b51-400c-9870-d6de42d63c58-lib-modules\") pod \"tuned-qblqb\" (UID: \"66015df4-1b51-400c-9870-d6de42d63c58\") " pod="openshift-cluster-node-tuning-operator/tuned-qblqb" Jun 09 11:55:06.187461 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.185924 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/66015df4-1b51-400c-9870-d6de42d63c58-host\") pod \"tuned-qblqb\" (UID: \"66015df4-1b51-400c-9870-d6de42d63c58\") " pod="openshift-cluster-node-tuning-operator/tuned-qblqb" Jun 09 11:55:06.187461 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.185962 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrl6n\" (UniqueName: \"kubernetes.io/projected/f08417f2-9d8d-49a9-9853-cd362983ffec-kube-api-access-hrl6n\") pod \"multus-97p2n\" (UID: \"f08417f2-9d8d-49a9-9853-cd362983ffec\") " pod="openshift-multus/multus-97p2n" Jun 09 11:55:06.187461 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.185985 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/66015df4-1b51-400c-9870-d6de42d63c58-etc-sysconfig\") pod \"tuned-qblqb\" (UID: \"66015df4-1b51-400c-9870-d6de42d63c58\") " pod="openshift-cluster-node-tuning-operator/tuned-qblqb" Jun 09 11:55:06.187461 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.186017 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/66015df4-1b51-400c-9870-d6de42d63c58-etc-sysctl-conf\") pod \"tuned-qblqb\" (UID: \"66015df4-1b51-400c-9870-d6de42d63c58\") " pod="openshift-cluster-node-tuning-operator/tuned-qblqb" Jun 09 11:55:06.187461 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.186018 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/66015df4-1b51-400c-9870-d6de42d63c58-host\") pod \"tuned-qblqb\" (UID: \"66015df4-1b51-400c-9870-d6de42d63c58\") " pod="openshift-cluster-node-tuning-operator/tuned-qblqb" Jun 09 11:55:06.187461 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.186022 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/66015df4-1b51-400c-9870-d6de42d63c58-etc-systemd\") pod \"tuned-qblqb\" (UID: \"66015df4-1b51-400c-9870-d6de42d63c58\") " pod="openshift-cluster-node-tuning-operator/tuned-qblqb" Jun 09 11:55:06.187461 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.186062 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/95714450-2586-44d2-8146-bdbff71f4555-etc-selinux\") pod \"aws-ebs-csi-driver-node-7hz22\" (UID: \"95714450-2586-44d2-8146-bdbff71f4555\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hz22" Jun 09 11:55:06.187461 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.186079 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/66015df4-1b51-400c-9870-d6de42d63c58-lib-modules\") pod \"tuned-qblqb\" (UID: \"66015df4-1b51-400c-9870-d6de42d63c58\") " pod="openshift-cluster-node-tuning-operator/tuned-qblqb" Jun 09 11:55:06.187461 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.186090 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f08417f2-9d8d-49a9-9853-cd362983ffec-host-run-multus-certs\") pod \"multus-97p2n\" (UID: \"f08417f2-9d8d-49a9-9853-cd362983ffec\") " pod="openshift-multus/multus-97p2n" Jun 09 11:55:06.187461 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.186118 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7d76adfc-1b62-407e-9ce4-7300f09659c8-host-run-netns\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.187461 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.186132 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/66015df4-1b51-400c-9870-d6de42d63c58-etc-sysconfig\") pod \"tuned-qblqb\" (UID: \"66015df4-1b51-400c-9870-d6de42d63c58\") " pod="openshift-cluster-node-tuning-operator/tuned-qblqb" Jun 09 11:55:06.187461 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.186141 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7d76adfc-1b62-407e-9ce4-7300f09659c8-run-openvswitch\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.187461 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.186168 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/95714450-2586-44d2-8146-bdbff71f4555-etc-selinux\") pod \"aws-ebs-csi-driver-node-7hz22\" (UID: \"95714450-2586-44d2-8146-bdbff71f4555\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hz22" Jun 09 11:55:06.187461 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.186085 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/66015df4-1b51-400c-9870-d6de42d63c58-etc-systemd\") pod \"tuned-qblqb\" (UID: \"66015df4-1b51-400c-9870-d6de42d63c58\") " pod="openshift-cluster-node-tuning-operator/tuned-qblqb" Jun 09 11:55:06.187461 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.186189 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7d76adfc-1b62-407e-9ce4-7300f09659c8-ovnkube-config\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.187461 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.186191 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f08417f2-9d8d-49a9-9853-cd362983ffec-host-run-multus-certs\") pod \"multus-97p2n\" (UID: \"f08417f2-9d8d-49a9-9853-cd362983ffec\") " pod="openshift-multus/multus-97p2n" Jun 09 11:55:06.187461 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.186218 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7d76adfc-1b62-407e-9ce4-7300f09659c8-run-openvswitch\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.188379 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.186264 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7d76adfc-1b62-407e-9ce4-7300f09659c8-host-run-netns\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.188379 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.186307 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/95714450-2586-44d2-8146-bdbff71f4555-registration-dir\") pod \"aws-ebs-csi-driver-node-7hz22\" (UID: \"95714450-2586-44d2-8146-bdbff71f4555\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hz22" Jun 09 11:55:06.188379 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.186333 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f08417f2-9d8d-49a9-9853-cd362983ffec-os-release\") pod \"multus-97p2n\" (UID: \"f08417f2-9d8d-49a9-9853-cd362983ffec\") " pod="openshift-multus/multus-97p2n" Jun 09 11:55:06.188379 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.186361 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7d76adfc-1b62-407e-9ce4-7300f09659c8-var-lib-openvswitch\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.188379 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.186394 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/95714450-2586-44d2-8146-bdbff71f4555-registration-dir\") pod \"aws-ebs-csi-driver-node-7hz22\" (UID: \"95714450-2586-44d2-8146-bdbff71f4555\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hz22" Jun 09 11:55:06.188379 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.186405 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7d76adfc-1b62-407e-9ce4-7300f09659c8-var-lib-openvswitch\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.188379 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.186432 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f08417f2-9d8d-49a9-9853-cd362983ffec-os-release\") pod \"multus-97p2n\" (UID: \"f08417f2-9d8d-49a9-9853-cd362983ffec\") " pod="openshift-multus/multus-97p2n" Jun 09 11:55:06.188379 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.186669 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/66015df4-1b51-400c-9870-d6de42d63c58-etc-sysctl-d\") pod \"tuned-qblqb\" (UID: \"66015df4-1b51-400c-9870-d6de42d63c58\") " pod="openshift-cluster-node-tuning-operator/tuned-qblqb" Jun 09 11:55:06.188379 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.186863 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7d76adfc-1b62-407e-9ce4-7300f09659c8-ovnkube-config\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.188379 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.186463 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/66015df4-1b51-400c-9870-d6de42d63c58-etc-sysctl-d\") pod \"tuned-qblqb\" (UID: \"66015df4-1b51-400c-9870-d6de42d63c58\") " pod="openshift-cluster-node-tuning-operator/tuned-qblqb" Jun 09 11:55:06.188379 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.186945 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nj7p\" (UniqueName: \"kubernetes.io/projected/01f9bafd-cb94-4a81-a033-1baef2ace912-kube-api-access-6nj7p\") pod \"node-resolver-z728s\" (UID: \"01f9bafd-cb94-4a81-a033-1baef2ace912\") " pod="openshift-dns/node-resolver-z728s" Jun 09 11:55:06.188379 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.186971 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7d76adfc-1b62-407e-9ce4-7300f09659c8-host-slash\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.188379 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.186995 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f08417f2-9d8d-49a9-9853-cd362983ffec-etc-kubernetes\") pod \"multus-97p2n\" (UID: \"f08417f2-9d8d-49a9-9853-cd362983ffec\") " pod="openshift-multus/multus-97p2n" Jun 09 11:55:06.188379 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.187022 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7d76adfc-1b62-407e-9ce4-7300f09659c8-run-systemd\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.188379 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.187048 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d76adfc-1b62-407e-9ce4-7300f09659c8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.188379 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.187092 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7d76adfc-1b62-407e-9ce4-7300f09659c8-env-overrides\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.188379 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.187116 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7d76adfc-1b62-407e-9ce4-7300f09659c8-ovn-node-metrics-cert\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.189225 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.187148 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7d76adfc-1b62-407e-9ce4-7300f09659c8-host-slash\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.189225 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.187140 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7d76adfc-1b62-407e-9ce4-7300f09659c8-ovnkube-script-lib\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.189225 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.187192 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/66015df4-1b51-400c-9870-d6de42d63c58-var-lib-kubelet\") pod \"tuned-qblqb\" (UID: \"66015df4-1b51-400c-9870-d6de42d63c58\") " pod="openshift-cluster-node-tuning-operator/tuned-qblqb" Jun 09 11:55:06.189225 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.187220 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/52890875-2219-4d5e-ae66-1b004a5c2cca-kubelet-config\") pod \"global-pull-secret-syncer-6hkq6\" (UID: \"52890875-2219-4d5e-ae66-1b004a5c2cca\") " pod="kube-system/global-pull-secret-syncer-6hkq6" Jun 09 11:55:06.189225 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.187223 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7d76adfc-1b62-407e-9ce4-7300f09659c8-run-systemd\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.189225 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.187243 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7d76adfc-1b62-407e-9ce4-7300f09659c8-systemd-units\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.189225 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.187267 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/95714450-2586-44d2-8146-bdbff71f4555-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7hz22\" (UID: \"95714450-2586-44d2-8146-bdbff71f4555\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hz22" Jun 09 11:55:06.189225 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.187269 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d76adfc-1b62-407e-9ce4-7300f09659c8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.189225 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.187292 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpqjp\" (UniqueName: \"kubernetes.io/projected/95714450-2586-44d2-8146-bdbff71f4555-kube-api-access-bpqjp\") pod \"aws-ebs-csi-driver-node-7hz22\" (UID: \"95714450-2586-44d2-8146-bdbff71f4555\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hz22" Jun 09 11:55:06.189225 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.187316 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ab0c9312-14d5-40ed-9840-b89f7637bf85-serviceca\") pod \"node-ca-vhxvf\" (UID: \"ab0c9312-14d5-40ed-9840-b89f7637bf85\") " pod="openshift-image-registry/node-ca-vhxvf" Jun 09 11:55:06.189225 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.187324 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/66015df4-1b51-400c-9870-d6de42d63c58-var-lib-kubelet\") pod \"tuned-qblqb\" (UID: \"66015df4-1b51-400c-9870-d6de42d63c58\") " pod="openshift-cluster-node-tuning-operator/tuned-qblqb" Jun 09 11:55:06.189225 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.187338 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f08417f2-9d8d-49a9-9853-cd362983ffec-multus-conf-dir\") pod \"multus-97p2n\" (UID: \"f08417f2-9d8d-49a9-9853-cd362983ffec\") " pod="openshift-multus/multus-97p2n" Jun 09 11:55:06.189225 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.187374 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7d76adfc-1b62-407e-9ce4-7300f09659c8-host-cni-bin\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.189225 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.187400 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7d76adfc-1b62-407e-9ce4-7300f09659c8-host-cni-netd\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.189225 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.187423 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01f9bafd-cb94-4a81-a033-1baef2ace912-tmp-dir\") pod \"node-resolver-z728s\" (UID: \"01f9bafd-cb94-4a81-a033-1baef2ace912\") " pod="openshift-dns/node-resolver-z728s" Jun 09 11:55:06.189225 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.187446 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dldwp\" (UniqueName: \"kubernetes.io/projected/ab0c9312-14d5-40ed-9840-b89f7637bf85-kube-api-access-dldwp\") pod \"node-ca-vhxvf\" (UID: \"ab0c9312-14d5-40ed-9840-b89f7637bf85\") " pod="openshift-image-registry/node-ca-vhxvf" Jun 09 11:55:06.189225 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.187468 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f08417f2-9d8d-49a9-9853-cd362983ffec-cni-binary-copy\") pod \"multus-97p2n\" (UID: \"f08417f2-9d8d-49a9-9853-cd362983ffec\") " pod="openshift-multus/multus-97p2n" Jun 09 11:55:06.190085 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.187497 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f08417f2-9d8d-49a9-9853-cd362983ffec-multus-socket-dir-parent\") pod \"multus-97p2n\" (UID: \"f08417f2-9d8d-49a9-9853-cd362983ffec\") " pod="openshift-multus/multus-97p2n" Jun 09 11:55:06.190085 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.187513 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7d76adfc-1b62-407e-9ce4-7300f09659c8-env-overrides\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.190085 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.187520 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f08417f2-9d8d-49a9-9853-cd362983ffec-host-run-k8s-cni-cncf-io\") pod \"multus-97p2n\" (UID: \"f08417f2-9d8d-49a9-9853-cd362983ffec\") " pod="openshift-multus/multus-97p2n" Jun 09 11:55:06.190085 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.187564 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d76adfc-1b62-407e-9ce4-7300f09659c8-host-kubelet\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.190085 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.187569 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f08417f2-9d8d-49a9-9853-cd362983ffec-host-run-k8s-cni-cncf-io\") pod \"multus-97p2n\" (UID: \"f08417f2-9d8d-49a9-9853-cd362983ffec\") " pod="openshift-multus/multus-97p2n" Jun 09 11:55:06.190085 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.187592 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/66015df4-1b51-400c-9870-d6de42d63c58-etc-modprobe-d\") pod \"tuned-qblqb\" (UID: \"66015df4-1b51-400c-9870-d6de42d63c58\") " pod="openshift-cluster-node-tuning-operator/tuned-qblqb" Jun 09 11:55:06.190085 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.187635 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/66015df4-1b51-400c-9870-d6de42d63c58-run\") pod \"tuned-qblqb\" (UID: \"66015df4-1b51-400c-9870-d6de42d63c58\") " pod="openshift-cluster-node-tuning-operator/tuned-qblqb" Jun 09 11:55:06.190085 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.187640 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/52890875-2219-4d5e-ae66-1b004a5c2cca-kubelet-config\") pod \"global-pull-secret-syncer-6hkq6\" (UID: \"52890875-2219-4d5e-ae66-1b004a5c2cca\") " pod="kube-system/global-pull-secret-syncer-6hkq6" Jun 09 11:55:06.190085 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.187668 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/01f9bafd-cb94-4a81-a033-1baef2ace912-hosts-file\") pod \"node-resolver-z728s\" (UID: \"01f9bafd-cb94-4a81-a033-1baef2ace912\") " pod="openshift-dns/node-resolver-z728s" Jun 09 11:55:06.190085 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.187688 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7d76adfc-1b62-407e-9ce4-7300f09659c8-systemd-units\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.190085 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.187768 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7d76adfc-1b62-407e-9ce4-7300f09659c8-host-cni-netd\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.190085 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.187785 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7d76adfc-1b62-407e-9ce4-7300f09659c8-host-cni-bin\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.190085 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.187834 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d76adfc-1b62-407e-9ce4-7300f09659c8-host-kubelet\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.190085 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.187889 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/95714450-2586-44d2-8146-bdbff71f4555-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7hz22\" (UID: \"95714450-2586-44d2-8146-bdbff71f4555\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hz22" Jun 09 11:55:06.190085 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.187115 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f08417f2-9d8d-49a9-9853-cd362983ffec-etc-kubernetes\") pod \"multus-97p2n\" (UID: \"f08417f2-9d8d-49a9-9853-cd362983ffec\") " pod="openshift-multus/multus-97p2n" Jun 09 11:55:06.190085 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.188042 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/66015df4-1b51-400c-9870-d6de42d63c58-etc-modprobe-d\") pod \"tuned-qblqb\" (UID: \"66015df4-1b51-400c-9870-d6de42d63c58\") " pod="openshift-cluster-node-tuning-operator/tuned-qblqb" Jun 09 11:55:06.190085 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.188078 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f08417f2-9d8d-49a9-9853-cd362983ffec-multus-conf-dir\") pod \"multus-97p2n\" (UID: \"f08417f2-9d8d-49a9-9853-cd362983ffec\") " pod="openshift-multus/multus-97p2n" Jun 09 11:55:06.190085 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.188215 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/66015df4-1b51-400c-9870-d6de42d63c58-run\") pod \"tuned-qblqb\" (UID: \"66015df4-1b51-400c-9870-d6de42d63c58\") " pod="openshift-cluster-node-tuning-operator/tuned-qblqb" Jun 09 11:55:06.190927 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.188284 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66015df4-1b51-400c-9870-d6de42d63c58-tmp\") pod \"tuned-qblqb\" (UID: \"66015df4-1b51-400c-9870-d6de42d63c58\") " pod="openshift-cluster-node-tuning-operator/tuned-qblqb" Jun 09 11:55:06.190927 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.188314 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/01f9bafd-cb94-4a81-a033-1baef2ace912-hosts-file\") pod \"node-resolver-z728s\" (UID: \"01f9bafd-cb94-4a81-a033-1baef2ace912\") " pod="openshift-dns/node-resolver-z728s" Jun 09 11:55:06.190927 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.188366 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f08417f2-9d8d-49a9-9853-cd362983ffec-multus-socket-dir-parent\") pod \"multus-97p2n\" (UID: \"f08417f2-9d8d-49a9-9853-cd362983ffec\") " pod="openshift-multus/multus-97p2n" Jun 09 11:55:06.190927 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.188474 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ab0c9312-14d5-40ed-9840-b89f7637bf85-serviceca\") pod \"node-ca-vhxvf\" (UID: \"ab0c9312-14d5-40ed-9840-b89f7637bf85\") " pod="openshift-image-registry/node-ca-vhxvf" Jun 09 11:55:06.190927 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.188917 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01f9bafd-cb94-4a81-a033-1baef2ace912-tmp-dir\") pod \"node-resolver-z728s\" (UID: \"01f9bafd-cb94-4a81-a033-1baef2ace912\") " pod="openshift-dns/node-resolver-z728s" Jun 09 11:55:06.190927 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.189720 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/66015df4-1b51-400c-9870-d6de42d63c58-etc-tuned\") pod \"tuned-qblqb\" (UID: \"66015df4-1b51-400c-9870-d6de42d63c58\") " pod="openshift-cluster-node-tuning-operator/tuned-qblqb" Jun 09 11:55:06.190927 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.189774 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7d76adfc-1b62-407e-9ce4-7300f09659c8-ovnkube-script-lib\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.190927 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.189841 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f08417f2-9d8d-49a9-9853-cd362983ffec-cni-binary-copy\") pod \"multus-97p2n\" (UID: \"f08417f2-9d8d-49a9-9853-cd362983ffec\") " pod="openshift-multus/multus-97p2n" Jun 09 11:55:06.190927 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.190004 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7d76adfc-1b62-407e-9ce4-7300f09659c8-ovn-node-metrics-cert\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.207243 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.207185 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tl7wv\" (UniqueName: \"kubernetes.io/projected/66015df4-1b51-400c-9870-d6de42d63c58-kube-api-access-tl7wv\") pod \"tuned-qblqb\" (UID: \"66015df4-1b51-400c-9870-d6de42d63c58\") " pod="openshift-cluster-node-tuning-operator/tuned-qblqb" Jun 09 11:55:06.208622 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.208591 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkgqw\" (UniqueName: \"kubernetes.io/projected/7d76adfc-1b62-407e-9ce4-7300f09659c8-kube-api-access-qkgqw\") pod \"ovnkube-node-g4ssk\" (UID: \"7d76adfc-1b62-407e-9ce4-7300f09659c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.212497 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.212473 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dldwp\" (UniqueName: \"kubernetes.io/projected/ab0c9312-14d5-40ed-9840-b89f7637bf85-kube-api-access-dldwp\") pod \"node-ca-vhxvf\" (UID: \"ab0c9312-14d5-40ed-9840-b89f7637bf85\") " pod="openshift-image-registry/node-ca-vhxvf" Jun 09 11:55:06.214760 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.214736 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nj7p\" (UniqueName: \"kubernetes.io/projected/01f9bafd-cb94-4a81-a033-1baef2ace912-kube-api-access-6nj7p\") pod \"node-resolver-z728s\" (UID: \"01f9bafd-cb94-4a81-a033-1baef2ace912\") " pod="openshift-dns/node-resolver-z728s" Jun 09 11:55:06.216154 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.216124 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpqjp\" (UniqueName: \"kubernetes.io/projected/95714450-2586-44d2-8146-bdbff71f4555-kube-api-access-bpqjp\") pod \"aws-ebs-csi-driver-node-7hz22\" (UID: \"95714450-2586-44d2-8146-bdbff71f4555\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hz22" Jun 09 11:55:06.216773 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.216753 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrl6n\" (UniqueName: \"kubernetes.io/projected/f08417f2-9d8d-49a9-9853-cd362983ffec-kube-api-access-hrl6n\") pod \"multus-97p2n\" (UID: \"f08417f2-9d8d-49a9-9853-cd362983ffec\") " pod="openshift-multus/multus-97p2n" Jun 09 11:55:06.274947 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.274911 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nkhzs" Jun 09 11:55:06.283547 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.283525 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pfqql" Jun 09 11:55:06.294428 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.294406 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ktt4d" Jun 09 11:55:06.299070 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.299048 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:06.305229 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.305209 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qblqb" Jun 09 11:55:06.312953 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.312930 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hz22" Jun 09 11:55:06.319509 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.319468 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z728s" Jun 09 11:55:06.325989 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.325972 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vhxvf" Jun 09 11:55:06.330552 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.330535 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-97p2n" Jun 09 11:55:06.414036 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.414002 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 11:55:06.591014 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.590931 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e14c077a-6021-4bf9-a3e7-ae5ca648b191-metrics-certs\") pod \"network-metrics-daemon-cvhwb\" (UID: \"e14c077a-6021-4bf9-a3e7-ae5ca648b191\") " pod="openshift-multus/network-metrics-daemon-cvhwb" Jun 09 11:55:06.591167 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:06.591096 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:55:06.591235 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:06.591176 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e14c077a-6021-4bf9-a3e7-ae5ca648b191-metrics-certs podName:e14c077a-6021-4bf9-a3e7-ae5ca648b191 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:07.591155031 +0000 UTC m=+4.013712807 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e14c077a-6021-4bf9-a3e7-ae5ca648b191-metrics-certs") pod "network-metrics-daemon-cvhwb" (UID: "e14c077a-6021-4bf9-a3e7-ae5ca648b191") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:55:06.692247 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.692213 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b82bs\" (UniqueName: \"kubernetes.io/projected/190991b2-0a7b-4f95-a21d-ed8ed4d549c1-kube-api-access-b82bs\") pod \"network-check-target-ncsh5\" (UID: \"190991b2-0a7b-4f95-a21d-ed8ed4d549c1\") " pod="openshift-network-diagnostics/network-check-target-ncsh5" Jun 09 11:55:06.692418 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:06.692265 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52890875-2219-4d5e-ae66-1b004a5c2cca-original-pull-secret\") pod \"global-pull-secret-syncer-6hkq6\" (UID: \"52890875-2219-4d5e-ae66-1b004a5c2cca\") " pod="kube-system/global-pull-secret-syncer-6hkq6" Jun 09 11:55:06.692418 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:06.692396 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 11:55:06.692536 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:06.692418 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 11:55:06.692536 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:06.692444 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 11:55:06.692536 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:06.692458 2577 projected.go:196] Error preparing data for projected volume kube-api-access-b82bs for pod openshift-network-diagnostics/network-check-target-ncsh5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:55:06.692536 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:06.692469 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52890875-2219-4d5e-ae66-1b004a5c2cca-original-pull-secret podName:52890875-2219-4d5e-ae66-1b004a5c2cca nodeName:}" failed. No retries permitted until 2026-06-09 11:55:07.692445644 +0000 UTC m=+4.115003419 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/52890875-2219-4d5e-ae66-1b004a5c2cca-original-pull-secret") pod "global-pull-secret-syncer-6hkq6" (UID: "52890875-2219-4d5e-ae66-1b004a5c2cca") : object "kube-system"/"original-pull-secret" not registered Jun 09 11:55:06.692536 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:06.692510 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/190991b2-0a7b-4f95-a21d-ed8ed4d549c1-kube-api-access-b82bs podName:190991b2-0a7b-4f95-a21d-ed8ed4d549c1 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:07.692494875 +0000 UTC m=+4.115052644 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-b82bs" (UniqueName: "kubernetes.io/projected/190991b2-0a7b-4f95-a21d-ed8ed4d549c1-kube-api-access-b82bs") pod "network-check-target-ncsh5" (UID: "190991b2-0a7b-4f95-a21d-ed8ed4d549c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:55:06.819283 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:06.819239 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf08417f2_9d8d_49a9_9853_cd362983ffec.slice/crio-5894a1be7ed9dc8e7e4181d30a54dc4e8e1044d60d222b63d3bcc170ac2d6757 WatchSource:0}: Error finding container 5894a1be7ed9dc8e7e4181d30a54dc4e8e1044d60d222b63d3bcc170ac2d6757: Status 404 returned error can't find the container with id 5894a1be7ed9dc8e7e4181d30a54dc4e8e1044d60d222b63d3bcc170ac2d6757 Jun 09 11:55:06.822142 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:06.822112 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b9182f2_a873_43c6_87d6_f43e10065979.slice/crio-db58a90d4583e914546b9ac5321a8c26816e49340c6484023f7e1f5d2e36ed83 WatchSource:0}: Error finding container db58a90d4583e914546b9ac5321a8c26816e49340c6484023f7e1f5d2e36ed83: Status 404 returned error can't find the container with id db58a90d4583e914546b9ac5321a8c26816e49340c6484023f7e1f5d2e36ed83 Jun 09 11:55:06.824663 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:06.824640 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66015df4_1b51_400c_9870_d6de42d63c58.slice/crio-33e25dc7c6042889475464586469f611fb4f8e02b60c3f638087307314724508 WatchSource:0}: Error finding container 33e25dc7c6042889475464586469f611fb4f8e02b60c3f638087307314724508: Status 404 returned error can't find the container with id 33e25dc7c6042889475464586469f611fb4f8e02b60c3f638087307314724508 Jun 09 11:55:06.826249 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:06.826216 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01f9bafd_cb94_4a81_a033_1baef2ace912.slice/crio-3ab8912bd97625c55f47d00b270c70e571f43ce32518339e0e00e10f8f7d647a WatchSource:0}: Error finding container 3ab8912bd97625c55f47d00b270c70e571f43ce32518339e0e00e10f8f7d647a: Status 404 returned error can't find the container with id 3ab8912bd97625c55f47d00b270c70e571f43ce32518339e0e00e10f8f7d647a Jun 09 11:55:06.827318 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:06.827286 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95714450_2586_44d2_8146_bdbff71f4555.slice/crio-af5dde804773deb1f27cc63b658226842da53492a5d2a84c0265cbb6910c69a7 WatchSource:0}: Error finding container af5dde804773deb1f27cc63b658226842da53492a5d2a84c0265cbb6910c69a7: Status 404 returned error can't find the container with id af5dde804773deb1f27cc63b658226842da53492a5d2a84c0265cbb6910c69a7 Jun 09 11:55:06.848929 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:06.848899 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95e2cd86_14d8_4689_8d09_80d623678fab.slice/crio-ccd8060a036e1b07d4a81196fa0b23c71c2349bc1298c4f18e1b3c80da0f20b4 WatchSource:0}: Error finding container ccd8060a036e1b07d4a81196fa0b23c71c2349bc1298c4f18e1b3c80da0f20b4: Status 404 returned error can't find the container with id ccd8060a036e1b07d4a81196fa0b23c71c2349bc1298c4f18e1b3c80da0f20b4 Jun 09 11:55:06.850407 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:06.850315 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d76adfc_1b62_407e_9ce4_7300f09659c8.slice/crio-78162e8a42ea6f8e42d36f8f4f98ba44328ca388a4da051f26139b2239a661e5 WatchSource:0}: Error finding container 78162e8a42ea6f8e42d36f8f4f98ba44328ca388a4da051f26139b2239a661e5: Status 404 returned error can't find the container with id 78162e8a42ea6f8e42d36f8f4f98ba44328ca388a4da051f26139b2239a661e5 Jun 09 11:55:06.851327 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:06.851301 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab0c9312_14d5_40ed_9840_b89f7637bf85.slice/crio-26ba7b2108c73f3807fd5dc6eef27358590f44a5c03c195af4c999d763881b18 WatchSource:0}: Error finding container 26ba7b2108c73f3807fd5dc6eef27358590f44a5c03c195af4c999d763881b18: Status 404 returned error can't find the container with id 26ba7b2108c73f3807fd5dc6eef27358590f44a5c03c195af4c999d763881b18 Jun 09 11:55:06.852057 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:06.852039 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ef53ac3_35c1_47b3_902e_c34733bf2aa7.slice/crio-266d6668b7910b533d2ea522e11eebee147ab7e4cfeb1d003a5696e5a142726d WatchSource:0}: Error finding container 266d6668b7910b533d2ea522e11eebee147ab7e4cfeb1d003a5696e5a142726d: Status 404 returned error can't find the container with id 266d6668b7910b533d2ea522e11eebee147ab7e4cfeb1d003a5696e5a142726d Jun 09 11:55:07.047263 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:07.047230 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hz22" event={"ID":"95714450-2586-44d2-8146-bdbff71f4555","Type":"ContainerStarted","Data":"af5dde804773deb1f27cc63b658226842da53492a5d2a84c0265cbb6910c69a7"} Jun 09 11:55:07.048376 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:07.048353 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z728s" event={"ID":"01f9bafd-cb94-4a81-a033-1baef2ace912","Type":"ContainerStarted","Data":"3ab8912bd97625c55f47d00b270c70e571f43ce32518339e0e00e10f8f7d647a"} Jun 09 11:55:07.049346 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:07.049324 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qblqb" event={"ID":"66015df4-1b51-400c-9870-d6de42d63c58","Type":"ContainerStarted","Data":"33e25dc7c6042889475464586469f611fb4f8e02b60c3f638087307314724508"} Jun 09 11:55:07.050468 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:07.050445 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ktt4d" event={"ID":"6b9182f2-a873-43c6-87d6-f43e10065979","Type":"ContainerStarted","Data":"db58a90d4583e914546b9ac5321a8c26816e49340c6484023f7e1f5d2e36ed83"} Jun 09 11:55:07.051472 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:07.051450 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-97p2n" event={"ID":"f08417f2-9d8d-49a9-9853-cd362983ffec","Type":"ContainerStarted","Data":"5894a1be7ed9dc8e7e4181d30a54dc4e8e1044d60d222b63d3bcc170ac2d6757"} Jun 09 11:55:07.055461 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:07.053975 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" event={"ID":"7d76adfc-1b62-407e-9ce4-7300f09659c8","Type":"ContainerStarted","Data":"78162e8a42ea6f8e42d36f8f4f98ba44328ca388a4da051f26139b2239a661e5"} Jun 09 11:55:07.056258 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:07.056224 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pfqql" event={"ID":"95e2cd86-14d8-4689-8d09-80d623678fab","Type":"ContainerStarted","Data":"ccd8060a036e1b07d4a81196fa0b23c71c2349bc1298c4f18e1b3c80da0f20b4"} Jun 09 11:55:07.058247 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:07.058220 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-80.ec2.internal" event={"ID":"246a63a2537303c010a4ab50419f2e46","Type":"ContainerStarted","Data":"4e22b9879e60dfeb87857fd40e4e91774322b909db5a23359b516aedae4fbf68"} Jun 09 11:55:07.059452 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:07.059433 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nkhzs" event={"ID":"3ef53ac3-35c1-47b3-902e-c34733bf2aa7","Type":"ContainerStarted","Data":"266d6668b7910b533d2ea522e11eebee147ab7e4cfeb1d003a5696e5a142726d"} Jun 09 11:55:07.060476 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:07.060456 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vhxvf" event={"ID":"ab0c9312-14d5-40ed-9840-b89f7637bf85","Type":"ContainerStarted","Data":"26ba7b2108c73f3807fd5dc6eef27358590f44a5c03c195af4c999d763881b18"} Jun 09 11:55:07.073053 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:07.073006 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 11:50:06 +0000 UTC" deadline="2028-03-20 09:37:25.860899496 +0000 UTC" Jun 09 11:55:07.073053 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:07.073052 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15597h42m18.787851348s" Jun 09 11:55:07.074062 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:07.074025 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-80.ec2.internal" podStartSLOduration=2.074010091 podStartE2EDuration="2.074010091s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:55:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:55:07.07344415 +0000 UTC m=+3.496001954" watchObservedRunningTime="2026-06-09 11:55:07.074010091 +0000 UTC m=+3.496567866" Jun 09 11:55:07.599387 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:07.599349 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e14c077a-6021-4bf9-a3e7-ae5ca648b191-metrics-certs\") pod \"network-metrics-daemon-cvhwb\" (UID: \"e14c077a-6021-4bf9-a3e7-ae5ca648b191\") " pod="openshift-multus/network-metrics-daemon-cvhwb" Jun 09 11:55:07.599594 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:07.599538 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:55:07.599731 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:07.599692 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e14c077a-6021-4bf9-a3e7-ae5ca648b191-metrics-certs podName:e14c077a-6021-4bf9-a3e7-ae5ca648b191 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:09.599584026 +0000 UTC m=+6.022141779 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e14c077a-6021-4bf9-a3e7-ae5ca648b191-metrics-certs") pod "network-metrics-daemon-cvhwb" (UID: "e14c077a-6021-4bf9-a3e7-ae5ca648b191") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:55:07.700517 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:07.700478 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b82bs\" (UniqueName: \"kubernetes.io/projected/190991b2-0a7b-4f95-a21d-ed8ed4d549c1-kube-api-access-b82bs\") pod \"network-check-target-ncsh5\" (UID: \"190991b2-0a7b-4f95-a21d-ed8ed4d549c1\") " pod="openshift-network-diagnostics/network-check-target-ncsh5" Jun 09 11:55:07.700711 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:07.700541 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52890875-2219-4d5e-ae66-1b004a5c2cca-original-pull-secret\") pod \"global-pull-secret-syncer-6hkq6\" (UID: \"52890875-2219-4d5e-ae66-1b004a5c2cca\") " pod="kube-system/global-pull-secret-syncer-6hkq6" Jun 09 11:55:07.700711 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:07.700695 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 11:55:07.700837 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:07.700761 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52890875-2219-4d5e-ae66-1b004a5c2cca-original-pull-secret podName:52890875-2219-4d5e-ae66-1b004a5c2cca nodeName:}" failed. No retries permitted until 2026-06-09 11:55:09.700741286 +0000 UTC m=+6.123299043 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/52890875-2219-4d5e-ae66-1b004a5c2cca-original-pull-secret") pod "global-pull-secret-syncer-6hkq6" (UID: "52890875-2219-4d5e-ae66-1b004a5c2cca") : object "kube-system"/"original-pull-secret" not registered Jun 09 11:55:07.701175 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:07.701155 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 11:55:07.701264 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:07.701183 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 11:55:07.701264 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:07.701196 2577 projected.go:196] Error preparing data for projected volume kube-api-access-b82bs for pod openshift-network-diagnostics/network-check-target-ncsh5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:55:07.701264 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:07.701244 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/190991b2-0a7b-4f95-a21d-ed8ed4d549c1-kube-api-access-b82bs podName:190991b2-0a7b-4f95-a21d-ed8ed4d549c1 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:09.701228956 +0000 UTC m=+6.123786714 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-b82bs" (UniqueName: "kubernetes.io/projected/190991b2-0a7b-4f95-a21d-ed8ed4d549c1-kube-api-access-b82bs") pod "network-check-target-ncsh5" (UID: "190991b2-0a7b-4f95-a21d-ed8ed4d549c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:55:08.038772 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:08.038738 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hkq6" Jun 09 11:55:08.038938 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:08.038874 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hkq6" podUID="52890875-2219-4d5e-ae66-1b004a5c2cca" Jun 09 11:55:08.039273 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:08.039096 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvhwb" Jun 09 11:55:08.039273 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:08.039229 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvhwb" podUID="e14c077a-6021-4bf9-a3e7-ae5ca648b191" Jun 09 11:55:08.039273 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:08.039258 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncsh5" Jun 09 11:55:08.039460 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:08.039339 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncsh5" podUID="190991b2-0a7b-4f95-a21d-ed8ed4d549c1" Jun 09 11:55:08.074271 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:08.072872 2577 generic.go:356] "Generic (PLEG): container finished" podID="39f6ad5cad04ca187e177396b47c6b2b" containerID="212cd7bb58746a5fbba13964f096f3dbe631451b532003064ea5feacb92dfbce" exitCode=0 Jun 09 11:55:08.074271 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:08.073993 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-80.ec2.internal" event={"ID":"39f6ad5cad04ca187e177396b47c6b2b","Type":"ContainerDied","Data":"212cd7bb58746a5fbba13964f096f3dbe631451b532003064ea5feacb92dfbce"} Jun 09 11:55:08.074271 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:08.074053 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 11:50:06 +0000 UTC" deadline="2027-11-02 14:28:19.112479586 +0000 UTC" Jun 09 11:55:08.074271 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:08.074074 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12266h33m11.038409691s" Jun 09 11:55:09.087064 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:09.087022 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-80.ec2.internal" event={"ID":"39f6ad5cad04ca187e177396b47c6b2b","Type":"ContainerStarted","Data":"5abc143ca3e2f64b7e7b69932bff6289aebb51c8ad0f2a65986f2b3532c2366b"} Jun 09 11:55:09.619433 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:09.619394 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e14c077a-6021-4bf9-a3e7-ae5ca648b191-metrics-certs\") pod \"network-metrics-daemon-cvhwb\" (UID: \"e14c077a-6021-4bf9-a3e7-ae5ca648b191\") " pod="openshift-multus/network-metrics-daemon-cvhwb" Jun 09 11:55:09.619641 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:09.619575 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:55:09.619720 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:09.619656 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e14c077a-6021-4bf9-a3e7-ae5ca648b191-metrics-certs podName:e14c077a-6021-4bf9-a3e7-ae5ca648b191 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:13.619637143 +0000 UTC m=+10.042194901 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e14c077a-6021-4bf9-a3e7-ae5ca648b191-metrics-certs") pod "network-metrics-daemon-cvhwb" (UID: "e14c077a-6021-4bf9-a3e7-ae5ca648b191") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:55:09.720236 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:09.720195 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b82bs\" (UniqueName: \"kubernetes.io/projected/190991b2-0a7b-4f95-a21d-ed8ed4d549c1-kube-api-access-b82bs\") pod \"network-check-target-ncsh5\" (UID: \"190991b2-0a7b-4f95-a21d-ed8ed4d549c1\") " pod="openshift-network-diagnostics/network-check-target-ncsh5" Jun 09 11:55:09.720412 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:09.720256 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52890875-2219-4d5e-ae66-1b004a5c2cca-original-pull-secret\") pod \"global-pull-secret-syncer-6hkq6\" (UID: \"52890875-2219-4d5e-ae66-1b004a5c2cca\") " pod="kube-system/global-pull-secret-syncer-6hkq6" Jun 09 11:55:09.720412 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:09.720380 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 11:55:09.720515 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:09.720441 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52890875-2219-4d5e-ae66-1b004a5c2cca-original-pull-secret podName:52890875-2219-4d5e-ae66-1b004a5c2cca nodeName:}" failed. No retries permitted until 2026-06-09 11:55:13.72042288 +0000 UTC m=+10.142980634 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/52890875-2219-4d5e-ae66-1b004a5c2cca-original-pull-secret") pod "global-pull-secret-syncer-6hkq6" (UID: "52890875-2219-4d5e-ae66-1b004a5c2cca") : object "kube-system"/"original-pull-secret" not registered Jun 09 11:55:09.720893 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:09.720872 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 11:55:09.721000 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:09.720898 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 11:55:09.721000 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:09.720911 2577 projected.go:196] Error preparing data for projected volume kube-api-access-b82bs for pod openshift-network-diagnostics/network-check-target-ncsh5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:55:09.721000 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:09.720960 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/190991b2-0a7b-4f95-a21d-ed8ed4d549c1-kube-api-access-b82bs podName:190991b2-0a7b-4f95-a21d-ed8ed4d549c1 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:13.720944149 +0000 UTC m=+10.143501907 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-b82bs" (UniqueName: "kubernetes.io/projected/190991b2-0a7b-4f95-a21d-ed8ed4d549c1-kube-api-access-b82bs") pod "network-check-target-ncsh5" (UID: "190991b2-0a7b-4f95-a21d-ed8ed4d549c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:55:10.039326 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:10.039292 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hkq6" Jun 09 11:55:10.039326 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:10.039318 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvhwb" Jun 09 11:55:10.039570 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:10.039293 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncsh5" Jun 09 11:55:10.039570 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:10.039423 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hkq6" podUID="52890875-2219-4d5e-ae66-1b004a5c2cca" Jun 09 11:55:10.039570 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:10.039544 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncsh5" podUID="190991b2-0a7b-4f95-a21d-ed8ed4d549c1" Jun 09 11:55:10.039715 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:10.039662 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvhwb" podUID="e14c077a-6021-4bf9-a3e7-ae5ca648b191" Jun 09 11:55:12.039025 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:12.038858 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hkq6" Jun 09 11:55:12.039025 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:12.039015 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hkq6" podUID="52890875-2219-4d5e-ae66-1b004a5c2cca" Jun 09 11:55:12.039567 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:12.039027 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncsh5" Jun 09 11:55:12.039567 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:12.039113 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncsh5" podUID="190991b2-0a7b-4f95-a21d-ed8ed4d549c1" Jun 09 11:55:12.039567 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:12.039119 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvhwb" Jun 09 11:55:12.039567 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:12.039244 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvhwb" podUID="e14c077a-6021-4bf9-a3e7-ae5ca648b191" Jun 09 11:55:13.654727 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:13.654687 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e14c077a-6021-4bf9-a3e7-ae5ca648b191-metrics-certs\") pod \"network-metrics-daemon-cvhwb\" (UID: \"e14c077a-6021-4bf9-a3e7-ae5ca648b191\") " pod="openshift-multus/network-metrics-daemon-cvhwb" Jun 09 11:55:13.655178 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:13.654867 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:55:13.655178 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:13.654952 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e14c077a-6021-4bf9-a3e7-ae5ca648b191-metrics-certs podName:e14c077a-6021-4bf9-a3e7-ae5ca648b191 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:21.654929396 +0000 UTC m=+18.077487228 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e14c077a-6021-4bf9-a3e7-ae5ca648b191-metrics-certs") pod "network-metrics-daemon-cvhwb" (UID: "e14c077a-6021-4bf9-a3e7-ae5ca648b191") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:55:13.755100 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:13.755062 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52890875-2219-4d5e-ae66-1b004a5c2cca-original-pull-secret\") pod \"global-pull-secret-syncer-6hkq6\" (UID: \"52890875-2219-4d5e-ae66-1b004a5c2cca\") " pod="kube-system/global-pull-secret-syncer-6hkq6" Jun 09 11:55:13.755256 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:13.755155 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b82bs\" (UniqueName: \"kubernetes.io/projected/190991b2-0a7b-4f95-a21d-ed8ed4d549c1-kube-api-access-b82bs\") pod \"network-check-target-ncsh5\" (UID: \"190991b2-0a7b-4f95-a21d-ed8ed4d549c1\") " pod="openshift-network-diagnostics/network-check-target-ncsh5" Jun 09 11:55:13.755338 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:13.755295 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 11:55:13.755338 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:13.755313 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 11:55:13.755338 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:13.755326 2577 projected.go:196] Error preparing data for projected volume kube-api-access-b82bs for pod openshift-network-diagnostics/network-check-target-ncsh5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:55:13.755473 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:13.755385 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/190991b2-0a7b-4f95-a21d-ed8ed4d549c1-kube-api-access-b82bs podName:190991b2-0a7b-4f95-a21d-ed8ed4d549c1 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:21.755365711 +0000 UTC m=+18.177923473 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-b82bs" (UniqueName: "kubernetes.io/projected/190991b2-0a7b-4f95-a21d-ed8ed4d549c1-kube-api-access-b82bs") pod "network-check-target-ncsh5" (UID: "190991b2-0a7b-4f95-a21d-ed8ed4d549c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:55:13.755757 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:13.755738 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 11:55:13.755858 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:13.755825 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52890875-2219-4d5e-ae66-1b004a5c2cca-original-pull-secret podName:52890875-2219-4d5e-ae66-1b004a5c2cca nodeName:}" failed. No retries permitted until 2026-06-09 11:55:21.755784394 +0000 UTC m=+18.178342147 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/52890875-2219-4d5e-ae66-1b004a5c2cca-original-pull-secret") pod "global-pull-secret-syncer-6hkq6" (UID: "52890875-2219-4d5e-ae66-1b004a5c2cca") : object "kube-system"/"original-pull-secret" not registered Jun 09 11:55:14.039348 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:14.039263 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hkq6" Jun 09 11:55:14.039520 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:14.039391 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hkq6" podUID="52890875-2219-4d5e-ae66-1b004a5c2cca" Jun 09 11:55:14.039838 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:14.039813 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncsh5" Jun 09 11:55:14.039951 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:14.039925 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncsh5" podUID="190991b2-0a7b-4f95-a21d-ed8ed4d549c1" Jun 09 11:55:14.040041 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:14.040015 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvhwb" Jun 09 11:55:14.040164 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:14.040123 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvhwb" podUID="e14c077a-6021-4bf9-a3e7-ae5ca648b191" Jun 09 11:55:16.038390 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:16.038055 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hkq6" Jun 09 11:55:16.038390 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:16.038069 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncsh5" Jun 09 11:55:16.038390 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:16.038182 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hkq6" podUID="52890875-2219-4d5e-ae66-1b004a5c2cca" Jun 09 11:55:16.038390 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:16.038232 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncsh5" podUID="190991b2-0a7b-4f95-a21d-ed8ed4d549c1" Jun 09 11:55:16.038390 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:16.038334 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvhwb" Jun 09 11:55:16.039045 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:16.038412 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvhwb" podUID="e14c077a-6021-4bf9-a3e7-ae5ca648b191" Jun 09 11:55:18.038993 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:18.038959 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncsh5" Jun 09 11:55:18.039415 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:18.038999 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvhwb" Jun 09 11:55:18.039415 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:18.038959 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hkq6" Jun 09 11:55:18.039415 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:18.039087 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncsh5" podUID="190991b2-0a7b-4f95-a21d-ed8ed4d549c1" Jun 09 11:55:18.039415 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:18.039162 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hkq6" podUID="52890875-2219-4d5e-ae66-1b004a5c2cca" Jun 09 11:55:18.039415 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:18.039256 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvhwb" podUID="e14c077a-6021-4bf9-a3e7-ae5ca648b191" Jun 09 11:55:20.038976 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:20.038893 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncsh5" Jun 09 11:55:20.038976 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:20.038916 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hkq6" Jun 09 11:55:20.039373 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:20.039016 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvhwb" Jun 09 11:55:20.039373 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:20.039034 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncsh5" podUID="190991b2-0a7b-4f95-a21d-ed8ed4d549c1" Jun 09 11:55:20.039373 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:20.039122 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvhwb" podUID="e14c077a-6021-4bf9-a3e7-ae5ca648b191" Jun 09 11:55:20.039373 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:20.039198 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hkq6" podUID="52890875-2219-4d5e-ae66-1b004a5c2cca" Jun 09 11:55:21.716834 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:21.716744 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e14c077a-6021-4bf9-a3e7-ae5ca648b191-metrics-certs\") pod \"network-metrics-daemon-cvhwb\" (UID: \"e14c077a-6021-4bf9-a3e7-ae5ca648b191\") " pod="openshift-multus/network-metrics-daemon-cvhwb" Jun 09 11:55:21.717253 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:21.716926 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:55:21.717253 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:21.717002 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e14c077a-6021-4bf9-a3e7-ae5ca648b191-metrics-certs podName:e14c077a-6021-4bf9-a3e7-ae5ca648b191 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:37.716984347 +0000 UTC m=+34.139542101 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e14c077a-6021-4bf9-a3e7-ae5ca648b191-metrics-certs") pod "network-metrics-daemon-cvhwb" (UID: "e14c077a-6021-4bf9-a3e7-ae5ca648b191") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:55:21.818009 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:21.817967 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b82bs\" (UniqueName: \"kubernetes.io/projected/190991b2-0a7b-4f95-a21d-ed8ed4d549c1-kube-api-access-b82bs\") pod \"network-check-target-ncsh5\" (UID: \"190991b2-0a7b-4f95-a21d-ed8ed4d549c1\") " pod="openshift-network-diagnostics/network-check-target-ncsh5" Jun 09 11:55:21.818189 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:21.818032 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52890875-2219-4d5e-ae66-1b004a5c2cca-original-pull-secret\") pod \"global-pull-secret-syncer-6hkq6\" (UID: \"52890875-2219-4d5e-ae66-1b004a5c2cca\") " pod="kube-system/global-pull-secret-syncer-6hkq6" Jun 09 11:55:21.818189 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:21.818105 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 11:55:21.818189 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:21.818118 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 11:55:21.818189 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:21.818127 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 11:55:21.818189 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:21.818140 2577 projected.go:196] Error preparing data for projected volume kube-api-access-b82bs for pod openshift-network-diagnostics/network-check-target-ncsh5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:55:21.818189 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:21.818176 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52890875-2219-4d5e-ae66-1b004a5c2cca-original-pull-secret podName:52890875-2219-4d5e-ae66-1b004a5c2cca nodeName:}" failed. No retries permitted until 2026-06-09 11:55:37.818158247 +0000 UTC m=+34.240716019 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/52890875-2219-4d5e-ae66-1b004a5c2cca-original-pull-secret") pod "global-pull-secret-syncer-6hkq6" (UID: "52890875-2219-4d5e-ae66-1b004a5c2cca") : object "kube-system"/"original-pull-secret" not registered Jun 09 11:55:21.818189 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:21.818191 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/190991b2-0a7b-4f95-a21d-ed8ed4d549c1-kube-api-access-b82bs podName:190991b2-0a7b-4f95-a21d-ed8ed4d549c1 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:37.81818476 +0000 UTC m=+34.240742513 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-b82bs" (UniqueName: "kubernetes.io/projected/190991b2-0a7b-4f95-a21d-ed8ed4d549c1-kube-api-access-b82bs") pod "network-check-target-ncsh5" (UID: "190991b2-0a7b-4f95-a21d-ed8ed4d549c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:55:22.038284 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:22.038197 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncsh5" Jun 09 11:55:22.038434 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:22.038197 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hkq6" Jun 09 11:55:22.038434 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:22.038334 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncsh5" podUID="190991b2-0a7b-4f95-a21d-ed8ed4d549c1" Jun 09 11:55:22.038434 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:22.038343 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvhwb" Jun 09 11:55:22.038577 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:22.038446 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hkq6" podUID="52890875-2219-4d5e-ae66-1b004a5c2cca" Jun 09 11:55:22.038577 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:22.038544 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvhwb" podUID="e14c077a-6021-4bf9-a3e7-ae5ca648b191" Jun 09 11:55:24.039623 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:24.039588 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hkq6" Jun 09 11:55:24.040057 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:24.039726 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncsh5" Jun 09 11:55:24.040057 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:24.039755 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvhwb" Jun 09 11:55:24.040057 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:24.039832 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncsh5" podUID="190991b2-0a7b-4f95-a21d-ed8ed4d549c1" Jun 09 11:55:24.040057 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:24.039712 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hkq6" podUID="52890875-2219-4d5e-ae66-1b004a5c2cca" Jun 09 11:55:24.040057 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:24.039914 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvhwb" podUID="e14c077a-6021-4bf9-a3e7-ae5ca648b191" Jun 09 11:55:26.038474 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:26.038202 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hkq6" Jun 09 11:55:26.039187 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:26.038205 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncsh5" Jun 09 11:55:26.039187 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:26.038577 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hkq6" podUID="52890875-2219-4d5e-ae66-1b004a5c2cca" Jun 09 11:55:26.039187 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:26.038270 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvhwb" Jun 09 11:55:26.039187 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:26.038632 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncsh5" podUID="190991b2-0a7b-4f95-a21d-ed8ed4d549c1" Jun 09 11:55:26.039187 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:26.038744 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvhwb" podUID="e14c077a-6021-4bf9-a3e7-ae5ca648b191" Jun 09 11:55:26.129035 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:26.128946 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" event={"ID":"7d76adfc-1b62-407e-9ce4-7300f09659c8","Type":"ContainerStarted","Data":"5542245a122e4019402da2e57fce363383839084f52137eda6563d52f4e9beba"} Jun 09 11:55:26.129130 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:26.129063 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" event={"ID":"7d76adfc-1b62-407e-9ce4-7300f09659c8","Type":"ContainerStarted","Data":"a2a48dcda555403773196d3d2e4e081d695753f5fcd2441258e4c553304f296e"} Jun 09 11:55:26.129130 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:26.129115 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" event={"ID":"7d76adfc-1b62-407e-9ce4-7300f09659c8","Type":"ContainerStarted","Data":"d413776772aa2ced1ec87adc6ab7c538bbeda4f98a3f649b5e90c4b880fdb520"} Jun 09 11:55:26.129241 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:26.129159 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" event={"ID":"7d76adfc-1b62-407e-9ce4-7300f09659c8","Type":"ContainerStarted","Data":"cf8b95572ca87ef5cd2bdfd4b8857666437758da1608f971d98b826c1322ab7b"} Jun 09 11:55:26.130702 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:26.130678 2577 generic.go:356] "Generic (PLEG): container finished" podID="95e2cd86-14d8-4689-8d09-80d623678fab" containerID="23aec71d711132485cd3c648c240224021549306e9c1b8c228276cb406c31f6e" exitCode=0 Jun 09 11:55:26.130781 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:26.130752 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pfqql" event={"ID":"95e2cd86-14d8-4689-8d09-80d623678fab","Type":"ContainerDied","Data":"23aec71d711132485cd3c648c240224021549306e9c1b8c228276cb406c31f6e"} Jun 09 11:55:26.132402 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:26.132373 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nkhzs" event={"ID":"3ef53ac3-35c1-47b3-902e-c34733bf2aa7","Type":"ContainerStarted","Data":"162ca85965932f246c1d2f6d79a55124e822c1d1a4ee340fd7e97c706f7b5f2b"} Jun 09 11:55:26.133765 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:26.133740 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vhxvf" event={"ID":"ab0c9312-14d5-40ed-9840-b89f7637bf85","Type":"ContainerStarted","Data":"7ac72d9d1810298d3e8f2efdc6fc687db5b1320be6f332a82d0d314cdaaaa323"} Jun 09 11:55:26.135337 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:26.135315 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hz22" event={"ID":"95714450-2586-44d2-8146-bdbff71f4555","Type":"ContainerStarted","Data":"c9d68b427278e1380487b7d987ad31e1662ed27fbe34902fd16359e65f553ec9"} Jun 09 11:55:26.136770 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:26.136748 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z728s" event={"ID":"01f9bafd-cb94-4a81-a033-1baef2ace912","Type":"ContainerStarted","Data":"4c83b5960d86bd1bf9f80f92ca87650fdfb67cfdb4bb01117031fd8a32bfef34"} Jun 09 11:55:26.138247 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:26.138224 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qblqb" event={"ID":"66015df4-1b51-400c-9870-d6de42d63c58","Type":"ContainerStarted","Data":"57a7ad0aee4759254931c45966d9cd9b3a7f9f31e21ba4dc6af1b8a336d758b6"} Jun 09 11:55:26.139971 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:26.139924 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-97p2n" event={"ID":"f08417f2-9d8d-49a9-9853-cd362983ffec","Type":"ContainerStarted","Data":"86d120f2136eb4ef4f796ab660c6e8ff6e802f2d623e4fdff44682d2920c9b10"} Jun 09 11:55:26.159954 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:26.159904 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-80.ec2.internal" podStartSLOduration=21.159886559 podStartE2EDuration="21.159886559s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:55:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:55:09.126386398 +0000 UTC m=+5.548944175" watchObservedRunningTime="2026-06-09 11:55:26.159886559 +0000 UTC m=+22.582444336" Jun 09 11:55:26.178175 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:26.178130 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nkhzs" podStartSLOduration=7.645091658 podStartE2EDuration="22.17811139s" totalImagesPullingTime="14.533019732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:55:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:55:26.177718275 +0000 UTC m=+22.600276051" watchObservedRunningTime="2026-06-09 11:55:26.17811139 +0000 UTC m=+22.600669165" Jun 09 11:55:26.202312 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:26.202273 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qblqb" podStartSLOduration=3.4359890650000002 podStartE2EDuration="22.202257966s" totalImagesPullingTime="18.766268901s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:55:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:55:26.201488043 +0000 UTC m=+22.624045819" watchObservedRunningTime="2026-06-09 11:55:26.202257966 +0000 UTC m=+22.624815741" Jun 09 11:55:26.222838 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:26.222795 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-z728s" podStartSLOduration=3.50563848 podStartE2EDuration="22.222777258s" totalImagesPullingTime="18.717138778s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:55:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:55:26.221704682 +0000 UTC m=+22.644262476" watchObservedRunningTime="2026-06-09 11:55:26.222777258 +0000 UTC m=+22.645335034" Jun 09 11:55:26.243660 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:26.243600 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vhxvf" podStartSLOduration=3.534371937 podStartE2EDuration="22.243585085s" totalImagesPullingTime="18.709213148s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:55:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:55:26.241910936 +0000 UTC m=+22.664468724" watchObservedRunningTime="2026-06-09 11:55:26.243585085 +0000 UTC m=+22.666142860" Jun 09 11:55:27.071400 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:27.071372 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 09 11:55:27.096033 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:27.096007 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nkhzs" Jun 09 11:55:27.096629 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:27.096595 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nkhzs" Jun 09 11:55:27.113255 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:27.113203 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-97p2n" podStartSLOduration=4.306160694 podStartE2EDuration="23.113183463s" totalImagesPullingTime="18.807022769s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:55:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:55:26.267975502 +0000 UTC m=+22.690533278" watchObservedRunningTime="2026-06-09 11:55:27.113183463 +0000 UTC m=+23.535741219" Jun 09 11:55:27.144011 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:27.143927 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ktt4d" event={"ID":"6b9182f2-a873-43c6-87d6-f43e10065979","Type":"ContainerStarted","Data":"b150e1700f80698ebc63255ede0da17b35ac20114993aceab92d44b06ed2f83b"} Jun 09 11:55:27.147684 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:27.147648 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" event={"ID":"7d76adfc-1b62-407e-9ce4-7300f09659c8","Type":"ContainerStarted","Data":"e95dea9fb291b5d1c4245e55b38e2f4d77eb310787080f1d03ee64f890b1205d"} Jun 09 11:55:27.147823 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:27.147752 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" event={"ID":"7d76adfc-1b62-407e-9ce4-7300f09659c8","Type":"ContainerStarted","Data":"c4693d48f1f86e4a798efc36a8afd3ed95c95a0860e7ee65e72703602aa40523"} Jun 09 11:55:27.149721 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:27.149699 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hz22" event={"ID":"95714450-2586-44d2-8146-bdbff71f4555","Type":"ContainerStarted","Data":"ed95b0640ed579a96843e279fe29d4a71af68f37623aeccc211940b4c9868180"} Jun 09 11:55:27.150223 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:27.149850 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nkhzs" Jun 09 11:55:27.150380 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:27.150359 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nkhzs" Jun 09 11:55:27.162428 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:27.162380 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ktt4d" podStartSLOduration=4.422475186 podStartE2EDuration="23.16236091s" totalImagesPullingTime="18.739885724s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:55:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:55:27.161795316 +0000 UTC m=+23.584353093" watchObservedRunningTime="2026-06-09 11:55:27.16236091 +0000 UTC m=+23.584918691" Jun 09 11:55:28.038922 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:28.038877 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvhwb" Jun 09 11:55:28.039264 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:28.038877 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hkq6" Jun 09 11:55:28.039264 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:28.039037 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncsh5" Jun 09 11:55:28.039264 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:28.039029 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvhwb" podUID="e14c077a-6021-4bf9-a3e7-ae5ca648b191" Jun 09 11:55:28.039264 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:28.039163 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hkq6" podUID="52890875-2219-4d5e-ae66-1b004a5c2cca" Jun 09 11:55:28.039431 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:28.039280 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncsh5" podUID="190991b2-0a7b-4f95-a21d-ed8ed4d549c1" Jun 09 11:55:28.042529 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:28.042451 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T11:55:27.071393628Z","UUID":"03c1eb93-947d-4fe7-9450-8eaff980d838","Handler":null,"Name":"","Endpoint":""} Jun 09 11:55:28.043984 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:28.043966 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 09 11:55:28.044094 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:28.043999 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 09 11:55:29.158505 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:29.158321 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" event={"ID":"7d76adfc-1b62-407e-9ce4-7300f09659c8","Type":"ContainerStarted","Data":"2b532b5cebf6772f552d30dd93e0bb146fdc75b0a62df75da1a8b2384da31cec"} Jun 09 11:55:29.160503 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:29.160473 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hz22" event={"ID":"95714450-2586-44d2-8146-bdbff71f4555","Type":"ContainerStarted","Data":"d212c5da04db8b2be6e4d6181c61c770f4d331017be48f27d4fd3b1d0399b403"} Jun 09 11:55:29.192107 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:29.192048 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hz22" podStartSLOduration=4.229995609 podStartE2EDuration="25.192030869s" totalImagesPullingTime="20.96203526s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:55:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:55:29.191796914 +0000 UTC m=+25.614354690" watchObservedRunningTime="2026-06-09 11:55:29.192030869 +0000 UTC m=+25.614588644" Jun 09 11:55:30.038158 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:30.038120 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncsh5" Jun 09 11:55:30.038158 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:30.038153 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hkq6" Jun 09 11:55:30.038358 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:30.038121 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvhwb" Jun 09 11:55:30.038358 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:30.038233 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncsh5" podUID="190991b2-0a7b-4f95-a21d-ed8ed4d549c1" Jun 09 11:55:30.038358 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:30.038323 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvhwb" podUID="e14c077a-6021-4bf9-a3e7-ae5ca648b191" Jun 09 11:55:30.038460 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:30.038390 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hkq6" podUID="52890875-2219-4d5e-ae66-1b004a5c2cca" Jun 09 11:55:31.168083 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:31.167892 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" event={"ID":"7d76adfc-1b62-407e-9ce4-7300f09659c8","Type":"ContainerStarted","Data":"6b55ff785c256fa3b30a4e03189485b1682abf0e3348261f7c54275da3f5b580"} Jun 09 11:55:31.168984 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:31.168174 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:31.168984 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:31.168225 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:31.170279 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:31.170242 2577 generic.go:356] "Generic (PLEG): container finished" podID="95e2cd86-14d8-4689-8d09-80d623678fab" containerID="d0be7ebb20f2eb0c91aecb1ac588e376b4964b7341b81c70120b3002640c0352" exitCode=0 Jun 09 11:55:31.170422 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:31.170284 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pfqql" event={"ID":"95e2cd86-14d8-4689-8d09-80d623678fab","Type":"ContainerDied","Data":"d0be7ebb20f2eb0c91aecb1ac588e376b4964b7341b81c70120b3002640c0352"} Jun 09 11:55:31.184138 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:31.184115 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:31.184322 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:31.184302 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:31.199821 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:31.199783 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" podStartSLOduration=8.422482268 podStartE2EDuration="27.199769862s" totalImagesPullingTime="18.777287594s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:55:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:55:31.19849668 +0000 UTC m=+27.621054455" watchObservedRunningTime="2026-06-09 11:55:31.199769862 +0000 UTC m=+27.622327637" Jun 09 11:55:32.039025 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:32.038995 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hkq6" Jun 09 11:55:32.039260 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:32.039054 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvhwb" Jun 09 11:55:32.039260 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:32.039158 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hkq6" podUID="52890875-2219-4d5e-ae66-1b004a5c2cca" Jun 09 11:55:32.039260 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:32.039183 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncsh5" Jun 09 11:55:32.039386 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:32.039271 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvhwb" podUID="e14c077a-6021-4bf9-a3e7-ae5ca648b191" Jun 09 11:55:32.039386 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:32.039333 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncsh5" podUID="190991b2-0a7b-4f95-a21d-ed8ed4d549c1" Jun 09 11:55:32.172894 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:32.172871 2577 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 09 11:55:32.503274 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:32.503080 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6hkq6"] Jun 09 11:55:32.503451 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:32.503406 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hkq6" Jun 09 11:55:32.503554 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:32.503532 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hkq6" podUID="52890875-2219-4d5e-ae66-1b004a5c2cca" Jun 09 11:55:32.503807 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:32.503784 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ncsh5"] Jun 09 11:55:32.503904 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:32.503892 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncsh5" Jun 09 11:55:32.503975 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:32.503959 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncsh5" podUID="190991b2-0a7b-4f95-a21d-ed8ed4d549c1" Jun 09 11:55:32.505503 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:32.505485 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cvhwb"] Jun 09 11:55:32.505598 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:32.505589 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvhwb" Jun 09 11:55:32.505721 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:32.505704 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvhwb" podUID="e14c077a-6021-4bf9-a3e7-ae5ca648b191" Jun 09 11:55:33.177031 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:33.176997 2577 generic.go:356] "Generic (PLEG): container finished" podID="95e2cd86-14d8-4689-8d09-80d623678fab" containerID="a8eb5bfa894c9d2a786b8bd1f5cb8f435923ba0895f7e2bb7aabab19f2e57ba0" exitCode=0 Jun 09 11:55:33.177600 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:33.177076 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pfqql" event={"ID":"95e2cd86-14d8-4689-8d09-80d623678fab","Type":"ContainerDied","Data":"a8eb5bfa894c9d2a786b8bd1f5cb8f435923ba0895f7e2bb7aabab19f2e57ba0"} Jun 09 11:55:33.177600 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:33.177142 2577 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 09 11:55:34.038913 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:34.038884 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hkq6" Jun 09 11:55:34.039126 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:34.038920 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvhwb" Jun 09 11:55:34.039126 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:34.038978 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncsh5" Jun 09 11:55:34.039126 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:34.039009 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hkq6" podUID="52890875-2219-4d5e-ae66-1b004a5c2cca" Jun 09 11:55:34.039126 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:34.039044 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncsh5" podUID="190991b2-0a7b-4f95-a21d-ed8ed4d549c1" Jun 09 11:55:34.039317 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:34.039128 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvhwb" podUID="e14c077a-6021-4bf9-a3e7-ae5ca648b191" Jun 09 11:55:35.184261 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:35.184215 2577 generic.go:356] "Generic (PLEG): container finished" podID="95e2cd86-14d8-4689-8d09-80d623678fab" containerID="ed391b35b321a13198f42dba576a22293d980e196d42710c7a75061e2b13cbe8" exitCode=0 Jun 09 11:55:35.184768 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:35.184293 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pfqql" event={"ID":"95e2cd86-14d8-4689-8d09-80d623678fab","Type":"ContainerDied","Data":"ed391b35b321a13198f42dba576a22293d980e196d42710c7a75061e2b13cbe8"} Jun 09 11:55:36.038690 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:36.038607 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvhwb" Jun 09 11:55:36.038890 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:36.038629 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hkq6" Jun 09 11:55:36.038890 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:36.038775 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncsh5" Jun 09 11:55:36.038890 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:36.038768 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvhwb" podUID="e14c077a-6021-4bf9-a3e7-ae5ca648b191" Jun 09 11:55:36.039040 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:36.038906 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hkq6" podUID="52890875-2219-4d5e-ae66-1b004a5c2cca" Jun 09 11:55:36.039040 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:36.038995 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncsh5" podUID="190991b2-0a7b-4f95-a21d-ed8ed4d549c1" Jun 09 11:55:36.257497 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:36.257458 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:55:36.258088 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:36.257722 2577 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 09 11:55:36.275168 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:36.275129 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" podUID="7d76adfc-1b62-407e-9ce4-7300f09659c8" containerName="ovnkube-controller" probeResult="failure" output="" Jun 09 11:55:36.284625 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:36.284578 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" podUID="7d76adfc-1b62-407e-9ce4-7300f09659c8" containerName="ovnkube-controller" probeResult="failure" output="" Jun 09 11:55:37.732904 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:37.732875 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e14c077a-6021-4bf9-a3e7-ae5ca648b191-metrics-certs\") pod \"network-metrics-daemon-cvhwb\" (UID: \"e14c077a-6021-4bf9-a3e7-ae5ca648b191\") " pod="openshift-multus/network-metrics-daemon-cvhwb" Jun 09 11:55:37.733325 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:37.733041 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:55:37.733325 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:37.733114 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e14c077a-6021-4bf9-a3e7-ae5ca648b191-metrics-certs podName:e14c077a-6021-4bf9-a3e7-ae5ca648b191 nodeName:}" failed. No retries permitted until 2026-06-09 11:56:09.733096733 +0000 UTC m=+66.155654487 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e14c077a-6021-4bf9-a3e7-ae5ca648b191-metrics-certs") pod "network-metrics-daemon-cvhwb" (UID: "e14c077a-6021-4bf9-a3e7-ae5ca648b191") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:55:37.834176 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:37.834137 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b82bs\" (UniqueName: \"kubernetes.io/projected/190991b2-0a7b-4f95-a21d-ed8ed4d549c1-kube-api-access-b82bs\") pod \"network-check-target-ncsh5\" (UID: \"190991b2-0a7b-4f95-a21d-ed8ed4d549c1\") " pod="openshift-network-diagnostics/network-check-target-ncsh5" Jun 09 11:55:37.834367 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:37.834196 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52890875-2219-4d5e-ae66-1b004a5c2cca-original-pull-secret\") pod \"global-pull-secret-syncer-6hkq6\" (UID: \"52890875-2219-4d5e-ae66-1b004a5c2cca\") " pod="kube-system/global-pull-secret-syncer-6hkq6" Jun 09 11:55:37.834367 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:37.834323 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 11:55:37.834367 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:37.834330 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 11:55:37.834367 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:37.834355 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 11:55:37.834367 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:37.834368 2577 projected.go:196] Error preparing data for projected volume kube-api-access-b82bs for pod openshift-network-diagnostics/network-check-target-ncsh5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:55:37.834570 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:37.834394 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52890875-2219-4d5e-ae66-1b004a5c2cca-original-pull-secret podName:52890875-2219-4d5e-ae66-1b004a5c2cca nodeName:}" failed. No retries permitted until 2026-06-09 11:56:09.834373914 +0000 UTC m=+66.256931685 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/52890875-2219-4d5e-ae66-1b004a5c2cca-original-pull-secret") pod "global-pull-secret-syncer-6hkq6" (UID: "52890875-2219-4d5e-ae66-1b004a5c2cca") : object "kube-system"/"original-pull-secret" not registered Jun 09 11:55:37.834570 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:37.834428 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/190991b2-0a7b-4f95-a21d-ed8ed4d549c1-kube-api-access-b82bs podName:190991b2-0a7b-4f95-a21d-ed8ed4d549c1 nodeName:}" failed. No retries permitted until 2026-06-09 11:56:09.834410784 +0000 UTC m=+66.256968540 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-b82bs" (UniqueName: "kubernetes.io/projected/190991b2-0a7b-4f95-a21d-ed8ed4d549c1-kube-api-access-b82bs") pod "network-check-target-ncsh5" (UID: "190991b2-0a7b-4f95-a21d-ed8ed4d549c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:55:38.038936 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:38.038858 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hkq6" Jun 09 11:55:38.038936 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:38.038891 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvhwb" Jun 09 11:55:38.039174 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:38.038858 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncsh5" Jun 09 11:55:38.039174 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:38.039000 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hkq6" podUID="52890875-2219-4d5e-ae66-1b004a5c2cca" Jun 09 11:55:38.039174 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:38.039078 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ncsh5" podUID="190991b2-0a7b-4f95-a21d-ed8ed4d549c1" Jun 09 11:55:38.039174 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:38.039142 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvhwb" podUID="e14c077a-6021-4bf9-a3e7-ae5ca648b191" Jun 09 11:55:38.387462 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:38.387435 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-80.ec2.internal" event="NodeReady" Jun 09 11:55:38.387648 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:38.387589 2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 09 11:55:38.430007 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:38.429976 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pdlth"] Jun 09 11:55:38.432849 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:38.432827 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pdlth" Jun 09 11:55:38.432994 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:38.432968 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6l8jt"] Jun 09 11:55:38.436366 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:38.435420 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 09 11:55:38.436366 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:38.435434 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 09 11:55:38.437144 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:38.437120 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xs666\"" Jun 09 11:55:38.438191 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:38.438171 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6l8jt" Jun 09 11:55:38.440402 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:38.440250 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 09 11:55:38.440402 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:38.440314 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 09 11:55:38.440573 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:38.440503 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 09 11:55:38.440649 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:38.440635 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-tpmhc\"" Jun 09 11:55:38.445035 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:38.444809 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pdlth"] Jun 09 11:55:38.446953 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:38.446900 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6l8jt"] Jun 09 11:55:38.538747 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:38.538712 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/44157499-35a9-4824-a79c-daa659f4b622-cert\") pod \"ingress-canary-6l8jt\" (UID: \"44157499-35a9-4824-a79c-daa659f4b622\") " pod="openshift-ingress-canary/ingress-canary-6l8jt" Jun 09 11:55:38.538908 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:38.538778 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/447b1c43-1b2e-442c-b9ba-13e5b175df87-metrics-tls\") pod \"dns-default-pdlth\" (UID: \"447b1c43-1b2e-442c-b9ba-13e5b175df87\") " pod="openshift-dns/dns-default-pdlth" Jun 09 11:55:38.538908 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:38.538805 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f994l\" (UniqueName: \"kubernetes.io/projected/447b1c43-1b2e-442c-b9ba-13e5b175df87-kube-api-access-f994l\") pod \"dns-default-pdlth\" (UID: \"447b1c43-1b2e-442c-b9ba-13e5b175df87\") " pod="openshift-dns/dns-default-pdlth" Jun 09 11:55:38.538908 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:38.538869 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/447b1c43-1b2e-442c-b9ba-13e5b175df87-config-volume\") pod \"dns-default-pdlth\" (UID: \"447b1c43-1b2e-442c-b9ba-13e5b175df87\") " pod="openshift-dns/dns-default-pdlth" Jun 09 11:55:38.538908 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:38.538895 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/447b1c43-1b2e-442c-b9ba-13e5b175df87-tmp-dir\") pod \"dns-default-pdlth\" (UID: \"447b1c43-1b2e-442c-b9ba-13e5b175df87\") " pod="openshift-dns/dns-default-pdlth" Jun 09 11:55:38.539084 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:38.538912 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5nqf\" (UniqueName: \"kubernetes.io/projected/44157499-35a9-4824-a79c-daa659f4b622-kube-api-access-g5nqf\") pod \"ingress-canary-6l8jt\" (UID: \"44157499-35a9-4824-a79c-daa659f4b622\") " pod="openshift-ingress-canary/ingress-canary-6l8jt" Jun 09 11:55:38.640093 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:38.640005 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/44157499-35a9-4824-a79c-daa659f4b622-cert\") pod \"ingress-canary-6l8jt\" (UID: \"44157499-35a9-4824-a79c-daa659f4b622\") " pod="openshift-ingress-canary/ingress-canary-6l8jt" Jun 09 11:55:38.640093 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:38.640058 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/447b1c43-1b2e-442c-b9ba-13e5b175df87-metrics-tls\") pod \"dns-default-pdlth\" (UID: \"447b1c43-1b2e-442c-b9ba-13e5b175df87\") " pod="openshift-dns/dns-default-pdlth" Jun 09 11:55:38.640288 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:38.640167 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 11:55:38.640288 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:38.640176 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f994l\" (UniqueName: \"kubernetes.io/projected/447b1c43-1b2e-442c-b9ba-13e5b175df87-kube-api-access-f994l\") pod \"dns-default-pdlth\" (UID: \"447b1c43-1b2e-442c-b9ba-13e5b175df87\") " pod="openshift-dns/dns-default-pdlth" Jun 09 11:55:38.640288 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:38.640227 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/447b1c43-1b2e-442c-b9ba-13e5b175df87-metrics-tls podName:447b1c43-1b2e-442c-b9ba-13e5b175df87 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:39.140208977 +0000 UTC m=+35.562766752 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/447b1c43-1b2e-442c-b9ba-13e5b175df87-metrics-tls") pod "dns-default-pdlth" (UID: "447b1c43-1b2e-442c-b9ba-13e5b175df87") : secret "dns-default-metrics-tls" not found Jun 09 11:55:38.640288 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:38.640277 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/447b1c43-1b2e-442c-b9ba-13e5b175df87-config-volume\") pod \"dns-default-pdlth\" (UID: \"447b1c43-1b2e-442c-b9ba-13e5b175df87\") " pod="openshift-dns/dns-default-pdlth" Jun 09 11:55:38.640466 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:38.640316 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/447b1c43-1b2e-442c-b9ba-13e5b175df87-tmp-dir\") pod \"dns-default-pdlth\" (UID: \"447b1c43-1b2e-442c-b9ba-13e5b175df87\") " pod="openshift-dns/dns-default-pdlth" Jun 09 11:55:38.640466 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:38.640343 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5nqf\" (UniqueName: \"kubernetes.io/projected/44157499-35a9-4824-a79c-daa659f4b622-kube-api-access-g5nqf\") pod \"ingress-canary-6l8jt\" (UID: \"44157499-35a9-4824-a79c-daa659f4b622\") " pod="openshift-ingress-canary/ingress-canary-6l8jt" Jun 09 11:55:38.640748 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:38.640715 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/447b1c43-1b2e-442c-b9ba-13e5b175df87-tmp-dir\") pod \"dns-default-pdlth\" (UID: \"447b1c43-1b2e-442c-b9ba-13e5b175df87\") " pod="openshift-dns/dns-default-pdlth" Jun 09 11:55:38.640868 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:38.640811 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/447b1c43-1b2e-442c-b9ba-13e5b175df87-config-volume\") pod \"dns-default-pdlth\" (UID: \"447b1c43-1b2e-442c-b9ba-13e5b175df87\") " pod="openshift-dns/dns-default-pdlth" Jun 09 11:55:38.644598 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:38.644579 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/44157499-35a9-4824-a79c-daa659f4b622-cert\") pod \"ingress-canary-6l8jt\" (UID: \"44157499-35a9-4824-a79c-daa659f4b622\") " pod="openshift-ingress-canary/ingress-canary-6l8jt" Jun 09 11:55:38.650926 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:38.650899 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f994l\" (UniqueName: \"kubernetes.io/projected/447b1c43-1b2e-442c-b9ba-13e5b175df87-kube-api-access-f994l\") pod \"dns-default-pdlth\" (UID: \"447b1c43-1b2e-442c-b9ba-13e5b175df87\") " pod="openshift-dns/dns-default-pdlth" Jun 09 11:55:38.651178 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:38.651156 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5nqf\" (UniqueName: \"kubernetes.io/projected/44157499-35a9-4824-a79c-daa659f4b622-kube-api-access-g5nqf\") pod \"ingress-canary-6l8jt\" (UID: \"44157499-35a9-4824-a79c-daa659f4b622\") " pod="openshift-ingress-canary/ingress-canary-6l8jt" Jun 09 11:55:38.753925 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:38.753891 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6l8jt" Jun 09 11:55:39.144127 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:39.144084 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/447b1c43-1b2e-442c-b9ba-13e5b175df87-metrics-tls\") pod \"dns-default-pdlth\" (UID: \"447b1c43-1b2e-442c-b9ba-13e5b175df87\") " pod="openshift-dns/dns-default-pdlth" Jun 09 11:55:39.144325 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:39.144254 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 11:55:39.144392 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:39.144336 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/447b1c43-1b2e-442c-b9ba-13e5b175df87-metrics-tls podName:447b1c43-1b2e-442c-b9ba-13e5b175df87 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:40.144311209 +0000 UTC m=+36.566868979 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/447b1c43-1b2e-442c-b9ba-13e5b175df87-metrics-tls") pod "dns-default-pdlth" (UID: "447b1c43-1b2e-442c-b9ba-13e5b175df87") : secret "dns-default-metrics-tls" not found Jun 09 11:55:39.329700 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:39.329513 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6l8jt"] Jun 09 11:55:39.332763 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:55:39.332732 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44157499_35a9_4824_a79c_daa659f4b622.slice/crio-1c0caea45d11283e57e0b976405567f55172817b9a3cc85566e65b72e082acbb WatchSource:0}: Error finding container 1c0caea45d11283e57e0b976405567f55172817b9a3cc85566e65b72e082acbb: Status 404 returned error can't find the container with id 1c0caea45d11283e57e0b976405567f55172817b9a3cc85566e65b72e082acbb Jun 09 11:55:40.038932 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:40.038891 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncsh5" Jun 09 11:55:40.039520 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:40.038950 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvhwb" Jun 09 11:55:40.039520 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:40.038899 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hkq6" Jun 09 11:55:40.042231 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:40.042199 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mq88t\"" Jun 09 11:55:40.042373 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:40.042230 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 11:55:40.043017 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:40.042996 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 11:55:40.043111 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:40.043090 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 11:55:40.043243 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:40.043228 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 11:55:40.043336 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:40.043317 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wmll9\"" Jun 09 11:55:40.150192 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:40.150157 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/447b1c43-1b2e-442c-b9ba-13e5b175df87-metrics-tls\") pod \"dns-default-pdlth\" (UID: \"447b1c43-1b2e-442c-b9ba-13e5b175df87\") " pod="openshift-dns/dns-default-pdlth" Jun 09 11:55:40.150368 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:40.150328 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 11:55:40.150433 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:40.150405 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/447b1c43-1b2e-442c-b9ba-13e5b175df87-metrics-tls podName:447b1c43-1b2e-442c-b9ba-13e5b175df87 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:42.1503879 +0000 UTC m=+38.572945656 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/447b1c43-1b2e-442c-b9ba-13e5b175df87-metrics-tls") pod "dns-default-pdlth" (UID: "447b1c43-1b2e-442c-b9ba-13e5b175df87") : secret "dns-default-metrics-tls" not found Jun 09 11:55:40.200660 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:40.200623 2577 generic.go:356] "Generic (PLEG): container finished" podID="95e2cd86-14d8-4689-8d09-80d623678fab" containerID="ef9f6b656a144baa69b746a046154f23f11cdb1ca7bfac76d91c1df88f5b5060" exitCode=0 Jun 09 11:55:40.200660 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:40.200644 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pfqql" event={"ID":"95e2cd86-14d8-4689-8d09-80d623678fab","Type":"ContainerDied","Data":"ef9f6b656a144baa69b746a046154f23f11cdb1ca7bfac76d91c1df88f5b5060"} Jun 09 11:55:40.202151 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:40.202119 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6l8jt" event={"ID":"44157499-35a9-4824-a79c-daa659f4b622","Type":"ContainerStarted","Data":"1c0caea45d11283e57e0b976405567f55172817b9a3cc85566e65b72e082acbb"} Jun 09 11:55:41.207526 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:41.207366 2577 generic.go:356] "Generic (PLEG): container finished" podID="95e2cd86-14d8-4689-8d09-80d623678fab" containerID="224db123afe14e489abf1b556a61c243eee319b79dca9149e71d53c732fd459b" exitCode=0 Jun 09 11:55:41.207951 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:41.207441 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pfqql" event={"ID":"95e2cd86-14d8-4689-8d09-80d623678fab","Type":"ContainerDied","Data":"224db123afe14e489abf1b556a61c243eee319b79dca9149e71d53c732fd459b"} Jun 09 11:55:41.209038 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:41.209020 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6l8jt" event={"ID":"44157499-35a9-4824-a79c-daa659f4b622","Type":"ContainerStarted","Data":"ad246f02376d018a7f09208e6fc673239befddf8292eec29b39ec3899ed5daf8"} Jun 09 11:55:41.246777 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:41.246723 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6l8jt" podStartSLOduration=1.706515645 podStartE2EDuration="3.246703362s" totalImagesPullingTime="1.540187717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:55:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:55:41.245832125 +0000 UTC m=+37.668389926" watchObservedRunningTime="2026-06-09 11:55:41.246703362 +0000 UTC m=+37.669261141" Jun 09 11:55:42.164503 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:42.164471 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/447b1c43-1b2e-442c-b9ba-13e5b175df87-metrics-tls\") pod \"dns-default-pdlth\" (UID: \"447b1c43-1b2e-442c-b9ba-13e5b175df87\") " pod="openshift-dns/dns-default-pdlth" Jun 09 11:55:42.164661 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:42.164641 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 11:55:42.164723 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:42.164713 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/447b1c43-1b2e-442c-b9ba-13e5b175df87-metrics-tls podName:447b1c43-1b2e-442c-b9ba-13e5b175df87 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:46.164693594 +0000 UTC m=+42.587251349 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/447b1c43-1b2e-442c-b9ba-13e5b175df87-metrics-tls") pod "dns-default-pdlth" (UID: "447b1c43-1b2e-442c-b9ba-13e5b175df87") : secret "dns-default-metrics-tls" not found Jun 09 11:55:42.214376 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:42.214333 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pfqql" event={"ID":"95e2cd86-14d8-4689-8d09-80d623678fab","Type":"ContainerStarted","Data":"84294ad55a5b2bacabc105d719192da00059c06e397a78f19943f6457f8726f0"} Jun 09 11:55:42.240059 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:42.240015 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pfqql" podStartSLOduration=9.072597764 podStartE2EDuration="38.239999356s" totalImagesPullingTime="29.167401592s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:55:04 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:55:42.238952175 +0000 UTC m=+38.661509968" watchObservedRunningTime="2026-06-09 11:55:42.239999356 +0000 UTC m=+38.662557130" Jun 09 11:55:46.193563 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:46.193524 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/447b1c43-1b2e-442c-b9ba-13e5b175df87-metrics-tls\") pod \"dns-default-pdlth\" (UID: \"447b1c43-1b2e-442c-b9ba-13e5b175df87\") " pod="openshift-dns/dns-default-pdlth" Jun 09 11:55:46.193940 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:46.193698 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 11:55:46.193940 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:46.193764 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/447b1c43-1b2e-442c-b9ba-13e5b175df87-metrics-tls podName:447b1c43-1b2e-442c-b9ba-13e5b175df87 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:54.193749325 +0000 UTC m=+50.616307078 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/447b1c43-1b2e-442c-b9ba-13e5b175df87-metrics-tls") pod "dns-default-pdlth" (UID: "447b1c43-1b2e-442c-b9ba-13e5b175df87") : secret "dns-default-metrics-tls" not found Jun 09 11:55:54.251085 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:55:54.251047 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/447b1c43-1b2e-442c-b9ba-13e5b175df87-metrics-tls\") pod \"dns-default-pdlth\" (UID: \"447b1c43-1b2e-442c-b9ba-13e5b175df87\") " pod="openshift-dns/dns-default-pdlth" Jun 09 11:55:54.251647 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:54.251210 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 11:55:54.251647 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:55:54.251286 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/447b1c43-1b2e-442c-b9ba-13e5b175df87-metrics-tls podName:447b1c43-1b2e-442c-b9ba-13e5b175df87 nodeName:}" failed. No retries permitted until 2026-06-09 11:56:10.251268793 +0000 UTC m=+66.673826546 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/447b1c43-1b2e-442c-b9ba-13e5b175df87-metrics-tls") pod "dns-default-pdlth" (UID: "447b1c43-1b2e-442c-b9ba-13e5b175df87") : secret "dns-default-metrics-tls" not found Jun 09 11:56:06.284917 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:56:06.284890 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g4ssk" Jun 09 11:56:09.761584 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:56:09.761543 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e14c077a-6021-4bf9-a3e7-ae5ca648b191-metrics-certs\") pod \"network-metrics-daemon-cvhwb\" (UID: \"e14c077a-6021-4bf9-a3e7-ae5ca648b191\") " pod="openshift-multus/network-metrics-daemon-cvhwb" Jun 09 11:56:09.764246 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:56:09.764224 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 11:56:09.772513 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:56:09.772480 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 11:56:09.772668 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:56:09.772578 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e14c077a-6021-4bf9-a3e7-ae5ca648b191-metrics-certs podName:e14c077a-6021-4bf9-a3e7-ae5ca648b191 nodeName:}" failed. No retries permitted until 2026-06-09 11:57:13.772554535 +0000 UTC m=+130.195112292 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e14c077a-6021-4bf9-a3e7-ae5ca648b191-metrics-certs") pod "network-metrics-daemon-cvhwb" (UID: "e14c077a-6021-4bf9-a3e7-ae5ca648b191") : secret "metrics-daemon-secret" not found Jun 09 11:56:09.862197 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:56:09.862157 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b82bs\" (UniqueName: \"kubernetes.io/projected/190991b2-0a7b-4f95-a21d-ed8ed4d549c1-kube-api-access-b82bs\") pod \"network-check-target-ncsh5\" (UID: \"190991b2-0a7b-4f95-a21d-ed8ed4d549c1\") " pod="openshift-network-diagnostics/network-check-target-ncsh5" Jun 09 11:56:09.862375 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:56:09.862207 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52890875-2219-4d5e-ae66-1b004a5c2cca-original-pull-secret\") pod \"global-pull-secret-syncer-6hkq6\" (UID: \"52890875-2219-4d5e-ae66-1b004a5c2cca\") " pod="kube-system/global-pull-secret-syncer-6hkq6" Jun 09 11:56:09.864817 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:56:09.864795 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 11:56:09.864899 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:56:09.864869 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 11:56:09.874775 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:56:09.874756 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 11:56:09.876342 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:56:09.876321 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52890875-2219-4d5e-ae66-1b004a5c2cca-original-pull-secret\") pod \"global-pull-secret-syncer-6hkq6\" (UID: \"52890875-2219-4d5e-ae66-1b004a5c2cca\") " pod="kube-system/global-pull-secret-syncer-6hkq6" Jun 09 11:56:09.885725 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:56:09.885705 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b82bs\" (UniqueName: \"kubernetes.io/projected/190991b2-0a7b-4f95-a21d-ed8ed4d549c1-kube-api-access-b82bs\") pod \"network-check-target-ncsh5\" (UID: \"190991b2-0a7b-4f95-a21d-ed8ed4d549c1\") " pod="openshift-network-diagnostics/network-check-target-ncsh5" Jun 09 11:56:10.055108 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:56:10.055035 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mq88t\"" Jun 09 11:56:10.063458 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:56:10.063434 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ncsh5" Jun 09 11:56:10.066799 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:56:10.066783 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hkq6" Jun 09 11:56:10.225249 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:56:10.222332 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ncsh5"] Jun 09 11:56:10.228212 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:56:10.228182 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod190991b2_0a7b_4f95_a21d_ed8ed4d549c1.slice/crio-91f8a9fb80a91d22dd51dc70f1600a3aa760cfd870ac103b1b795a35a6aaf4b9 WatchSource:0}: Error finding container 91f8a9fb80a91d22dd51dc70f1600a3aa760cfd870ac103b1b795a35a6aaf4b9: Status 404 returned error can't find the container with id 91f8a9fb80a91d22dd51dc70f1600a3aa760cfd870ac103b1b795a35a6aaf4b9 Jun 09 11:56:10.246061 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:56:10.246039 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6hkq6"] Jun 09 11:56:10.248907 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:56:10.248881 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52890875_2219_4d5e_ae66_1b004a5c2cca.slice/crio-99c4e4a2831abc6a24408823a631898eb7c112b9ff6241443d7ca1d4d7d0dea8 WatchSource:0}: Error finding container 99c4e4a2831abc6a24408823a631898eb7c112b9ff6241443d7ca1d4d7d0dea8: Status 404 returned error can't find the container with id 99c4e4a2831abc6a24408823a631898eb7c112b9ff6241443d7ca1d4d7d0dea8 Jun 09 11:56:10.264341 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:56:10.264320 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/447b1c43-1b2e-442c-b9ba-13e5b175df87-metrics-tls\") pod \"dns-default-pdlth\" (UID: \"447b1c43-1b2e-442c-b9ba-13e5b175df87\") " pod="openshift-dns/dns-default-pdlth" Jun 09 11:56:10.264452 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:56:10.264440 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 11:56:10.264507 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:56:10.264498 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/447b1c43-1b2e-442c-b9ba-13e5b175df87-metrics-tls podName:447b1c43-1b2e-442c-b9ba-13e5b175df87 nodeName:}" failed. No retries permitted until 2026-06-09 11:56:42.264483875 +0000 UTC m=+98.687041628 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/447b1c43-1b2e-442c-b9ba-13e5b175df87-metrics-tls") pod "dns-default-pdlth" (UID: "447b1c43-1b2e-442c-b9ba-13e5b175df87") : secret "dns-default-metrics-tls" not found Jun 09 11:56:10.283877 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:56:10.283852 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6hkq6" event={"ID":"52890875-2219-4d5e-ae66-1b004a5c2cca","Type":"ContainerStarted","Data":"99c4e4a2831abc6a24408823a631898eb7c112b9ff6241443d7ca1d4d7d0dea8"} Jun 09 11:56:10.284791 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:56:10.284766 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ncsh5" event={"ID":"190991b2-0a7b-4f95-a21d-ed8ed4d549c1","Type":"ContainerStarted","Data":"91f8a9fb80a91d22dd51dc70f1600a3aa760cfd870ac103b1b795a35a6aaf4b9"} Jun 09 11:56:13.295499 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:56:13.295461 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ncsh5" event={"ID":"190991b2-0a7b-4f95-a21d-ed8ed4d549c1","Type":"ContainerStarted","Data":"e2a477841eac6d61d1a9f81f16d126d7b0e7f0e702d28b40f549138b793a1188"} Jun 09 11:56:13.295915 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:56:13.295675 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ncsh5" Jun 09 11:56:13.312972 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:56:13.312923 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ncsh5" podStartSLOduration=66.416529683 podStartE2EDuration="1m9.312907453s" totalImagesPullingTime="2.89637777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:55:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:56:13.311546559 +0000 UTC m=+69.734104331" watchObservedRunningTime="2026-06-09 11:56:13.312907453 +0000 UTC m=+69.735465239" Jun 09 11:56:15.302495 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:56:15.302456 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6hkq6" event={"ID":"52890875-2219-4d5e-ae66-1b004a5c2cca","Type":"ContainerStarted","Data":"8f743ed366595385feedc7de0203bd6ff213bb8e0a28f738bede1f33b2cf90e8"} Jun 09 11:56:15.317452 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:56:15.317404 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6hkq6" podStartSLOduration=66.769909368 podStartE2EDuration="1m11.31738957s" totalImagesPullingTime="4.547480202s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:55:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:56:15.316743096 +0000 UTC m=+71.739300873" watchObservedRunningTime="2026-06-09 11:56:15.31738957 +0000 UTC m=+71.739947345" Jun 09 11:56:42.283813 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:56:42.283756 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/447b1c43-1b2e-442c-b9ba-13e5b175df87-metrics-tls\") pod \"dns-default-pdlth\" (UID: \"447b1c43-1b2e-442c-b9ba-13e5b175df87\") " pod="openshift-dns/dns-default-pdlth" Jun 09 11:56:42.284240 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:56:42.283927 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 11:56:42.284240 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:56:42.284009 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/447b1c43-1b2e-442c-b9ba-13e5b175df87-metrics-tls podName:447b1c43-1b2e-442c-b9ba-13e5b175df87 nodeName:}" failed. No retries permitted until 2026-06-09 11:57:46.283991133 +0000 UTC m=+162.706548887 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/447b1c43-1b2e-442c-b9ba-13e5b175df87-metrics-tls") pod "dns-default-pdlth" (UID: "447b1c43-1b2e-442c-b9ba-13e5b175df87") : secret "dns-default-metrics-tls" not found Jun 09 11:56:44.301066 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:56:44.301031 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ncsh5" Jun 09 11:57:13.797126 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:57:13.797071 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e14c077a-6021-4bf9-a3e7-ae5ca648b191-metrics-certs\") pod \"network-metrics-daemon-cvhwb\" (UID: \"e14c077a-6021-4bf9-a3e7-ae5ca648b191\") " pod="openshift-multus/network-metrics-daemon-cvhwb" Jun 09 11:57:13.797662 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:57:13.797227 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 11:57:13.797662 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:57:13.797297 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e14c077a-6021-4bf9-a3e7-ae5ca648b191-metrics-certs podName:e14c077a-6021-4bf9-a3e7-ae5ca648b191 nodeName:}" failed. No retries permitted until 2026-06-09 11:59:15.797280429 +0000 UTC m=+252.219838182 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e14c077a-6021-4bf9-a3e7-ae5ca648b191-metrics-certs") pod "network-metrics-daemon-cvhwb" (UID: "e14c077a-6021-4bf9-a3e7-ae5ca648b191") : secret "metrics-daemon-secret" not found Jun 09 11:57:41.448792 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:57:41.448735 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-pdlth" podUID="447b1c43-1b2e-442c-b9ba-13e5b175df87" Jun 09 11:57:41.502694 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:57:41.502661 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pdlth" Jun 09 11:57:43.061145 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:57:43.061104 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-cvhwb" podUID="e14c077a-6021-4bf9-a3e7-ae5ca648b191" Jun 09 11:57:46.315081 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:57:46.315021 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/447b1c43-1b2e-442c-b9ba-13e5b175df87-metrics-tls\") pod \"dns-default-pdlth\" (UID: \"447b1c43-1b2e-442c-b9ba-13e5b175df87\") " pod="openshift-dns/dns-default-pdlth" Jun 09 11:57:46.315488 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:57:46.315178 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 11:57:46.315488 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:57:46.315245 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/447b1c43-1b2e-442c-b9ba-13e5b175df87-metrics-tls podName:447b1c43-1b2e-442c-b9ba-13e5b175df87 nodeName:}" failed. No retries permitted until 2026-06-09 11:59:48.315227202 +0000 UTC m=+284.737784954 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/447b1c43-1b2e-442c-b9ba-13e5b175df87-metrics-tls") pod "dns-default-pdlth" (UID: "447b1c43-1b2e-442c-b9ba-13e5b175df87") : secret "dns-default-metrics-tls" not found Jun 09 11:57:58.038801 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:57:58.038709 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvhwb" Jun 09 11:59:08.555088 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.555039 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hm9tp"] Jun 09 11:59:08.556784 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.556768 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-7f6qn"] Jun 09 11:59:08.556900 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.556881 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hm9tp" Jun 09 11:59:08.558488 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.558467 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-7f6qn" Jun 09 11:59:08.563914 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.563890 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-cfbx6\"" Jun 09 11:59:08.564052 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.564036 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 09 11:59:08.564120 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.564095 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 09 11:59:08.564170 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.564120 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 09 11:59:08.564238 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.564223 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 09 11:59:08.564816 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.564797 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 09 11:59:08.564927 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.564829 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 09 11:59:08.564927 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.564840 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 09 11:59:08.564927 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.564831 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-r9wwn\"" Jun 09 11:59:08.570478 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.570458 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5c74ff5cff-rflz7"] Jun 09 11:59:08.572191 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.572168 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c74ff5cff-rflz7" Jun 09 11:59:08.576932 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.576915 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 09 11:59:08.577060 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.577042 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-frx5g\"" Jun 09 11:59:08.577463 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.577390 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 09 11:59:08.577463 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.577423 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 09 11:59:08.584625 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.584597 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 09 11:59:08.589249 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.589228 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hm9tp"] Jun 09 11:59:08.589885 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.589867 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-7f6qn"] Jun 09 11:59:08.598865 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.598843 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c74ff5cff-rflz7"] Jun 09 11:59:08.659013 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.658979 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-b8mrg"] Jun 09 11:59:08.659226 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.659206 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1ef19b4-8463-492a-843a-024e5d26e0c1-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-7f6qn\" (UID: \"e1ef19b4-8463-492a-843a-024e5d26e0c1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-7f6qn" Jun 09 11:59:08.659320 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.659241 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d17337fd-8815-4f95-bc78-d713701722af-registry-tls\") pod \"image-registry-5c74ff5cff-rflz7\" (UID: \"d17337fd-8815-4f95-bc78-d713701722af\") " pod="openshift-image-registry/image-registry-5c74ff5cff-rflz7" Jun 09 11:59:08.659320 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.659272 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whstm\" (UniqueName: \"kubernetes.io/projected/494fd567-bebb-432c-aaac-a6994d3ef40c-kube-api-access-whstm\") pod \"service-ca-operator-6bc5ff68f5-hm9tp\" (UID: \"494fd567-bebb-432c-aaac-a6994d3ef40c\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hm9tp" Jun 09 11:59:08.659431 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.659342 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkcb2\" (UniqueName: \"kubernetes.io/projected/e1ef19b4-8463-492a-843a-024e5d26e0c1-kube-api-access-gkcb2\") pod \"cluster-samples-operator-854f8b96b6-7f6qn\" (UID: \"e1ef19b4-8463-492a-843a-024e5d26e0c1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-7f6qn" Jun 09 11:59:08.659431 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.659367 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d17337fd-8815-4f95-bc78-d713701722af-registry-certificates\") pod \"image-registry-5c74ff5cff-rflz7\" (UID: \"d17337fd-8815-4f95-bc78-d713701722af\") " pod="openshift-image-registry/image-registry-5c74ff5cff-rflz7" Jun 09 11:59:08.659431 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.659390 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d17337fd-8815-4f95-bc78-d713701722af-trusted-ca\") pod \"image-registry-5c74ff5cff-rflz7\" (UID: \"d17337fd-8815-4f95-bc78-d713701722af\") " pod="openshift-image-registry/image-registry-5c74ff5cff-rflz7" Jun 09 11:59:08.659568 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.659457 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d17337fd-8815-4f95-bc78-d713701722af-ca-trust-extracted\") pod \"image-registry-5c74ff5cff-rflz7\" (UID: \"d17337fd-8815-4f95-bc78-d713701722af\") " pod="openshift-image-registry/image-registry-5c74ff5cff-rflz7" Jun 09 11:59:08.659568 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.659506 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8djsz\" (UniqueName: \"kubernetes.io/projected/d17337fd-8815-4f95-bc78-d713701722af-kube-api-access-8djsz\") pod \"image-registry-5c74ff5cff-rflz7\" (UID: \"d17337fd-8815-4f95-bc78-d713701722af\") " pod="openshift-image-registry/image-registry-5c74ff5cff-rflz7" Jun 09 11:59:08.659697 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.659582 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/494fd567-bebb-432c-aaac-a6994d3ef40c-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-hm9tp\" (UID: \"494fd567-bebb-432c-aaac-a6994d3ef40c\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hm9tp" Jun 09 11:59:08.659697 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.659635 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d17337fd-8815-4f95-bc78-d713701722af-installation-pull-secrets\") pod \"image-registry-5c74ff5cff-rflz7\" (UID: \"d17337fd-8815-4f95-bc78-d713701722af\") " pod="openshift-image-registry/image-registry-5c74ff5cff-rflz7" Jun 09 11:59:08.659697 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.659665 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/494fd567-bebb-432c-aaac-a6994d3ef40c-config\") pod \"service-ca-operator-6bc5ff68f5-hm9tp\" (UID: \"494fd567-bebb-432c-aaac-a6994d3ef40c\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hm9tp" Jun 09 11:59:08.659808 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.659700 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d17337fd-8815-4f95-bc78-d713701722af-image-registry-private-configuration\") pod \"image-registry-5c74ff5cff-rflz7\" (UID: \"d17337fd-8815-4f95-bc78-d713701722af\") " pod="openshift-image-registry/image-registry-5c74ff5cff-rflz7" Jun 09 11:59:08.659808 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.659720 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d17337fd-8815-4f95-bc78-d713701722af-bound-sa-token\") pod \"image-registry-5c74ff5cff-rflz7\" (UID: \"d17337fd-8815-4f95-bc78-d713701722af\") " pod="openshift-image-registry/image-registry-5c74ff5cff-rflz7" Jun 09 11:59:08.660767 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.660745 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-b8mrg" Jun 09 11:59:08.663354 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.663332 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 09 11:59:08.663665 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.663645 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 09 11:59:08.663771 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.663670 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 09 11:59:08.663771 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.663742 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 09 11:59:08.665159 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.665144 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-d6qvx\"" Jun 09 11:59:08.679779 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.679747 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-b8mrg"] Jun 09 11:59:08.760665 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.760629 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d17337fd-8815-4f95-bc78-d713701722af-ca-trust-extracted\") pod \"image-registry-5c74ff5cff-rflz7\" (UID: \"d17337fd-8815-4f95-bc78-d713701722af\") " pod="openshift-image-registry/image-registry-5c74ff5cff-rflz7" Jun 09 11:59:08.760665 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.760666 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8djsz\" (UniqueName: \"kubernetes.io/projected/d17337fd-8815-4f95-bc78-d713701722af-kube-api-access-8djsz\") pod \"image-registry-5c74ff5cff-rflz7\" (UID: \"d17337fd-8815-4f95-bc78-d713701722af\") " pod="openshift-image-registry/image-registry-5c74ff5cff-rflz7" Jun 09 11:59:08.760916 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.760707 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/494fd567-bebb-432c-aaac-a6994d3ef40c-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-hm9tp\" (UID: \"494fd567-bebb-432c-aaac-a6994d3ef40c\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hm9tp" Jun 09 11:59:08.760916 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.760725 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d17337fd-8815-4f95-bc78-d713701722af-installation-pull-secrets\") pod \"image-registry-5c74ff5cff-rflz7\" (UID: \"d17337fd-8815-4f95-bc78-d713701722af\") " pod="openshift-image-registry/image-registry-5c74ff5cff-rflz7" Jun 09 11:59:08.760916 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.760747 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/494fd567-bebb-432c-aaac-a6994d3ef40c-config\") pod \"service-ca-operator-6bc5ff68f5-hm9tp\" (UID: \"494fd567-bebb-432c-aaac-a6994d3ef40c\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hm9tp" Jun 09 11:59:08.760916 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.760771 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d17337fd-8815-4f95-bc78-d713701722af-image-registry-private-configuration\") pod \"image-registry-5c74ff5cff-rflz7\" (UID: \"d17337fd-8815-4f95-bc78-d713701722af\") " pod="openshift-image-registry/image-registry-5c74ff5cff-rflz7" Jun 09 11:59:08.760916 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.760794 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d17337fd-8815-4f95-bc78-d713701722af-bound-sa-token\") pod \"image-registry-5c74ff5cff-rflz7\" (UID: \"d17337fd-8815-4f95-bc78-d713701722af\") " pod="openshift-image-registry/image-registry-5c74ff5cff-rflz7" Jun 09 11:59:08.760916 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.760823 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/35890da8-8ba3-4a9c-b524-4130ae63284c-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-b8mrg\" (UID: \"35890da8-8ba3-4a9c-b524-4130ae63284c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-b8mrg" Jun 09 11:59:08.760916 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.760849 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/35890da8-8ba3-4a9c-b524-4130ae63284c-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-b8mrg\" (UID: \"35890da8-8ba3-4a9c-b524-4130ae63284c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-b8mrg" Jun 09 11:59:08.760916 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.760875 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmdvk\" (UniqueName: \"kubernetes.io/projected/35890da8-8ba3-4a9c-b524-4130ae63284c-kube-api-access-kmdvk\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-b8mrg\" (UID: \"35890da8-8ba3-4a9c-b524-4130ae63284c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-b8mrg" Jun 09 11:59:08.760916 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.760914 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1ef19b4-8463-492a-843a-024e5d26e0c1-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-7f6qn\" (UID: \"e1ef19b4-8463-492a-843a-024e5d26e0c1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-7f6qn" Jun 09 11:59:08.761350 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.760937 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d17337fd-8815-4f95-bc78-d713701722af-registry-tls\") pod \"image-registry-5c74ff5cff-rflz7\" (UID: \"d17337fd-8815-4f95-bc78-d713701722af\") " pod="openshift-image-registry/image-registry-5c74ff5cff-rflz7" Jun 09 11:59:08.761350 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.760967 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whstm\" (UniqueName: \"kubernetes.io/projected/494fd567-bebb-432c-aaac-a6994d3ef40c-kube-api-access-whstm\") pod \"service-ca-operator-6bc5ff68f5-hm9tp\" (UID: \"494fd567-bebb-432c-aaac-a6994d3ef40c\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hm9tp" Jun 09 11:59:08.761350 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.761006 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkcb2\" (UniqueName: \"kubernetes.io/projected/e1ef19b4-8463-492a-843a-024e5d26e0c1-kube-api-access-gkcb2\") pod \"cluster-samples-operator-854f8b96b6-7f6qn\" (UID: \"e1ef19b4-8463-492a-843a-024e5d26e0c1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-7f6qn" Jun 09 11:59:08.761350 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.761033 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d17337fd-8815-4f95-bc78-d713701722af-registry-certificates\") pod \"image-registry-5c74ff5cff-rflz7\" (UID: \"d17337fd-8815-4f95-bc78-d713701722af\") " pod="openshift-image-registry/image-registry-5c74ff5cff-rflz7" Jun 09 11:59:08.761350 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.761039 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d17337fd-8815-4f95-bc78-d713701722af-ca-trust-extracted\") pod \"image-registry-5c74ff5cff-rflz7\" (UID: \"d17337fd-8815-4f95-bc78-d713701722af\") " pod="openshift-image-registry/image-registry-5c74ff5cff-rflz7" Jun 09 11:59:08.761350 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.761057 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d17337fd-8815-4f95-bc78-d713701722af-trusted-ca\") pod \"image-registry-5c74ff5cff-rflz7\" (UID: \"d17337fd-8815-4f95-bc78-d713701722af\") " pod="openshift-image-registry/image-registry-5c74ff5cff-rflz7" Jun 09 11:59:08.761350 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:59:08.761140 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 11:59:08.761350 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:59:08.761235 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1ef19b4-8463-492a-843a-024e5d26e0c1-samples-operator-tls podName:e1ef19b4-8463-492a-843a-024e5d26e0c1 nodeName:}" failed. No retries permitted until 2026-06-09 11:59:09.261217164 +0000 UTC m=+245.683774928 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e1ef19b4-8463-492a-843a-024e5d26e0c1-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-7f6qn" (UID: "e1ef19b4-8463-492a-843a-024e5d26e0c1") : secret "samples-operator-tls" not found Jun 09 11:59:08.761350 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:59:08.761246 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 11:59:08.761350 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:59:08.761262 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c74ff5cff-rflz7: secret "image-registry-tls" not found Jun 09 11:59:08.761350 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:59:08.761321 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d17337fd-8815-4f95-bc78-d713701722af-registry-tls podName:d17337fd-8815-4f95-bc78-d713701722af nodeName:}" failed. No retries permitted until 2026-06-09 11:59:09.261300689 +0000 UTC m=+245.683858461 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d17337fd-8815-4f95-bc78-d713701722af-registry-tls") pod "image-registry-5c74ff5cff-rflz7" (UID: "d17337fd-8815-4f95-bc78-d713701722af") : secret "image-registry-tls" not found Jun 09 11:59:08.761937 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.761359 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/494fd567-bebb-432c-aaac-a6994d3ef40c-config\") pod \"service-ca-operator-6bc5ff68f5-hm9tp\" (UID: \"494fd567-bebb-432c-aaac-a6994d3ef40c\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hm9tp" Jun 09 11:59:08.761937 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.761838 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d17337fd-8815-4f95-bc78-d713701722af-registry-certificates\") pod \"image-registry-5c74ff5cff-rflz7\" (UID: \"d17337fd-8815-4f95-bc78-d713701722af\") " pod="openshift-image-registry/image-registry-5c74ff5cff-rflz7" Jun 09 11:59:08.762136 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.762116 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d17337fd-8815-4f95-bc78-d713701722af-trusted-ca\") pod \"image-registry-5c74ff5cff-rflz7\" (UID: \"d17337fd-8815-4f95-bc78-d713701722af\") " pod="openshift-image-registry/image-registry-5c74ff5cff-rflz7" Jun 09 11:59:08.763157 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.763129 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d17337fd-8815-4f95-bc78-d713701722af-installation-pull-secrets\") pod \"image-registry-5c74ff5cff-rflz7\" (UID: \"d17337fd-8815-4f95-bc78-d713701722af\") " pod="openshift-image-registry/image-registry-5c74ff5cff-rflz7" Jun 09 11:59:08.763515 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.763499 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d17337fd-8815-4f95-bc78-d713701722af-image-registry-private-configuration\") pod \"image-registry-5c74ff5cff-rflz7\" (UID: \"d17337fd-8815-4f95-bc78-d713701722af\") " pod="openshift-image-registry/image-registry-5c74ff5cff-rflz7" Jun 09 11:59:08.763661 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.763644 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/494fd567-bebb-432c-aaac-a6994d3ef40c-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-hm9tp\" (UID: \"494fd567-bebb-432c-aaac-a6994d3ef40c\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hm9tp" Jun 09 11:59:08.771209 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.771183 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xb86r"] Jun 09 11:59:08.773576 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.773559 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xb86r" Jun 09 11:59:08.775774 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.775707 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 09 11:59:08.775774 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.775709 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 11:59:08.777046 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.777021 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 11:59:08.777308 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.777020 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-vb7gq\"" Jun 09 11:59:08.777308 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.777107 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 09 11:59:08.777572 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.777521 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8djsz\" (UniqueName: \"kubernetes.io/projected/d17337fd-8815-4f95-bc78-d713701722af-kube-api-access-8djsz\") pod \"image-registry-5c74ff5cff-rflz7\" (UID: \"d17337fd-8815-4f95-bc78-d713701722af\") " pod="openshift-image-registry/image-registry-5c74ff5cff-rflz7" Jun 09 11:59:08.779135 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.779117 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whstm\" (UniqueName: \"kubernetes.io/projected/494fd567-bebb-432c-aaac-a6994d3ef40c-kube-api-access-whstm\") pod \"service-ca-operator-6bc5ff68f5-hm9tp\" (UID: \"494fd567-bebb-432c-aaac-a6994d3ef40c\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hm9tp" Jun 09 11:59:08.779207 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.779153 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d17337fd-8815-4f95-bc78-d713701722af-bound-sa-token\") pod \"image-registry-5c74ff5cff-rflz7\" (UID: \"d17337fd-8815-4f95-bc78-d713701722af\") " pod="openshift-image-registry/image-registry-5c74ff5cff-rflz7" Jun 09 11:59:08.784327 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.784308 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkcb2\" (UniqueName: \"kubernetes.io/projected/e1ef19b4-8463-492a-843a-024e5d26e0c1-kube-api-access-gkcb2\") pod \"cluster-samples-operator-854f8b96b6-7f6qn\" (UID: \"e1ef19b4-8463-492a-843a-024e5d26e0c1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-7f6qn" Jun 09 11:59:08.788076 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.788054 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xb86r"] Jun 09 11:59:08.861882 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.861781 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/35890da8-8ba3-4a9c-b524-4130ae63284c-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-b8mrg\" (UID: \"35890da8-8ba3-4a9c-b524-4130ae63284c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-b8mrg" Jun 09 11:59:08.861882 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.861824 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/35890da8-8ba3-4a9c-b524-4130ae63284c-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-b8mrg\" (UID: \"35890da8-8ba3-4a9c-b524-4130ae63284c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-b8mrg" Jun 09 11:59:08.861882 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.861848 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmdvk\" (UniqueName: \"kubernetes.io/projected/35890da8-8ba3-4a9c-b524-4130ae63284c-kube-api-access-kmdvk\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-b8mrg\" (UID: \"35890da8-8ba3-4a9c-b524-4130ae63284c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-b8mrg" Jun 09 11:59:08.862133 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.861903 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gns9k\" (UniqueName: \"kubernetes.io/projected/852bcbc1-0bb1-440d-b031-180317de8131-kube-api-access-gns9k\") pod \"cluster-monitoring-operator-74bbf69bbb-xb86r\" (UID: \"852bcbc1-0bb1-440d-b031-180317de8131\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xb86r" Jun 09 11:59:08.862133 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.861931 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/852bcbc1-0bb1-440d-b031-180317de8131-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-xb86r\" (UID: \"852bcbc1-0bb1-440d-b031-180317de8131\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xb86r" Jun 09 11:59:08.862133 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.862012 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/852bcbc1-0bb1-440d-b031-180317de8131-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-xb86r\" (UID: \"852bcbc1-0bb1-440d-b031-180317de8131\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xb86r" Jun 09 11:59:08.862435 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.862417 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/35890da8-8ba3-4a9c-b524-4130ae63284c-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-b8mrg\" (UID: \"35890da8-8ba3-4a9c-b524-4130ae63284c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-b8mrg" Jun 09 11:59:08.864057 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.864037 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/35890da8-8ba3-4a9c-b524-4130ae63284c-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-b8mrg\" (UID: \"35890da8-8ba3-4a9c-b524-4130ae63284c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-b8mrg" Jun 09 11:59:08.867067 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.867051 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hm9tp" Jun 09 11:59:08.870198 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.870181 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmdvk\" (UniqueName: \"kubernetes.io/projected/35890da8-8ba3-4a9c-b524-4130ae63284c-kube-api-access-kmdvk\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-b8mrg\" (UID: \"35890da8-8ba3-4a9c-b524-4130ae63284c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-b8mrg" Jun 09 11:59:08.962978 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.962950 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gns9k\" (UniqueName: \"kubernetes.io/projected/852bcbc1-0bb1-440d-b031-180317de8131-kube-api-access-gns9k\") pod \"cluster-monitoring-operator-74bbf69bbb-xb86r\" (UID: \"852bcbc1-0bb1-440d-b031-180317de8131\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xb86r" Jun 09 11:59:08.963146 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.962982 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/852bcbc1-0bb1-440d-b031-180317de8131-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-xb86r\" (UID: \"852bcbc1-0bb1-440d-b031-180317de8131\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xb86r" Jun 09 11:59:08.963146 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.963012 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/852bcbc1-0bb1-440d-b031-180317de8131-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-xb86r\" (UID: \"852bcbc1-0bb1-440d-b031-180317de8131\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xb86r" Jun 09 11:59:08.963146 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:59:08.963109 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 11:59:08.963297 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:59:08.963173 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/852bcbc1-0bb1-440d-b031-180317de8131-cluster-monitoring-operator-tls podName:852bcbc1-0bb1-440d-b031-180317de8131 nodeName:}" failed. No retries permitted until 2026-06-09 11:59:09.463154963 +0000 UTC m=+245.885712718 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/852bcbc1-0bb1-440d-b031-180317de8131-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-xb86r" (UID: "852bcbc1-0bb1-440d-b031-180317de8131") : secret "cluster-monitoring-operator-tls" not found Jun 09 11:59:08.963660 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.963642 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/852bcbc1-0bb1-440d-b031-180317de8131-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-xb86r\" (UID: \"852bcbc1-0bb1-440d-b031-180317de8131\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xb86r" Jun 09 11:59:08.968889 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.968870 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-b8mrg" Jun 09 11:59:08.971817 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.971797 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gns9k\" (UniqueName: \"kubernetes.io/projected/852bcbc1-0bb1-440d-b031-180317de8131-kube-api-access-gns9k\") pod \"cluster-monitoring-operator-74bbf69bbb-xb86r\" (UID: \"852bcbc1-0bb1-440d-b031-180317de8131\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xb86r" Jun 09 11:59:08.987355 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:08.987331 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hm9tp"] Jun 09 11:59:08.989731 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:59:08.989700 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod494fd567_bebb_432c_aaac_a6994d3ef40c.slice/crio-419a78101ce6f65f40a6691952dbd09663cf2d5be3c0663f12b30407763b2774 WatchSource:0}: Error finding container 419a78101ce6f65f40a6691952dbd09663cf2d5be3c0663f12b30407763b2774: Status 404 returned error can't find the container with id 419a78101ce6f65f40a6691952dbd09663cf2d5be3c0663f12b30407763b2774 Jun 09 11:59:09.088095 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:09.087963 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-b8mrg"] Jun 09 11:59:09.090418 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:59:09.090389 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35890da8_8ba3_4a9c_b524_4130ae63284c.slice/crio-63707192ff7cd26b885e02b2d1441de2059fc587d3f4010995f89d095d69c885 WatchSource:0}: Error finding container 63707192ff7cd26b885e02b2d1441de2059fc587d3f4010995f89d095d69c885: Status 404 returned error can't find the container with id 63707192ff7cd26b885e02b2d1441de2059fc587d3f4010995f89d095d69c885 Jun 09 11:59:09.265551 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:09.265509 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1ef19b4-8463-492a-843a-024e5d26e0c1-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-7f6qn\" (UID: \"e1ef19b4-8463-492a-843a-024e5d26e0c1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-7f6qn" Jun 09 11:59:09.265551 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:09.265549 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d17337fd-8815-4f95-bc78-d713701722af-registry-tls\") pod \"image-registry-5c74ff5cff-rflz7\" (UID: \"d17337fd-8815-4f95-bc78-d713701722af\") " pod="openshift-image-registry/image-registry-5c74ff5cff-rflz7" Jun 09 11:59:09.265782 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:59:09.265691 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 11:59:09.265782 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:59:09.265753 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1ef19b4-8463-492a-843a-024e5d26e0c1-samples-operator-tls podName:e1ef19b4-8463-492a-843a-024e5d26e0c1 nodeName:}" failed. No retries permitted until 2026-06-09 11:59:10.26573795 +0000 UTC m=+246.688295703 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e1ef19b4-8463-492a-843a-024e5d26e0c1-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-7f6qn" (UID: "e1ef19b4-8463-492a-843a-024e5d26e0c1") : secret "samples-operator-tls" not found Jun 09 11:59:09.265782 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:59:09.265692 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 11:59:09.265782 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:59:09.265773 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c74ff5cff-rflz7: secret "image-registry-tls" not found Jun 09 11:59:09.265942 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:59:09.265796 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d17337fd-8815-4f95-bc78-d713701722af-registry-tls podName:d17337fd-8815-4f95-bc78-d713701722af nodeName:}" failed. No retries permitted until 2026-06-09 11:59:10.265789619 +0000 UTC m=+246.688347371 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d17337fd-8815-4f95-bc78-d713701722af-registry-tls") pod "image-registry-5c74ff5cff-rflz7" (UID: "d17337fd-8815-4f95-bc78-d713701722af") : secret "image-registry-tls" not found Jun 09 11:59:09.469510 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:09.467787 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/852bcbc1-0bb1-440d-b031-180317de8131-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-xb86r\" (UID: \"852bcbc1-0bb1-440d-b031-180317de8131\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xb86r" Jun 09 11:59:09.469510 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:59:09.468015 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 11:59:09.469510 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:59:09.468089 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/852bcbc1-0bb1-440d-b031-180317de8131-cluster-monitoring-operator-tls podName:852bcbc1-0bb1-440d-b031-180317de8131 nodeName:}" failed. No retries permitted until 2026-06-09 11:59:10.468062864 +0000 UTC m=+246.890620632 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/852bcbc1-0bb1-440d-b031-180317de8131-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-xb86r" (UID: "852bcbc1-0bb1-440d-b031-180317de8131") : secret "cluster-monitoring-operator-tls" not found Jun 09 11:59:09.703201 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:09.703160 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-b8mrg" event={"ID":"35890da8-8ba3-4a9c-b524-4130ae63284c","Type":"ContainerStarted","Data":"63707192ff7cd26b885e02b2d1441de2059fc587d3f4010995f89d095d69c885"} Jun 09 11:59:09.704736 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:09.704700 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hm9tp" event={"ID":"494fd567-bebb-432c-aaac-a6994d3ef40c","Type":"ContainerStarted","Data":"419a78101ce6f65f40a6691952dbd09663cf2d5be3c0663f12b30407763b2774"} Jun 09 11:59:10.274684 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:10.274645 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1ef19b4-8463-492a-843a-024e5d26e0c1-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-7f6qn\" (UID: \"e1ef19b4-8463-492a-843a-024e5d26e0c1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-7f6qn" Jun 09 11:59:10.274684 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:10.274688 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d17337fd-8815-4f95-bc78-d713701722af-registry-tls\") pod \"image-registry-5c74ff5cff-rflz7\" (UID: \"d17337fd-8815-4f95-bc78-d713701722af\") " pod="openshift-image-registry/image-registry-5c74ff5cff-rflz7" Jun 09 11:59:10.274940 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:59:10.274810 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 11:59:10.274940 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:59:10.274828 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 11:59:10.274940 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:59:10.274842 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c74ff5cff-rflz7: secret "image-registry-tls" not found Jun 09 11:59:10.274940 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:59:10.274890 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1ef19b4-8463-492a-843a-024e5d26e0c1-samples-operator-tls podName:e1ef19b4-8463-492a-843a-024e5d26e0c1 nodeName:}" failed. No retries permitted until 2026-06-09 11:59:12.274874094 +0000 UTC m=+248.697431847 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e1ef19b4-8463-492a-843a-024e5d26e0c1-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-7f6qn" (UID: "e1ef19b4-8463-492a-843a-024e5d26e0c1") : secret "samples-operator-tls" not found Jun 09 11:59:10.274940 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:59:10.274907 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d17337fd-8815-4f95-bc78-d713701722af-registry-tls podName:d17337fd-8815-4f95-bc78-d713701722af nodeName:}" failed. No retries permitted until 2026-06-09 11:59:12.274900191 +0000 UTC m=+248.697457944 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d17337fd-8815-4f95-bc78-d713701722af-registry-tls") pod "image-registry-5c74ff5cff-rflz7" (UID: "d17337fd-8815-4f95-bc78-d713701722af") : secret "image-registry-tls" not found Jun 09 11:59:10.477406 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:10.477361 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/852bcbc1-0bb1-440d-b031-180317de8131-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-xb86r\" (UID: \"852bcbc1-0bb1-440d-b031-180317de8131\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xb86r" Jun 09 11:59:10.477594 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:59:10.477487 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 11:59:10.477594 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:59:10.477551 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/852bcbc1-0bb1-440d-b031-180317de8131-cluster-monitoring-operator-tls podName:852bcbc1-0bb1-440d-b031-180317de8131 nodeName:}" failed. No retries permitted until 2026-06-09 11:59:12.477536626 +0000 UTC m=+248.900094379 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/852bcbc1-0bb1-440d-b031-180317de8131-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-xb86r" (UID: "852bcbc1-0bb1-440d-b031-180317de8131") : secret "cluster-monitoring-operator-tls" not found Jun 09 11:59:11.711925 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:11.711888 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-b8mrg" event={"ID":"35890da8-8ba3-4a9c-b524-4130ae63284c","Type":"ContainerStarted","Data":"46a253b8b48f1b588bd5f4516296e077154997b90e3f82a35c792e67f7ab498c"} Jun 09 11:59:11.713390 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:11.713360 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hm9tp" event={"ID":"494fd567-bebb-432c-aaac-a6994d3ef40c","Type":"ContainerStarted","Data":"bac44bd4cad2cfcaa760be47fa316f473fe444aa6448fa689a002ebccb9a40a8"} Jun 09 11:59:11.730792 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:11.730734 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-b8mrg" podStartSLOduration=1.732949364 podStartE2EDuration="3.730714154s" totalImagesPullingTime="1.99776479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:59:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:59:11.729330262 +0000 UTC m=+248.151888067" watchObservedRunningTime="2026-06-09 11:59:11.730714154 +0000 UTC m=+248.153271931" Jun 09 11:59:11.748304 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:11.748243 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hm9tp" podStartSLOduration=1.651668219 podStartE2EDuration="3.748220554s" totalImagesPullingTime="2.096552335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:59:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:59:11.746738554 +0000 UTC m=+248.169296332" watchObservedRunningTime="2026-06-09 11:59:11.748220554 +0000 UTC m=+248.170778332" Jun 09 11:59:12.293564 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:12.293531 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1ef19b4-8463-492a-843a-024e5d26e0c1-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-7f6qn\" (UID: \"e1ef19b4-8463-492a-843a-024e5d26e0c1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-7f6qn" Jun 09 11:59:12.293564 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:12.293567 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d17337fd-8815-4f95-bc78-d713701722af-registry-tls\") pod \"image-registry-5c74ff5cff-rflz7\" (UID: \"d17337fd-8815-4f95-bc78-d713701722af\") " pod="openshift-image-registry/image-registry-5c74ff5cff-rflz7" Jun 09 11:59:12.293771 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:59:12.293708 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 11:59:12.293771 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:59:12.293733 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 11:59:12.293771 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:59:12.293745 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c74ff5cff-rflz7: secret "image-registry-tls" not found Jun 09 11:59:12.293896 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:59:12.293780 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1ef19b4-8463-492a-843a-024e5d26e0c1-samples-operator-tls podName:e1ef19b4-8463-492a-843a-024e5d26e0c1 nodeName:}" failed. No retries permitted until 2026-06-09 11:59:16.293762013 +0000 UTC m=+252.716319783 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e1ef19b4-8463-492a-843a-024e5d26e0c1-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-7f6qn" (UID: "e1ef19b4-8463-492a-843a-024e5d26e0c1") : secret "samples-operator-tls" not found Jun 09 11:59:12.293896 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:59:12.293795 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d17337fd-8815-4f95-bc78-d713701722af-registry-tls podName:d17337fd-8815-4f95-bc78-d713701722af nodeName:}" failed. No retries permitted until 2026-06-09 11:59:16.293788434 +0000 UTC m=+252.716346189 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d17337fd-8815-4f95-bc78-d713701722af-registry-tls") pod "image-registry-5c74ff5cff-rflz7" (UID: "d17337fd-8815-4f95-bc78-d713701722af") : secret "image-registry-tls" not found Jun 09 11:59:12.495670 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:12.495640 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/852bcbc1-0bb1-440d-b031-180317de8131-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-xb86r\" (UID: \"852bcbc1-0bb1-440d-b031-180317de8131\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xb86r" Jun 09 11:59:12.495838 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:59:12.495777 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 11:59:12.495884 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:59:12.495845 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/852bcbc1-0bb1-440d-b031-180317de8131-cluster-monitoring-operator-tls podName:852bcbc1-0bb1-440d-b031-180317de8131 nodeName:}" failed. No retries permitted until 2026-06-09 11:59:16.495829734 +0000 UTC m=+252.918387487 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/852bcbc1-0bb1-440d-b031-180317de8131-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-xb86r" (UID: "852bcbc1-0bb1-440d-b031-180317de8131") : secret "cluster-monitoring-operator-tls" not found Jun 09 11:59:14.728078 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:14.728048 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z728s_01f9bafd-cb94-4a81-a033-1baef2ace912/dns-node-resolver/0.log" Jun 09 11:59:14.789046 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:14.789011 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-5dl4l"] Jun 09 11:59:14.793269 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:14.793247 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-5dl4l" Jun 09 11:59:14.795784 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:14.795766 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 09 11:59:14.795921 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:14.795763 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 09 11:59:14.796181 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:14.796165 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 09 11:59:14.796729 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:14.796716 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-pm489\"" Jun 09 11:59:14.796806 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:14.796761 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 09 11:59:14.799953 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:14.799752 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-5dl4l"] Jun 09 11:59:14.915465 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:14.915425 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1ebcfca6-690a-4657-b13b-71fa2c8c4ec3-signing-cabundle\") pod \"service-ca-7d74d578b8-5dl4l\" (UID: \"1ebcfca6-690a-4657-b13b-71fa2c8c4ec3\") " pod="openshift-service-ca/service-ca-7d74d578b8-5dl4l" Jun 09 11:59:14.915465 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:14.915461 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vnlj\" (UniqueName: \"kubernetes.io/projected/1ebcfca6-690a-4657-b13b-71fa2c8c4ec3-kube-api-access-4vnlj\") pod \"service-ca-7d74d578b8-5dl4l\" (UID: \"1ebcfca6-690a-4657-b13b-71fa2c8c4ec3\") " pod="openshift-service-ca/service-ca-7d74d578b8-5dl4l" Jun 09 11:59:14.915725 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:14.915505 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1ebcfca6-690a-4657-b13b-71fa2c8c4ec3-signing-key\") pod \"service-ca-7d74d578b8-5dl4l\" (UID: \"1ebcfca6-690a-4657-b13b-71fa2c8c4ec3\") " pod="openshift-service-ca/service-ca-7d74d578b8-5dl4l" Jun 09 11:59:15.016219 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:15.016128 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1ebcfca6-690a-4657-b13b-71fa2c8c4ec3-signing-cabundle\") pod \"service-ca-7d74d578b8-5dl4l\" (UID: \"1ebcfca6-690a-4657-b13b-71fa2c8c4ec3\") " pod="openshift-service-ca/service-ca-7d74d578b8-5dl4l" Jun 09 11:59:15.016219 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:15.016164 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vnlj\" (UniqueName: \"kubernetes.io/projected/1ebcfca6-690a-4657-b13b-71fa2c8c4ec3-kube-api-access-4vnlj\") pod \"service-ca-7d74d578b8-5dl4l\" (UID: \"1ebcfca6-690a-4657-b13b-71fa2c8c4ec3\") " pod="openshift-service-ca/service-ca-7d74d578b8-5dl4l" Jun 09 11:59:15.016409 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:15.016265 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1ebcfca6-690a-4657-b13b-71fa2c8c4ec3-signing-key\") pod \"service-ca-7d74d578b8-5dl4l\" (UID: \"1ebcfca6-690a-4657-b13b-71fa2c8c4ec3\") " pod="openshift-service-ca/service-ca-7d74d578b8-5dl4l" Jun 09 11:59:15.016828 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:15.016809 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1ebcfca6-690a-4657-b13b-71fa2c8c4ec3-signing-cabundle\") pod \"service-ca-7d74d578b8-5dl4l\" (UID: \"1ebcfca6-690a-4657-b13b-71fa2c8c4ec3\") " pod="openshift-service-ca/service-ca-7d74d578b8-5dl4l" Jun 09 11:59:15.018596 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:15.018563 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1ebcfca6-690a-4657-b13b-71fa2c8c4ec3-signing-key\") pod \"service-ca-7d74d578b8-5dl4l\" (UID: \"1ebcfca6-690a-4657-b13b-71fa2c8c4ec3\") " pod="openshift-service-ca/service-ca-7d74d578b8-5dl4l" Jun 09 11:59:15.025420 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:15.025397 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vnlj\" (UniqueName: \"kubernetes.io/projected/1ebcfca6-690a-4657-b13b-71fa2c8c4ec3-kube-api-access-4vnlj\") pod \"service-ca-7d74d578b8-5dl4l\" (UID: \"1ebcfca6-690a-4657-b13b-71fa2c8c4ec3\") " pod="openshift-service-ca/service-ca-7d74d578b8-5dl4l" Jun 09 11:59:15.102253 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:15.102216 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-5dl4l" Jun 09 11:59:15.228571 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:15.228534 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-5dl4l"] Jun 09 11:59:15.231759 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:59:15.231725 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ebcfca6_690a_4657_b13b_71fa2c8c4ec3.slice/crio-00ca5b33b4328fd1ff885e79d60452ed2ab7a3a4eb091e5db05fcb739c54f757 WatchSource:0}: Error finding container 00ca5b33b4328fd1ff885e79d60452ed2ab7a3a4eb091e5db05fcb739c54f757: Status 404 returned error can't find the container with id 00ca5b33b4328fd1ff885e79d60452ed2ab7a3a4eb091e5db05fcb739c54f757 Jun 09 11:59:15.725226 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:15.725190 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-5dl4l" event={"ID":"1ebcfca6-690a-4657-b13b-71fa2c8c4ec3","Type":"ContainerStarted","Data":"5812d07208e32b1d6b3a1cc839f592d4726b1ad22c344c039f5806eba76a65d5"} Jun 09 11:59:15.725432 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:15.725247 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-5dl4l" event={"ID":"1ebcfca6-690a-4657-b13b-71fa2c8c4ec3","Type":"ContainerStarted","Data":"00ca5b33b4328fd1ff885e79d60452ed2ab7a3a4eb091e5db05fcb739c54f757"} Jun 09 11:59:15.730654 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:15.730633 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vhxvf_ab0c9312-14d5-40ed-9840-b89f7637bf85/node-ca/0.log" Jun 09 11:59:15.744695 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:15.744636 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-5dl4l" podStartSLOduration=1.7446045799999998 podStartE2EDuration="1.74460458s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:59:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:59:15.744423321 +0000 UTC m=+252.166981096" watchObservedRunningTime="2026-06-09 11:59:15.74460458 +0000 UTC m=+252.167162355" Jun 09 11:59:15.822822 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:15.822776 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e14c077a-6021-4bf9-a3e7-ae5ca648b191-metrics-certs\") pod \"network-metrics-daemon-cvhwb\" (UID: \"e14c077a-6021-4bf9-a3e7-ae5ca648b191\") " pod="openshift-multus/network-metrics-daemon-cvhwb" Jun 09 11:59:15.823025 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:59:15.822932 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 11:59:15.823025 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:59:15.823010 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e14c077a-6021-4bf9-a3e7-ae5ca648b191-metrics-certs podName:e14c077a-6021-4bf9-a3e7-ae5ca648b191 nodeName:}" failed. No retries permitted until 2026-06-09 12:01:17.822987086 +0000 UTC m=+374.245544842 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e14c077a-6021-4bf9-a3e7-ae5ca648b191-metrics-certs") pod "network-metrics-daemon-cvhwb" (UID: "e14c077a-6021-4bf9-a3e7-ae5ca648b191") : secret "metrics-daemon-secret" not found Jun 09 11:59:16.140450 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:16.140418 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6l8jt_44157499-35a9-4824-a79c-daa659f4b622/serve-healthcheck-canary/0.log" Jun 09 11:59:16.326722 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:16.326687 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1ef19b4-8463-492a-843a-024e5d26e0c1-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-7f6qn\" (UID: \"e1ef19b4-8463-492a-843a-024e5d26e0c1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-7f6qn" Jun 09 11:59:16.326927 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:16.326733 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d17337fd-8815-4f95-bc78-d713701722af-registry-tls\") pod \"image-registry-5c74ff5cff-rflz7\" (UID: \"d17337fd-8815-4f95-bc78-d713701722af\") " pod="openshift-image-registry/image-registry-5c74ff5cff-rflz7" Jun 09 11:59:16.326927 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:59:16.326831 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 11:59:16.326927 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:59:16.326845 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c74ff5cff-rflz7: secret "image-registry-tls" not found Jun 09 11:59:16.326927 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:59:16.326854 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 11:59:16.327082 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:59:16.326926 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d17337fd-8815-4f95-bc78-d713701722af-registry-tls podName:d17337fd-8815-4f95-bc78-d713701722af nodeName:}" failed. No retries permitted until 2026-06-09 11:59:24.32690757 +0000 UTC m=+260.749465323 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d17337fd-8815-4f95-bc78-d713701722af-registry-tls") pod "image-registry-5c74ff5cff-rflz7" (UID: "d17337fd-8815-4f95-bc78-d713701722af") : secret "image-registry-tls" not found Jun 09 11:59:16.327082 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:59:16.326949 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1ef19b4-8463-492a-843a-024e5d26e0c1-samples-operator-tls podName:e1ef19b4-8463-492a-843a-024e5d26e0c1 nodeName:}" failed. No retries permitted until 2026-06-09 11:59:24.326942078 +0000 UTC m=+260.749499830 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e1ef19b4-8463-492a-843a-024e5d26e0c1-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-7f6qn" (UID: "e1ef19b4-8463-492a-843a-024e5d26e0c1") : secret "samples-operator-tls" not found Jun 09 11:59:16.528181 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:16.528080 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/852bcbc1-0bb1-440d-b031-180317de8131-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-xb86r\" (UID: \"852bcbc1-0bb1-440d-b031-180317de8131\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xb86r" Jun 09 11:59:16.528502 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:59:16.528222 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 11:59:16.528645 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:59:16.528579 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/852bcbc1-0bb1-440d-b031-180317de8131-cluster-monitoring-operator-tls podName:852bcbc1-0bb1-440d-b031-180317de8131 nodeName:}" failed. No retries permitted until 2026-06-09 11:59:24.52855196 +0000 UTC m=+260.951109719 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/852bcbc1-0bb1-440d-b031-180317de8131-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-xb86r" (UID: "852bcbc1-0bb1-440d-b031-180317de8131") : secret "cluster-monitoring-operator-tls" not found Jun 09 11:59:24.397326 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:24.397234 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1ef19b4-8463-492a-843a-024e5d26e0c1-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-7f6qn\" (UID: \"e1ef19b4-8463-492a-843a-024e5d26e0c1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-7f6qn" Jun 09 11:59:24.397326 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:24.397284 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d17337fd-8815-4f95-bc78-d713701722af-registry-tls\") pod \"image-registry-5c74ff5cff-rflz7\" (UID: \"d17337fd-8815-4f95-bc78-d713701722af\") " pod="openshift-image-registry/image-registry-5c74ff5cff-rflz7" Jun 09 11:59:24.399656 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:24.399632 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1ef19b4-8463-492a-843a-024e5d26e0c1-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-7f6qn\" (UID: \"e1ef19b4-8463-492a-843a-024e5d26e0c1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-7f6qn" Jun 09 11:59:24.399781 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:24.399662 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d17337fd-8815-4f95-bc78-d713701722af-registry-tls\") pod \"image-registry-5c74ff5cff-rflz7\" (UID: \"d17337fd-8815-4f95-bc78-d713701722af\") " pod="openshift-image-registry/image-registry-5c74ff5cff-rflz7" Jun 09 11:59:24.471638 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:24.471583 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-7f6qn" Jun 09 11:59:24.479689 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:24.479662 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c74ff5cff-rflz7" Jun 09 11:59:24.599186 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:24.599147 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/852bcbc1-0bb1-440d-b031-180317de8131-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-xb86r\" (UID: \"852bcbc1-0bb1-440d-b031-180317de8131\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xb86r" Jun 09 11:59:24.601528 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:24.601504 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/852bcbc1-0bb1-440d-b031-180317de8131-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-xb86r\" (UID: \"852bcbc1-0bb1-440d-b031-180317de8131\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xb86r" Jun 09 11:59:24.606110 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:24.606087 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-7f6qn"] Jun 09 11:59:24.624024 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:24.623994 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c74ff5cff-rflz7"] Jun 09 11:59:24.626455 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:59:24.626428 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd17337fd_8815_4f95_bc78_d713701722af.slice/crio-3bc5c55d97fd9af1d57b21c5f70f31c2d7d00fd9a7171f9fcf03be301e35f1b0 WatchSource:0}: Error finding container 3bc5c55d97fd9af1d57b21c5f70f31c2d7d00fd9a7171f9fcf03be301e35f1b0: Status 404 returned error can't find the container with id 3bc5c55d97fd9af1d57b21c5f70f31c2d7d00fd9a7171f9fcf03be301e35f1b0 Jun 09 11:59:24.696185 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:24.696153 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xb86r" Jun 09 11:59:24.755713 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:24.755391 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c74ff5cff-rflz7" event={"ID":"d17337fd-8815-4f95-bc78-d713701722af","Type":"ContainerStarted","Data":"be3ff98432ef45b82ef9003a12e751eedcbc8ce2a3842827c35f55e985e3e609"} Jun 09 11:59:24.755713 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:24.755452 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c74ff5cff-rflz7" event={"ID":"d17337fd-8815-4f95-bc78-d713701722af","Type":"ContainerStarted","Data":"3bc5c55d97fd9af1d57b21c5f70f31c2d7d00fd9a7171f9fcf03be301e35f1b0"} Jun 09 11:59:24.755713 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:24.755486 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5c74ff5cff-rflz7" Jun 09 11:59:24.756832 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:24.756805 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-7f6qn" event={"ID":"e1ef19b4-8463-492a-843a-024e5d26e0c1","Type":"ContainerStarted","Data":"da0b5b7108b2f728f71d2e1d324f5a19196e7e3a71895fa9d12db43d0c6f4f8b"} Jun 09 11:59:24.776689 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:24.776632 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5c74ff5cff-rflz7" podStartSLOduration=16.776588075 podStartE2EDuration="16.776588075s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:59:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:59:24.775282687 +0000 UTC m=+261.197840462" watchObservedRunningTime="2026-06-09 11:59:24.776588075 +0000 UTC m=+261.199145847" Jun 09 11:59:24.837511 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:24.837477 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xb86r"] Jun 09 11:59:24.840592 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:59:24.840562 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod852bcbc1_0bb1_440d_b031_180317de8131.slice/crio-4f77cc15640659998e51885494e1751d55dd8481f443d6d4ff40130ccfd867f6 WatchSource:0}: Error finding container 4f77cc15640659998e51885494e1751d55dd8481f443d6d4ff40130ccfd867f6: Status 404 returned error can't find the container with id 4f77cc15640659998e51885494e1751d55dd8481f443d6d4ff40130ccfd867f6 Jun 09 11:59:25.762765 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:25.762688 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xb86r" event={"ID":"852bcbc1-0bb1-440d-b031-180317de8131","Type":"ContainerStarted","Data":"4f77cc15640659998e51885494e1751d55dd8481f443d6d4ff40130ccfd867f6"} Jun 09 11:59:26.770480 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:26.770450 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-7f6qn" event={"ID":"e1ef19b4-8463-492a-843a-024e5d26e0c1","Type":"ContainerStarted","Data":"8ba24d2e39916db8d8219fed9f911a3e5eea4da1b8d0480ec9d333704cc83fd1"} Jun 09 11:59:26.772380 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:26.772353 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xb86r" event={"ID":"852bcbc1-0bb1-440d-b031-180317de8131","Type":"ContainerStarted","Data":"47285cba20009827893b8d1e8a00c4e3e77cd4a208680147a05767fa2c526b37"} Jun 09 11:59:26.809897 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:26.809835 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xb86r" podStartSLOduration=17.018082768 podStartE2EDuration="18.80981122s" totalImagesPullingTime="1.791728452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:59:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:59:26.808832478 +0000 UTC m=+263.231390279" watchObservedRunningTime="2026-06-09 11:59:26.80981122 +0000 UTC m=+263.232368997" Jun 09 11:59:27.776860 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:27.776828 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-7f6qn" event={"ID":"e1ef19b4-8463-492a-843a-024e5d26e0c1","Type":"ContainerStarted","Data":"e582f42d89a4f1a4b8f4d27ade0283a5ec9f6134d52ad0032cf9a898bb1ae625"} Jun 09 11:59:27.794789 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:27.794737 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-7f6qn" podStartSLOduration=17.809175211 podStartE2EDuration="19.794722424s" totalImagesPullingTime="1.985547213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:59:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:59:27.793800788 +0000 UTC m=+264.216358564" watchObservedRunningTime="2026-06-09 11:59:27.794722424 +0000 UTC m=+264.217280198" Jun 09 11:59:38.052731 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:38.052699 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8k6gr"] Jun 09 11:59:38.055429 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:38.055408 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5c74ff5cff-rflz7"] Jun 09 11:59:38.055557 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:38.055521 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8k6gr" Jun 09 11:59:38.057861 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:38.057841 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-s4x4b\"" Jun 09 11:59:38.058064 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:38.058042 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 11:59:38.058352 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:38.058336 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 11:59:38.058773 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:38.058748 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 11:59:38.058877 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:38.058785 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 11:59:38.068769 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:38.068749 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8k6gr"] Jun 09 11:59:38.203036 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:38.203000 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a2ce5048-fe61-42a6-b869-bd1c7afc0a67-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8k6gr\" (UID: \"a2ce5048-fe61-42a6-b869-bd1c7afc0a67\") " pod="openshift-insights/insights-runtime-extractor-8k6gr" Jun 09 11:59:38.203209 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:38.203096 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h87l2\" (UniqueName: \"kubernetes.io/projected/a2ce5048-fe61-42a6-b869-bd1c7afc0a67-kube-api-access-h87l2\") pod \"insights-runtime-extractor-8k6gr\" (UID: \"a2ce5048-fe61-42a6-b869-bd1c7afc0a67\") " pod="openshift-insights/insights-runtime-extractor-8k6gr" Jun 09 11:59:38.203209 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:38.203145 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a2ce5048-fe61-42a6-b869-bd1c7afc0a67-crio-socket\") pod \"insights-runtime-extractor-8k6gr\" (UID: \"a2ce5048-fe61-42a6-b869-bd1c7afc0a67\") " pod="openshift-insights/insights-runtime-extractor-8k6gr" Jun 09 11:59:38.203209 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:38.203174 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a2ce5048-fe61-42a6-b869-bd1c7afc0a67-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8k6gr\" (UID: \"a2ce5048-fe61-42a6-b869-bd1c7afc0a67\") " pod="openshift-insights/insights-runtime-extractor-8k6gr" Jun 09 11:59:38.203332 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:38.203251 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a2ce5048-fe61-42a6-b869-bd1c7afc0a67-data-volume\") pod \"insights-runtime-extractor-8k6gr\" (UID: \"a2ce5048-fe61-42a6-b869-bd1c7afc0a67\") " pod="openshift-insights/insights-runtime-extractor-8k6gr" Jun 09 11:59:38.303792 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:38.303701 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a2ce5048-fe61-42a6-b869-bd1c7afc0a67-crio-socket\") pod \"insights-runtime-extractor-8k6gr\" (UID: \"a2ce5048-fe61-42a6-b869-bd1c7afc0a67\") " pod="openshift-insights/insights-runtime-extractor-8k6gr" Jun 09 11:59:38.303792 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:38.303742 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a2ce5048-fe61-42a6-b869-bd1c7afc0a67-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8k6gr\" (UID: \"a2ce5048-fe61-42a6-b869-bd1c7afc0a67\") " pod="openshift-insights/insights-runtime-extractor-8k6gr" Jun 09 11:59:38.303792 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:38.303789 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a2ce5048-fe61-42a6-b869-bd1c7afc0a67-data-volume\") pod \"insights-runtime-extractor-8k6gr\" (UID: \"a2ce5048-fe61-42a6-b869-bd1c7afc0a67\") " pod="openshift-insights/insights-runtime-extractor-8k6gr" Jun 09 11:59:38.304019 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:38.303806 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a2ce5048-fe61-42a6-b869-bd1c7afc0a67-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8k6gr\" (UID: \"a2ce5048-fe61-42a6-b869-bd1c7afc0a67\") " pod="openshift-insights/insights-runtime-extractor-8k6gr" Jun 09 11:59:38.304019 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:38.303829 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h87l2\" (UniqueName: \"kubernetes.io/projected/a2ce5048-fe61-42a6-b869-bd1c7afc0a67-kube-api-access-h87l2\") pod \"insights-runtime-extractor-8k6gr\" (UID: \"a2ce5048-fe61-42a6-b869-bd1c7afc0a67\") " pod="openshift-insights/insights-runtime-extractor-8k6gr" Jun 09 11:59:38.304019 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:38.303850 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a2ce5048-fe61-42a6-b869-bd1c7afc0a67-crio-socket\") pod \"insights-runtime-extractor-8k6gr\" (UID: \"a2ce5048-fe61-42a6-b869-bd1c7afc0a67\") " pod="openshift-insights/insights-runtime-extractor-8k6gr" Jun 09 11:59:38.304239 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:38.304223 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a2ce5048-fe61-42a6-b869-bd1c7afc0a67-data-volume\") pod \"insights-runtime-extractor-8k6gr\" (UID: \"a2ce5048-fe61-42a6-b869-bd1c7afc0a67\") " pod="openshift-insights/insights-runtime-extractor-8k6gr" Jun 09 11:59:38.304440 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:38.304416 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a2ce5048-fe61-42a6-b869-bd1c7afc0a67-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8k6gr\" (UID: \"a2ce5048-fe61-42a6-b869-bd1c7afc0a67\") " pod="openshift-insights/insights-runtime-extractor-8k6gr" Jun 09 11:59:38.306219 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:38.306201 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a2ce5048-fe61-42a6-b869-bd1c7afc0a67-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8k6gr\" (UID: \"a2ce5048-fe61-42a6-b869-bd1c7afc0a67\") " pod="openshift-insights/insights-runtime-extractor-8k6gr" Jun 09 11:59:38.312846 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:38.312826 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h87l2\" (UniqueName: \"kubernetes.io/projected/a2ce5048-fe61-42a6-b869-bd1c7afc0a67-kube-api-access-h87l2\") pod \"insights-runtime-extractor-8k6gr\" (UID: \"a2ce5048-fe61-42a6-b869-bd1c7afc0a67\") " pod="openshift-insights/insights-runtime-extractor-8k6gr" Jun 09 11:59:38.365800 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:38.365769 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8k6gr" Jun 09 11:59:38.488712 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:38.488683 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8k6gr"] Jun 09 11:59:38.491531 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:59:38.491496 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2ce5048_fe61_42a6_b869_bd1c7afc0a67.slice/crio-10ebf0dc5086430c8ee10481a75b10f6fcf7901b4d67dad8a0563f94dd50f38c WatchSource:0}: Error finding container 10ebf0dc5086430c8ee10481a75b10f6fcf7901b4d67dad8a0563f94dd50f38c: Status 404 returned error can't find the container with id 10ebf0dc5086430c8ee10481a75b10f6fcf7901b4d67dad8a0563f94dd50f38c Jun 09 11:59:38.810880 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:38.810851 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8k6gr" event={"ID":"a2ce5048-fe61-42a6-b869-bd1c7afc0a67","Type":"ContainerStarted","Data":"1db8ea7aed948e260332c99d9027f80fa3cb7aa4c9bde30a3fb464367ac7fed7"} Jun 09 11:59:38.811087 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:38.810901 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8k6gr" event={"ID":"a2ce5048-fe61-42a6-b869-bd1c7afc0a67","Type":"ContainerStarted","Data":"10ebf0dc5086430c8ee10481a75b10f6fcf7901b4d67dad8a0563f94dd50f38c"} Jun 09 11:59:39.816545 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:39.816491 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8k6gr" event={"ID":"a2ce5048-fe61-42a6-b869-bd1c7afc0a67","Type":"ContainerStarted","Data":"8810b9be381fdafd551ffd2be780d7e79b369ba227c055aa312ed75316d1584e"} Jun 09 11:59:41.218235 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:41.218204 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-2kbd5"] Jun 09 11:59:41.236130 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:41.236105 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-2kbd5"] Jun 09 11:59:41.236252 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:41.236202 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-2kbd5" Jun 09 11:59:41.239646 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:41.239511 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-vxvw8\"" Jun 09 11:59:41.239646 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:41.239519 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 09 11:59:41.239646 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:41.239535 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 11:59:41.239646 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:41.239574 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 09 11:59:41.324795 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:41.324760 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a40eb224-264b-469f-b87d-c92452e16872-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-2kbd5\" (UID: \"a40eb224-264b-469f-b87d-c92452e16872\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-2kbd5" Jun 09 11:59:41.324795 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:41.324798 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a40eb224-264b-469f-b87d-c92452e16872-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-2kbd5\" (UID: \"a40eb224-264b-469f-b87d-c92452e16872\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-2kbd5" Jun 09 11:59:41.325021 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:41.324860 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtn25\" (UniqueName: \"kubernetes.io/projected/a40eb224-264b-469f-b87d-c92452e16872-kube-api-access-qtn25\") pod \"prometheus-operator-7f7d445d84-2kbd5\" (UID: \"a40eb224-264b-469f-b87d-c92452e16872\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-2kbd5" Jun 09 11:59:41.325021 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:41.324922 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a40eb224-264b-469f-b87d-c92452e16872-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-2kbd5\" (UID: \"a40eb224-264b-469f-b87d-c92452e16872\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-2kbd5" Jun 09 11:59:41.425630 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:41.425579 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtn25\" (UniqueName: \"kubernetes.io/projected/a40eb224-264b-469f-b87d-c92452e16872-kube-api-access-qtn25\") pod \"prometheus-operator-7f7d445d84-2kbd5\" (UID: \"a40eb224-264b-469f-b87d-c92452e16872\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-2kbd5" Jun 09 11:59:41.425809 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:41.425636 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a40eb224-264b-469f-b87d-c92452e16872-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-2kbd5\" (UID: \"a40eb224-264b-469f-b87d-c92452e16872\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-2kbd5" Jun 09 11:59:41.425809 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:41.425686 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a40eb224-264b-469f-b87d-c92452e16872-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-2kbd5\" (UID: \"a40eb224-264b-469f-b87d-c92452e16872\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-2kbd5" Jun 09 11:59:41.425809 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:41.425705 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a40eb224-264b-469f-b87d-c92452e16872-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-2kbd5\" (UID: \"a40eb224-264b-469f-b87d-c92452e16872\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-2kbd5" Jun 09 11:59:41.426467 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:41.426444 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a40eb224-264b-469f-b87d-c92452e16872-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-2kbd5\" (UID: \"a40eb224-264b-469f-b87d-c92452e16872\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-2kbd5" Jun 09 11:59:41.428101 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:41.428076 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a40eb224-264b-469f-b87d-c92452e16872-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-2kbd5\" (UID: \"a40eb224-264b-469f-b87d-c92452e16872\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-2kbd5" Jun 09 11:59:41.428175 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:41.428151 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a40eb224-264b-469f-b87d-c92452e16872-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-2kbd5\" (UID: \"a40eb224-264b-469f-b87d-c92452e16872\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-2kbd5" Jun 09 11:59:41.433640 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:41.433605 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtn25\" (UniqueName: \"kubernetes.io/projected/a40eb224-264b-469f-b87d-c92452e16872-kube-api-access-qtn25\") pod \"prometheus-operator-7f7d445d84-2kbd5\" (UID: \"a40eb224-264b-469f-b87d-c92452e16872\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-2kbd5" Jun 09 11:59:41.546332 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:41.546247 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-2kbd5" Jun 09 11:59:41.698542 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:41.698509 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-2kbd5"] Jun 09 11:59:41.701304 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:59:41.701279 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda40eb224_264b_469f_b87d_c92452e16872.slice/crio-9bcf924c1812fa2e6a632769447127cff3ce3598267dc1e6bb22d66f00f1d3a4 WatchSource:0}: Error finding container 9bcf924c1812fa2e6a632769447127cff3ce3598267dc1e6bb22d66f00f1d3a4: Status 404 returned error can't find the container with id 9bcf924c1812fa2e6a632769447127cff3ce3598267dc1e6bb22d66f00f1d3a4 Jun 09 11:59:41.828680 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:41.828591 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8k6gr" event={"ID":"a2ce5048-fe61-42a6-b869-bd1c7afc0a67","Type":"ContainerStarted","Data":"4866d0670aa7a39d96262be0c94faa1016d906b60230b14e88038242b5209ae3"} Jun 09 11:59:41.829745 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:41.829724 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-2kbd5" event={"ID":"a40eb224-264b-469f-b87d-c92452e16872","Type":"ContainerStarted","Data":"9bcf924c1812fa2e6a632769447127cff3ce3598267dc1e6bb22d66f00f1d3a4"} Jun 09 11:59:41.855158 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:41.855111 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8k6gr" podStartSLOduration=1.62670694 podStartE2EDuration="3.855100214s" totalImagesPullingTime="2.228393274s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:59:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:59:41.85380274 +0000 UTC m=+278.276360516" watchObservedRunningTime="2026-06-09 11:59:41.855100214 +0000 UTC m=+278.277657988" Jun 09 11:59:43.838048 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:43.838015 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-2kbd5" event={"ID":"a40eb224-264b-469f-b87d-c92452e16872","Type":"ContainerStarted","Data":"b953de4dff6af80a810fcd02a4462e48dd99f741f43eb0d8a5cb7327530d46f9"} Jun 09 11:59:43.838426 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:43.838065 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-2kbd5" event={"ID":"a40eb224-264b-469f-b87d-c92452e16872","Type":"ContainerStarted","Data":"8e311a44645e8b57e8d0fb224db9e52cee03dce7af30fffa5dfbe02705cac00b"} Jun 09 11:59:43.860403 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:43.860351 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-2kbd5" podStartSLOduration=1.645802387 podStartE2EDuration="2.860335407s" totalImagesPullingTime="1.21453302s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:59:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:59:43.858473791 +0000 UTC m=+280.281031586" watchObservedRunningTime="2026-06-09 11:59:43.860335407 +0000 UTC m=+280.282893182" Jun 09 11:59:44.503525 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:59:44.503466 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-pdlth" podUID="447b1c43-1b2e-442c-b9ba-13e5b175df87" Jun 09 11:59:44.841509 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:44.841432 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pdlth" Jun 09 11:59:45.565529 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.565492 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-jgdbp"] Jun 09 11:59:45.568003 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.567982 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jgdbp" Jun 09 11:59:45.570660 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.570466 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 09 11:59:45.570660 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.570544 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 09 11:59:45.570660 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.570636 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-r444x\"" Jun 09 11:59:45.578013 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.577991 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-xcnkg"] Jun 09 11:59:45.580003 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.579977 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xcnkg" Jun 09 11:59:45.581115 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.581058 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-jgdbp"] Jun 09 11:59:45.582258 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.582241 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5k8wf\"" Jun 09 11:59:45.583489 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.583137 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 11:59:45.583489 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.583358 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 11:59:45.584353 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.584326 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-fjqt7"] Jun 09 11:59:45.585757 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.585735 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 11:59:45.587827 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.587404 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-fjqt7" Jun 09 11:59:45.590626 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.590594 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 09 11:59:45.592146 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.592131 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-56c75\"" Jun 09 11:59:45.592754 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.592735 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 09 11:59:45.593317 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.593303 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 09 11:59:45.605862 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.605812 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-fjqt7"] Jun 09 11:59:45.661699 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.661667 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/30ecf080-3b8f-4137-83c3-50565d54bf82-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-jgdbp\" (UID: \"30ecf080-3b8f-4137-83c3-50565d54bf82\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jgdbp" Jun 09 11:59:45.661699 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.661703 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmhrg\" (UniqueName: \"kubernetes.io/projected/30ecf080-3b8f-4137-83c3-50565d54bf82-kube-api-access-pmhrg\") pod \"openshift-state-metrics-65f78d5c66-jgdbp\" (UID: \"30ecf080-3b8f-4137-83c3-50565d54bf82\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jgdbp" Jun 09 11:59:45.661892 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.661750 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/30ecf080-3b8f-4137-83c3-50565d54bf82-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-jgdbp\" (UID: \"30ecf080-3b8f-4137-83c3-50565d54bf82\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jgdbp" Jun 09 11:59:45.661892 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.661825 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30ecf080-3b8f-4137-83c3-50565d54bf82-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-jgdbp\" (UID: \"30ecf080-3b8f-4137-83c3-50565d54bf82\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jgdbp" Jun 09 11:59:45.762180 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.762144 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c600f4e7-0884-4162-80c9-c6d94565c70c-node-exporter-tls\") pod \"node-exporter-xcnkg\" (UID: \"c600f4e7-0884-4162-80c9-c6d94565c70c\") " pod="openshift-monitoring/node-exporter-xcnkg" Jun 09 11:59:45.762180 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.762179 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c600f4e7-0884-4162-80c9-c6d94565c70c-node-exporter-wtmp\") pod \"node-exporter-xcnkg\" (UID: \"c600f4e7-0884-4162-80c9-c6d94565c70c\") " pod="openshift-monitoring/node-exporter-xcnkg" Jun 09 11:59:45.762430 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.762210 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/30ecf080-3b8f-4137-83c3-50565d54bf82-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-jgdbp\" (UID: \"30ecf080-3b8f-4137-83c3-50565d54bf82\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jgdbp" Jun 09 11:59:45.762430 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.762267 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmhrg\" (UniqueName: \"kubernetes.io/projected/30ecf080-3b8f-4137-83c3-50565d54bf82-kube-api-access-pmhrg\") pod \"openshift-state-metrics-65f78d5c66-jgdbp\" (UID: \"30ecf080-3b8f-4137-83c3-50565d54bf82\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jgdbp" Jun 09 11:59:45.762430 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.762306 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxv22\" (UniqueName: \"kubernetes.io/projected/c600f4e7-0884-4162-80c9-c6d94565c70c-kube-api-access-fxv22\") pod \"node-exporter-xcnkg\" (UID: \"c600f4e7-0884-4162-80c9-c6d94565c70c\") " pod="openshift-monitoring/node-exporter-xcnkg" Jun 09 11:59:45.762430 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.762334 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c600f4e7-0884-4162-80c9-c6d94565c70c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xcnkg\" (UID: \"c600f4e7-0884-4162-80c9-c6d94565c70c\") " pod="openshift-monitoring/node-exporter-xcnkg" Jun 09 11:59:45.762430 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.762366 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/30ecf080-3b8f-4137-83c3-50565d54bf82-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-jgdbp\" (UID: \"30ecf080-3b8f-4137-83c3-50565d54bf82\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jgdbp" Jun 09 11:59:45.762430 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.762388 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e65dc36a-35ca-489d-9089-7d1416b51b4f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-fjqt7\" (UID: \"e65dc36a-35ca-489d-9089-7d1416b51b4f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-fjqt7" Jun 09 11:59:45.762761 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.762431 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c600f4e7-0884-4162-80c9-c6d94565c70c-sys\") pod \"node-exporter-xcnkg\" (UID: \"c600f4e7-0884-4162-80c9-c6d94565c70c\") " pod="openshift-monitoring/node-exporter-xcnkg" Jun 09 11:59:45.762761 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:59:45.762473 2577 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 09 11:59:45.762761 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.762474 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c600f4e7-0884-4162-80c9-c6d94565c70c-node-exporter-accelerators-collector-config\") pod \"node-exporter-xcnkg\" (UID: \"c600f4e7-0884-4162-80c9-c6d94565c70c\") " pod="openshift-monitoring/node-exporter-xcnkg" Jun 09 11:59:45.762761 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.762520 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vk5ln\" (UniqueName: \"kubernetes.io/projected/e65dc36a-35ca-489d-9089-7d1416b51b4f-kube-api-access-vk5ln\") pod \"kube-state-metrics-57bbf8bfb5-fjqt7\" (UID: \"e65dc36a-35ca-489d-9089-7d1416b51b4f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-fjqt7" Jun 09 11:59:45.762761 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:59:45.762539 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30ecf080-3b8f-4137-83c3-50565d54bf82-openshift-state-metrics-tls podName:30ecf080-3b8f-4137-83c3-50565d54bf82 nodeName:}" failed. No retries permitted until 2026-06-09 11:59:46.262519063 +0000 UTC m=+282.685076833 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/30ecf080-3b8f-4137-83c3-50565d54bf82-openshift-state-metrics-tls") pod "openshift-state-metrics-65f78d5c66-jgdbp" (UID: "30ecf080-3b8f-4137-83c3-50565d54bf82") : secret "openshift-state-metrics-tls" not found Jun 09 11:59:45.762761 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.762607 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30ecf080-3b8f-4137-83c3-50565d54bf82-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-jgdbp\" (UID: \"30ecf080-3b8f-4137-83c3-50565d54bf82\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jgdbp" Jun 09 11:59:45.762761 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.762660 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e65dc36a-35ca-489d-9089-7d1416b51b4f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-fjqt7\" (UID: \"e65dc36a-35ca-489d-9089-7d1416b51b4f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-fjqt7" Jun 09 11:59:45.762761 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.762695 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c600f4e7-0884-4162-80c9-c6d94565c70c-root\") pod \"node-exporter-xcnkg\" (UID: \"c600f4e7-0884-4162-80c9-c6d94565c70c\") " pod="openshift-monitoring/node-exporter-xcnkg" Jun 09 11:59:45.762761 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.762739 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c600f4e7-0884-4162-80c9-c6d94565c70c-node-exporter-textfile\") pod \"node-exporter-xcnkg\" (UID: \"c600f4e7-0884-4162-80c9-c6d94565c70c\") " pod="openshift-monitoring/node-exporter-xcnkg" Jun 09 11:59:45.763184 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.762775 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e65dc36a-35ca-489d-9089-7d1416b51b4f-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-fjqt7\" (UID: \"e65dc36a-35ca-489d-9089-7d1416b51b4f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-fjqt7" Jun 09 11:59:45.763184 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.762808 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c600f4e7-0884-4162-80c9-c6d94565c70c-metrics-client-ca\") pod \"node-exporter-xcnkg\" (UID: \"c600f4e7-0884-4162-80c9-c6d94565c70c\") " pod="openshift-monitoring/node-exporter-xcnkg" Jun 09 11:59:45.763184 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.762857 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e65dc36a-35ca-489d-9089-7d1416b51b4f-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-fjqt7\" (UID: \"e65dc36a-35ca-489d-9089-7d1416b51b4f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-fjqt7" Jun 09 11:59:45.763184 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.762909 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e65dc36a-35ca-489d-9089-7d1416b51b4f-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-fjqt7\" (UID: \"e65dc36a-35ca-489d-9089-7d1416b51b4f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-fjqt7" Jun 09 11:59:45.763377 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.763244 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30ecf080-3b8f-4137-83c3-50565d54bf82-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-jgdbp\" (UID: \"30ecf080-3b8f-4137-83c3-50565d54bf82\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jgdbp" Jun 09 11:59:45.765218 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.765200 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/30ecf080-3b8f-4137-83c3-50565d54bf82-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-jgdbp\" (UID: \"30ecf080-3b8f-4137-83c3-50565d54bf82\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jgdbp" Jun 09 11:59:45.773322 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.773289 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmhrg\" (UniqueName: \"kubernetes.io/projected/30ecf080-3b8f-4137-83c3-50565d54bf82-kube-api-access-pmhrg\") pod \"openshift-state-metrics-65f78d5c66-jgdbp\" (UID: \"30ecf080-3b8f-4137-83c3-50565d54bf82\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jgdbp" Jun 09 11:59:45.864388 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.864344 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c600f4e7-0884-4162-80c9-c6d94565c70c-metrics-client-ca\") pod \"node-exporter-xcnkg\" (UID: \"c600f4e7-0884-4162-80c9-c6d94565c70c\") " pod="openshift-monitoring/node-exporter-xcnkg" Jun 09 11:59:45.864844 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.864432 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e65dc36a-35ca-489d-9089-7d1416b51b4f-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-fjqt7\" (UID: \"e65dc36a-35ca-489d-9089-7d1416b51b4f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-fjqt7" Jun 09 11:59:45.864844 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.864485 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e65dc36a-35ca-489d-9089-7d1416b51b4f-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-fjqt7\" (UID: \"e65dc36a-35ca-489d-9089-7d1416b51b4f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-fjqt7" Jun 09 11:59:45.864844 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.864521 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c600f4e7-0884-4162-80c9-c6d94565c70c-node-exporter-tls\") pod \"node-exporter-xcnkg\" (UID: \"c600f4e7-0884-4162-80c9-c6d94565c70c\") " pod="openshift-monitoring/node-exporter-xcnkg" Jun 09 11:59:45.864844 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.864546 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c600f4e7-0884-4162-80c9-c6d94565c70c-node-exporter-wtmp\") pod \"node-exporter-xcnkg\" (UID: \"c600f4e7-0884-4162-80c9-c6d94565c70c\") " pod="openshift-monitoring/node-exporter-xcnkg" Jun 09 11:59:45.864844 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.864662 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxv22\" (UniqueName: \"kubernetes.io/projected/c600f4e7-0884-4162-80c9-c6d94565c70c-kube-api-access-fxv22\") pod \"node-exporter-xcnkg\" (UID: \"c600f4e7-0884-4162-80c9-c6d94565c70c\") " pod="openshift-monitoring/node-exporter-xcnkg" Jun 09 11:59:45.864844 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.864726 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c600f4e7-0884-4162-80c9-c6d94565c70c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xcnkg\" (UID: \"c600f4e7-0884-4162-80c9-c6d94565c70c\") " pod="openshift-monitoring/node-exporter-xcnkg" Jun 09 11:59:45.864844 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.864749 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c600f4e7-0884-4162-80c9-c6d94565c70c-node-exporter-wtmp\") pod \"node-exporter-xcnkg\" (UID: \"c600f4e7-0884-4162-80c9-c6d94565c70c\") " pod="openshift-monitoring/node-exporter-xcnkg" Jun 09 11:59:45.864844 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.864783 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e65dc36a-35ca-489d-9089-7d1416b51b4f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-fjqt7\" (UID: \"e65dc36a-35ca-489d-9089-7d1416b51b4f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-fjqt7" Jun 09 11:59:45.864844 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.864817 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c600f4e7-0884-4162-80c9-c6d94565c70c-sys\") pod \"node-exporter-xcnkg\" (UID: \"c600f4e7-0884-4162-80c9-c6d94565c70c\") " pod="openshift-monitoring/node-exporter-xcnkg" Jun 09 11:59:45.865255 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.864952 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c600f4e7-0884-4162-80c9-c6d94565c70c-node-exporter-accelerators-collector-config\") pod \"node-exporter-xcnkg\" (UID: \"c600f4e7-0884-4162-80c9-c6d94565c70c\") " pod="openshift-monitoring/node-exporter-xcnkg" Jun 09 11:59:45.865255 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.865062 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vk5ln\" (UniqueName: \"kubernetes.io/projected/e65dc36a-35ca-489d-9089-7d1416b51b4f-kube-api-access-vk5ln\") pod \"kube-state-metrics-57bbf8bfb5-fjqt7\" (UID: \"e65dc36a-35ca-489d-9089-7d1416b51b4f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-fjqt7" Jun 09 11:59:45.865255 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.865113 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e65dc36a-35ca-489d-9089-7d1416b51b4f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-fjqt7\" (UID: \"e65dc36a-35ca-489d-9089-7d1416b51b4f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-fjqt7" Jun 09 11:59:45.865402 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.865263 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c600f4e7-0884-4162-80c9-c6d94565c70c-root\") pod \"node-exporter-xcnkg\" (UID: \"c600f4e7-0884-4162-80c9-c6d94565c70c\") " pod="openshift-monitoring/node-exporter-xcnkg" Jun 09 11:59:45.865402 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.865309 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c600f4e7-0884-4162-80c9-c6d94565c70c-node-exporter-textfile\") pod \"node-exporter-xcnkg\" (UID: \"c600f4e7-0884-4162-80c9-c6d94565c70c\") " pod="openshift-monitoring/node-exporter-xcnkg" Jun 09 11:59:45.865402 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.865395 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e65dc36a-35ca-489d-9089-7d1416b51b4f-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-fjqt7\" (UID: \"e65dc36a-35ca-489d-9089-7d1416b51b4f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-fjqt7" Jun 09 11:59:45.865542 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.865492 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c600f4e7-0884-4162-80c9-c6d94565c70c-metrics-client-ca\") pod \"node-exporter-xcnkg\" (UID: \"c600f4e7-0884-4162-80c9-c6d94565c70c\") " pod="openshift-monitoring/node-exporter-xcnkg" Jun 09 11:59:45.866510 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.866487 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c600f4e7-0884-4162-80c9-c6d94565c70c-sys\") pod \"node-exporter-xcnkg\" (UID: \"c600f4e7-0884-4162-80c9-c6d94565c70c\") " pod="openshift-monitoring/node-exporter-xcnkg" Jun 09 11:59:45.867934 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:59:45.866895 2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 09 11:59:45.867934 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:59:45.866969 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c600f4e7-0884-4162-80c9-c6d94565c70c-node-exporter-tls podName:c600f4e7-0884-4162-80c9-c6d94565c70c nodeName:}" failed. No retries permitted until 2026-06-09 11:59:46.366941864 +0000 UTC m=+282.789499620 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/c600f4e7-0884-4162-80c9-c6d94565c70c-node-exporter-tls") pod "node-exporter-xcnkg" (UID: "c600f4e7-0884-4162-80c9-c6d94565c70c") : secret "node-exporter-tls" not found Jun 09 11:59:45.868141 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.867951 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c600f4e7-0884-4162-80c9-c6d94565c70c-node-exporter-textfile\") pod \"node-exporter-xcnkg\" (UID: \"c600f4e7-0884-4162-80c9-c6d94565c70c\") " pod="openshift-monitoring/node-exporter-xcnkg" Jun 09 11:59:45.868141 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.867959 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e65dc36a-35ca-489d-9089-7d1416b51b4f-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-fjqt7\" (UID: \"e65dc36a-35ca-489d-9089-7d1416b51b4f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-fjqt7" Jun 09 11:59:45.876516 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.868602 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c600f4e7-0884-4162-80c9-c6d94565c70c-node-exporter-accelerators-collector-config\") pod \"node-exporter-xcnkg\" (UID: \"c600f4e7-0884-4162-80c9-c6d94565c70c\") " pod="openshift-monitoring/node-exporter-xcnkg" Jun 09 11:59:45.876516 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.868841 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c600f4e7-0884-4162-80c9-c6d94565c70c-root\") pod \"node-exporter-xcnkg\" (UID: \"c600f4e7-0884-4162-80c9-c6d94565c70c\") " pod="openshift-monitoring/node-exporter-xcnkg" Jun 09 11:59:45.876516 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.874484 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c600f4e7-0884-4162-80c9-c6d94565c70c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xcnkg\" (UID: \"c600f4e7-0884-4162-80c9-c6d94565c70c\") " pod="openshift-monitoring/node-exporter-xcnkg" Jun 09 11:59:45.876516 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.876298 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxv22\" (UniqueName: \"kubernetes.io/projected/c600f4e7-0884-4162-80c9-c6d94565c70c-kube-api-access-fxv22\") pod \"node-exporter-xcnkg\" (UID: \"c600f4e7-0884-4162-80c9-c6d94565c70c\") " pod="openshift-monitoring/node-exporter-xcnkg" Jun 09 11:59:45.877575 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.877269 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e65dc36a-35ca-489d-9089-7d1416b51b4f-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-fjqt7\" (UID: \"e65dc36a-35ca-489d-9089-7d1416b51b4f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-fjqt7" Jun 09 11:59:45.877575 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.877378 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e65dc36a-35ca-489d-9089-7d1416b51b4f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-fjqt7\" (UID: \"e65dc36a-35ca-489d-9089-7d1416b51b4f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-fjqt7" Jun 09 11:59:45.878663 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.878548 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e65dc36a-35ca-489d-9089-7d1416b51b4f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-fjqt7\" (UID: \"e65dc36a-35ca-489d-9089-7d1416b51b4f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-fjqt7" Jun 09 11:59:45.880913 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.880872 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vk5ln\" (UniqueName: \"kubernetes.io/projected/e65dc36a-35ca-489d-9089-7d1416b51b4f-kube-api-access-vk5ln\") pod \"kube-state-metrics-57bbf8bfb5-fjqt7\" (UID: \"e65dc36a-35ca-489d-9089-7d1416b51b4f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-fjqt7" Jun 09 11:59:45.881284 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.881263 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e65dc36a-35ca-489d-9089-7d1416b51b4f-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-fjqt7\" (UID: \"e65dc36a-35ca-489d-9089-7d1416b51b4f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-fjqt7" Jun 09 11:59:45.901360 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:45.901335 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-fjqt7" Jun 09 11:59:46.043298 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:59:46.043260 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode65dc36a_35ca_489d_9089_7d1416b51b4f.slice/crio-7026375d4d751015628113b4998e4312bee4d79407da8b5e52c21342a798a4bb WatchSource:0}: Error finding container 7026375d4d751015628113b4998e4312bee4d79407da8b5e52c21342a798a4bb: Status 404 returned error can't find the container with id 7026375d4d751015628113b4998e4312bee4d79407da8b5e52c21342a798a4bb Jun 09 11:59:46.043478 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.043456 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-fjqt7"] Jun 09 11:59:46.269793 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.269703 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/30ecf080-3b8f-4137-83c3-50565d54bf82-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-jgdbp\" (UID: \"30ecf080-3b8f-4137-83c3-50565d54bf82\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jgdbp" Jun 09 11:59:46.271957 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.271938 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/30ecf080-3b8f-4137-83c3-50565d54bf82-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-jgdbp\" (UID: \"30ecf080-3b8f-4137-83c3-50565d54bf82\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jgdbp" Jun 09 11:59:46.371197 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.371164 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c600f4e7-0884-4162-80c9-c6d94565c70c-node-exporter-tls\") pod \"node-exporter-xcnkg\" (UID: \"c600f4e7-0884-4162-80c9-c6d94565c70c\") " pod="openshift-monitoring/node-exporter-xcnkg" Jun 09 11:59:46.371360 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:59:46.371280 2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 09 11:59:46.371360 ip-10-0-133-80 kubenswrapper[2577]: E0609 11:59:46.371337 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c600f4e7-0884-4162-80c9-c6d94565c70c-node-exporter-tls podName:c600f4e7-0884-4162-80c9-c6d94565c70c nodeName:}" failed. No retries permitted until 2026-06-09 11:59:47.371324608 +0000 UTC m=+283.793882362 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/c600f4e7-0884-4162-80c9-c6d94565c70c-node-exporter-tls") pod "node-exporter-xcnkg" (UID: "c600f4e7-0884-4162-80c9-c6d94565c70c") : secret "node-exporter-tls" not found Jun 09 11:59:46.478301 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.478267 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jgdbp" Jun 09 11:59:46.646583 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.646553 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-jgdbp"] Jun 09 11:59:46.650139 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:59:46.650104 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30ecf080_3b8f_4137_83c3_50565d54bf82.slice/crio-28188f0198062ad7053473f01cf294bc403370d06792600675f33480cb0846a1 WatchSource:0}: Error finding container 28188f0198062ad7053473f01cf294bc403370d06792600675f33480cb0846a1: Status 404 returned error can't find the container with id 28188f0198062ad7053473f01cf294bc403370d06792600675f33480cb0846a1 Jun 09 11:59:46.656798 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.656777 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 11:59:46.660329 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.660311 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:59:46.663193 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.663161 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 09 11:59:46.665304 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.665189 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 09 11:59:46.666273 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.666003 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 09 11:59:46.666273 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.666117 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 09 11:59:46.666273 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.666117 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 09 11:59:46.666469 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.666411 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vwk2r\"" Jun 09 11:59:46.666767 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.666746 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 09 11:59:46.677854 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.677645 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 09 11:59:46.677854 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.677694 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 09 11:59:46.678734 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.678704 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 09 11:59:46.681754 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.681672 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 11:59:46.776866 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.776175 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e9ccb63a-d996-4630-936b-c5a1cc3530a4-config-out\") pod \"alertmanager-main-0\" (UID: \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:59:46.776866 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.776216 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9ccb63a-d996-4630-936b-c5a1cc3530a4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:59:46.776866 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.776291 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e9ccb63a-d996-4630-936b-c5a1cc3530a4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:59:46.776866 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.776330 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e9ccb63a-d996-4630-936b-c5a1cc3530a4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:59:46.776866 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.776359 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e9ccb63a-d996-4630-936b-c5a1cc3530a4-web-config\") pod \"alertmanager-main-0\" (UID: \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:59:46.776866 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.776384 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9ccb63a-d996-4630-936b-c5a1cc3530a4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:59:46.776866 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.776410 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e9ccb63a-d996-4630-936b-c5a1cc3530a4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:59:46.776866 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.776444 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hngct\" (UniqueName: \"kubernetes.io/projected/e9ccb63a-d996-4630-936b-c5a1cc3530a4-kube-api-access-hngct\") pod \"alertmanager-main-0\" (UID: \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:59:46.776866 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.776473 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e9ccb63a-d996-4630-936b-c5a1cc3530a4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:59:46.776866 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.776510 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e9ccb63a-d996-4630-936b-c5a1cc3530a4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:59:46.776866 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.776556 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e9ccb63a-d996-4630-936b-c5a1cc3530a4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:59:46.776866 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.776587 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e9ccb63a-d996-4630-936b-c5a1cc3530a4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:59:46.776866 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.776631 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e9ccb63a-d996-4630-936b-c5a1cc3530a4-config-volume\") pod \"alertmanager-main-0\" (UID: \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:59:46.851536 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.851487 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-fjqt7" event={"ID":"e65dc36a-35ca-489d-9089-7d1416b51b4f","Type":"ContainerStarted","Data":"7026375d4d751015628113b4998e4312bee4d79407da8b5e52c21342a798a4bb"} Jun 09 11:59:46.853314 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.853288 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jgdbp" event={"ID":"30ecf080-3b8f-4137-83c3-50565d54bf82","Type":"ContainerStarted","Data":"4c8d40ccf8067ed76f247241cea08d19b8cbb986f38304f78e572098298cbe00"} Jun 09 11:59:46.853399 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.853346 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jgdbp" event={"ID":"30ecf080-3b8f-4137-83c3-50565d54bf82","Type":"ContainerStarted","Data":"4019d52bb06628b1a0a4b40784c2cf1522adf7002cafcfd9fcdd68260857551e"} Jun 09 11:59:46.853399 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.853375 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jgdbp" event={"ID":"30ecf080-3b8f-4137-83c3-50565d54bf82","Type":"ContainerStarted","Data":"28188f0198062ad7053473f01cf294bc403370d06792600675f33480cb0846a1"} Jun 09 11:59:46.877167 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.877138 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e9ccb63a-d996-4630-936b-c5a1cc3530a4-web-config\") pod \"alertmanager-main-0\" (UID: \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:59:46.878766 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.877178 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9ccb63a-d996-4630-936b-c5a1cc3530a4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:59:46.878766 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.877205 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e9ccb63a-d996-4630-936b-c5a1cc3530a4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:59:46.878766 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.877237 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hngct\" (UniqueName: \"kubernetes.io/projected/e9ccb63a-d996-4630-936b-c5a1cc3530a4-kube-api-access-hngct\") pod \"alertmanager-main-0\" (UID: \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:59:46.878766 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.877280 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e9ccb63a-d996-4630-936b-c5a1cc3530a4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:59:46.878766 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.877325 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e9ccb63a-d996-4630-936b-c5a1cc3530a4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:59:46.878766 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.877387 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e9ccb63a-d996-4630-936b-c5a1cc3530a4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:59:46.878766 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.877418 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e9ccb63a-d996-4630-936b-c5a1cc3530a4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:59:46.878766 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.877468 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e9ccb63a-d996-4630-936b-c5a1cc3530a4-config-volume\") pod \"alertmanager-main-0\" (UID: \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:59:46.878766 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.877501 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e9ccb63a-d996-4630-936b-c5a1cc3530a4-config-out\") pod \"alertmanager-main-0\" (UID: \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:59:46.878766 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.877526 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9ccb63a-d996-4630-936b-c5a1cc3530a4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:59:46.878766 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.877597 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e9ccb63a-d996-4630-936b-c5a1cc3530a4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:59:46.878766 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.877678 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e9ccb63a-d996-4630-936b-c5a1cc3530a4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:59:46.878766 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.878474 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e9ccb63a-d996-4630-936b-c5a1cc3530a4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:59:46.880941 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.880089 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9ccb63a-d996-4630-936b-c5a1cc3530a4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:59:46.880941 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.880443 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e9ccb63a-d996-4630-936b-c5a1cc3530a4-web-config\") pod \"alertmanager-main-0\" (UID: \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:59:46.880941 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.880894 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9ccb63a-d996-4630-936b-c5a1cc3530a4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:59:46.882577 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.882534 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e9ccb63a-d996-4630-936b-c5a1cc3530a4-config-volume\") pod \"alertmanager-main-0\" (UID: \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:59:46.884140 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.884084 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e9ccb63a-d996-4630-936b-c5a1cc3530a4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:59:46.884655 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.884592 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e9ccb63a-d996-4630-936b-c5a1cc3530a4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:59:46.885521 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.885111 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e9ccb63a-d996-4630-936b-c5a1cc3530a4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:59:46.885521 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.885346 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e9ccb63a-d996-4630-936b-c5a1cc3530a4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:59:46.886190 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.886147 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e9ccb63a-d996-4630-936b-c5a1cc3530a4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:59:46.887467 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.887443 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e9ccb63a-d996-4630-936b-c5a1cc3530a4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:59:46.888187 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.888148 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e9ccb63a-d996-4630-936b-c5a1cc3530a4-config-out\") pod \"alertmanager-main-0\" (UID: \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:59:46.890669 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.890627 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hngct\" (UniqueName: \"kubernetes.io/projected/e9ccb63a-d996-4630-936b-c5a1cc3530a4-kube-api-access-hngct\") pod \"alertmanager-main-0\" (UID: \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:59:46.974042 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:46.974011 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:59:47.128957 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:47.128796 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 11:59:47.321738 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:59:47.321641 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9ccb63a_d996_4630_936b_c5a1cc3530a4.slice/crio-da1fff17a3bc12577e81d0b32164f9b0014306e0892a94de4a14c857bc36788f WatchSource:0}: Error finding container da1fff17a3bc12577e81d0b32164f9b0014306e0892a94de4a14c857bc36788f: Status 404 returned error can't find the container with id da1fff17a3bc12577e81d0b32164f9b0014306e0892a94de4a14c857bc36788f Jun 09 11:59:47.383161 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:47.383129 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c600f4e7-0884-4162-80c9-c6d94565c70c-node-exporter-tls\") pod \"node-exporter-xcnkg\" (UID: \"c600f4e7-0884-4162-80c9-c6d94565c70c\") " pod="openshift-monitoring/node-exporter-xcnkg" Jun 09 11:59:47.385433 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:47.385410 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c600f4e7-0884-4162-80c9-c6d94565c70c-node-exporter-tls\") pod \"node-exporter-xcnkg\" (UID: \"c600f4e7-0884-4162-80c9-c6d94565c70c\") " pod="openshift-monitoring/node-exporter-xcnkg" Jun 09 11:59:47.394479 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:47.394458 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xcnkg" Jun 09 11:59:47.406958 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:59:47.406917 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc600f4e7_0884_4162_80c9_c6d94565c70c.slice/crio-c521145cd524af1e3512ee261f2c3119d09844dc2df0d3435e6b409a7fe9fcb0 WatchSource:0}: Error finding container c521145cd524af1e3512ee261f2c3119d09844dc2df0d3435e6b409a7fe9fcb0: Status 404 returned error can't find the container with id c521145cd524af1e3512ee261f2c3119d09844dc2df0d3435e6b409a7fe9fcb0 Jun 09 11:59:47.862645 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:47.862208 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-fjqt7" event={"ID":"e65dc36a-35ca-489d-9089-7d1416b51b4f","Type":"ContainerStarted","Data":"7de7a137c9e3069287a6dbe4f517b76e8e25c09eb8571f69072a0d875db085e3"} Jun 09 11:59:47.862645 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:47.862277 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-fjqt7" event={"ID":"e65dc36a-35ca-489d-9089-7d1416b51b4f","Type":"ContainerStarted","Data":"833170c6e2f6c4266bec0f733a3376a8ef3632014b707705f6c1eab1932760a8"} Jun 09 11:59:47.862645 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:47.862313 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-fjqt7" event={"ID":"e65dc36a-35ca-489d-9089-7d1416b51b4f","Type":"ContainerStarted","Data":"2cce3d9c9a1e4f55dbd107fff0e019c1bee43965a472bfa55899cb360f621258"} Jun 09 11:59:47.864115 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:47.864088 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xcnkg" event={"ID":"c600f4e7-0884-4162-80c9-c6d94565c70c","Type":"ContainerStarted","Data":"c521145cd524af1e3512ee261f2c3119d09844dc2df0d3435e6b409a7fe9fcb0"} Jun 09 11:59:47.865720 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:47.865651 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9ccb63a-d996-4630-936b-c5a1cc3530a4","Type":"ContainerStarted","Data":"da1fff17a3bc12577e81d0b32164f9b0014306e0892a94de4a14c857bc36788f"} Jun 09 11:59:47.897268 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:47.897169 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-fjqt7" podStartSLOduration=1.577193931 podStartE2EDuration="2.897144258s" totalImagesPullingTime="1.319950327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:59:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:59:47.896166705 +0000 UTC m=+284.318724522" watchObservedRunningTime="2026-06-09 11:59:47.897144258 +0000 UTC m=+284.319702035" Jun 09 11:59:48.061372 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:48.061339 2577 patch_prober.go:28] interesting pod/image-registry-5c74ff5cff-rflz7 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 11:59:48.061520 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:48.061393 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5c74ff5cff-rflz7" podUID="d17337fd-8815-4f95-bc78-d713701722af" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 11:59:48.394353 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:48.394308 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/447b1c43-1b2e-442c-b9ba-13e5b175df87-metrics-tls\") pod \"dns-default-pdlth\" (UID: \"447b1c43-1b2e-442c-b9ba-13e5b175df87\") " pod="openshift-dns/dns-default-pdlth" Jun 09 11:59:48.396868 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:48.396839 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/447b1c43-1b2e-442c-b9ba-13e5b175df87-metrics-tls\") pod \"dns-default-pdlth\" (UID: \"447b1c43-1b2e-442c-b9ba-13e5b175df87\") " pod="openshift-dns/dns-default-pdlth" Jun 09 11:59:48.444381 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:48.444351 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xs666\"" Jun 09 11:59:48.452775 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:48.452742 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pdlth" Jun 09 11:59:48.718526 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:48.718501 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pdlth"] Jun 09 11:59:48.732507 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:59:48.732476 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod447b1c43_1b2e_442c_b9ba_13e5b175df87.slice/crio-12f1936537a5a19e039fa8e73c63395cc4f22a68d76d51fca5ea0249f6cab3b3 WatchSource:0}: Error finding container 12f1936537a5a19e039fa8e73c63395cc4f22a68d76d51fca5ea0249f6cab3b3: Status 404 returned error can't find the container with id 12f1936537a5a19e039fa8e73c63395cc4f22a68d76d51fca5ea0249f6cab3b3 Jun 09 11:59:48.870817 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:48.870786 2577 generic.go:356] "Generic (PLEG): container finished" podID="c600f4e7-0884-4162-80c9-c6d94565c70c" containerID="a41ae070d4a064491c9d0c5e2a2ea976a061ffb5b2829c4919d1fff8dcb836b7" exitCode=0 Jun 09 11:59:48.871004 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:48.870875 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xcnkg" event={"ID":"c600f4e7-0884-4162-80c9-c6d94565c70c","Type":"ContainerDied","Data":"a41ae070d4a064491c9d0c5e2a2ea976a061ffb5b2829c4919d1fff8dcb836b7"} Jun 09 11:59:48.872538 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:48.872510 2577 generic.go:356] "Generic (PLEG): container finished" podID="e9ccb63a-d996-4630-936b-c5a1cc3530a4" containerID="ded3f6e5abab4b6a8183e5abc42e6a7bbe04d7304b9db173f7717d1746ae3784" exitCode=0 Jun 09 11:59:48.872699 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:48.872603 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9ccb63a-d996-4630-936b-c5a1cc3530a4","Type":"ContainerDied","Data":"ded3f6e5abab4b6a8183e5abc42e6a7bbe04d7304b9db173f7717d1746ae3784"} Jun 09 11:59:48.875054 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:48.874929 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jgdbp" event={"ID":"30ecf080-3b8f-4137-83c3-50565d54bf82","Type":"ContainerStarted","Data":"ec771c43674f43dd2a794776464fc3dc94212bd037cda1bcd328c8bb0f068ba9"} Jun 09 11:59:48.876252 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:48.876230 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pdlth" event={"ID":"447b1c43-1b2e-442c-b9ba-13e5b175df87","Type":"ContainerStarted","Data":"12f1936537a5a19e039fa8e73c63395cc4f22a68d76d51fca5ea0249f6cab3b3"} Jun 09 11:59:48.914077 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:48.914033 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jgdbp" podStartSLOduration=2.156167297 podStartE2EDuration="3.914014664s" totalImagesPullingTime="1.757847367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:59:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:59:48.912522593 +0000 UTC m=+285.335080397" watchObservedRunningTime="2026-06-09 11:59:48.914014664 +0000 UTC m=+285.336572441" Jun 09 11:59:49.882581 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:49.882544 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xcnkg" event={"ID":"c600f4e7-0884-4162-80c9-c6d94565c70c","Type":"ContainerStarted","Data":"740771cf58022d7fbb87be1a4993ea8fa1fafa833b109aee7c2e34498b9ea1ac"} Jun 09 11:59:49.882785 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:49.882595 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xcnkg" event={"ID":"c600f4e7-0884-4162-80c9-c6d94565c70c","Type":"ContainerStarted","Data":"9080781743f8ff77941f012562f7824e9913f7d84d97d320f78eb318ffdd5c39"} Jun 09 11:59:49.904663 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:49.904590 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-xcnkg" podStartSLOduration=3.612316765 podStartE2EDuration="4.904571285s" totalImagesPullingTime="1.213427367s" totalInitContainerRuntime="78.827153ms" isStatefulPod=true podCreationTimestamp="2026-06-09 11:59:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:59:49.90346847 +0000 UTC m=+286.326026264" watchObservedRunningTime="2026-06-09 11:59:49.904571285 +0000 UTC m=+286.327129059" Jun 09 11:59:50.888163 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:50.888104 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pdlth" event={"ID":"447b1c43-1b2e-442c-b9ba-13e5b175df87","Type":"ContainerStarted","Data":"06c1c969ba6b89076fb6e04ee1cf7d130415593984de143461075ac04aa94aaf"} Jun 09 11:59:50.888634 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:50.888165 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pdlth" event={"ID":"447b1c43-1b2e-442c-b9ba-13e5b175df87","Type":"ContainerStarted","Data":"a082628255c03c5e5f6e1226da95da63c91dd6ea1c28d5b591ef3bbf1440ccee"} Jun 09 11:59:50.888634 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:50.888219 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pdlth" Jun 09 11:59:50.891558 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:50.891534 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9ccb63a-d996-4630-936b-c5a1cc3530a4","Type":"ContainerStarted","Data":"22d0ceac63111801e1df708d2a748686ae2f1c50dafe243a2c6e2ad1529bb7b4"} Jun 09 11:59:50.891839 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:50.891599 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9ccb63a-d996-4630-936b-c5a1cc3530a4","Type":"ContainerStarted","Data":"fd4db49e83863ebd34d9054caf27665054730771790efb1d21dce746211d8460"} Jun 09 11:59:50.891839 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:50.891658 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9ccb63a-d996-4630-936b-c5a1cc3530a4","Type":"ContainerStarted","Data":"4b260b2ccf40aaf9e9192853c075375beeba42379b18a54a1ed2ccc588ab6de0"} Jun 09 11:59:50.891839 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:50.891704 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9ccb63a-d996-4630-936b-c5a1cc3530a4","Type":"ContainerStarted","Data":"243c7fdd8c858d7ec0bbab7d247d245b6deccd169b856ff6b04db8d7a3ed9dae"} Jun 09 11:59:50.891839 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:50.891731 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9ccb63a-d996-4630-936b-c5a1cc3530a4","Type":"ContainerStarted","Data":"db3586f252c4abeee804dd8852a4714318c993cff2ec036dece56fd56265635d"} Jun 09 11:59:50.911541 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:50.908832 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-pdlth" podStartSLOduration=251.112043704 podStartE2EDuration="4m12.908813462s" totalImagesPullingTime="1.796769758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:55:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:59:50.90556397 +0000 UTC m=+287.328121746" watchObservedRunningTime="2026-06-09 11:59:50.908813462 +0000 UTC m=+287.331371239" Jun 09 11:59:51.792546 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.792454 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 11:59:51.796871 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.796846 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.799653 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.799605 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 09 11:59:51.799906 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.799887 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 09 11:59:51.800197 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.800179 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 09 11:59:51.800376 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.800360 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-bhbw4\"" Jun 09 11:59:51.800553 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.800536 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 09 11:59:51.800934 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.800832 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 09 11:59:51.800934 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.800870 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 09 11:59:51.800934 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.800912 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 09 11:59:51.801114 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.801032 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 09 11:59:51.801114 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.801058 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 09 11:59:51.801114 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.801083 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 09 11:59:51.801317 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.801300 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 09 11:59:51.801367 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.801351 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 09 11:59:51.801574 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.801552 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 09 11:59:51.802103 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.802072 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3aoffovrh5ab4\"" Jun 09 11:59:51.802240 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.802120 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 09 11:59:51.804977 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.804960 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 09 11:59:51.815721 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.815696 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 11:59:51.831220 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.831183 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/59b14c47-4d37-4853-8b37-7edfbcaaed09-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.831377 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.831224 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/59b14c47-4d37-4853-8b37-7edfbcaaed09-config\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.831377 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.831253 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/59b14c47-4d37-4853-8b37-7edfbcaaed09-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.831377 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.831317 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/59b14c47-4d37-4853-8b37-7edfbcaaed09-web-config\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.831377 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.831366 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/59b14c47-4d37-4853-8b37-7edfbcaaed09-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.831540 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.831391 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/59b14c47-4d37-4853-8b37-7edfbcaaed09-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.831540 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.831415 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59b14c47-4d37-4853-8b37-7edfbcaaed09-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.831540 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.831487 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/59b14c47-4d37-4853-8b37-7edfbcaaed09-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.831540 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.831535 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59b14c47-4d37-4853-8b37-7edfbcaaed09-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.831703 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.831574 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/59b14c47-4d37-4853-8b37-7edfbcaaed09-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.831703 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.831625 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58xww\" (UniqueName: \"kubernetes.io/projected/59b14c47-4d37-4853-8b37-7edfbcaaed09-kube-api-access-58xww\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.831703 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.831662 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/59b14c47-4d37-4853-8b37-7edfbcaaed09-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.831802 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.831726 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59b14c47-4d37-4853-8b37-7edfbcaaed09-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.831802 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.831751 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/59b14c47-4d37-4853-8b37-7edfbcaaed09-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.831802 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.831774 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/59b14c47-4d37-4853-8b37-7edfbcaaed09-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.831904 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.831798 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/59b14c47-4d37-4853-8b37-7edfbcaaed09-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.831904 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.831865 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/59b14c47-4d37-4853-8b37-7edfbcaaed09-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.831974 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.831901 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/59b14c47-4d37-4853-8b37-7edfbcaaed09-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.831974 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.831963 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/59b14c47-4d37-4853-8b37-7edfbcaaed09-config-out\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.832063 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.831988 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59b14c47-4d37-4853-8b37-7edfbcaaed09-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.898733 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.898698 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9ccb63a-d996-4630-936b-c5a1cc3530a4","Type":"ContainerStarted","Data":"33d44d06d25e8d40424668727ed85b31299628cf766b862032e8dd96906443a5"} Jun 09 11:59:51.926686 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.926635 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.393103016 podStartE2EDuration="5.926603618s" totalImagesPullingTime="3.51100693s" totalInitContainerRuntime="22.493672ms" isStatefulPod=false podCreationTimestamp="2026-06-09 11:59:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:59:51.924643934 +0000 UTC m=+288.347201709" watchObservedRunningTime="2026-06-09 11:59:51.926603618 +0000 UTC m=+288.349161398" Jun 09 11:59:51.932814 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.932793 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58xww\" (UniqueName: \"kubernetes.io/projected/59b14c47-4d37-4853-8b37-7edfbcaaed09-kube-api-access-58xww\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.932915 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.932823 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/59b14c47-4d37-4853-8b37-7edfbcaaed09-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.932915 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.932870 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59b14c47-4d37-4853-8b37-7edfbcaaed09-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.932915 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.932895 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/59b14c47-4d37-4853-8b37-7edfbcaaed09-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.933093 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.932918 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/59b14c47-4d37-4853-8b37-7edfbcaaed09-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.933093 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.932941 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/59b14c47-4d37-4853-8b37-7edfbcaaed09-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.933093 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.933042 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/59b14c47-4d37-4853-8b37-7edfbcaaed09-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.933093 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.933067 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/59b14c47-4d37-4853-8b37-7edfbcaaed09-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.933283 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.933124 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/59b14c47-4d37-4853-8b37-7edfbcaaed09-config-out\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.933283 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.933149 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59b14c47-4d37-4853-8b37-7edfbcaaed09-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.933283 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.933209 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/59b14c47-4d37-4853-8b37-7edfbcaaed09-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.933283 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.933275 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/59b14c47-4d37-4853-8b37-7edfbcaaed09-config\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.933481 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.933307 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/59b14c47-4d37-4853-8b37-7edfbcaaed09-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.933481 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.933348 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/59b14c47-4d37-4853-8b37-7edfbcaaed09-web-config\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.933481 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.933391 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/59b14c47-4d37-4853-8b37-7edfbcaaed09-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.933481 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.933414 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/59b14c47-4d37-4853-8b37-7edfbcaaed09-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.933481 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.933448 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59b14c47-4d37-4853-8b37-7edfbcaaed09-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.933735 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.933543 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/59b14c47-4d37-4853-8b37-7edfbcaaed09-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.933735 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.933546 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/59b14c47-4d37-4853-8b37-7edfbcaaed09-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.933735 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.933567 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59b14c47-4d37-4853-8b37-7edfbcaaed09-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.933735 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.933600 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/59b14c47-4d37-4853-8b37-7edfbcaaed09-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.934130 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.934104 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59b14c47-4d37-4853-8b37-7edfbcaaed09-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.935297 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.934787 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/59b14c47-4d37-4853-8b37-7edfbcaaed09-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.935297 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.935288 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59b14c47-4d37-4853-8b37-7edfbcaaed09-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.937028 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.936569 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/59b14c47-4d37-4853-8b37-7edfbcaaed09-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.937028 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.936641 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/59b14c47-4d37-4853-8b37-7edfbcaaed09-web-config\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.937028 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.936817 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/59b14c47-4d37-4853-8b37-7edfbcaaed09-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.938357 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.938218 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/59b14c47-4d37-4853-8b37-7edfbcaaed09-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.939182 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.939010 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/59b14c47-4d37-4853-8b37-7edfbcaaed09-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.940899 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.940858 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/59b14c47-4d37-4853-8b37-7edfbcaaed09-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.940993 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.940938 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59b14c47-4d37-4853-8b37-7edfbcaaed09-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.940993 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.940945 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/59b14c47-4d37-4853-8b37-7edfbcaaed09-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.941339 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.941299 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/59b14c47-4d37-4853-8b37-7edfbcaaed09-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.941533 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.941499 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/59b14c47-4d37-4853-8b37-7edfbcaaed09-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.941604 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.941527 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/59b14c47-4d37-4853-8b37-7edfbcaaed09-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.941681 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.941636 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/59b14c47-4d37-4853-8b37-7edfbcaaed09-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.941739 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.941721 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/59b14c47-4d37-4853-8b37-7edfbcaaed09-config-out\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.942035 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.942012 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/59b14c47-4d37-4853-8b37-7edfbcaaed09-config\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.942176 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.942154 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59b14c47-4d37-4853-8b37-7edfbcaaed09-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:51.943866 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:51.943845 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58xww\" (UniqueName: \"kubernetes.io/projected/59b14c47-4d37-4853-8b37-7edfbcaaed09-kube-api-access-58xww\") pod \"prometheus-k8s-0\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:52.109676 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:52.109585 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:52.267284 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:52.267247 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 11:59:52.269996 ip-10-0-133-80 kubenswrapper[2577]: W0609 11:59:52.269972 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59b14c47_4d37_4853_8b37_7edfbcaaed09.slice/crio-0184a100785bcf4f526be4658aca0ae493e65a7e02e62501648b897ae1dc872a WatchSource:0}: Error finding container 0184a100785bcf4f526be4658aca0ae493e65a7e02e62501648b897ae1dc872a: Status 404 returned error can't find the container with id 0184a100785bcf4f526be4658aca0ae493e65a7e02e62501648b897ae1dc872a Jun 09 11:59:52.903985 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:52.903951 2577 generic.go:356] "Generic (PLEG): container finished" podID="59b14c47-4d37-4853-8b37-7edfbcaaed09" containerID="d9829f3d42335bac94071a71dbc31541734570ca84a1b910ee8ee2462d8e3273" exitCode=0 Jun 09 11:59:52.904355 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:52.904034 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"59b14c47-4d37-4853-8b37-7edfbcaaed09","Type":"ContainerDied","Data":"d9829f3d42335bac94071a71dbc31541734570ca84a1b910ee8ee2462d8e3273"} Jun 09 11:59:52.904355 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:52.904104 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"59b14c47-4d37-4853-8b37-7edfbcaaed09","Type":"ContainerStarted","Data":"0184a100785bcf4f526be4658aca0ae493e65a7e02e62501648b897ae1dc872a"} Jun 09 11:59:55.920826 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:55.920638 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"59b14c47-4d37-4853-8b37-7edfbcaaed09","Type":"ContainerStarted","Data":"b1f1cde9ac750bde508b7d950f4d027a32e201764dda6c2199f807a692087c95"} Jun 09 11:59:55.920826 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:55.920737 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"59b14c47-4d37-4853-8b37-7edfbcaaed09","Type":"ContainerStarted","Data":"d5c1ba6b29e2911e24aeba41b355d3078ed3b8325373570e11de80997f2fbbfc"} Jun 09 11:59:57.937484 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:57.937441 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"59b14c47-4d37-4853-8b37-7edfbcaaed09","Type":"ContainerStarted","Data":"19dc7f1849d14a348a93c9bd2836e68755bff3079e079161a44744b978caefcd"} Jun 09 11:59:57.937906 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:57.937567 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"59b14c47-4d37-4853-8b37-7edfbcaaed09","Type":"ContainerStarted","Data":"3a260ee540e09e7ecf8cc5d682ab2afa205d4620c46bedfdab2ee982b6edfbc1"} Jun 09 11:59:57.937906 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:57.937626 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"59b14c47-4d37-4853-8b37-7edfbcaaed09","Type":"ContainerStarted","Data":"4e8944c31b4f81066e7e718bc7372483859b4164c1bc1a9a97ee6d8ca37a9bac"} Jun 09 11:59:57.937906 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:57.937671 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"59b14c47-4d37-4853-8b37-7edfbcaaed09","Type":"ContainerStarted","Data":"f23948441119f155ea2617198402b893fa7c5a6330b4f20111976283a388da2f"} Jun 09 11:59:57.970382 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:57.970326 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.383615235 podStartE2EDuration="6.970309765s" totalImagesPullingTime="4.56983111s" totalInitContainerRuntime="16.86342ms" isStatefulPod=false podCreationTimestamp="2026-06-09 11:59:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:59:57.968033085 +0000 UTC m=+294.390590908" watchObservedRunningTime="2026-06-09 11:59:57.970309765 +0000 UTC m=+294.392867540" Jun 09 11:59:58.060183 ip-10-0-133-80 kubenswrapper[2577]: I0609 11:59:58.060156 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5c74ff5cff-rflz7" Jun 09 12:00:00.901249 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:00:00.901221 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pdlth" Jun 09 12:00:01.039631 ip-10-0-133-80 kubenswrapper[2577]: E0609 12:00:01.039573 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-cvhwb" podUID="e14c077a-6021-4bf9-a3e7-ae5ca648b191" Jun 09 12:00:02.110559 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:00:02.110521 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:00:03.076182 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:00:03.076140 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5c74ff5cff-rflz7" podUID="d17337fd-8815-4f95-bc78-d713701722af" containerName="registry" containerID="cri-o://be3ff98432ef45b82ef9003a12e751eedcbc8ce2a3842827c35f55e985e3e609" gracePeriod=30 Jun 09 12:00:03.326989 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:00:03.326927 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c74ff5cff-rflz7" Jun 09 12:00:03.441944 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:00:03.441907 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d17337fd-8815-4f95-bc78-d713701722af-registry-tls\") pod \"d17337fd-8815-4f95-bc78-d713701722af\" (UID: \"d17337fd-8815-4f95-bc78-d713701722af\") " Jun 09 12:00:03.442125 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:00:03.441957 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d17337fd-8815-4f95-bc78-d713701722af-image-registry-private-configuration\") pod \"d17337fd-8815-4f95-bc78-d713701722af\" (UID: \"d17337fd-8815-4f95-bc78-d713701722af\") " Jun 09 12:00:03.442125 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:00:03.441980 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d17337fd-8815-4f95-bc78-d713701722af-ca-trust-extracted\") pod \"d17337fd-8815-4f95-bc78-d713701722af\" (UID: \"d17337fd-8815-4f95-bc78-d713701722af\") " Jun 09 12:00:03.442125 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:00:03.442001 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d17337fd-8815-4f95-bc78-d713701722af-installation-pull-secrets\") pod \"d17337fd-8815-4f95-bc78-d713701722af\" (UID: \"d17337fd-8815-4f95-bc78-d713701722af\") " Jun 09 12:00:03.442125 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:00:03.442022 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d17337fd-8815-4f95-bc78-d713701722af-trusted-ca\") pod \"d17337fd-8815-4f95-bc78-d713701722af\" (UID: \"d17337fd-8815-4f95-bc78-d713701722af\") " Jun 09 12:00:03.442125 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:00:03.442067 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8djsz\" (UniqueName: \"kubernetes.io/projected/d17337fd-8815-4f95-bc78-d713701722af-kube-api-access-8djsz\") pod \"d17337fd-8815-4f95-bc78-d713701722af\" (UID: \"d17337fd-8815-4f95-bc78-d713701722af\") " Jun 09 12:00:03.442125 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:00:03.442097 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d17337fd-8815-4f95-bc78-d713701722af-bound-sa-token\") pod \"d17337fd-8815-4f95-bc78-d713701722af\" (UID: \"d17337fd-8815-4f95-bc78-d713701722af\") " Jun 09 12:00:03.442384 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:00:03.442177 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d17337fd-8815-4f95-bc78-d713701722af-registry-certificates\") pod \"d17337fd-8815-4f95-bc78-d713701722af\" (UID: \"d17337fd-8815-4f95-bc78-d713701722af\") " Jun 09 12:00:03.442442 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:00:03.442421 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d17337fd-8815-4f95-bc78-d713701722af-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d17337fd-8815-4f95-bc78-d713701722af" (UID: "d17337fd-8815-4f95-bc78-d713701722af"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:00:03.442896 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:00:03.442865 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d17337fd-8815-4f95-bc78-d713701722af-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d17337fd-8815-4f95-bc78-d713701722af" (UID: "d17337fd-8815-4f95-bc78-d713701722af"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:00:03.444408 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:00:03.444375 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d17337fd-8815-4f95-bc78-d713701722af-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d17337fd-8815-4f95-bc78-d713701722af" (UID: "d17337fd-8815-4f95-bc78-d713701722af"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:00:03.444559 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:00:03.444537 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d17337fd-8815-4f95-bc78-d713701722af-kube-api-access-8djsz" (OuterVolumeSpecName: "kube-api-access-8djsz") pod "d17337fd-8815-4f95-bc78-d713701722af" (UID: "d17337fd-8815-4f95-bc78-d713701722af"). InnerVolumeSpecName "kube-api-access-8djsz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:00:03.444708 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:00:03.444687 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d17337fd-8815-4f95-bc78-d713701722af-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d17337fd-8815-4f95-bc78-d713701722af" (UID: "d17337fd-8815-4f95-bc78-d713701722af"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:00:03.444852 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:00:03.444827 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d17337fd-8815-4f95-bc78-d713701722af-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d17337fd-8815-4f95-bc78-d713701722af" (UID: "d17337fd-8815-4f95-bc78-d713701722af"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:00:03.444915 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:00:03.444835 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d17337fd-8815-4f95-bc78-d713701722af-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d17337fd-8815-4f95-bc78-d713701722af" (UID: "d17337fd-8815-4f95-bc78-d713701722af"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:00:03.451075 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:00:03.451053 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d17337fd-8815-4f95-bc78-d713701722af-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d17337fd-8815-4f95-bc78-d713701722af" (UID: "d17337fd-8815-4f95-bc78-d713701722af"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:00:03.543605 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:00:03.543558 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8djsz\" (UniqueName: \"kubernetes.io/projected/d17337fd-8815-4f95-bc78-d713701722af-kube-api-access-8djsz\") on node \"ip-10-0-133-80.ec2.internal\" DevicePath \"\"" Jun 09 12:00:03.543605 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:00:03.543599 2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d17337fd-8815-4f95-bc78-d713701722af-bound-sa-token\") on node \"ip-10-0-133-80.ec2.internal\" DevicePath \"\"" Jun 09 12:00:03.543605 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:00:03.543630 2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d17337fd-8815-4f95-bc78-d713701722af-registry-certificates\") on node \"ip-10-0-133-80.ec2.internal\" DevicePath \"\"" Jun 09 12:00:03.543605 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:00:03.543642 2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d17337fd-8815-4f95-bc78-d713701722af-registry-tls\") on node \"ip-10-0-133-80.ec2.internal\" DevicePath \"\"" Jun 09 12:00:03.543890 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:00:03.543651 2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d17337fd-8815-4f95-bc78-d713701722af-image-registry-private-configuration\") on node \"ip-10-0-133-80.ec2.internal\" DevicePath \"\"" Jun 09 12:00:03.543890 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:00:03.543660 2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d17337fd-8815-4f95-bc78-d713701722af-ca-trust-extracted\") on node \"ip-10-0-133-80.ec2.internal\" DevicePath \"\"" Jun 09 12:00:03.543890 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:00:03.543668 2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d17337fd-8815-4f95-bc78-d713701722af-installation-pull-secrets\") on node \"ip-10-0-133-80.ec2.internal\" DevicePath \"\"" Jun 09 12:00:03.543890 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:00:03.543676 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d17337fd-8815-4f95-bc78-d713701722af-trusted-ca\") on node \"ip-10-0-133-80.ec2.internal\" DevicePath \"\"" Jun 09 12:00:03.962140 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:00:03.962102 2577 generic.go:356] "Generic (PLEG): container finished" podID="d17337fd-8815-4f95-bc78-d713701722af" containerID="be3ff98432ef45b82ef9003a12e751eedcbc8ce2a3842827c35f55e985e3e609" exitCode=0 Jun 09 12:00:03.962336 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:00:03.962159 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c74ff5cff-rflz7" Jun 09 12:00:03.962336 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:00:03.962184 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c74ff5cff-rflz7" event={"ID":"d17337fd-8815-4f95-bc78-d713701722af","Type":"ContainerDied","Data":"be3ff98432ef45b82ef9003a12e751eedcbc8ce2a3842827c35f55e985e3e609"} Jun 09 12:00:03.962336 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:00:03.962233 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c74ff5cff-rflz7" event={"ID":"d17337fd-8815-4f95-bc78-d713701722af","Type":"ContainerDied","Data":"3bc5c55d97fd9af1d57b21c5f70f31c2d7d00fd9a7171f9fcf03be301e35f1b0"} Jun 09 12:00:03.962336 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:00:03.962253 2577 scope.go:117] "RemoveContainer" containerID="be3ff98432ef45b82ef9003a12e751eedcbc8ce2a3842827c35f55e985e3e609" Jun 09 12:00:03.972750 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:00:03.972724 2577 scope.go:117] "RemoveContainer" containerID="be3ff98432ef45b82ef9003a12e751eedcbc8ce2a3842827c35f55e985e3e609" Jun 09 12:00:03.973080 ip-10-0-133-80 kubenswrapper[2577]: E0609 12:00:03.973057 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be3ff98432ef45b82ef9003a12e751eedcbc8ce2a3842827c35f55e985e3e609\": container with ID starting with be3ff98432ef45b82ef9003a12e751eedcbc8ce2a3842827c35f55e985e3e609 not found: ID does not exist" containerID="be3ff98432ef45b82ef9003a12e751eedcbc8ce2a3842827c35f55e985e3e609" Jun 09 12:00:03.973148 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:00:03.973090 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be3ff98432ef45b82ef9003a12e751eedcbc8ce2a3842827c35f55e985e3e609"} err="failed to get container status \"be3ff98432ef45b82ef9003a12e751eedcbc8ce2a3842827c35f55e985e3e609\": rpc error: code = NotFound desc = could not find container \"be3ff98432ef45b82ef9003a12e751eedcbc8ce2a3842827c35f55e985e3e609\": container with ID starting with be3ff98432ef45b82ef9003a12e751eedcbc8ce2a3842827c35f55e985e3e609 not found: ID does not exist" Jun 09 12:00:03.986516 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:00:03.986485 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5c74ff5cff-rflz7"] Jun 09 12:00:03.991834 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:00:03.991805 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5c74ff5cff-rflz7"] Jun 09 12:00:04.016494 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:00:04.016469 2577 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 12:00:04.045254 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:00:04.045085 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d17337fd-8815-4f95-bc78-d713701722af" path="/var/lib/kubelet/pods/d17337fd-8815-4f95-bc78-d713701722af/volumes" Jun 09 12:00:16.038869 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:00:16.038831 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvhwb" Jun 09 12:00:22.029885 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:00:22.029784 2577 generic.go:356] "Generic (PLEG): container finished" podID="494fd567-bebb-432c-aaac-a6994d3ef40c" containerID="bac44bd4cad2cfcaa760be47fa316f473fe444aa6448fa689a002ebccb9a40a8" exitCode=0 Jun 09 12:00:22.029885 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:00:22.029862 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hm9tp" event={"ID":"494fd567-bebb-432c-aaac-a6994d3ef40c","Type":"ContainerDied","Data":"bac44bd4cad2cfcaa760be47fa316f473fe444aa6448fa689a002ebccb9a40a8"} Jun 09 12:00:22.030373 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:00:22.030336 2577 scope.go:117] "RemoveContainer" containerID="bac44bd4cad2cfcaa760be47fa316f473fe444aa6448fa689a002ebccb9a40a8" Jun 09 12:00:23.035964 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:00:23.035932 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hm9tp" event={"ID":"494fd567-bebb-432c-aaac-a6994d3ef40c","Type":"ContainerStarted","Data":"14923bf22c59131320d344e0f294703fd4956e0d36954877000e6b2c262587d8"} Jun 09 12:00:38.098910 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:00:38.098878 2577 generic.go:356] "Generic (PLEG): container finished" podID="35890da8-8ba3-4a9c-b524-4130ae63284c" containerID="46a253b8b48f1b588bd5f4516296e077154997b90e3f82a35c792e67f7ab498c" exitCode=0 Jun 09 12:00:38.099340 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:00:38.098945 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-b8mrg" event={"ID":"35890da8-8ba3-4a9c-b524-4130ae63284c","Type":"ContainerDied","Data":"46a253b8b48f1b588bd5f4516296e077154997b90e3f82a35c792e67f7ab498c"} Jun 09 12:00:38.099340 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:00:38.099242 2577 scope.go:117] "RemoveContainer" containerID="46a253b8b48f1b588bd5f4516296e077154997b90e3f82a35c792e67f7ab498c" Jun 09 12:00:39.104473 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:00:39.104435 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-b8mrg" event={"ID":"35890da8-8ba3-4a9c-b524-4130ae63284c","Type":"ContainerStarted","Data":"0c4e9385254edf60b5ff34f784f9f8e9593cda75d6de6d597a34492bfd683113"} Jun 09 12:00:52.109957 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:00:52.109902 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:00:52.130276 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:00:52.130247 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:00:52.172430 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:00:52.172392 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:05.890677 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:05.890638 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 12:01:05.891232 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:05.890943 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e9ccb63a-d996-4630-936b-c5a1cc3530a4" containerName="alertmanager" containerID="cri-o://db3586f252c4abeee804dd8852a4714318c993cff2ec036dece56fd56265635d" gracePeriod=120 Jun 09 12:01:05.891232 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:05.891001 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e9ccb63a-d996-4630-936b-c5a1cc3530a4" containerName="kube-rbac-proxy-metric" containerID="cri-o://22d0ceac63111801e1df708d2a748686ae2f1c50dafe243a2c6e2ad1529bb7b4" gracePeriod=120 Jun 09 12:01:05.891232 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:05.891072 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e9ccb63a-d996-4630-936b-c5a1cc3530a4" containerName="kube-rbac-proxy" containerID="cri-o://fd4db49e83863ebd34d9054caf27665054730771790efb1d21dce746211d8460" gracePeriod=120 Jun 09 12:01:05.891232 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:05.891089 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e9ccb63a-d996-4630-936b-c5a1cc3530a4" containerName="kube-rbac-proxy-web" containerID="cri-o://4b260b2ccf40aaf9e9192853c075375beeba42379b18a54a1ed2ccc588ab6de0" gracePeriod=120 Jun 09 12:01:05.891232 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:05.891019 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e9ccb63a-d996-4630-936b-c5a1cc3530a4" containerName="prom-label-proxy" containerID="cri-o://33d44d06d25e8d40424668727ed85b31299628cf766b862032e8dd96906443a5" gracePeriod=120 Jun 09 12:01:05.891232 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:05.891073 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e9ccb63a-d996-4630-936b-c5a1cc3530a4" containerName="config-reloader" containerID="cri-o://243c7fdd8c858d7ec0bbab7d247d245b6deccd169b856ff6b04db8d7a3ed9dae" gracePeriod=120 Jun 09 12:01:06.212810 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:06.212723 2577 generic.go:356] "Generic (PLEG): container finished" podID="e9ccb63a-d996-4630-936b-c5a1cc3530a4" containerID="33d44d06d25e8d40424668727ed85b31299628cf766b862032e8dd96906443a5" exitCode=0 Jun 09 12:01:06.212810 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:06.212750 2577 generic.go:356] "Generic (PLEG): container finished" podID="e9ccb63a-d996-4630-936b-c5a1cc3530a4" containerID="fd4db49e83863ebd34d9054caf27665054730771790efb1d21dce746211d8460" exitCode=0 Jun 09 12:01:06.212810 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:06.212759 2577 generic.go:356] "Generic (PLEG): container finished" podID="e9ccb63a-d996-4630-936b-c5a1cc3530a4" containerID="243c7fdd8c858d7ec0bbab7d247d245b6deccd169b856ff6b04db8d7a3ed9dae" exitCode=0 Jun 09 12:01:06.212810 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:06.212768 2577 generic.go:356] "Generic (PLEG): container finished" podID="e9ccb63a-d996-4630-936b-c5a1cc3530a4" containerID="db3586f252c4abeee804dd8852a4714318c993cff2ec036dece56fd56265635d" exitCode=0 Jun 09 12:01:06.212810 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:06.212790 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9ccb63a-d996-4630-936b-c5a1cc3530a4","Type":"ContainerDied","Data":"33d44d06d25e8d40424668727ed85b31299628cf766b862032e8dd96906443a5"} Jun 09 12:01:06.213078 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:06.212851 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9ccb63a-d996-4630-936b-c5a1cc3530a4","Type":"ContainerDied","Data":"fd4db49e83863ebd34d9054caf27665054730771790efb1d21dce746211d8460"} Jun 09 12:01:06.213078 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:06.212877 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9ccb63a-d996-4630-936b-c5a1cc3530a4","Type":"ContainerDied","Data":"243c7fdd8c858d7ec0bbab7d247d245b6deccd169b856ff6b04db8d7a3ed9dae"} Jun 09 12:01:06.213078 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:06.212901 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9ccb63a-d996-4630-936b-c5a1cc3530a4","Type":"ContainerDied","Data":"db3586f252c4abeee804dd8852a4714318c993cff2ec036dece56fd56265635d"} Jun 09 12:01:07.219757 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:07.219725 2577 generic.go:356] "Generic (PLEG): container finished" podID="e9ccb63a-d996-4630-936b-c5a1cc3530a4" containerID="22d0ceac63111801e1df708d2a748686ae2f1c50dafe243a2c6e2ad1529bb7b4" exitCode=0 Jun 09 12:01:07.219757 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:07.219748 2577 generic.go:356] "Generic (PLEG): container finished" podID="e9ccb63a-d996-4630-936b-c5a1cc3530a4" containerID="4b260b2ccf40aaf9e9192853c075375beeba42379b18a54a1ed2ccc588ab6de0" exitCode=0 Jun 09 12:01:07.220158 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:07.219791 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9ccb63a-d996-4630-936b-c5a1cc3530a4","Type":"ContainerDied","Data":"22d0ceac63111801e1df708d2a748686ae2f1c50dafe243a2c6e2ad1529bb7b4"} Jun 09 12:01:07.220158 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:07.219855 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9ccb63a-d996-4630-936b-c5a1cc3530a4","Type":"ContainerDied","Data":"4b260b2ccf40aaf9e9192853c075375beeba42379b18a54a1ed2ccc588ab6de0"} Jun 09 12:01:07.632122 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:07.632097 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:01:07.718384 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:07.718350 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e9ccb63a-d996-4630-936b-c5a1cc3530a4-config-volume\") pod \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\" (UID: \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\") " Jun 09 12:01:07.718384 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:07.718398 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e9ccb63a-d996-4630-936b-c5a1cc3530a4-alertmanager-main-db\") pod \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\" (UID: \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\") " Jun 09 12:01:07.718676 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:07.718418 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e9ccb63a-d996-4630-936b-c5a1cc3530a4-web-config\") pod \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\" (UID: \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\") " Jun 09 12:01:07.718676 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:07.718448 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e9ccb63a-d996-4630-936b-c5a1cc3530a4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\" (UID: \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\") " Jun 09 12:01:07.718676 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:07.718467 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9ccb63a-d996-4630-936b-c5a1cc3530a4-metrics-client-ca\") pod \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\" (UID: \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\") " Jun 09 12:01:07.718676 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:07.718490 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e9ccb63a-d996-4630-936b-c5a1cc3530a4-secret-alertmanager-kube-rbac-proxy\") pod \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\" (UID: \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\") " Jun 09 12:01:07.718676 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:07.718511 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e9ccb63a-d996-4630-936b-c5a1cc3530a4-config-out\") pod \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\" (UID: \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\") " Jun 09 12:01:07.718676 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:07.718541 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9ccb63a-d996-4630-936b-c5a1cc3530a4-alertmanager-trusted-ca-bundle\") pod \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\" (UID: \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\") " Jun 09 12:01:07.718676 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:07.718571 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hngct\" (UniqueName: \"kubernetes.io/projected/e9ccb63a-d996-4630-936b-c5a1cc3530a4-kube-api-access-hngct\") pod \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\" (UID: \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\") " Jun 09 12:01:07.718676 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:07.718599 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e9ccb63a-d996-4630-936b-c5a1cc3530a4-secret-alertmanager-kube-rbac-proxy-web\") pod \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\" (UID: \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\") " Jun 09 12:01:07.718676 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:07.718668 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e9ccb63a-d996-4630-936b-c5a1cc3530a4-tls-assets\") pod \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\" (UID: \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\") " Jun 09 12:01:07.719141 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:07.718698 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e9ccb63a-d996-4630-936b-c5a1cc3530a4-cluster-tls-config\") pod \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\" (UID: \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\") " Jun 09 12:01:07.719141 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:07.718732 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e9ccb63a-d996-4630-936b-c5a1cc3530a4-secret-alertmanager-main-tls\") pod \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\" (UID: \"e9ccb63a-d996-4630-936b-c5a1cc3530a4\") " Jun 09 12:01:07.719141 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:07.718742 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9ccb63a-d996-4630-936b-c5a1cc3530a4-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "e9ccb63a-d996-4630-936b-c5a1cc3530a4" (UID: "e9ccb63a-d996-4630-936b-c5a1cc3530a4"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:01:07.719141 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:07.719004 2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e9ccb63a-d996-4630-936b-c5a1cc3530a4-alertmanager-main-db\") on node \"ip-10-0-133-80.ec2.internal\" DevicePath \"\"" Jun 09 12:01:07.719920 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:07.719867 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9ccb63a-d996-4630-936b-c5a1cc3530a4-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "e9ccb63a-d996-4630-936b-c5a1cc3530a4" (UID: "e9ccb63a-d996-4630-936b-c5a1cc3530a4"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:01:07.720046 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:07.719992 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9ccb63a-d996-4630-936b-c5a1cc3530a4-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "e9ccb63a-d996-4630-936b-c5a1cc3530a4" (UID: "e9ccb63a-d996-4630-936b-c5a1cc3530a4"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:01:07.721684 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:07.721594 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9ccb63a-d996-4630-936b-c5a1cc3530a4-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "e9ccb63a-d996-4630-936b-c5a1cc3530a4" (UID: "e9ccb63a-d996-4630-936b-c5a1cc3530a4"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:01:07.721928 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:07.721880 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9ccb63a-d996-4630-936b-c5a1cc3530a4-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "e9ccb63a-d996-4630-936b-c5a1cc3530a4" (UID: "e9ccb63a-d996-4630-936b-c5a1cc3530a4"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:01:07.722096 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:07.722052 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9ccb63a-d996-4630-936b-c5a1cc3530a4-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "e9ccb63a-d996-4630-936b-c5a1cc3530a4" (UID: "e9ccb63a-d996-4630-936b-c5a1cc3530a4"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:01:07.722290 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:07.722266 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9ccb63a-d996-4630-936b-c5a1cc3530a4-config-volume" (OuterVolumeSpecName: "config-volume") pod "e9ccb63a-d996-4630-936b-c5a1cc3530a4" (UID: "e9ccb63a-d996-4630-936b-c5a1cc3530a4"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:01:07.722505 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:07.722472 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9ccb63a-d996-4630-936b-c5a1cc3530a4-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "e9ccb63a-d996-4630-936b-c5a1cc3530a4" (UID: "e9ccb63a-d996-4630-936b-c5a1cc3530a4"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:01:07.722668 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:07.722643 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9ccb63a-d996-4630-936b-c5a1cc3530a4-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "e9ccb63a-d996-4630-936b-c5a1cc3530a4" (UID: "e9ccb63a-d996-4630-936b-c5a1cc3530a4"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:01:07.722847 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:07.722819 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9ccb63a-d996-4630-936b-c5a1cc3530a4-config-out" (OuterVolumeSpecName: "config-out") pod "e9ccb63a-d996-4630-936b-c5a1cc3530a4" (UID: "e9ccb63a-d996-4630-936b-c5a1cc3530a4"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:01:07.723477 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:07.723450 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9ccb63a-d996-4630-936b-c5a1cc3530a4-kube-api-access-hngct" (OuterVolumeSpecName: "kube-api-access-hngct") pod "e9ccb63a-d996-4630-936b-c5a1cc3530a4" (UID: "e9ccb63a-d996-4630-936b-c5a1cc3530a4"). InnerVolumeSpecName "kube-api-access-hngct". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:01:07.725798 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:07.725776 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9ccb63a-d996-4630-936b-c5a1cc3530a4-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "e9ccb63a-d996-4630-936b-c5a1cc3530a4" (UID: "e9ccb63a-d996-4630-936b-c5a1cc3530a4"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:01:07.732268 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:07.732244 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9ccb63a-d996-4630-936b-c5a1cc3530a4-web-config" (OuterVolumeSpecName: "web-config") pod "e9ccb63a-d996-4630-936b-c5a1cc3530a4" (UID: "e9ccb63a-d996-4630-936b-c5a1cc3530a4"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:01:07.819672 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:07.819550 2577 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e9ccb63a-d996-4630-936b-c5a1cc3530a4-config-volume\") on node \"ip-10-0-133-80.ec2.internal\" DevicePath \"\"" Jun 09 12:01:07.819672 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:07.819590 2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e9ccb63a-d996-4630-936b-c5a1cc3530a4-web-config\") on node \"ip-10-0-133-80.ec2.internal\" DevicePath \"\"" Jun 09 12:01:07.819672 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:07.819599 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e9ccb63a-d996-4630-936b-c5a1cc3530a4-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-133-80.ec2.internal\" DevicePath \"\"" Jun 09 12:01:07.819672 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:07.819608 2577 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9ccb63a-d996-4630-936b-c5a1cc3530a4-metrics-client-ca\") on node \"ip-10-0-133-80.ec2.internal\" DevicePath \"\"" Jun 09 12:01:07.819672 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:07.819645 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e9ccb63a-d996-4630-936b-c5a1cc3530a4-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-133-80.ec2.internal\" DevicePath \"\"" Jun 09 12:01:07.819672 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:07.819654 2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e9ccb63a-d996-4630-936b-c5a1cc3530a4-config-out\") on node \"ip-10-0-133-80.ec2.internal\" DevicePath \"\"" Jun 09 12:01:07.819672 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:07.819663 2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9ccb63a-d996-4630-936b-c5a1cc3530a4-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-133-80.ec2.internal\" DevicePath \"\"" Jun 09 12:01:07.819672 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:07.819673 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hngct\" (UniqueName: \"kubernetes.io/projected/e9ccb63a-d996-4630-936b-c5a1cc3530a4-kube-api-access-hngct\") on node \"ip-10-0-133-80.ec2.internal\" DevicePath \"\"" Jun 09 12:01:07.820024 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:07.819684 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e9ccb63a-d996-4630-936b-c5a1cc3530a4-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-133-80.ec2.internal\" DevicePath \"\"" Jun 09 12:01:07.820024 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:07.819693 2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e9ccb63a-d996-4630-936b-c5a1cc3530a4-tls-assets\") on node \"ip-10-0-133-80.ec2.internal\" DevicePath \"\"" Jun 09 12:01:07.820024 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:07.819701 2577 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e9ccb63a-d996-4630-936b-c5a1cc3530a4-cluster-tls-config\") on node \"ip-10-0-133-80.ec2.internal\" DevicePath \"\"" Jun 09 12:01:07.820024 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:07.819710 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e9ccb63a-d996-4630-936b-c5a1cc3530a4-secret-alertmanager-main-tls\") on node \"ip-10-0-133-80.ec2.internal\" DevicePath \"\"" Jun 09 12:01:08.226998 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.226965 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9ccb63a-d996-4630-936b-c5a1cc3530a4","Type":"ContainerDied","Data":"da1fff17a3bc12577e81d0b32164f9b0014306e0892a94de4a14c857bc36788f"} Jun 09 12:01:08.227404 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.227032 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:01:08.227404 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.227039 2577 scope.go:117] "RemoveContainer" containerID="33d44d06d25e8d40424668727ed85b31299628cf766b862032e8dd96906443a5" Jun 09 12:01:08.234912 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.234889 2577 scope.go:117] "RemoveContainer" containerID="22d0ceac63111801e1df708d2a748686ae2f1c50dafe243a2c6e2ad1529bb7b4" Jun 09 12:01:08.242639 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.242608 2577 scope.go:117] "RemoveContainer" containerID="fd4db49e83863ebd34d9054caf27665054730771790efb1d21dce746211d8460" Jun 09 12:01:08.248412 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.248377 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 12:01:08.250841 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.250794 2577 scope.go:117] "RemoveContainer" containerID="4b260b2ccf40aaf9e9192853c075375beeba42379b18a54a1ed2ccc588ab6de0" Jun 09 12:01:08.253865 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.253839 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 12:01:08.258816 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.258795 2577 scope.go:117] "RemoveContainer" containerID="243c7fdd8c858d7ec0bbab7d247d245b6deccd169b856ff6b04db8d7a3ed9dae" Jun 09 12:01:08.266341 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.266321 2577 scope.go:117] "RemoveContainer" containerID="db3586f252c4abeee804dd8852a4714318c993cff2ec036dece56fd56265635d" Jun 09 12:01:08.274936 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.274916 2577 scope.go:117] "RemoveContainer" containerID="ded3f6e5abab4b6a8183e5abc42e6a7bbe04d7304b9db173f7717d1746ae3784" Jun 09 12:01:08.279433 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.279398 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 12:01:08.279773 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.279758 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9ccb63a-d996-4630-936b-c5a1cc3530a4" containerName="kube-rbac-proxy-web" Jun 09 12:01:08.279773 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.279774 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9ccb63a-d996-4630-936b-c5a1cc3530a4" containerName="kube-rbac-proxy-web" Jun 09 12:01:08.279902 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.279784 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9ccb63a-d996-4630-936b-c5a1cc3530a4" containerName="kube-rbac-proxy" Jun 09 12:01:08.279902 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.279790 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9ccb63a-d996-4630-936b-c5a1cc3530a4" containerName="kube-rbac-proxy" Jun 09 12:01:08.279902 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.279799 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9ccb63a-d996-4630-936b-c5a1cc3530a4" containerName="init-config-reloader" Jun 09 12:01:08.279902 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.279804 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9ccb63a-d996-4630-936b-c5a1cc3530a4" containerName="init-config-reloader" Jun 09 12:01:08.279902 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.279814 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9ccb63a-d996-4630-936b-c5a1cc3530a4" containerName="kube-rbac-proxy-metric" Jun 09 12:01:08.279902 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.279819 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9ccb63a-d996-4630-936b-c5a1cc3530a4" containerName="kube-rbac-proxy-metric" Jun 09 12:01:08.279902 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.279827 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9ccb63a-d996-4630-936b-c5a1cc3530a4" containerName="alertmanager" Jun 09 12:01:08.279902 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.279832 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9ccb63a-d996-4630-936b-c5a1cc3530a4" containerName="alertmanager" Jun 09 12:01:08.279902 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.279842 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9ccb63a-d996-4630-936b-c5a1cc3530a4" containerName="config-reloader" Jun 09 12:01:08.279902 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.279847 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9ccb63a-d996-4630-936b-c5a1cc3530a4" containerName="config-reloader" Jun 09 12:01:08.279902 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.279860 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d17337fd-8815-4f95-bc78-d713701722af" containerName="registry" Jun 09 12:01:08.279902 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.279868 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d17337fd-8815-4f95-bc78-d713701722af" containerName="registry" Jun 09 12:01:08.279902 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.279877 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9ccb63a-d996-4630-936b-c5a1cc3530a4" containerName="prom-label-proxy" Jun 09 12:01:08.279902 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.279882 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9ccb63a-d996-4630-936b-c5a1cc3530a4" containerName="prom-label-proxy" Jun 09 12:01:08.280355 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.279924 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d17337fd-8815-4f95-bc78-d713701722af" containerName="registry" Jun 09 12:01:08.280355 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.279932 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9ccb63a-d996-4630-936b-c5a1cc3530a4" containerName="kube-rbac-proxy-web" Jun 09 12:01:08.280355 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.279939 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9ccb63a-d996-4630-936b-c5a1cc3530a4" containerName="config-reloader" Jun 09 12:01:08.280355 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.279946 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9ccb63a-d996-4630-936b-c5a1cc3530a4" containerName="kube-rbac-proxy" Jun 09 12:01:08.280355 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.279952 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9ccb63a-d996-4630-936b-c5a1cc3530a4" containerName="prom-label-proxy" Jun 09 12:01:08.280355 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.279958 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9ccb63a-d996-4630-936b-c5a1cc3530a4" containerName="alertmanager" Jun 09 12:01:08.280355 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.279963 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9ccb63a-d996-4630-936b-c5a1cc3530a4" containerName="kube-rbac-proxy-metric" Jun 09 12:01:08.283351 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.283333 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:01:08.287008 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.286981 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vwk2r\"" Jun 09 12:01:08.287140 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.287037 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 09 12:01:08.287140 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.287045 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 09 12:01:08.287140 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.287089 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 09 12:01:08.287910 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.287891 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 09 12:01:08.288013 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.287930 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 09 12:01:08.288013 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.287940 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 09 12:01:08.288013 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.287951 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 09 12:01:08.288013 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.287940 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 09 12:01:08.300510 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.299659 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 09 12:01:08.303248 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.303209 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 12:01:08.322417 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.322384 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c344855-dc3c-4772-9bba-8c6d19373038-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1c344855-dc3c-4772-9bba-8c6d19373038\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:01:08.322581 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.322427 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1c344855-dc3c-4772-9bba-8c6d19373038-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1c344855-dc3c-4772-9bba-8c6d19373038\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:01:08.322581 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.322454 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1c344855-dc3c-4772-9bba-8c6d19373038-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1c344855-dc3c-4772-9bba-8c6d19373038\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:01:08.322581 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.322479 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1c344855-dc3c-4772-9bba-8c6d19373038-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1c344855-dc3c-4772-9bba-8c6d19373038\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:01:08.322581 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.322534 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1c344855-dc3c-4772-9bba-8c6d19373038-config-volume\") pod \"alertmanager-main-0\" (UID: \"1c344855-dc3c-4772-9bba-8c6d19373038\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:01:08.322581 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.322570 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4wxr\" (UniqueName: \"kubernetes.io/projected/1c344855-dc3c-4772-9bba-8c6d19373038-kube-api-access-t4wxr\") pod \"alertmanager-main-0\" (UID: \"1c344855-dc3c-4772-9bba-8c6d19373038\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:01:08.322859 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.322607 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c344855-dc3c-4772-9bba-8c6d19373038-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1c344855-dc3c-4772-9bba-8c6d19373038\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:01:08.322859 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.322664 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1c344855-dc3c-4772-9bba-8c6d19373038-config-out\") pod \"alertmanager-main-0\" (UID: \"1c344855-dc3c-4772-9bba-8c6d19373038\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:01:08.322859 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.322684 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1c344855-dc3c-4772-9bba-8c6d19373038-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1c344855-dc3c-4772-9bba-8c6d19373038\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:01:08.322859 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.322702 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1c344855-dc3c-4772-9bba-8c6d19373038-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1c344855-dc3c-4772-9bba-8c6d19373038\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:01:08.322859 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.322757 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1c344855-dc3c-4772-9bba-8c6d19373038-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1c344855-dc3c-4772-9bba-8c6d19373038\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:01:08.322859 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.322790 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1c344855-dc3c-4772-9bba-8c6d19373038-web-config\") pod \"alertmanager-main-0\" (UID: \"1c344855-dc3c-4772-9bba-8c6d19373038\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:01:08.322859 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.322812 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1c344855-dc3c-4772-9bba-8c6d19373038-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1c344855-dc3c-4772-9bba-8c6d19373038\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:01:08.423551 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.423501 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1c344855-dc3c-4772-9bba-8c6d19373038-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1c344855-dc3c-4772-9bba-8c6d19373038\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:01:08.423794 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.423567 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1c344855-dc3c-4772-9bba-8c6d19373038-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1c344855-dc3c-4772-9bba-8c6d19373038\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:01:08.423794 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.423596 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1c344855-dc3c-4772-9bba-8c6d19373038-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1c344855-dc3c-4772-9bba-8c6d19373038\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:01:08.423794 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.423644 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1c344855-dc3c-4772-9bba-8c6d19373038-config-volume\") pod \"alertmanager-main-0\" (UID: \"1c344855-dc3c-4772-9bba-8c6d19373038\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:01:08.423794 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.423679 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4wxr\" (UniqueName: \"kubernetes.io/projected/1c344855-dc3c-4772-9bba-8c6d19373038-kube-api-access-t4wxr\") pod \"alertmanager-main-0\" (UID: \"1c344855-dc3c-4772-9bba-8c6d19373038\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:01:08.423794 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.423731 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c344855-dc3c-4772-9bba-8c6d19373038-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1c344855-dc3c-4772-9bba-8c6d19373038\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:01:08.423794 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.423764 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1c344855-dc3c-4772-9bba-8c6d19373038-config-out\") pod \"alertmanager-main-0\" (UID: \"1c344855-dc3c-4772-9bba-8c6d19373038\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:01:08.423794 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.423793 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1c344855-dc3c-4772-9bba-8c6d19373038-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1c344855-dc3c-4772-9bba-8c6d19373038\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:01:08.424138 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.423821 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1c344855-dc3c-4772-9bba-8c6d19373038-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1c344855-dc3c-4772-9bba-8c6d19373038\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:01:08.424138 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.423865 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1c344855-dc3c-4772-9bba-8c6d19373038-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1c344855-dc3c-4772-9bba-8c6d19373038\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:01:08.424138 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.423889 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1c344855-dc3c-4772-9bba-8c6d19373038-web-config\") pod \"alertmanager-main-0\" (UID: \"1c344855-dc3c-4772-9bba-8c6d19373038\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:01:08.424138 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.423925 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1c344855-dc3c-4772-9bba-8c6d19373038-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1c344855-dc3c-4772-9bba-8c6d19373038\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:01:08.424138 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.423953 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c344855-dc3c-4772-9bba-8c6d19373038-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1c344855-dc3c-4772-9bba-8c6d19373038\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:01:08.424138 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.424126 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1c344855-dc3c-4772-9bba-8c6d19373038-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1c344855-dc3c-4772-9bba-8c6d19373038\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:01:08.425037 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.425006 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c344855-dc3c-4772-9bba-8c6d19373038-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1c344855-dc3c-4772-9bba-8c6d19373038\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:01:08.425166 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.425057 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c344855-dc3c-4772-9bba-8c6d19373038-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1c344855-dc3c-4772-9bba-8c6d19373038\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:01:08.426582 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.426556 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1c344855-dc3c-4772-9bba-8c6d19373038-config-out\") pod \"alertmanager-main-0\" (UID: \"1c344855-dc3c-4772-9bba-8c6d19373038\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:01:08.427128 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.427100 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1c344855-dc3c-4772-9bba-8c6d19373038-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1c344855-dc3c-4772-9bba-8c6d19373038\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:01:08.427241 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.427219 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1c344855-dc3c-4772-9bba-8c6d19373038-web-config\") pod \"alertmanager-main-0\" (UID: \"1c344855-dc3c-4772-9bba-8c6d19373038\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:01:08.427503 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.427478 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1c344855-dc3c-4772-9bba-8c6d19373038-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1c344855-dc3c-4772-9bba-8c6d19373038\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:01:08.427877 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.427842 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1c344855-dc3c-4772-9bba-8c6d19373038-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1c344855-dc3c-4772-9bba-8c6d19373038\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:01:08.428001 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.427980 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1c344855-dc3c-4772-9bba-8c6d19373038-config-volume\") pod \"alertmanager-main-0\" (UID: \"1c344855-dc3c-4772-9bba-8c6d19373038\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:01:08.428051 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.427981 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1c344855-dc3c-4772-9bba-8c6d19373038-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1c344855-dc3c-4772-9bba-8c6d19373038\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:01:08.428139 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.428125 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1c344855-dc3c-4772-9bba-8c6d19373038-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1c344855-dc3c-4772-9bba-8c6d19373038\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:01:08.428914 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.428899 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1c344855-dc3c-4772-9bba-8c6d19373038-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1c344855-dc3c-4772-9bba-8c6d19373038\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:01:08.431704 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.431682 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4wxr\" (UniqueName: \"kubernetes.io/projected/1c344855-dc3c-4772-9bba-8c6d19373038-kube-api-access-t4wxr\") pod \"alertmanager-main-0\" (UID: \"1c344855-dc3c-4772-9bba-8c6d19373038\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:01:08.601872 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.601785 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 12:01:08.744091 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:08.744062 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 12:01:08.746099 ip-10-0-133-80 kubenswrapper[2577]: W0609 12:01:08.746072 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c344855_dc3c_4772_9bba_8c6d19373038.slice/crio-5c748b0b406e3f5a0196fbd08db2e514f0a7a2a03b8516691fe612372483e1b7 WatchSource:0}: Error finding container 5c748b0b406e3f5a0196fbd08db2e514f0a7a2a03b8516691fe612372483e1b7: Status 404 returned error can't find the container with id 5c748b0b406e3f5a0196fbd08db2e514f0a7a2a03b8516691fe612372483e1b7 Jun 09 12:01:09.233494 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:09.233455 2577 generic.go:356] "Generic (PLEG): container finished" podID="1c344855-dc3c-4772-9bba-8c6d19373038" containerID="4ccf5fb099312272fffbf013c849428117c0c449a98d2780f7520eefb481fab5" exitCode=0 Jun 09 12:01:09.233899 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:09.233538 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c344855-dc3c-4772-9bba-8c6d19373038","Type":"ContainerDied","Data":"4ccf5fb099312272fffbf013c849428117c0c449a98d2780f7520eefb481fab5"} Jun 09 12:01:09.233899 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:09.233605 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c344855-dc3c-4772-9bba-8c6d19373038","Type":"ContainerStarted","Data":"5c748b0b406e3f5a0196fbd08db2e514f0a7a2a03b8516691fe612372483e1b7"} Jun 09 12:01:10.043772 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.043734 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9ccb63a-d996-4630-936b-c5a1cc3530a4" path="/var/lib/kubelet/pods/e9ccb63a-d996-4630-936b-c5a1cc3530a4/volumes" Jun 09 12:01:10.242798 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.242759 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c344855-dc3c-4772-9bba-8c6d19373038","Type":"ContainerStarted","Data":"1ba2de3855c6039c1241ffe13aca6a8d03caa437acb8f081f170d0f288112f35"} Jun 09 12:01:10.243253 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.242843 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c344855-dc3c-4772-9bba-8c6d19373038","Type":"ContainerStarted","Data":"677a4ba1a921e55d4c3c6c887f3ff9b7c458992bec421c05f427d456a6e000c1"} Jun 09 12:01:10.243253 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.242882 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c344855-dc3c-4772-9bba-8c6d19373038","Type":"ContainerStarted","Data":"02d2be2c3becaf00e9a030c7a680e5ec1caa1b6cf65a98eb93d9c0d2d35fa798"} Jun 09 12:01:10.243253 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.242922 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c344855-dc3c-4772-9bba-8c6d19373038","Type":"ContainerStarted","Data":"61b05f57570758559cd136c19f2f6c3fe35789ef534c24872fb3eda8484078ed"} Jun 09 12:01:10.243253 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.242957 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c344855-dc3c-4772-9bba-8c6d19373038","Type":"ContainerStarted","Data":"d0a97923757c7d29937cb487b55311436acab11207ef475dec3be2287ad36e23"} Jun 09 12:01:10.243253 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.242994 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c344855-dc3c-4772-9bba-8c6d19373038","Type":"ContainerStarted","Data":"94a5201aaae713ffe7bbc8267f6c93321e77abf4b8599084cecf2fb73841aab5"} Jun 09 12:01:10.259774 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.259737 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 12:01:10.260126 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.260089 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="59b14c47-4d37-4853-8b37-7edfbcaaed09" containerName="prometheus" containerID="cri-o://d5c1ba6b29e2911e24aeba41b355d3078ed3b8325373570e11de80997f2fbbfc" gracePeriod=600 Jun 09 12:01:10.260126 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.260115 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="59b14c47-4d37-4853-8b37-7edfbcaaed09" containerName="kube-rbac-proxy-thanos" containerID="cri-o://19dc7f1849d14a348a93c9bd2836e68755bff3079e079161a44744b978caefcd" gracePeriod=600 Jun 09 12:01:10.260309 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.260135 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="59b14c47-4d37-4853-8b37-7edfbcaaed09" containerName="config-reloader" containerID="cri-o://b1f1cde9ac750bde508b7d950f4d027a32e201764dda6c2199f807a692087c95" gracePeriod=600 Jun 09 12:01:10.260309 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.260108 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="59b14c47-4d37-4853-8b37-7edfbcaaed09" containerName="kube-rbac-proxy" containerID="cri-o://3a260ee540e09e7ecf8cc5d682ab2afa205d4620c46bedfdab2ee982b6edfbc1" gracePeriod=600 Jun 09 12:01:10.260309 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.260093 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="59b14c47-4d37-4853-8b37-7edfbcaaed09" containerName="thanos-sidecar" containerID="cri-o://f23948441119f155ea2617198402b893fa7c5a6330b4f20111976283a388da2f" gracePeriod=600 Jun 09 12:01:10.260309 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.260113 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="59b14c47-4d37-4853-8b37-7edfbcaaed09" containerName="kube-rbac-proxy-web" containerID="cri-o://4e8944c31b4f81066e7e718bc7372483859b4164c1bc1a9a97ee6d8ca37a9bac" gracePeriod=600 Jun 09 12:01:10.276876 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.276757 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.26200319 podStartE2EDuration="2.276735265s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.732075ms" isStatefulPod=false podCreationTimestamp="2026-06-09 12:01:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:01:10.275261831 +0000 UTC m=+366.697819631" watchObservedRunningTime="2026-06-09 12:01:10.276735265 +0000 UTC m=+366.699293042" Jun 09 12:01:10.520160 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.520135 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:10.543883 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.543820 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/59b14c47-4d37-4853-8b37-7edfbcaaed09-prometheus-k8s-rulefiles-2\") pod \"59b14c47-4d37-4853-8b37-7edfbcaaed09\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " Jun 09 12:01:10.543883 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.543879 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/59b14c47-4d37-4853-8b37-7edfbcaaed09-prometheus-k8s-db\") pod \"59b14c47-4d37-4853-8b37-7edfbcaaed09\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " Jun 09 12:01:10.544139 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.543912 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/59b14c47-4d37-4853-8b37-7edfbcaaed09-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"59b14c47-4d37-4853-8b37-7edfbcaaed09\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " Jun 09 12:01:10.544139 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.543940 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/59b14c47-4d37-4853-8b37-7edfbcaaed09-tls-assets\") pod \"59b14c47-4d37-4853-8b37-7edfbcaaed09\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " Jun 09 12:01:10.544139 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.543969 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/59b14c47-4d37-4853-8b37-7edfbcaaed09-secret-metrics-client-certs\") pod \"59b14c47-4d37-4853-8b37-7edfbcaaed09\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " Jun 09 12:01:10.544139 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.544003 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/59b14c47-4d37-4853-8b37-7edfbcaaed09-secret-prometheus-k8s-tls\") pod \"59b14c47-4d37-4853-8b37-7edfbcaaed09\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " Jun 09 12:01:10.544139 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.544026 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59b14c47-4d37-4853-8b37-7edfbcaaed09-prometheus-trusted-ca-bundle\") pod \"59b14c47-4d37-4853-8b37-7edfbcaaed09\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " Jun 09 12:01:10.544139 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.544051 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/59b14c47-4d37-4853-8b37-7edfbcaaed09-config\") pod \"59b14c47-4d37-4853-8b37-7edfbcaaed09\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " Jun 09 12:01:10.544139 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.544092 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/59b14c47-4d37-4853-8b37-7edfbcaaed09-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"59b14c47-4d37-4853-8b37-7edfbcaaed09\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " Jun 09 12:01:10.544139 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.544120 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/59b14c47-4d37-4853-8b37-7edfbcaaed09-secret-kube-rbac-proxy\") pod \"59b14c47-4d37-4853-8b37-7edfbcaaed09\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " Jun 09 12:01:10.544517 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.544149 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59b14c47-4d37-4853-8b37-7edfbcaaed09-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "59b14c47-4d37-4853-8b37-7edfbcaaed09" (UID: "59b14c47-4d37-4853-8b37-7edfbcaaed09"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:01:10.544517 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.544182 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/59b14c47-4d37-4853-8b37-7edfbcaaed09-secret-grpc-tls\") pod \"59b14c47-4d37-4853-8b37-7edfbcaaed09\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " Jun 09 12:01:10.544517 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.544210 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-58xww\" (UniqueName: \"kubernetes.io/projected/59b14c47-4d37-4853-8b37-7edfbcaaed09-kube-api-access-58xww\") pod \"59b14c47-4d37-4853-8b37-7edfbcaaed09\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " Jun 09 12:01:10.544517 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.544236 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/59b14c47-4d37-4853-8b37-7edfbcaaed09-config-out\") pod \"59b14c47-4d37-4853-8b37-7edfbcaaed09\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " Jun 09 12:01:10.544517 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.544281 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/59b14c47-4d37-4853-8b37-7edfbcaaed09-prometheus-k8s-rulefiles-0\") pod \"59b14c47-4d37-4853-8b37-7edfbcaaed09\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " Jun 09 12:01:10.544517 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.544313 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59b14c47-4d37-4853-8b37-7edfbcaaed09-configmap-kubelet-serving-ca-bundle\") pod \"59b14c47-4d37-4853-8b37-7edfbcaaed09\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " Jun 09 12:01:10.544517 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.544339 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59b14c47-4d37-4853-8b37-7edfbcaaed09-configmap-metrics-client-ca\") pod \"59b14c47-4d37-4853-8b37-7edfbcaaed09\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " Jun 09 12:01:10.544517 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.544380 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/59b14c47-4d37-4853-8b37-7edfbcaaed09-web-config\") pod \"59b14c47-4d37-4853-8b37-7edfbcaaed09\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " Jun 09 12:01:10.544517 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.544414 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59b14c47-4d37-4853-8b37-7edfbcaaed09-configmap-serving-certs-ca-bundle\") pod \"59b14c47-4d37-4853-8b37-7edfbcaaed09\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " Jun 09 12:01:10.544517 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.544454 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/59b14c47-4d37-4853-8b37-7edfbcaaed09-thanos-prometheus-http-client-file\") pod \"59b14c47-4d37-4853-8b37-7edfbcaaed09\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " Jun 09 12:01:10.544517 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.544483 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/59b14c47-4d37-4853-8b37-7edfbcaaed09-prometheus-k8s-rulefiles-1\") pod \"59b14c47-4d37-4853-8b37-7edfbcaaed09\" (UID: \"59b14c47-4d37-4853-8b37-7edfbcaaed09\") " Jun 09 12:01:10.545035 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.544775 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/59b14c47-4d37-4853-8b37-7edfbcaaed09-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-133-80.ec2.internal\" DevicePath \"\"" Jun 09 12:01:10.545089 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.545038 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59b14c47-4d37-4853-8b37-7edfbcaaed09-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "59b14c47-4d37-4853-8b37-7edfbcaaed09" (UID: "59b14c47-4d37-4853-8b37-7edfbcaaed09"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:01:10.545439 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.545310 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59b14c47-4d37-4853-8b37-7edfbcaaed09-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "59b14c47-4d37-4853-8b37-7edfbcaaed09" (UID: "59b14c47-4d37-4853-8b37-7edfbcaaed09"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:01:10.546028 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.545743 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59b14c47-4d37-4853-8b37-7edfbcaaed09-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "59b14c47-4d37-4853-8b37-7edfbcaaed09" (UID: "59b14c47-4d37-4853-8b37-7edfbcaaed09"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:01:10.546200 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.546024 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59b14c47-4d37-4853-8b37-7edfbcaaed09-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "59b14c47-4d37-4853-8b37-7edfbcaaed09" (UID: "59b14c47-4d37-4853-8b37-7edfbcaaed09"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:01:10.547047 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.546815 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59b14c47-4d37-4853-8b37-7edfbcaaed09-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "59b14c47-4d37-4853-8b37-7edfbcaaed09" (UID: "59b14c47-4d37-4853-8b37-7edfbcaaed09"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:01:10.547143 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.547050 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59b14c47-4d37-4853-8b37-7edfbcaaed09-config" (OuterVolumeSpecName: "config") pod "59b14c47-4d37-4853-8b37-7edfbcaaed09" (UID: "59b14c47-4d37-4853-8b37-7edfbcaaed09"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:01:10.547143 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.547112 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59b14c47-4d37-4853-8b37-7edfbcaaed09-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "59b14c47-4d37-4853-8b37-7edfbcaaed09" (UID: "59b14c47-4d37-4853-8b37-7edfbcaaed09"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:01:10.547259 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.547132 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59b14c47-4d37-4853-8b37-7edfbcaaed09-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "59b14c47-4d37-4853-8b37-7edfbcaaed09" (UID: "59b14c47-4d37-4853-8b37-7edfbcaaed09"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:01:10.547313 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.547274 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59b14c47-4d37-4853-8b37-7edfbcaaed09-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "59b14c47-4d37-4853-8b37-7edfbcaaed09" (UID: "59b14c47-4d37-4853-8b37-7edfbcaaed09"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:01:10.547584 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.547500 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59b14c47-4d37-4853-8b37-7edfbcaaed09-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "59b14c47-4d37-4853-8b37-7edfbcaaed09" (UID: "59b14c47-4d37-4853-8b37-7edfbcaaed09"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:01:10.550962 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.550938 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59b14c47-4d37-4853-8b37-7edfbcaaed09-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "59b14c47-4d37-4853-8b37-7edfbcaaed09" (UID: "59b14c47-4d37-4853-8b37-7edfbcaaed09"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:01:10.551154 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.551116 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59b14c47-4d37-4853-8b37-7edfbcaaed09-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "59b14c47-4d37-4853-8b37-7edfbcaaed09" (UID: "59b14c47-4d37-4853-8b37-7edfbcaaed09"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:01:10.551259 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.551161 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59b14c47-4d37-4853-8b37-7edfbcaaed09-kube-api-access-58xww" (OuterVolumeSpecName: "kube-api-access-58xww") pod "59b14c47-4d37-4853-8b37-7edfbcaaed09" (UID: "59b14c47-4d37-4853-8b37-7edfbcaaed09"). InnerVolumeSpecName "kube-api-access-58xww". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:01:10.551396 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.551361 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59b14c47-4d37-4853-8b37-7edfbcaaed09-config-out" (OuterVolumeSpecName: "config-out") pod "59b14c47-4d37-4853-8b37-7edfbcaaed09" (UID: "59b14c47-4d37-4853-8b37-7edfbcaaed09"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:01:10.551396 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.551387 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59b14c47-4d37-4853-8b37-7edfbcaaed09-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "59b14c47-4d37-4853-8b37-7edfbcaaed09" (UID: "59b14c47-4d37-4853-8b37-7edfbcaaed09"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:01:10.551547 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.551463 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59b14c47-4d37-4853-8b37-7edfbcaaed09-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "59b14c47-4d37-4853-8b37-7edfbcaaed09" (UID: "59b14c47-4d37-4853-8b37-7edfbcaaed09"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:01:10.552295 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.552271 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59b14c47-4d37-4853-8b37-7edfbcaaed09-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "59b14c47-4d37-4853-8b37-7edfbcaaed09" (UID: "59b14c47-4d37-4853-8b37-7edfbcaaed09"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:01:10.552398 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.552318 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59b14c47-4d37-4853-8b37-7edfbcaaed09-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "59b14c47-4d37-4853-8b37-7edfbcaaed09" (UID: "59b14c47-4d37-4853-8b37-7edfbcaaed09"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:01:10.562648 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.562604 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59b14c47-4d37-4853-8b37-7edfbcaaed09-web-config" (OuterVolumeSpecName: "web-config") pod "59b14c47-4d37-4853-8b37-7edfbcaaed09" (UID: "59b14c47-4d37-4853-8b37-7edfbcaaed09"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:01:10.645229 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.645194 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/59b14c47-4d37-4853-8b37-7edfbcaaed09-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-133-80.ec2.internal\" DevicePath \"\"" Jun 09 12:01:10.645229 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.645227 2577 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/59b14c47-4d37-4853-8b37-7edfbcaaed09-secret-kube-rbac-proxy\") on node \"ip-10-0-133-80.ec2.internal\" DevicePath \"\"" Jun 09 12:01:10.645229 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.645238 2577 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/59b14c47-4d37-4853-8b37-7edfbcaaed09-secret-grpc-tls\") on node \"ip-10-0-133-80.ec2.internal\" DevicePath \"\"" Jun 09 12:01:10.645453 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.645246 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-58xww\" (UniqueName: \"kubernetes.io/projected/59b14c47-4d37-4853-8b37-7edfbcaaed09-kube-api-access-58xww\") on node \"ip-10-0-133-80.ec2.internal\" DevicePath \"\"" Jun 09 12:01:10.645453 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.645255 2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/59b14c47-4d37-4853-8b37-7edfbcaaed09-config-out\") on node \"ip-10-0-133-80.ec2.internal\" DevicePath \"\"" Jun 09 12:01:10.645453 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.645263 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/59b14c47-4d37-4853-8b37-7edfbcaaed09-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-133-80.ec2.internal\" DevicePath \"\"" Jun 09 12:01:10.645453 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.645271 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59b14c47-4d37-4853-8b37-7edfbcaaed09-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-133-80.ec2.internal\" DevicePath \"\"" Jun 09 12:01:10.645453 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.645280 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59b14c47-4d37-4853-8b37-7edfbcaaed09-configmap-metrics-client-ca\") on node \"ip-10-0-133-80.ec2.internal\" DevicePath \"\"" Jun 09 12:01:10.645453 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.645289 2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/59b14c47-4d37-4853-8b37-7edfbcaaed09-web-config\") on node \"ip-10-0-133-80.ec2.internal\" DevicePath \"\"" Jun 09 12:01:10.645453 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.645298 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59b14c47-4d37-4853-8b37-7edfbcaaed09-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-133-80.ec2.internal\" DevicePath \"\"" Jun 09 12:01:10.645453 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.645306 2577 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/59b14c47-4d37-4853-8b37-7edfbcaaed09-thanos-prometheus-http-client-file\") on node \"ip-10-0-133-80.ec2.internal\" DevicePath \"\"" Jun 09 12:01:10.645453 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.645314 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/59b14c47-4d37-4853-8b37-7edfbcaaed09-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-133-80.ec2.internal\" DevicePath \"\"" Jun 09 12:01:10.645453 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.645322 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/59b14c47-4d37-4853-8b37-7edfbcaaed09-prometheus-k8s-db\") on node \"ip-10-0-133-80.ec2.internal\" DevicePath \"\"" Jun 09 12:01:10.645453 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.645331 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/59b14c47-4d37-4853-8b37-7edfbcaaed09-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-133-80.ec2.internal\" DevicePath \"\"" Jun 09 12:01:10.645453 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.645340 2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/59b14c47-4d37-4853-8b37-7edfbcaaed09-tls-assets\") on node \"ip-10-0-133-80.ec2.internal\" DevicePath \"\"" Jun 09 12:01:10.645453 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.645349 2577 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/59b14c47-4d37-4853-8b37-7edfbcaaed09-secret-metrics-client-certs\") on node \"ip-10-0-133-80.ec2.internal\" DevicePath \"\"" Jun 09 12:01:10.645453 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.645357 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/59b14c47-4d37-4853-8b37-7edfbcaaed09-secret-prometheus-k8s-tls\") on node \"ip-10-0-133-80.ec2.internal\" DevicePath \"\"" Jun 09 12:01:10.645453 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.645365 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59b14c47-4d37-4853-8b37-7edfbcaaed09-prometheus-trusted-ca-bundle\") on node \"ip-10-0-133-80.ec2.internal\" DevicePath \"\"" Jun 09 12:01:10.645453 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:10.645373 2577 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/59b14c47-4d37-4853-8b37-7edfbcaaed09-config\") on node \"ip-10-0-133-80.ec2.internal\" DevicePath \"\"" Jun 09 12:01:11.250193 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.250093 2577 generic.go:356] "Generic (PLEG): container finished" podID="59b14c47-4d37-4853-8b37-7edfbcaaed09" containerID="19dc7f1849d14a348a93c9bd2836e68755bff3079e079161a44744b978caefcd" exitCode=0 Jun 09 12:01:11.250193 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.250123 2577 generic.go:356] "Generic (PLEG): container finished" podID="59b14c47-4d37-4853-8b37-7edfbcaaed09" containerID="3a260ee540e09e7ecf8cc5d682ab2afa205d4620c46bedfdab2ee982b6edfbc1" exitCode=0 Jun 09 12:01:11.250193 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.250133 2577 generic.go:356] "Generic (PLEG): container finished" podID="59b14c47-4d37-4853-8b37-7edfbcaaed09" containerID="4e8944c31b4f81066e7e718bc7372483859b4164c1bc1a9a97ee6d8ca37a9bac" exitCode=0 Jun 09 12:01:11.250193 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.250142 2577 generic.go:356] "Generic (PLEG): container finished" podID="59b14c47-4d37-4853-8b37-7edfbcaaed09" containerID="f23948441119f155ea2617198402b893fa7c5a6330b4f20111976283a388da2f" exitCode=0 Jun 09 12:01:11.250193 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.250150 2577 generic.go:356] "Generic (PLEG): container finished" podID="59b14c47-4d37-4853-8b37-7edfbcaaed09" containerID="b1f1cde9ac750bde508b7d950f4d027a32e201764dda6c2199f807a692087c95" exitCode=0 Jun 09 12:01:11.250193 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.250158 2577 generic.go:356] "Generic (PLEG): container finished" podID="59b14c47-4d37-4853-8b37-7edfbcaaed09" containerID="d5c1ba6b29e2911e24aeba41b355d3078ed3b8325373570e11de80997f2fbbfc" exitCode=0 Jun 09 12:01:11.250193 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.250162 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.250193 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.250173 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"59b14c47-4d37-4853-8b37-7edfbcaaed09","Type":"ContainerDied","Data":"19dc7f1849d14a348a93c9bd2836e68755bff3079e079161a44744b978caefcd"} Jun 09 12:01:11.251160 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.250245 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"59b14c47-4d37-4853-8b37-7edfbcaaed09","Type":"ContainerDied","Data":"3a260ee540e09e7ecf8cc5d682ab2afa205d4620c46bedfdab2ee982b6edfbc1"} Jun 09 12:01:11.251160 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.250273 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"59b14c47-4d37-4853-8b37-7edfbcaaed09","Type":"ContainerDied","Data":"4e8944c31b4f81066e7e718bc7372483859b4164c1bc1a9a97ee6d8ca37a9bac"} Jun 09 12:01:11.251160 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.250298 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"59b14c47-4d37-4853-8b37-7edfbcaaed09","Type":"ContainerDied","Data":"f23948441119f155ea2617198402b893fa7c5a6330b4f20111976283a388da2f"} Jun 09 12:01:11.251160 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.250318 2577 scope.go:117] "RemoveContainer" containerID="19dc7f1849d14a348a93c9bd2836e68755bff3079e079161a44744b978caefcd" Jun 09 12:01:11.251160 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.250322 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"59b14c47-4d37-4853-8b37-7edfbcaaed09","Type":"ContainerDied","Data":"b1f1cde9ac750bde508b7d950f4d027a32e201764dda6c2199f807a692087c95"} Jun 09 12:01:11.251160 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.250476 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"59b14c47-4d37-4853-8b37-7edfbcaaed09","Type":"ContainerDied","Data":"d5c1ba6b29e2911e24aeba41b355d3078ed3b8325373570e11de80997f2fbbfc"} Jun 09 12:01:11.251160 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.250519 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"59b14c47-4d37-4853-8b37-7edfbcaaed09","Type":"ContainerDied","Data":"0184a100785bcf4f526be4658aca0ae493e65a7e02e62501648b897ae1dc872a"} Jun 09 12:01:11.262855 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.262828 2577 scope.go:117] "RemoveContainer" containerID="3a260ee540e09e7ecf8cc5d682ab2afa205d4620c46bedfdab2ee982b6edfbc1" Jun 09 12:01:11.270874 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.270850 2577 scope.go:117] "RemoveContainer" containerID="4e8944c31b4f81066e7e718bc7372483859b4164c1bc1a9a97ee6d8ca37a9bac" Jun 09 12:01:11.278467 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.278373 2577 scope.go:117] "RemoveContainer" containerID="f23948441119f155ea2617198402b893fa7c5a6330b4f20111976283a388da2f" Jun 09 12:01:11.280437 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.280401 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 12:01:11.285323 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.285297 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 12:01:11.288968 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.288947 2577 scope.go:117] "RemoveContainer" containerID="b1f1cde9ac750bde508b7d950f4d027a32e201764dda6c2199f807a692087c95" Jun 09 12:01:11.296400 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.296382 2577 scope.go:117] "RemoveContainer" containerID="d5c1ba6b29e2911e24aeba41b355d3078ed3b8325373570e11de80997f2fbbfc" Jun 09 12:01:11.304049 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.304026 2577 scope.go:117] "RemoveContainer" containerID="d9829f3d42335bac94071a71dbc31541734570ca84a1b910ee8ee2462d8e3273" Jun 09 12:01:11.310759 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.310734 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 12:01:11.311121 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.311103 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59b14c47-4d37-4853-8b37-7edfbcaaed09" containerName="thanos-sidecar" Jun 09 12:01:11.311204 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.311122 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="59b14c47-4d37-4853-8b37-7edfbcaaed09" containerName="thanos-sidecar" Jun 09 12:01:11.311204 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.311135 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59b14c47-4d37-4853-8b37-7edfbcaaed09" containerName="kube-rbac-proxy" Jun 09 12:01:11.311204 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.311145 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="59b14c47-4d37-4853-8b37-7edfbcaaed09" containerName="kube-rbac-proxy" Jun 09 12:01:11.311204 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.311159 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59b14c47-4d37-4853-8b37-7edfbcaaed09" containerName="init-config-reloader" Jun 09 12:01:11.311204 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.311169 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="59b14c47-4d37-4853-8b37-7edfbcaaed09" containerName="init-config-reloader" Jun 09 12:01:11.311204 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.311177 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59b14c47-4d37-4853-8b37-7edfbcaaed09" containerName="prometheus" Jun 09 12:01:11.311204 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.311186 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="59b14c47-4d37-4853-8b37-7edfbcaaed09" containerName="prometheus" Jun 09 12:01:11.311204 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.311201 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59b14c47-4d37-4853-8b37-7edfbcaaed09" containerName="config-reloader" Jun 09 12:01:11.311669 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.311211 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="59b14c47-4d37-4853-8b37-7edfbcaaed09" containerName="config-reloader" Jun 09 12:01:11.311669 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.311225 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59b14c47-4d37-4853-8b37-7edfbcaaed09" containerName="kube-rbac-proxy-thanos" Jun 09 12:01:11.311669 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.311233 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="59b14c47-4d37-4853-8b37-7edfbcaaed09" containerName="kube-rbac-proxy-thanos" Jun 09 12:01:11.311669 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.311250 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59b14c47-4d37-4853-8b37-7edfbcaaed09" containerName="kube-rbac-proxy-web" Jun 09 12:01:11.311669 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.311258 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="59b14c47-4d37-4853-8b37-7edfbcaaed09" containerName="kube-rbac-proxy-web" Jun 09 12:01:11.311669 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.311282 2577 scope.go:117] "RemoveContainer" containerID="19dc7f1849d14a348a93c9bd2836e68755bff3079e079161a44744b978caefcd" Jun 09 12:01:11.311669 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.311324 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="59b14c47-4d37-4853-8b37-7edfbcaaed09" containerName="prometheus" Jun 09 12:01:11.311669 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.311339 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="59b14c47-4d37-4853-8b37-7edfbcaaed09" containerName="kube-rbac-proxy" Jun 09 12:01:11.311669 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.311350 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="59b14c47-4d37-4853-8b37-7edfbcaaed09" containerName="thanos-sidecar" Jun 09 12:01:11.311669 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.311359 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="59b14c47-4d37-4853-8b37-7edfbcaaed09" containerName="config-reloader" Jun 09 12:01:11.311669 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.311369 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="59b14c47-4d37-4853-8b37-7edfbcaaed09" containerName="kube-rbac-proxy-web" Jun 09 12:01:11.311669 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.311379 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="59b14c47-4d37-4853-8b37-7edfbcaaed09" containerName="kube-rbac-proxy-thanos" Jun 09 12:01:11.311669 ip-10-0-133-80 kubenswrapper[2577]: E0609 12:01:11.311539 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19dc7f1849d14a348a93c9bd2836e68755bff3079e079161a44744b978caefcd\": container with ID starting with 19dc7f1849d14a348a93c9bd2836e68755bff3079e079161a44744b978caefcd not found: ID does not exist" containerID="19dc7f1849d14a348a93c9bd2836e68755bff3079e079161a44744b978caefcd" Jun 09 12:01:11.311669 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.311575 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19dc7f1849d14a348a93c9bd2836e68755bff3079e079161a44744b978caefcd"} err="failed to get container status \"19dc7f1849d14a348a93c9bd2836e68755bff3079e079161a44744b978caefcd\": rpc error: code = NotFound desc = could not find container \"19dc7f1849d14a348a93c9bd2836e68755bff3079e079161a44744b978caefcd\": container with ID starting with 19dc7f1849d14a348a93c9bd2836e68755bff3079e079161a44744b978caefcd not found: ID does not exist" Jun 09 12:01:11.311669 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.311594 2577 scope.go:117] "RemoveContainer" containerID="3a260ee540e09e7ecf8cc5d682ab2afa205d4620c46bedfdab2ee982b6edfbc1" Jun 09 12:01:11.312383 ip-10-0-133-80 kubenswrapper[2577]: E0609 12:01:11.311839 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a260ee540e09e7ecf8cc5d682ab2afa205d4620c46bedfdab2ee982b6edfbc1\": container with ID starting with 3a260ee540e09e7ecf8cc5d682ab2afa205d4620c46bedfdab2ee982b6edfbc1 not found: ID does not exist" containerID="3a260ee540e09e7ecf8cc5d682ab2afa205d4620c46bedfdab2ee982b6edfbc1" Jun 09 12:01:11.312383 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.311864 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a260ee540e09e7ecf8cc5d682ab2afa205d4620c46bedfdab2ee982b6edfbc1"} err="failed to get container status \"3a260ee540e09e7ecf8cc5d682ab2afa205d4620c46bedfdab2ee982b6edfbc1\": rpc error: code = NotFound desc = could not find container \"3a260ee540e09e7ecf8cc5d682ab2afa205d4620c46bedfdab2ee982b6edfbc1\": container with ID starting with 3a260ee540e09e7ecf8cc5d682ab2afa205d4620c46bedfdab2ee982b6edfbc1 not found: ID does not exist" Jun 09 12:01:11.312383 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.311879 2577 scope.go:117] "RemoveContainer" containerID="4e8944c31b4f81066e7e718bc7372483859b4164c1bc1a9a97ee6d8ca37a9bac" Jun 09 12:01:11.312383 ip-10-0-133-80 kubenswrapper[2577]: E0609 12:01:11.312123 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e8944c31b4f81066e7e718bc7372483859b4164c1bc1a9a97ee6d8ca37a9bac\": container with ID starting with 4e8944c31b4f81066e7e718bc7372483859b4164c1bc1a9a97ee6d8ca37a9bac not found: ID does not exist" containerID="4e8944c31b4f81066e7e718bc7372483859b4164c1bc1a9a97ee6d8ca37a9bac" Jun 09 12:01:11.312383 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.312139 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e8944c31b4f81066e7e718bc7372483859b4164c1bc1a9a97ee6d8ca37a9bac"} err="failed to get container status \"4e8944c31b4f81066e7e718bc7372483859b4164c1bc1a9a97ee6d8ca37a9bac\": rpc error: code = NotFound desc = could not find container \"4e8944c31b4f81066e7e718bc7372483859b4164c1bc1a9a97ee6d8ca37a9bac\": container with ID starting with 4e8944c31b4f81066e7e718bc7372483859b4164c1bc1a9a97ee6d8ca37a9bac not found: ID does not exist" Jun 09 12:01:11.312383 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.312150 2577 scope.go:117] "RemoveContainer" containerID="f23948441119f155ea2617198402b893fa7c5a6330b4f20111976283a388da2f" Jun 09 12:01:11.312383 ip-10-0-133-80 kubenswrapper[2577]: E0609 12:01:11.312330 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f23948441119f155ea2617198402b893fa7c5a6330b4f20111976283a388da2f\": container with ID starting with f23948441119f155ea2617198402b893fa7c5a6330b4f20111976283a388da2f not found: ID does not exist" containerID="f23948441119f155ea2617198402b893fa7c5a6330b4f20111976283a388da2f" Jun 09 12:01:11.312383 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.312346 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f23948441119f155ea2617198402b893fa7c5a6330b4f20111976283a388da2f"} err="failed to get container status \"f23948441119f155ea2617198402b893fa7c5a6330b4f20111976283a388da2f\": rpc error: code = NotFound desc = could not find container \"f23948441119f155ea2617198402b893fa7c5a6330b4f20111976283a388da2f\": container with ID starting with f23948441119f155ea2617198402b893fa7c5a6330b4f20111976283a388da2f not found: ID does not exist" Jun 09 12:01:11.312383 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.312357 2577 scope.go:117] "RemoveContainer" containerID="b1f1cde9ac750bde508b7d950f4d027a32e201764dda6c2199f807a692087c95" Jun 09 12:01:11.312837 ip-10-0-133-80 kubenswrapper[2577]: E0609 12:01:11.312540 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1f1cde9ac750bde508b7d950f4d027a32e201764dda6c2199f807a692087c95\": container with ID starting with b1f1cde9ac750bde508b7d950f4d027a32e201764dda6c2199f807a692087c95 not found: ID does not exist" containerID="b1f1cde9ac750bde508b7d950f4d027a32e201764dda6c2199f807a692087c95" Jun 09 12:01:11.312837 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.312567 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1f1cde9ac750bde508b7d950f4d027a32e201764dda6c2199f807a692087c95"} err="failed to get container status \"b1f1cde9ac750bde508b7d950f4d027a32e201764dda6c2199f807a692087c95\": rpc error: code = NotFound desc = could not find container \"b1f1cde9ac750bde508b7d950f4d027a32e201764dda6c2199f807a692087c95\": container with ID starting with b1f1cde9ac750bde508b7d950f4d027a32e201764dda6c2199f807a692087c95 not found: ID does not exist" Jun 09 12:01:11.312837 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.312580 2577 scope.go:117] "RemoveContainer" containerID="d5c1ba6b29e2911e24aeba41b355d3078ed3b8325373570e11de80997f2fbbfc" Jun 09 12:01:11.312837 ip-10-0-133-80 kubenswrapper[2577]: E0609 12:01:11.312784 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5c1ba6b29e2911e24aeba41b355d3078ed3b8325373570e11de80997f2fbbfc\": container with ID starting with d5c1ba6b29e2911e24aeba41b355d3078ed3b8325373570e11de80997f2fbbfc not found: ID does not exist" containerID="d5c1ba6b29e2911e24aeba41b355d3078ed3b8325373570e11de80997f2fbbfc" Jun 09 12:01:11.312837 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.312802 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5c1ba6b29e2911e24aeba41b355d3078ed3b8325373570e11de80997f2fbbfc"} err="failed to get container status \"d5c1ba6b29e2911e24aeba41b355d3078ed3b8325373570e11de80997f2fbbfc\": rpc error: code = NotFound desc = could not find container \"d5c1ba6b29e2911e24aeba41b355d3078ed3b8325373570e11de80997f2fbbfc\": container with ID starting with d5c1ba6b29e2911e24aeba41b355d3078ed3b8325373570e11de80997f2fbbfc not found: ID does not exist" Jun 09 12:01:11.312837 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.312815 2577 scope.go:117] "RemoveContainer" containerID="d9829f3d42335bac94071a71dbc31541734570ca84a1b910ee8ee2462d8e3273" Jun 09 12:01:11.313104 ip-10-0-133-80 kubenswrapper[2577]: E0609 12:01:11.313044 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9829f3d42335bac94071a71dbc31541734570ca84a1b910ee8ee2462d8e3273\": container with ID starting with d9829f3d42335bac94071a71dbc31541734570ca84a1b910ee8ee2462d8e3273 not found: ID does not exist" containerID="d9829f3d42335bac94071a71dbc31541734570ca84a1b910ee8ee2462d8e3273" Jun 09 12:01:11.313104 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.313060 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9829f3d42335bac94071a71dbc31541734570ca84a1b910ee8ee2462d8e3273"} err="failed to get container status \"d9829f3d42335bac94071a71dbc31541734570ca84a1b910ee8ee2462d8e3273\": rpc error: code = NotFound desc = could not find container \"d9829f3d42335bac94071a71dbc31541734570ca84a1b910ee8ee2462d8e3273\": container with ID starting with d9829f3d42335bac94071a71dbc31541734570ca84a1b910ee8ee2462d8e3273 not found: ID does not exist" Jun 09 12:01:11.313104 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.313072 2577 scope.go:117] "RemoveContainer" containerID="19dc7f1849d14a348a93c9bd2836e68755bff3079e079161a44744b978caefcd" Jun 09 12:01:11.313260 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.313245 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19dc7f1849d14a348a93c9bd2836e68755bff3079e079161a44744b978caefcd"} err="failed to get container status \"19dc7f1849d14a348a93c9bd2836e68755bff3079e079161a44744b978caefcd\": rpc error: code = NotFound desc = could not find container \"19dc7f1849d14a348a93c9bd2836e68755bff3079e079161a44744b978caefcd\": container with ID starting with 19dc7f1849d14a348a93c9bd2836e68755bff3079e079161a44744b978caefcd not found: ID does not exist" Jun 09 12:01:11.313298 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.313260 2577 scope.go:117] "RemoveContainer" containerID="3a260ee540e09e7ecf8cc5d682ab2afa205d4620c46bedfdab2ee982b6edfbc1" Jun 09 12:01:11.313467 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.313453 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a260ee540e09e7ecf8cc5d682ab2afa205d4620c46bedfdab2ee982b6edfbc1"} err="failed to get container status \"3a260ee540e09e7ecf8cc5d682ab2afa205d4620c46bedfdab2ee982b6edfbc1\": rpc error: code = NotFound desc = could not find container \"3a260ee540e09e7ecf8cc5d682ab2afa205d4620c46bedfdab2ee982b6edfbc1\": container with ID starting with 3a260ee540e09e7ecf8cc5d682ab2afa205d4620c46bedfdab2ee982b6edfbc1 not found: ID does not exist" Jun 09 12:01:11.313507 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.313466 2577 scope.go:117] "RemoveContainer" containerID="4e8944c31b4f81066e7e718bc7372483859b4164c1bc1a9a97ee6d8ca37a9bac" Jun 09 12:01:11.313710 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.313690 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e8944c31b4f81066e7e718bc7372483859b4164c1bc1a9a97ee6d8ca37a9bac"} err="failed to get container status \"4e8944c31b4f81066e7e718bc7372483859b4164c1bc1a9a97ee6d8ca37a9bac\": rpc error: code = NotFound desc = could not find container \"4e8944c31b4f81066e7e718bc7372483859b4164c1bc1a9a97ee6d8ca37a9bac\": container with ID starting with 4e8944c31b4f81066e7e718bc7372483859b4164c1bc1a9a97ee6d8ca37a9bac not found: ID does not exist" Jun 09 12:01:11.313755 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.313711 2577 scope.go:117] "RemoveContainer" containerID="f23948441119f155ea2617198402b893fa7c5a6330b4f20111976283a388da2f" Jun 09 12:01:11.313933 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.313913 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f23948441119f155ea2617198402b893fa7c5a6330b4f20111976283a388da2f"} err="failed to get container status \"f23948441119f155ea2617198402b893fa7c5a6330b4f20111976283a388da2f\": rpc error: code = NotFound desc = could not find container \"f23948441119f155ea2617198402b893fa7c5a6330b4f20111976283a388da2f\": container with ID starting with f23948441119f155ea2617198402b893fa7c5a6330b4f20111976283a388da2f not found: ID does not exist" Jun 09 12:01:11.314018 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.313933 2577 scope.go:117] "RemoveContainer" containerID="b1f1cde9ac750bde508b7d950f4d027a32e201764dda6c2199f807a692087c95" Jun 09 12:01:11.314146 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.314128 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1f1cde9ac750bde508b7d950f4d027a32e201764dda6c2199f807a692087c95"} err="failed to get container status \"b1f1cde9ac750bde508b7d950f4d027a32e201764dda6c2199f807a692087c95\": rpc error: code = NotFound desc = could not find container \"b1f1cde9ac750bde508b7d950f4d027a32e201764dda6c2199f807a692087c95\": container with ID starting with b1f1cde9ac750bde508b7d950f4d027a32e201764dda6c2199f807a692087c95 not found: ID does not exist" Jun 09 12:01:11.314206 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.314146 2577 scope.go:117] "RemoveContainer" containerID="d5c1ba6b29e2911e24aeba41b355d3078ed3b8325373570e11de80997f2fbbfc" Jun 09 12:01:11.314392 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.314338 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5c1ba6b29e2911e24aeba41b355d3078ed3b8325373570e11de80997f2fbbfc"} err="failed to get container status \"d5c1ba6b29e2911e24aeba41b355d3078ed3b8325373570e11de80997f2fbbfc\": rpc error: code = NotFound desc = could not find container \"d5c1ba6b29e2911e24aeba41b355d3078ed3b8325373570e11de80997f2fbbfc\": container with ID starting with d5c1ba6b29e2911e24aeba41b355d3078ed3b8325373570e11de80997f2fbbfc not found: ID does not exist" Jun 09 12:01:11.314392 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.314355 2577 scope.go:117] "RemoveContainer" containerID="d9829f3d42335bac94071a71dbc31541734570ca84a1b910ee8ee2462d8e3273" Jun 09 12:01:11.314665 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.314639 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9829f3d42335bac94071a71dbc31541734570ca84a1b910ee8ee2462d8e3273"} err="failed to get container status \"d9829f3d42335bac94071a71dbc31541734570ca84a1b910ee8ee2462d8e3273\": rpc error: code = NotFound desc = could not find container \"d9829f3d42335bac94071a71dbc31541734570ca84a1b910ee8ee2462d8e3273\": container with ID starting with d9829f3d42335bac94071a71dbc31541734570ca84a1b910ee8ee2462d8e3273 not found: ID does not exist" Jun 09 12:01:11.314743 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.314668 2577 scope.go:117] "RemoveContainer" containerID="19dc7f1849d14a348a93c9bd2836e68755bff3079e079161a44744b978caefcd" Jun 09 12:01:11.314977 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.314959 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19dc7f1849d14a348a93c9bd2836e68755bff3079e079161a44744b978caefcd"} err="failed to get container status \"19dc7f1849d14a348a93c9bd2836e68755bff3079e079161a44744b978caefcd\": rpc error: code = NotFound desc = could not find container \"19dc7f1849d14a348a93c9bd2836e68755bff3079e079161a44744b978caefcd\": container with ID starting with 19dc7f1849d14a348a93c9bd2836e68755bff3079e079161a44744b978caefcd not found: ID does not exist" Jun 09 12:01:11.315030 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.314977 2577 scope.go:117] "RemoveContainer" containerID="3a260ee540e09e7ecf8cc5d682ab2afa205d4620c46bedfdab2ee982b6edfbc1" Jun 09 12:01:11.315202 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.315184 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a260ee540e09e7ecf8cc5d682ab2afa205d4620c46bedfdab2ee982b6edfbc1"} err="failed to get container status \"3a260ee540e09e7ecf8cc5d682ab2afa205d4620c46bedfdab2ee982b6edfbc1\": rpc error: code = NotFound desc = could not find container \"3a260ee540e09e7ecf8cc5d682ab2afa205d4620c46bedfdab2ee982b6edfbc1\": container with ID starting with 3a260ee540e09e7ecf8cc5d682ab2afa205d4620c46bedfdab2ee982b6edfbc1 not found: ID does not exist" Jun 09 12:01:11.315243 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.315204 2577 scope.go:117] "RemoveContainer" containerID="4e8944c31b4f81066e7e718bc7372483859b4164c1bc1a9a97ee6d8ca37a9bac" Jun 09 12:01:11.315403 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.315384 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e8944c31b4f81066e7e718bc7372483859b4164c1bc1a9a97ee6d8ca37a9bac"} err="failed to get container status \"4e8944c31b4f81066e7e718bc7372483859b4164c1bc1a9a97ee6d8ca37a9bac\": rpc error: code = NotFound desc = could not find container \"4e8944c31b4f81066e7e718bc7372483859b4164c1bc1a9a97ee6d8ca37a9bac\": container with ID starting with 4e8944c31b4f81066e7e718bc7372483859b4164c1bc1a9a97ee6d8ca37a9bac not found: ID does not exist" Jun 09 12:01:11.315453 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.315403 2577 scope.go:117] "RemoveContainer" containerID="f23948441119f155ea2617198402b893fa7c5a6330b4f20111976283a388da2f" Jun 09 12:01:11.315706 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.315686 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f23948441119f155ea2617198402b893fa7c5a6330b4f20111976283a388da2f"} err="failed to get container status \"f23948441119f155ea2617198402b893fa7c5a6330b4f20111976283a388da2f\": rpc error: code = NotFound desc = could not find container \"f23948441119f155ea2617198402b893fa7c5a6330b4f20111976283a388da2f\": container with ID starting with f23948441119f155ea2617198402b893fa7c5a6330b4f20111976283a388da2f not found: ID does not exist" Jun 09 12:01:11.315706 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.315704 2577 scope.go:117] "RemoveContainer" containerID="b1f1cde9ac750bde508b7d950f4d027a32e201764dda6c2199f807a692087c95" Jun 09 12:01:11.315936 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.315918 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1f1cde9ac750bde508b7d950f4d027a32e201764dda6c2199f807a692087c95"} err="failed to get container status \"b1f1cde9ac750bde508b7d950f4d027a32e201764dda6c2199f807a692087c95\": rpc error: code = NotFound desc = could not find container \"b1f1cde9ac750bde508b7d950f4d027a32e201764dda6c2199f807a692087c95\": container with ID starting with b1f1cde9ac750bde508b7d950f4d027a32e201764dda6c2199f807a692087c95 not found: ID does not exist" Jun 09 12:01:11.315995 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.315937 2577 scope.go:117] "RemoveContainer" containerID="d5c1ba6b29e2911e24aeba41b355d3078ed3b8325373570e11de80997f2fbbfc" Jun 09 12:01:11.316208 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.316188 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5c1ba6b29e2911e24aeba41b355d3078ed3b8325373570e11de80997f2fbbfc"} err="failed to get container status \"d5c1ba6b29e2911e24aeba41b355d3078ed3b8325373570e11de80997f2fbbfc\": rpc error: code = NotFound desc = could not find container \"d5c1ba6b29e2911e24aeba41b355d3078ed3b8325373570e11de80997f2fbbfc\": container with ID starting with d5c1ba6b29e2911e24aeba41b355d3078ed3b8325373570e11de80997f2fbbfc not found: ID does not exist" Jun 09 12:01:11.316268 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.316208 2577 scope.go:117] "RemoveContainer" containerID="d9829f3d42335bac94071a71dbc31541734570ca84a1b910ee8ee2462d8e3273" Jun 09 12:01:11.316400 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.316384 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9829f3d42335bac94071a71dbc31541734570ca84a1b910ee8ee2462d8e3273"} err="failed to get container status \"d9829f3d42335bac94071a71dbc31541734570ca84a1b910ee8ee2462d8e3273\": rpc error: code = NotFound desc = could not find container \"d9829f3d42335bac94071a71dbc31541734570ca84a1b910ee8ee2462d8e3273\": container with ID starting with d9829f3d42335bac94071a71dbc31541734570ca84a1b910ee8ee2462d8e3273 not found: ID does not exist" Jun 09 12:01:11.316446 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.316401 2577 scope.go:117] "RemoveContainer" containerID="19dc7f1849d14a348a93c9bd2836e68755bff3079e079161a44744b978caefcd" Jun 09 12:01:11.316573 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.316557 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19dc7f1849d14a348a93c9bd2836e68755bff3079e079161a44744b978caefcd"} err="failed to get container status \"19dc7f1849d14a348a93c9bd2836e68755bff3079e079161a44744b978caefcd\": rpc error: code = NotFound desc = could not find container \"19dc7f1849d14a348a93c9bd2836e68755bff3079e079161a44744b978caefcd\": container with ID starting with 19dc7f1849d14a348a93c9bd2836e68755bff3079e079161a44744b978caefcd not found: ID does not exist" Jun 09 12:01:11.316647 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.316574 2577 scope.go:117] "RemoveContainer" containerID="3a260ee540e09e7ecf8cc5d682ab2afa205d4620c46bedfdab2ee982b6edfbc1" Jun 09 12:01:11.316801 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.316780 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a260ee540e09e7ecf8cc5d682ab2afa205d4620c46bedfdab2ee982b6edfbc1"} err="failed to get container status \"3a260ee540e09e7ecf8cc5d682ab2afa205d4620c46bedfdab2ee982b6edfbc1\": rpc error: code = NotFound desc = could not find container \"3a260ee540e09e7ecf8cc5d682ab2afa205d4620c46bedfdab2ee982b6edfbc1\": container with ID starting with 3a260ee540e09e7ecf8cc5d682ab2afa205d4620c46bedfdab2ee982b6edfbc1 not found: ID does not exist" Jun 09 12:01:11.316860 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.316800 2577 scope.go:117] "RemoveContainer" containerID="4e8944c31b4f81066e7e718bc7372483859b4164c1bc1a9a97ee6d8ca37a9bac" Jun 09 12:01:11.316975 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.316958 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e8944c31b4f81066e7e718bc7372483859b4164c1bc1a9a97ee6d8ca37a9bac"} err="failed to get container status \"4e8944c31b4f81066e7e718bc7372483859b4164c1bc1a9a97ee6d8ca37a9bac\": rpc error: code = NotFound desc = could not find container \"4e8944c31b4f81066e7e718bc7372483859b4164c1bc1a9a97ee6d8ca37a9bac\": container with ID starting with 4e8944c31b4f81066e7e718bc7372483859b4164c1bc1a9a97ee6d8ca37a9bac not found: ID does not exist" Jun 09 12:01:11.317019 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.316977 2577 scope.go:117] "RemoveContainer" containerID="f23948441119f155ea2617198402b893fa7c5a6330b4f20111976283a388da2f" Jun 09 12:01:11.317254 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.317229 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f23948441119f155ea2617198402b893fa7c5a6330b4f20111976283a388da2f"} err="failed to get container status \"f23948441119f155ea2617198402b893fa7c5a6330b4f20111976283a388da2f\": rpc error: code = NotFound desc = could not find container \"f23948441119f155ea2617198402b893fa7c5a6330b4f20111976283a388da2f\": container with ID starting with f23948441119f155ea2617198402b893fa7c5a6330b4f20111976283a388da2f not found: ID does not exist" Jun 09 12:01:11.317365 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.317258 2577 scope.go:117] "RemoveContainer" containerID="b1f1cde9ac750bde508b7d950f4d027a32e201764dda6c2199f807a692087c95" Jun 09 12:01:11.317365 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.317241 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.318042 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.317978 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1f1cde9ac750bde508b7d950f4d027a32e201764dda6c2199f807a692087c95"} err="failed to get container status \"b1f1cde9ac750bde508b7d950f4d027a32e201764dda6c2199f807a692087c95\": rpc error: code = NotFound desc = could not find container \"b1f1cde9ac750bde508b7d950f4d027a32e201764dda6c2199f807a692087c95\": container with ID starting with b1f1cde9ac750bde508b7d950f4d027a32e201764dda6c2199f807a692087c95 not found: ID does not exist" Jun 09 12:01:11.318042 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.318001 2577 scope.go:117] "RemoveContainer" containerID="d5c1ba6b29e2911e24aeba41b355d3078ed3b8325373570e11de80997f2fbbfc" Jun 09 12:01:11.318446 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.318260 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5c1ba6b29e2911e24aeba41b355d3078ed3b8325373570e11de80997f2fbbfc"} err="failed to get container status \"d5c1ba6b29e2911e24aeba41b355d3078ed3b8325373570e11de80997f2fbbfc\": rpc error: code = NotFound desc = could not find container \"d5c1ba6b29e2911e24aeba41b355d3078ed3b8325373570e11de80997f2fbbfc\": container with ID starting with d5c1ba6b29e2911e24aeba41b355d3078ed3b8325373570e11de80997f2fbbfc not found: ID does not exist" Jun 09 12:01:11.318446 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.318288 2577 scope.go:117] "RemoveContainer" containerID="d9829f3d42335bac94071a71dbc31541734570ca84a1b910ee8ee2462d8e3273" Jun 09 12:01:11.319693 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.318724 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9829f3d42335bac94071a71dbc31541734570ca84a1b910ee8ee2462d8e3273"} err="failed to get container status \"d9829f3d42335bac94071a71dbc31541734570ca84a1b910ee8ee2462d8e3273\": rpc error: code = NotFound desc = could not find container \"d9829f3d42335bac94071a71dbc31541734570ca84a1b910ee8ee2462d8e3273\": container with ID starting with d9829f3d42335bac94071a71dbc31541734570ca84a1b910ee8ee2462d8e3273 not found: ID does not exist" Jun 09 12:01:11.319693 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.318749 2577 scope.go:117] "RemoveContainer" containerID="19dc7f1849d14a348a93c9bd2836e68755bff3079e079161a44744b978caefcd" Jun 09 12:01:11.319693 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.318982 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19dc7f1849d14a348a93c9bd2836e68755bff3079e079161a44744b978caefcd"} err="failed to get container status \"19dc7f1849d14a348a93c9bd2836e68755bff3079e079161a44744b978caefcd\": rpc error: code = NotFound desc = could not find container \"19dc7f1849d14a348a93c9bd2836e68755bff3079e079161a44744b978caefcd\": container with ID starting with 19dc7f1849d14a348a93c9bd2836e68755bff3079e079161a44744b978caefcd not found: ID does not exist" Jun 09 12:01:11.319693 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.319004 2577 scope.go:117] "RemoveContainer" containerID="3a260ee540e09e7ecf8cc5d682ab2afa205d4620c46bedfdab2ee982b6edfbc1" Jun 09 12:01:11.319693 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.319229 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a260ee540e09e7ecf8cc5d682ab2afa205d4620c46bedfdab2ee982b6edfbc1"} err="failed to get container status \"3a260ee540e09e7ecf8cc5d682ab2afa205d4620c46bedfdab2ee982b6edfbc1\": rpc error: code = NotFound desc = could not find container \"3a260ee540e09e7ecf8cc5d682ab2afa205d4620c46bedfdab2ee982b6edfbc1\": container with ID starting with 3a260ee540e09e7ecf8cc5d682ab2afa205d4620c46bedfdab2ee982b6edfbc1 not found: ID does not exist" Jun 09 12:01:11.319693 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.319248 2577 scope.go:117] "RemoveContainer" containerID="4e8944c31b4f81066e7e718bc7372483859b4164c1bc1a9a97ee6d8ca37a9bac" Jun 09 12:01:11.319693 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.319465 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e8944c31b4f81066e7e718bc7372483859b4164c1bc1a9a97ee6d8ca37a9bac"} err="failed to get container status \"4e8944c31b4f81066e7e718bc7372483859b4164c1bc1a9a97ee6d8ca37a9bac\": rpc error: code = NotFound desc = could not find container \"4e8944c31b4f81066e7e718bc7372483859b4164c1bc1a9a97ee6d8ca37a9bac\": container with ID starting with 4e8944c31b4f81066e7e718bc7372483859b4164c1bc1a9a97ee6d8ca37a9bac not found: ID does not exist" Jun 09 12:01:11.319693 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.319486 2577 scope.go:117] "RemoveContainer" containerID="f23948441119f155ea2617198402b893fa7c5a6330b4f20111976283a388da2f" Jun 09 12:01:11.320960 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.320911 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f23948441119f155ea2617198402b893fa7c5a6330b4f20111976283a388da2f"} err="failed to get container status \"f23948441119f155ea2617198402b893fa7c5a6330b4f20111976283a388da2f\": rpc error: code = NotFound desc = could not find container \"f23948441119f155ea2617198402b893fa7c5a6330b4f20111976283a388da2f\": container with ID starting with f23948441119f155ea2617198402b893fa7c5a6330b4f20111976283a388da2f not found: ID does not exist" Jun 09 12:01:11.320960 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.320956 2577 scope.go:117] "RemoveContainer" containerID="b1f1cde9ac750bde508b7d950f4d027a32e201764dda6c2199f807a692087c95" Jun 09 12:01:11.321213 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.321192 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 09 12:01:11.321213 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.321213 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1f1cde9ac750bde508b7d950f4d027a32e201764dda6c2199f807a692087c95"} err="failed to get container status \"b1f1cde9ac750bde508b7d950f4d027a32e201764dda6c2199f807a692087c95\": rpc error: code = NotFound desc = could not find container \"b1f1cde9ac750bde508b7d950f4d027a32e201764dda6c2199f807a692087c95\": container with ID starting with b1f1cde9ac750bde508b7d950f4d027a32e201764dda6c2199f807a692087c95 not found: ID does not exist" Jun 09 12:01:11.321479 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.321242 2577 scope.go:117] "RemoveContainer" containerID="d5c1ba6b29e2911e24aeba41b355d3078ed3b8325373570e11de80997f2fbbfc" Jun 09 12:01:11.321479 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.321250 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3aoffovrh5ab4\"" Jun 09 12:01:11.321479 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.321239 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 09 12:01:11.321479 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.321293 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 09 12:01:11.321479 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.321434 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 09 12:01:11.321812 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.321480 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-bhbw4\"" Jun 09 12:01:11.321812 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.321492 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 09 12:01:11.321812 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.321530 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 09 12:01:11.321812 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.321628 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 09 12:01:11.321812 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.321652 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 09 12:01:11.321812 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.321655 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 09 12:01:11.322061 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.321817 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5c1ba6b29e2911e24aeba41b355d3078ed3b8325373570e11de80997f2fbbfc"} err="failed to get container status \"d5c1ba6b29e2911e24aeba41b355d3078ed3b8325373570e11de80997f2fbbfc\": rpc error: code = NotFound desc = could not find container \"d5c1ba6b29e2911e24aeba41b355d3078ed3b8325373570e11de80997f2fbbfc\": container with ID starting with d5c1ba6b29e2911e24aeba41b355d3078ed3b8325373570e11de80997f2fbbfc not found: ID does not exist" Jun 09 12:01:11.322061 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.321841 2577 scope.go:117] "RemoveContainer" containerID="d9829f3d42335bac94071a71dbc31541734570ca84a1b910ee8ee2462d8e3273" Jun 09 12:01:11.322159 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.322064 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 09 12:01:11.322159 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.322096 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 09 12:01:11.322159 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.322134 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9829f3d42335bac94071a71dbc31541734570ca84a1b910ee8ee2462d8e3273"} err="failed to get container status \"d9829f3d42335bac94071a71dbc31541734570ca84a1b910ee8ee2462d8e3273\": rpc error: code = NotFound desc = could not find container \"d9829f3d42335bac94071a71dbc31541734570ca84a1b910ee8ee2462d8e3273\": container with ID starting with d9829f3d42335bac94071a71dbc31541734570ca84a1b910ee8ee2462d8e3273 not found: ID does not exist" Jun 09 12:01:11.322159 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.322155 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 09 12:01:11.322329 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.322161 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 09 12:01:11.322329 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.322155 2577 scope.go:117] "RemoveContainer" containerID="19dc7f1849d14a348a93c9bd2836e68755bff3079e079161a44744b978caefcd" Jun 09 12:01:11.322551 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.322520 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19dc7f1849d14a348a93c9bd2836e68755bff3079e079161a44744b978caefcd"} err="failed to get container status \"19dc7f1849d14a348a93c9bd2836e68755bff3079e079161a44744b978caefcd\": rpc error: code = NotFound desc = could not find container \"19dc7f1849d14a348a93c9bd2836e68755bff3079e079161a44744b978caefcd\": container with ID starting with 19dc7f1849d14a348a93c9bd2836e68755bff3079e079161a44744b978caefcd not found: ID does not exist" Jun 09 12:01:11.322551 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.322542 2577 scope.go:117] "RemoveContainer" containerID="3a260ee540e09e7ecf8cc5d682ab2afa205d4620c46bedfdab2ee982b6edfbc1" Jun 09 12:01:11.322835 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.322808 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a260ee540e09e7ecf8cc5d682ab2afa205d4620c46bedfdab2ee982b6edfbc1"} err="failed to get container status \"3a260ee540e09e7ecf8cc5d682ab2afa205d4620c46bedfdab2ee982b6edfbc1\": rpc error: code = NotFound desc = could not find container \"3a260ee540e09e7ecf8cc5d682ab2afa205d4620c46bedfdab2ee982b6edfbc1\": container with ID starting with 3a260ee540e09e7ecf8cc5d682ab2afa205d4620c46bedfdab2ee982b6edfbc1 not found: ID does not exist" Jun 09 12:01:11.322898 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.322833 2577 scope.go:117] "RemoveContainer" containerID="4e8944c31b4f81066e7e718bc7372483859b4164c1bc1a9a97ee6d8ca37a9bac" Jun 09 12:01:11.323120 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.323080 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e8944c31b4f81066e7e718bc7372483859b4164c1bc1a9a97ee6d8ca37a9bac"} err="failed to get container status \"4e8944c31b4f81066e7e718bc7372483859b4164c1bc1a9a97ee6d8ca37a9bac\": rpc error: code = NotFound desc = could not find container \"4e8944c31b4f81066e7e718bc7372483859b4164c1bc1a9a97ee6d8ca37a9bac\": container with ID starting with 4e8944c31b4f81066e7e718bc7372483859b4164c1bc1a9a97ee6d8ca37a9bac not found: ID does not exist" Jun 09 12:01:11.323120 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.323110 2577 scope.go:117] "RemoveContainer" containerID="f23948441119f155ea2617198402b893fa7c5a6330b4f20111976283a388da2f" Jun 09 12:01:11.323394 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.323355 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f23948441119f155ea2617198402b893fa7c5a6330b4f20111976283a388da2f"} err="failed to get container status \"f23948441119f155ea2617198402b893fa7c5a6330b4f20111976283a388da2f\": rpc error: code = NotFound desc = could not find container \"f23948441119f155ea2617198402b893fa7c5a6330b4f20111976283a388da2f\": container with ID starting with f23948441119f155ea2617198402b893fa7c5a6330b4f20111976283a388da2f not found: ID does not exist" Jun 09 12:01:11.323394 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.323387 2577 scope.go:117] "RemoveContainer" containerID="b1f1cde9ac750bde508b7d950f4d027a32e201764dda6c2199f807a692087c95" Jun 09 12:01:11.323808 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.323778 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1f1cde9ac750bde508b7d950f4d027a32e201764dda6c2199f807a692087c95"} err="failed to get container status \"b1f1cde9ac750bde508b7d950f4d027a32e201764dda6c2199f807a692087c95\": rpc error: code = NotFound desc = could not find container \"b1f1cde9ac750bde508b7d950f4d027a32e201764dda6c2199f807a692087c95\": container with ID starting with b1f1cde9ac750bde508b7d950f4d027a32e201764dda6c2199f807a692087c95 not found: ID does not exist" Jun 09 12:01:11.323924 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.323811 2577 scope.go:117] "RemoveContainer" containerID="d5c1ba6b29e2911e24aeba41b355d3078ed3b8325373570e11de80997f2fbbfc" Jun 09 12:01:11.324728 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.324672 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5c1ba6b29e2911e24aeba41b355d3078ed3b8325373570e11de80997f2fbbfc"} err="failed to get container status \"d5c1ba6b29e2911e24aeba41b355d3078ed3b8325373570e11de80997f2fbbfc\": rpc error: code = NotFound desc = could not find container \"d5c1ba6b29e2911e24aeba41b355d3078ed3b8325373570e11de80997f2fbbfc\": container with ID starting with d5c1ba6b29e2911e24aeba41b355d3078ed3b8325373570e11de80997f2fbbfc not found: ID does not exist" Jun 09 12:01:11.324728 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.324712 2577 scope.go:117] "RemoveContainer" containerID="d9829f3d42335bac94071a71dbc31541734570ca84a1b910ee8ee2462d8e3273" Jun 09 12:01:11.324965 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.324937 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 09 12:01:11.325223 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.325189 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9829f3d42335bac94071a71dbc31541734570ca84a1b910ee8ee2462d8e3273"} err="failed to get container status \"d9829f3d42335bac94071a71dbc31541734570ca84a1b910ee8ee2462d8e3273\": rpc error: code = NotFound desc = could not find container \"d9829f3d42335bac94071a71dbc31541734570ca84a1b910ee8ee2462d8e3273\": container with ID starting with d9829f3d42335bac94071a71dbc31541734570ca84a1b910ee8ee2462d8e3273 not found: ID does not exist" Jun 09 12:01:11.327516 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.327497 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 09 12:01:11.332660 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.332607 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 12:01:11.350384 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.350352 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/40a361ed-5da8-4eb9-8c55-f6228cea9974-config\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.350384 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.350382 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/40a361ed-5da8-4eb9-8c55-f6228cea9974-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.350573 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.350402 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40a361ed-5da8-4eb9-8c55-f6228cea9974-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.350573 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.350469 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40a361ed-5da8-4eb9-8c55-f6228cea9974-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.350573 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.350496 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40a361ed-5da8-4eb9-8c55-f6228cea9974-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.350573 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.350524 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/40a361ed-5da8-4eb9-8c55-f6228cea9974-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.350573 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.350540 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m958l\" (UniqueName: \"kubernetes.io/projected/40a361ed-5da8-4eb9-8c55-f6228cea9974-kube-api-access-m958l\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.350573 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.350556 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/40a361ed-5da8-4eb9-8c55-f6228cea9974-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.350779 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.350575 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/40a361ed-5da8-4eb9-8c55-f6228cea9974-web-config\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.350779 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.350663 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/40a361ed-5da8-4eb9-8c55-f6228cea9974-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.350779 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.350713 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40a361ed-5da8-4eb9-8c55-f6228cea9974-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.350913 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.350781 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/40a361ed-5da8-4eb9-8c55-f6228cea9974-config-out\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.350913 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.350807 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/40a361ed-5da8-4eb9-8c55-f6228cea9974-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.350913 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.350872 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40a361ed-5da8-4eb9-8c55-f6228cea9974-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.351082 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.351049 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/40a361ed-5da8-4eb9-8c55-f6228cea9974-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.351223 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.351197 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/40a361ed-5da8-4eb9-8c55-f6228cea9974-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.351304 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.351237 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/40a361ed-5da8-4eb9-8c55-f6228cea9974-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.351304 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.351260 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/40a361ed-5da8-4eb9-8c55-f6228cea9974-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.351304 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.351280 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/40a361ed-5da8-4eb9-8c55-f6228cea9974-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.351421 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.351404 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40a361ed-5da8-4eb9-8c55-f6228cea9974-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.452096 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.452055 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/40a361ed-5da8-4eb9-8c55-f6228cea9974-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.452276 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.452109 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/40a361ed-5da8-4eb9-8c55-f6228cea9974-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.452385 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.452363 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/40a361ed-5da8-4eb9-8c55-f6228cea9974-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.452445 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.452402 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/40a361ed-5da8-4eb9-8c55-f6228cea9974-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.452445 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.452436 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/40a361ed-5da8-4eb9-8c55-f6228cea9974-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.452542 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.452486 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40a361ed-5da8-4eb9-8c55-f6228cea9974-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.452542 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.452525 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/40a361ed-5da8-4eb9-8c55-f6228cea9974-config\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.452837 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.452549 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/40a361ed-5da8-4eb9-8c55-f6228cea9974-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.452837 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.452601 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40a361ed-5da8-4eb9-8c55-f6228cea9974-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.452837 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.452664 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40a361ed-5da8-4eb9-8c55-f6228cea9974-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.452837 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.452694 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40a361ed-5da8-4eb9-8c55-f6228cea9974-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.452837 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.452725 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/40a361ed-5da8-4eb9-8c55-f6228cea9974-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.452837 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.452751 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m958l\" (UniqueName: \"kubernetes.io/projected/40a361ed-5da8-4eb9-8c55-f6228cea9974-kube-api-access-m958l\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.452837 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.452779 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/40a361ed-5da8-4eb9-8c55-f6228cea9974-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.452837 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.452796 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/40a361ed-5da8-4eb9-8c55-f6228cea9974-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.452837 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.452804 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/40a361ed-5da8-4eb9-8c55-f6228cea9974-web-config\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.453283 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.452866 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/40a361ed-5da8-4eb9-8c55-f6228cea9974-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.453283 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.452905 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40a361ed-5da8-4eb9-8c55-f6228cea9974-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.453283 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.452975 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/40a361ed-5da8-4eb9-8c55-f6228cea9974-config-out\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.453283 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.453010 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/40a361ed-5da8-4eb9-8c55-f6228cea9974-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.453283 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.453051 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40a361ed-5da8-4eb9-8c55-f6228cea9974-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.453283 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.453219 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/40a361ed-5da8-4eb9-8c55-f6228cea9974-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.453948 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.453919 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40a361ed-5da8-4eb9-8c55-f6228cea9974-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.454052 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.453997 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40a361ed-5da8-4eb9-8c55-f6228cea9974-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.457061 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.455237 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40a361ed-5da8-4eb9-8c55-f6228cea9974-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.457061 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.455570 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/40a361ed-5da8-4eb9-8c55-f6228cea9974-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.457061 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.455632 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40a361ed-5da8-4eb9-8c55-f6228cea9974-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.457061 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.456069 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/40a361ed-5da8-4eb9-8c55-f6228cea9974-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.457061 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.456302 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/40a361ed-5da8-4eb9-8c55-f6228cea9974-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.457061 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.456410 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/40a361ed-5da8-4eb9-8c55-f6228cea9974-config-out\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.457061 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.456993 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/40a361ed-5da8-4eb9-8c55-f6228cea9974-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.457061 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.457063 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/40a361ed-5da8-4eb9-8c55-f6228cea9974-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.457647 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.457231 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/40a361ed-5da8-4eb9-8c55-f6228cea9974-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.457647 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.457500 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40a361ed-5da8-4eb9-8c55-f6228cea9974-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.457761 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.457671 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/40a361ed-5da8-4eb9-8c55-f6228cea9974-web-config\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.457840 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.457814 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/40a361ed-5da8-4eb9-8c55-f6228cea9974-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.458497 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.458476 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/40a361ed-5da8-4eb9-8c55-f6228cea9974-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.458769 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.458753 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40a361ed-5da8-4eb9-8c55-f6228cea9974-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.458922 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.458908 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/40a361ed-5da8-4eb9-8c55-f6228cea9974-config\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.463048 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.463023 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m958l\" (UniqueName: \"kubernetes.io/projected/40a361ed-5da8-4eb9-8c55-f6228cea9974-kube-api-access-m958l\") pod \"prometheus-k8s-0\" (UID: \"40a361ed-5da8-4eb9-8c55-f6228cea9974\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.629540 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.629500 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:11.767454 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:11.767421 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 12:01:11.770271 ip-10-0-133-80 kubenswrapper[2577]: W0609 12:01:11.770240 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40a361ed_5da8_4eb9_8c55_f6228cea9974.slice/crio-b6f21ea4ca64eeff870d28ef6c135803b11989a07676dd971bf44f3c83bed6c2 WatchSource:0}: Error finding container b6f21ea4ca64eeff870d28ef6c135803b11989a07676dd971bf44f3c83bed6c2: Status 404 returned error can't find the container with id b6f21ea4ca64eeff870d28ef6c135803b11989a07676dd971bf44f3c83bed6c2 Jun 09 12:01:12.044765 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:12.044688 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59b14c47-4d37-4853-8b37-7edfbcaaed09" path="/var/lib/kubelet/pods/59b14c47-4d37-4853-8b37-7edfbcaaed09/volumes" Jun 09 12:01:12.257500 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:12.257464 2577 generic.go:356] "Generic (PLEG): container finished" podID="40a361ed-5da8-4eb9-8c55-f6228cea9974" containerID="3442af4c7ef114e8e6a595044baac4be5679ea733695cf49e3f921582bebb218" exitCode=0 Jun 09 12:01:12.257891 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:12.257514 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40a361ed-5da8-4eb9-8c55-f6228cea9974","Type":"ContainerDied","Data":"3442af4c7ef114e8e6a595044baac4be5679ea733695cf49e3f921582bebb218"} Jun 09 12:01:12.257891 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:12.257576 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40a361ed-5da8-4eb9-8c55-f6228cea9974","Type":"ContainerStarted","Data":"b6f21ea4ca64eeff870d28ef6c135803b11989a07676dd971bf44f3c83bed6c2"} Jun 09 12:01:13.265272 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:13.265238 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40a361ed-5da8-4eb9-8c55-f6228cea9974","Type":"ContainerStarted","Data":"d2cb280d759962a27d6d89d41799c9e83b09dd4899100eef166eaa15b064877a"} Jun 09 12:01:13.265685 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:13.265334 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40a361ed-5da8-4eb9-8c55-f6228cea9974","Type":"ContainerStarted","Data":"65f1bf24753c4665dc4b0ebb11a11e7cf1fea943e6001617593f941b592799af"} Jun 09 12:01:13.265685 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:13.265365 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40a361ed-5da8-4eb9-8c55-f6228cea9974","Type":"ContainerStarted","Data":"3b7f4b6315dd2aa2ff87244c64bdb20c06c1c0d47dc8198952f2e59e9904025e"} Jun 09 12:01:13.265685 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:13.265391 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40a361ed-5da8-4eb9-8c55-f6228cea9974","Type":"ContainerStarted","Data":"df7cf78021dbc15f52541eaf064b9ad84b9cba8f3cf1da2df5abc0b3b4e82080"} Jun 09 12:01:13.265685 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:13.265414 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40a361ed-5da8-4eb9-8c55-f6228cea9974","Type":"ContainerStarted","Data":"399d46a2bdf21bc69297c7127af6a203a6f351b647d9e7a8c40b0ad0c6e39166"} Jun 09 12:01:13.265685 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:13.265441 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40a361ed-5da8-4eb9-8c55-f6228cea9974","Type":"ContainerStarted","Data":"0485161f077098ed28f5b6ab138d9b720013bb989660f574d0b653f49e91941e"} Jun 09 12:01:13.296362 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:13.296287 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.277069352 podStartE2EDuration="2.296264053s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.194701ms" isStatefulPod=false podCreationTimestamp="2026-06-09 12:01:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:01:13.295195482 +0000 UTC m=+369.717753289" watchObservedRunningTime="2026-06-09 12:01:13.296264053 +0000 UTC m=+369.718821829" Jun 09 12:01:16.630467 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:16.630415 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:17.914206 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:17.914168 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e14c077a-6021-4bf9-a3e7-ae5ca648b191-metrics-certs\") pod \"network-metrics-daemon-cvhwb\" (UID: \"e14c077a-6021-4bf9-a3e7-ae5ca648b191\") " pod="openshift-multus/network-metrics-daemon-cvhwb" Jun 09 12:01:17.916594 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:17.916571 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e14c077a-6021-4bf9-a3e7-ae5ca648b191-metrics-certs\") pod \"network-metrics-daemon-cvhwb\" (UID: \"e14c077a-6021-4bf9-a3e7-ae5ca648b191\") " pod="openshift-multus/network-metrics-daemon-cvhwb" Jun 09 12:01:18.142802 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:18.142767 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wmll9\"" Jun 09 12:01:18.151028 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:18.151001 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvhwb" Jun 09 12:01:18.288384 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:18.288350 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cvhwb"] Jun 09 12:01:18.291687 ip-10-0-133-80 kubenswrapper[2577]: W0609 12:01:18.291652 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode14c077a_6021_4bf9_a3e7_ae5ca648b191.slice/crio-df5c0671b26b92919700a611ac9b350790eb3a0c0220fedbfe112f5d32bf0fa9 WatchSource:0}: Error finding container df5c0671b26b92919700a611ac9b350790eb3a0c0220fedbfe112f5d32bf0fa9: Status 404 returned error can't find the container with id df5c0671b26b92919700a611ac9b350790eb3a0c0220fedbfe112f5d32bf0fa9 Jun 09 12:01:18.293645 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:18.293606 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 12:01:19.291188 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:19.291163 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cvhwb" event={"ID":"e14c077a-6021-4bf9-a3e7-ae5ca648b191","Type":"ContainerStarted","Data":"df5c0671b26b92919700a611ac9b350790eb3a0c0220fedbfe112f5d32bf0fa9"} Jun 09 12:01:20.296631 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:20.296585 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cvhwb" event={"ID":"e14c077a-6021-4bf9-a3e7-ae5ca648b191","Type":"ContainerStarted","Data":"b3869962ca3dfe2be8cafe501e63e14df7c36935e9576d91bfee1ae9589bf34e"} Jun 09 12:01:20.297083 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:20.296648 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cvhwb" event={"ID":"e14c077a-6021-4bf9-a3e7-ae5ca648b191","Type":"ContainerStarted","Data":"ac6590eb18ca7f8d2120c9456a9ecab6fbd4720d935fb509936797418202f2aa"} Jun 09 12:01:20.313423 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:01:20.313367 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-cvhwb" podStartSLOduration=375.328180876 podStartE2EDuration="6m16.313351634s" totalImagesPullingTime="985.170758ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:55:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:01:20.311273589 +0000 UTC m=+376.733831363" watchObservedRunningTime="2026-06-09 12:01:20.313351634 +0000 UTC m=+376.735909408" Jun 09 12:02:11.630170 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:02:11.630127 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:02:11.646091 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:02:11.646052 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:02:12.513169 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:02:12.513141 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:04:16.192774 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:04:16.192736 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z54j4"] Jun 09 12:04:16.195883 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:04:16.195867 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z54j4" Jun 09 12:04:16.199986 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:04:16.199930 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-gzk58\"" Jun 09 12:04:16.200186 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:04:16.200171 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 09 12:04:16.200250 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:04:16.200178 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 09 12:04:16.216016 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:04:16.215984 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z54j4"] Jun 09 12:04:16.289396 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:04:16.289362 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7csj\" (UniqueName: \"kubernetes.io/projected/65b46f49-d89d-4308-8447-3ad6fe54e377-kube-api-access-h7csj\") pod \"openshift-lws-operator-fd8ccff4c-z54j4\" (UID: \"65b46f49-d89d-4308-8447-3ad6fe54e377\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z54j4" Jun 09 12:04:16.289565 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:04:16.289415 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/65b46f49-d89d-4308-8447-3ad6fe54e377-tmp\") pod \"openshift-lws-operator-fd8ccff4c-z54j4\" (UID: \"65b46f49-d89d-4308-8447-3ad6fe54e377\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z54j4" Jun 09 12:04:16.390534 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:04:16.390490 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/65b46f49-d89d-4308-8447-3ad6fe54e377-tmp\") pod \"openshift-lws-operator-fd8ccff4c-z54j4\" (UID: \"65b46f49-d89d-4308-8447-3ad6fe54e377\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z54j4" Jun 09 12:04:16.390706 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:04:16.390572 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7csj\" (UniqueName: \"kubernetes.io/projected/65b46f49-d89d-4308-8447-3ad6fe54e377-kube-api-access-h7csj\") pod \"openshift-lws-operator-fd8ccff4c-z54j4\" (UID: \"65b46f49-d89d-4308-8447-3ad6fe54e377\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z54j4" Jun 09 12:04:16.390921 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:04:16.390889 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/65b46f49-d89d-4308-8447-3ad6fe54e377-tmp\") pod \"openshift-lws-operator-fd8ccff4c-z54j4\" (UID: \"65b46f49-d89d-4308-8447-3ad6fe54e377\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z54j4" Jun 09 12:04:16.398959 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:04:16.398930 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7csj\" (UniqueName: \"kubernetes.io/projected/65b46f49-d89d-4308-8447-3ad6fe54e377-kube-api-access-h7csj\") pod \"openshift-lws-operator-fd8ccff4c-z54j4\" (UID: \"65b46f49-d89d-4308-8447-3ad6fe54e377\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z54j4" Jun 09 12:04:16.516392 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:04:16.516293 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z54j4" Jun 09 12:04:16.647877 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:04:16.647807 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z54j4"] Jun 09 12:04:16.650381 ip-10-0-133-80 kubenswrapper[2577]: W0609 12:04:16.650354 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod65b46f49_d89d_4308_8447_3ad6fe54e377.slice/crio-b616f4acf731ebfeddf0246dc9d346f8729b7e5fd5ee50bb35d90662a83fd068 WatchSource:0}: Error finding container b616f4acf731ebfeddf0246dc9d346f8729b7e5fd5ee50bb35d90662a83fd068: Status 404 returned error can't find the container with id b616f4acf731ebfeddf0246dc9d346f8729b7e5fd5ee50bb35d90662a83fd068 Jun 09 12:04:16.979923 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:04:16.979890 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z54j4" event={"ID":"65b46f49-d89d-4308-8447-3ad6fe54e377","Type":"ContainerStarted","Data":"b616f4acf731ebfeddf0246dc9d346f8729b7e5fd5ee50bb35d90662a83fd068"} Jun 09 12:04:19.995525 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:04:19.995486 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z54j4" event={"ID":"65b46f49-d89d-4308-8447-3ad6fe54e377","Type":"ContainerStarted","Data":"d262d0e2a844281c5912a02ec5c6e7849c56c54765489e6b0e67867428869eaf"} Jun 09 12:04:20.014211 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:04:20.014158 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z54j4" podStartSLOduration=1.071956104 podStartE2EDuration="4.014143241s" totalImagesPullingTime="2.942187137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:04:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:04:20.012370487 +0000 UTC m=+556.434928263" watchObservedRunningTime="2026-06-09 12:04:20.014143241 +0000 UTC m=+556.436701015" Jun 09 12:04:40.547372 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:04:40.547342 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86976b546f-g4hct"] Jun 09 12:04:40.550801 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:04:40.550784 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86976b546f-g4hct" Jun 09 12:04:40.553267 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:04:40.553241 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 09 12:04:40.553410 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:04:40.553275 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 09 12:04:40.553572 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:04:40.553557 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-nf72c\"" Jun 09 12:04:40.553887 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:04:40.553871 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 09 12:04:40.553994 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:04:40.553983 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 09 12:04:40.579998 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:04:40.579968 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86976b546f-g4hct"] Jun 09 12:04:40.607041 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:04:40.607007 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a0595757-f346-4f57-b2f2-369e482db615-tmp\") pod \"opendatahub-operator-controller-manager-86976b546f-g4hct\" (UID: \"a0595757-f346-4f57-b2f2-369e482db615\") " pod="opendatahub/opendatahub-operator-controller-manager-86976b546f-g4hct" Jun 09 12:04:40.607194 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:04:40.607050 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a0595757-f346-4f57-b2f2-369e482db615-webhook-cert\") pod \"opendatahub-operator-controller-manager-86976b546f-g4hct\" (UID: \"a0595757-f346-4f57-b2f2-369e482db615\") " pod="opendatahub/opendatahub-operator-controller-manager-86976b546f-g4hct" Jun 09 12:04:40.607194 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:04:40.607084 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a0595757-f346-4f57-b2f2-369e482db615-manifests\") pod \"opendatahub-operator-controller-manager-86976b546f-g4hct\" (UID: \"a0595757-f346-4f57-b2f2-369e482db615\") " pod="opendatahub/opendatahub-operator-controller-manager-86976b546f-g4hct" Jun 09 12:04:40.607194 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:04:40.607159 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4glx\" (UniqueName: \"kubernetes.io/projected/a0595757-f346-4f57-b2f2-369e482db615-kube-api-access-n4glx\") pod \"opendatahub-operator-controller-manager-86976b546f-g4hct\" (UID: \"a0595757-f346-4f57-b2f2-369e482db615\") " pod="opendatahub/opendatahub-operator-controller-manager-86976b546f-g4hct" Jun 09 12:04:40.607194 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:04:40.607193 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a0595757-f346-4f57-b2f2-369e482db615-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86976b546f-g4hct\" (UID: \"a0595757-f346-4f57-b2f2-369e482db615\") " pod="opendatahub/opendatahub-operator-controller-manager-86976b546f-g4hct" Jun 09 12:04:40.708327 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:04:40.708294 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a0595757-f346-4f57-b2f2-369e482db615-tmp\") pod \"opendatahub-operator-controller-manager-86976b546f-g4hct\" (UID: \"a0595757-f346-4f57-b2f2-369e482db615\") " pod="opendatahub/opendatahub-operator-controller-manager-86976b546f-g4hct" Jun 09 12:04:40.708327 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:04:40.708331 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a0595757-f346-4f57-b2f2-369e482db615-webhook-cert\") pod \"opendatahub-operator-controller-manager-86976b546f-g4hct\" (UID: \"a0595757-f346-4f57-b2f2-369e482db615\") " pod="opendatahub/opendatahub-operator-controller-manager-86976b546f-g4hct" Jun 09 12:04:40.708551 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:04:40.708355 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a0595757-f346-4f57-b2f2-369e482db615-manifests\") pod \"opendatahub-operator-controller-manager-86976b546f-g4hct\" (UID: \"a0595757-f346-4f57-b2f2-369e482db615\") " pod="opendatahub/opendatahub-operator-controller-manager-86976b546f-g4hct" Jun 09 12:04:40.708551 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:04:40.708404 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4glx\" (UniqueName: \"kubernetes.io/projected/a0595757-f346-4f57-b2f2-369e482db615-kube-api-access-n4glx\") pod \"opendatahub-operator-controller-manager-86976b546f-g4hct\" (UID: \"a0595757-f346-4f57-b2f2-369e482db615\") " pod="opendatahub/opendatahub-operator-controller-manager-86976b546f-g4hct" Jun 09 12:04:40.708551 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:04:40.708431 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a0595757-f346-4f57-b2f2-369e482db615-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86976b546f-g4hct\" (UID: \"a0595757-f346-4f57-b2f2-369e482db615\") " pod="opendatahub/opendatahub-operator-controller-manager-86976b546f-g4hct" Jun 09 12:04:40.708796 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:04:40.708776 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a0595757-f346-4f57-b2f2-369e482db615-manifests\") pod \"opendatahub-operator-controller-manager-86976b546f-g4hct\" (UID: \"a0595757-f346-4f57-b2f2-369e482db615\") " pod="opendatahub/opendatahub-operator-controller-manager-86976b546f-g4hct" Jun 09 12:04:40.710782 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:04:40.710752 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a0595757-f346-4f57-b2f2-369e482db615-tmp\") pod \"opendatahub-operator-controller-manager-86976b546f-g4hct\" (UID: \"a0595757-f346-4f57-b2f2-369e482db615\") " pod="opendatahub/opendatahub-operator-controller-manager-86976b546f-g4hct" Jun 09 12:04:40.711002 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:04:40.710984 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a0595757-f346-4f57-b2f2-369e482db615-webhook-cert\") pod \"opendatahub-operator-controller-manager-86976b546f-g4hct\" (UID: \"a0595757-f346-4f57-b2f2-369e482db615\") " pod="opendatahub/opendatahub-operator-controller-manager-86976b546f-g4hct" Jun 09 12:04:40.711124 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:04:40.711105 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a0595757-f346-4f57-b2f2-369e482db615-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86976b546f-g4hct\" (UID: \"a0595757-f346-4f57-b2f2-369e482db615\") " pod="opendatahub/opendatahub-operator-controller-manager-86976b546f-g4hct" Jun 09 12:04:40.716726 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:04:40.716704 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4glx\" (UniqueName: \"kubernetes.io/projected/a0595757-f346-4f57-b2f2-369e482db615-kube-api-access-n4glx\") pod \"opendatahub-operator-controller-manager-86976b546f-g4hct\" (UID: \"a0595757-f346-4f57-b2f2-369e482db615\") " pod="opendatahub/opendatahub-operator-controller-manager-86976b546f-g4hct" Jun 09 12:04:40.861531 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:04:40.861446 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86976b546f-g4hct" Jun 09 12:04:40.999221 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:04:40.999195 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86976b546f-g4hct"] Jun 09 12:04:41.002056 ip-10-0-133-80 kubenswrapper[2577]: W0609 12:04:41.002028 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0595757_f346_4f57_b2f2_369e482db615.slice/crio-5c793e2c677b0c2c2413963728c533a8b11462c2632289f53796d6509fb28c15 WatchSource:0}: Error finding container 5c793e2c677b0c2c2413963728c533a8b11462c2632289f53796d6509fb28c15: Status 404 returned error can't find the container with id 5c793e2c677b0c2c2413963728c533a8b11462c2632289f53796d6509fb28c15 Jun 09 12:04:41.080452 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:04:41.080416 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86976b546f-g4hct" event={"ID":"a0595757-f346-4f57-b2f2-369e482db615","Type":"ContainerStarted","Data":"5c793e2c677b0c2c2413963728c533a8b11462c2632289f53796d6509fb28c15"} Jun 09 12:04:44.098290 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:04:44.098257 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86976b546f-g4hct" event={"ID":"a0595757-f346-4f57-b2f2-369e482db615","Type":"ContainerStarted","Data":"c8e6bc48f3b3cb0f13301b001496cb6f67dfe2f9e66b0b9425dd2c2e2f803202"} Jun 09 12:04:45.103916 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:04:45.103885 2577 generic.go:356] "Generic (PLEG): container finished" podID="a0595757-f346-4f57-b2f2-369e482db615" containerID="c8e6bc48f3b3cb0f13301b001496cb6f67dfe2f9e66b0b9425dd2c2e2f803202" exitCode=0 Jun 09 12:04:45.104289 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:04:45.103975 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86976b546f-g4hct" event={"ID":"a0595757-f346-4f57-b2f2-369e482db615","Type":"ContainerDied","Data":"c8e6bc48f3b3cb0f13301b001496cb6f67dfe2f9e66b0b9425dd2c2e2f803202"} Jun 09 12:04:46.111549 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:04:46.111500 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86976b546f-g4hct" event={"ID":"a0595757-f346-4f57-b2f2-369e482db615","Type":"ContainerStarted","Data":"40cd989420bb30ec2c1efc92de71dcc42432d8fbf2b73e92023688acdf07939f"} Jun 09 12:04:46.112033 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:04:46.111664 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-86976b546f-g4hct" Jun 09 12:04:46.169684 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:04:46.169632 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-86976b546f-g4hct" podStartSLOduration=1.957802129 podStartE2EDuration="6.169593244s" totalImagesPullingTime="3.194413957s" totalInitContainerRuntime="1.017377158s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:04:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:04:46.167889348 +0000 UTC m=+582.590447135" watchObservedRunningTime="2026-06-09 12:04:46.169593244 +0000 UTC m=+582.592151019" Jun 09 12:04:57.118236 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:04:57.118202 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-86976b546f-g4hct" Jun 09 12:05:08.049782 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:08.049749 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-57f7d46b46-lgfhc"] Jun 09 12:05:08.053248 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:08.053230 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-57f7d46b46-lgfhc" Jun 09 12:05:08.059408 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:08.059381 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-pr6dx\"" Jun 09 12:05:08.059572 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:08.059482 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 09 12:05:08.059694 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:08.059568 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 09 12:05:08.059694 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:08.059650 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 09 12:05:08.092508 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:08.092476 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-57f7d46b46-lgfhc"] Jun 09 12:05:08.162979 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:08.162939 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67jdj\" (UniqueName: \"kubernetes.io/projected/0fcd5095-af3d-4fa7-9c2d-0977725f9ce1-kube-api-access-67jdj\") pod \"lws-controller-manager-57f7d46b46-lgfhc\" (UID: \"0fcd5095-af3d-4fa7-9c2d-0977725f9ce1\") " pod="openshift-lws-operator/lws-controller-manager-57f7d46b46-lgfhc" Jun 09 12:05:08.163194 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:08.162987 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0fcd5095-af3d-4fa7-9c2d-0977725f9ce1-manager-config\") pod \"lws-controller-manager-57f7d46b46-lgfhc\" (UID: \"0fcd5095-af3d-4fa7-9c2d-0977725f9ce1\") " pod="openshift-lws-operator/lws-controller-manager-57f7d46b46-lgfhc" Jun 09 12:05:08.163194 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:08.163008 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0fcd5095-af3d-4fa7-9c2d-0977725f9ce1-cert\") pod \"lws-controller-manager-57f7d46b46-lgfhc\" (UID: \"0fcd5095-af3d-4fa7-9c2d-0977725f9ce1\") " pod="openshift-lws-operator/lws-controller-manager-57f7d46b46-lgfhc" Jun 09 12:05:08.163194 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:08.163147 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0fcd5095-af3d-4fa7-9c2d-0977725f9ce1-metrics-cert\") pod \"lws-controller-manager-57f7d46b46-lgfhc\" (UID: \"0fcd5095-af3d-4fa7-9c2d-0977725f9ce1\") " pod="openshift-lws-operator/lws-controller-manager-57f7d46b46-lgfhc" Jun 09 12:05:08.264366 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:08.264321 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0fcd5095-af3d-4fa7-9c2d-0977725f9ce1-manager-config\") pod \"lws-controller-manager-57f7d46b46-lgfhc\" (UID: \"0fcd5095-af3d-4fa7-9c2d-0977725f9ce1\") " pod="openshift-lws-operator/lws-controller-manager-57f7d46b46-lgfhc" Jun 09 12:05:08.264366 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:08.264364 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0fcd5095-af3d-4fa7-9c2d-0977725f9ce1-cert\") pod \"lws-controller-manager-57f7d46b46-lgfhc\" (UID: \"0fcd5095-af3d-4fa7-9c2d-0977725f9ce1\") " pod="openshift-lws-operator/lws-controller-manager-57f7d46b46-lgfhc" Jun 09 12:05:08.264641 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:08.264410 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0fcd5095-af3d-4fa7-9c2d-0977725f9ce1-metrics-cert\") pod \"lws-controller-manager-57f7d46b46-lgfhc\" (UID: \"0fcd5095-af3d-4fa7-9c2d-0977725f9ce1\") " pod="openshift-lws-operator/lws-controller-manager-57f7d46b46-lgfhc" Jun 09 12:05:08.264641 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:08.264509 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67jdj\" (UniqueName: \"kubernetes.io/projected/0fcd5095-af3d-4fa7-9c2d-0977725f9ce1-kube-api-access-67jdj\") pod \"lws-controller-manager-57f7d46b46-lgfhc\" (UID: \"0fcd5095-af3d-4fa7-9c2d-0977725f9ce1\") " pod="openshift-lws-operator/lws-controller-manager-57f7d46b46-lgfhc" Jun 09 12:05:08.265009 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:08.264981 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0fcd5095-af3d-4fa7-9c2d-0977725f9ce1-manager-config\") pod \"lws-controller-manager-57f7d46b46-lgfhc\" (UID: \"0fcd5095-af3d-4fa7-9c2d-0977725f9ce1\") " pod="openshift-lws-operator/lws-controller-manager-57f7d46b46-lgfhc" Jun 09 12:05:08.266971 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:08.266945 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0fcd5095-af3d-4fa7-9c2d-0977725f9ce1-metrics-cert\") pod \"lws-controller-manager-57f7d46b46-lgfhc\" (UID: \"0fcd5095-af3d-4fa7-9c2d-0977725f9ce1\") " pod="openshift-lws-operator/lws-controller-manager-57f7d46b46-lgfhc" Jun 09 12:05:08.267041 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:08.266956 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0fcd5095-af3d-4fa7-9c2d-0977725f9ce1-cert\") pod \"lws-controller-manager-57f7d46b46-lgfhc\" (UID: \"0fcd5095-af3d-4fa7-9c2d-0977725f9ce1\") " pod="openshift-lws-operator/lws-controller-manager-57f7d46b46-lgfhc" Jun 09 12:05:08.279057 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:08.279026 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67jdj\" (UniqueName: \"kubernetes.io/projected/0fcd5095-af3d-4fa7-9c2d-0977725f9ce1-kube-api-access-67jdj\") pod \"lws-controller-manager-57f7d46b46-lgfhc\" (UID: \"0fcd5095-af3d-4fa7-9c2d-0977725f9ce1\") " pod="openshift-lws-operator/lws-controller-manager-57f7d46b46-lgfhc" Jun 09 12:05:08.363282 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:08.363192 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-57f7d46b46-lgfhc" Jun 09 12:05:08.515282 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:08.515255 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-57f7d46b46-lgfhc"] Jun 09 12:05:08.518671 ip-10-0-133-80 kubenswrapper[2577]: W0609 12:05:08.518638 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fcd5095_af3d_4fa7_9c2d_0977725f9ce1.slice/crio-71a9c8589021b0c3742b0d730b276461718e3f7e96b6dee943221797f735bf64 WatchSource:0}: Error finding container 71a9c8589021b0c3742b0d730b276461718e3f7e96b6dee943221797f735bf64: Status 404 returned error can't find the container with id 71a9c8589021b0c3742b0d730b276461718e3f7e96b6dee943221797f735bf64 Jun 09 12:05:09.212190 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:09.212153 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-57f7d46b46-lgfhc" event={"ID":"0fcd5095-af3d-4fa7-9c2d-0977725f9ce1","Type":"ContainerStarted","Data":"71a9c8589021b0c3742b0d730b276461718e3f7e96b6dee943221797f735bf64"} Jun 09 12:05:11.223842 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:11.223756 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-57f7d46b46-lgfhc" event={"ID":"0fcd5095-af3d-4fa7-9c2d-0977725f9ce1","Type":"ContainerStarted","Data":"388eeea3c6a1a752c0e0bc9c38251520268321bf5c926ab352b863713d6c25b7"} Jun 09 12:05:11.224536 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:11.224516 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-57f7d46b46-lgfhc" Jun 09 12:05:11.249785 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:11.249728 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-57f7d46b46-lgfhc" podStartSLOduration=0.904004406 podStartE2EDuration="3.249577321s" totalImagesPullingTime="2.345572915s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:05:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:05:11.247760829 +0000 UTC m=+607.670318635" watchObservedRunningTime="2026-06-09 12:05:11.249577321 +0000 UTC m=+607.672135097" Jun 09 12:05:23.234151 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:23.234120 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-57f7d46b46-lgfhc" Jun 09 12:05:36.210815 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:36.210778 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-76df79655d-6gdtz"] Jun 09 12:05:36.214545 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:36.214518 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-76df79655d-6gdtz" Jun 09 12:05:36.217411 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:36.217369 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 09 12:05:36.217564 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:36.217546 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-bp824\"" Jun 09 12:05:36.224439 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:36.224408 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-76df79655d-6gdtz"] Jun 09 12:05:36.306247 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:36.306210 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/1bdc1578-d20c-446a-9cb6-e407bcb6dde9-redirect-config\") pod \"dashboard-redirect-76df79655d-6gdtz\" (UID: \"1bdc1578-d20c-446a-9cb6-e407bcb6dde9\") " pod="opendatahub/dashboard-redirect-76df79655d-6gdtz" Jun 09 12:05:36.306247 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:36.306250 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp279\" (UniqueName: \"kubernetes.io/projected/1bdc1578-d20c-446a-9cb6-e407bcb6dde9-kube-api-access-qp279\") pod \"dashboard-redirect-76df79655d-6gdtz\" (UID: \"1bdc1578-d20c-446a-9cb6-e407bcb6dde9\") " pod="opendatahub/dashboard-redirect-76df79655d-6gdtz" Jun 09 12:05:36.406589 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:36.406554 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/1bdc1578-d20c-446a-9cb6-e407bcb6dde9-redirect-config\") pod \"dashboard-redirect-76df79655d-6gdtz\" (UID: \"1bdc1578-d20c-446a-9cb6-e407bcb6dde9\") " pod="opendatahub/dashboard-redirect-76df79655d-6gdtz" Jun 09 12:05:36.406589 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:36.406590 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qp279\" (UniqueName: \"kubernetes.io/projected/1bdc1578-d20c-446a-9cb6-e407bcb6dde9-kube-api-access-qp279\") pod \"dashboard-redirect-76df79655d-6gdtz\" (UID: \"1bdc1578-d20c-446a-9cb6-e407bcb6dde9\") " pod="opendatahub/dashboard-redirect-76df79655d-6gdtz" Jun 09 12:05:36.407311 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:36.407289 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/1bdc1578-d20c-446a-9cb6-e407bcb6dde9-redirect-config\") pod \"dashboard-redirect-76df79655d-6gdtz\" (UID: \"1bdc1578-d20c-446a-9cb6-e407bcb6dde9\") " pod="opendatahub/dashboard-redirect-76df79655d-6gdtz" Jun 09 12:05:36.418322 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:36.418285 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp279\" (UniqueName: \"kubernetes.io/projected/1bdc1578-d20c-446a-9cb6-e407bcb6dde9-kube-api-access-qp279\") pod \"dashboard-redirect-76df79655d-6gdtz\" (UID: \"1bdc1578-d20c-446a-9cb6-e407bcb6dde9\") " pod="opendatahub/dashboard-redirect-76df79655d-6gdtz" Jun 09 12:05:36.528673 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:36.528542 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-76df79655d-6gdtz" Jun 09 12:05:36.661539 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:36.661474 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-76df79655d-6gdtz"] Jun 09 12:05:36.663791 ip-10-0-133-80 kubenswrapper[2577]: W0609 12:05:36.663762 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bdc1578_d20c_446a_9cb6_e407bcb6dde9.slice/crio-ca470225853014e049a8c17928c4573c39e470d920f55e721c0e2c6542baae2c WatchSource:0}: Error finding container ca470225853014e049a8c17928c4573c39e470d920f55e721c0e2c6542baae2c: Status 404 returned error can't find the container with id ca470225853014e049a8c17928c4573c39e470d920f55e721c0e2c6542baae2c Jun 09 12:05:37.340287 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:37.340258 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-76df79655d-6gdtz" event={"ID":"1bdc1578-d20c-446a-9cb6-e407bcb6dde9","Type":"ContainerStarted","Data":"ca470225853014e049a8c17928c4573c39e470d920f55e721c0e2c6542baae2c"} Jun 09 12:05:39.353471 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:39.353424 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-76df79655d-6gdtz" event={"ID":"1bdc1578-d20c-446a-9cb6-e407bcb6dde9","Type":"ContainerStarted","Data":"2f3cdc47e40cd1d664ad5e712cac8a64ac1784f94982ab2a4168c61ce65063e8"} Jun 09 12:05:39.386295 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:39.386232 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-76df79655d-6gdtz" podStartSLOduration=1.319792007 podStartE2EDuration="3.386214234s" totalImagesPullingTime="2.066422227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:05:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:05:39.384269529 +0000 UTC m=+635.806827307" watchObservedRunningTime="2026-06-09 12:05:39.386214234 +0000 UTC m=+635.808772008" Jun 09 12:05:54.947186 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:54.947151 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tbv74"] Jun 09 12:05:54.952101 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:54.952077 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tbv74" Jun 09 12:05:54.955941 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:54.955915 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 09 12:05:54.956057 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:54.955957 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-5tns7\"" Jun 09 12:05:54.956811 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:54.956784 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 09 12:05:54.956929 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:54.956886 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 09 12:05:54.963280 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:54.963260 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tbv74"] Jun 09 12:05:55.069304 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:55.069266 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07ce6663-7517-45b4-9dcd-b3aa260934f3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tbv74\" (UID: \"07ce6663-7517-45b4-9dcd-b3aa260934f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tbv74" Jun 09 12:05:55.069488 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:55.069319 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07ce6663-7517-45b4-9dcd-b3aa260934f3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tbv74\" (UID: \"07ce6663-7517-45b4-9dcd-b3aa260934f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tbv74" Jun 09 12:05:55.069488 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:55.069421 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07ce6663-7517-45b4-9dcd-b3aa260934f3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tbv74\" (UID: \"07ce6663-7517-45b4-9dcd-b3aa260934f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tbv74" Jun 09 12:05:55.069488 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:55.069451 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07ce6663-7517-45b4-9dcd-b3aa260934f3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tbv74\" (UID: \"07ce6663-7517-45b4-9dcd-b3aa260934f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tbv74" Jun 09 12:05:55.069645 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:55.069498 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07ce6663-7517-45b4-9dcd-b3aa260934f3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tbv74\" (UID: \"07ce6663-7517-45b4-9dcd-b3aa260934f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tbv74" Jun 09 12:05:55.069645 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:55.069558 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07ce6663-7517-45b4-9dcd-b3aa260934f3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tbv74\" (UID: \"07ce6663-7517-45b4-9dcd-b3aa260934f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tbv74" Jun 09 12:05:55.069645 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:55.069598 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07ce6663-7517-45b4-9dcd-b3aa260934f3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tbv74\" (UID: \"07ce6663-7517-45b4-9dcd-b3aa260934f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tbv74" Jun 09 12:05:55.069748 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:55.069644 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kkzf\" (UniqueName: \"kubernetes.io/projected/07ce6663-7517-45b4-9dcd-b3aa260934f3-kube-api-access-5kkzf\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tbv74\" (UID: \"07ce6663-7517-45b4-9dcd-b3aa260934f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tbv74" Jun 09 12:05:55.069748 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:55.069671 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07ce6663-7517-45b4-9dcd-b3aa260934f3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tbv74\" (UID: \"07ce6663-7517-45b4-9dcd-b3aa260934f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tbv74" Jun 09 12:05:55.170775 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:55.170729 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07ce6663-7517-45b4-9dcd-b3aa260934f3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tbv74\" (UID: \"07ce6663-7517-45b4-9dcd-b3aa260934f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tbv74" Jun 09 12:05:55.170968 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:55.170789 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07ce6663-7517-45b4-9dcd-b3aa260934f3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tbv74\" (UID: \"07ce6663-7517-45b4-9dcd-b3aa260934f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tbv74" Jun 09 12:05:55.170968 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:55.170843 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07ce6663-7517-45b4-9dcd-b3aa260934f3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tbv74\" (UID: \"07ce6663-7517-45b4-9dcd-b3aa260934f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tbv74" Jun 09 12:05:55.170968 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:55.170873 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kkzf\" (UniqueName: \"kubernetes.io/projected/07ce6663-7517-45b4-9dcd-b3aa260934f3-kube-api-access-5kkzf\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tbv74\" (UID: \"07ce6663-7517-45b4-9dcd-b3aa260934f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tbv74" Jun 09 12:05:55.170968 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:55.170903 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07ce6663-7517-45b4-9dcd-b3aa260934f3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tbv74\" (UID: \"07ce6663-7517-45b4-9dcd-b3aa260934f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tbv74" Jun 09 12:05:55.170968 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:55.170934 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07ce6663-7517-45b4-9dcd-b3aa260934f3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tbv74\" (UID: \"07ce6663-7517-45b4-9dcd-b3aa260934f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tbv74" Jun 09 12:05:55.170968 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:55.170966 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07ce6663-7517-45b4-9dcd-b3aa260934f3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tbv74\" (UID: \"07ce6663-7517-45b4-9dcd-b3aa260934f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tbv74" Jun 09 12:05:55.171270 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:55.171012 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07ce6663-7517-45b4-9dcd-b3aa260934f3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tbv74\" (UID: \"07ce6663-7517-45b4-9dcd-b3aa260934f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tbv74" Jun 09 12:05:55.171270 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:55.171043 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07ce6663-7517-45b4-9dcd-b3aa260934f3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tbv74\" (UID: \"07ce6663-7517-45b4-9dcd-b3aa260934f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tbv74" Jun 09 12:05:55.171376 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:55.171298 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07ce6663-7517-45b4-9dcd-b3aa260934f3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tbv74\" (UID: \"07ce6663-7517-45b4-9dcd-b3aa260934f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tbv74" Jun 09 12:05:55.172771 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:55.172743 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07ce6663-7517-45b4-9dcd-b3aa260934f3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tbv74\" (UID: \"07ce6663-7517-45b4-9dcd-b3aa260934f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tbv74" Jun 09 12:05:55.172957 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:55.172933 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07ce6663-7517-45b4-9dcd-b3aa260934f3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tbv74\" (UID: \"07ce6663-7517-45b4-9dcd-b3aa260934f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tbv74" Jun 09 12:05:55.173885 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:55.173862 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07ce6663-7517-45b4-9dcd-b3aa260934f3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tbv74\" (UID: \"07ce6663-7517-45b4-9dcd-b3aa260934f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tbv74" Jun 09 12:05:55.175289 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:55.175266 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07ce6663-7517-45b4-9dcd-b3aa260934f3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tbv74\" (UID: \"07ce6663-7517-45b4-9dcd-b3aa260934f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tbv74" Jun 09 12:05:55.176482 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:55.176459 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07ce6663-7517-45b4-9dcd-b3aa260934f3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tbv74\" (UID: \"07ce6663-7517-45b4-9dcd-b3aa260934f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tbv74" Jun 09 12:05:55.177002 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:55.176981 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07ce6663-7517-45b4-9dcd-b3aa260934f3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tbv74\" (UID: \"07ce6663-7517-45b4-9dcd-b3aa260934f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tbv74" Jun 09 12:05:55.179841 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:55.179809 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07ce6663-7517-45b4-9dcd-b3aa260934f3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tbv74\" (UID: \"07ce6663-7517-45b4-9dcd-b3aa260934f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tbv74" Jun 09 12:05:55.180052 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:55.180028 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kkzf\" (UniqueName: \"kubernetes.io/projected/07ce6663-7517-45b4-9dcd-b3aa260934f3-kube-api-access-5kkzf\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tbv74\" (UID: \"07ce6663-7517-45b4-9dcd-b3aa260934f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tbv74" Jun 09 12:05:55.263078 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:55.262979 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tbv74" Jun 09 12:05:55.409277 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:55.409090 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tbv74"] Jun 09 12:05:55.412009 ip-10-0-133-80 kubenswrapper[2577]: W0609 12:05:55.411978 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07ce6663_7517_45b4_9dcd_b3aa260934f3.slice/crio-94406f56e18d64f9300a87b4ca5677d53938ed0c91bd68ce08a8368d1b5beaea WatchSource:0}: Error finding container 94406f56e18d64f9300a87b4ca5677d53938ed0c91bd68ce08a8368d1b5beaea: Status 404 returned error can't find the container with id 94406f56e18d64f9300a87b4ca5677d53938ed0c91bd68ce08a8368d1b5beaea Jun 09 12:05:55.432742 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:55.432707 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tbv74" event={"ID":"07ce6663-7517-45b4-9dcd-b3aa260934f3","Type":"ContainerStarted","Data":"94406f56e18d64f9300a87b4ca5677d53938ed0c91bd68ce08a8368d1b5beaea"} Jun 09 12:05:58.063071 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:58.063032 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 09 12:05:58.063331 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:58.063107 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 09 12:05:58.063331 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:58.063142 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 09 12:05:58.452589 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:58.452543 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tbv74" event={"ID":"07ce6663-7517-45b4-9dcd-b3aa260934f3","Type":"ContainerStarted","Data":"e56831f1766bb6c2a1200a4689850bd2932820496c3d7ab0eecfbef002eebfed"} Jun 09 12:05:58.473715 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:58.473664 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tbv74" podStartSLOduration=1.824948108 podStartE2EDuration="4.473637268s" totalImagesPullingTime="2.64868916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:05:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:05:58.472500422 +0000 UTC m=+654.895058218" watchObservedRunningTime="2026-06-09 12:05:58.473637268 +0000 UTC m=+654.896195040" Jun 09 12:05:59.264093 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:59.264053 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tbv74" Jun 09 12:05:59.268790 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:59.268756 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tbv74" Jun 09 12:05:59.456999 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:59.456966 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tbv74" Jun 09 12:05:59.457982 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:05:59.457963 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tbv74" Jun 09 12:06:01.342400 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:01.342368 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-69ggg"] Jun 09 12:06:01.345950 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:01.345933 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-69ggg" Jun 09 12:06:01.349038 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:01.349015 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-lhtqk\"" Jun 09 12:06:01.349577 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:01.349562 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 12:06:01.349926 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:01.349909 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 12:06:01.371838 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:01.371805 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-69ggg"] Jun 09 12:06:01.432707 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:01.432672 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qs84w\" (UniqueName: \"kubernetes.io/projected/c1454f4a-3daa-4d8a-a206-f6e887416476-kube-api-access-qs84w\") pod \"kuadrant-operator-catalog-69ggg\" (UID: \"c1454f4a-3daa-4d8a-a206-f6e887416476\") " pod="kuadrant-system/kuadrant-operator-catalog-69ggg" Jun 09 12:06:01.534077 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:01.534039 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qs84w\" (UniqueName: \"kubernetes.io/projected/c1454f4a-3daa-4d8a-a206-f6e887416476-kube-api-access-qs84w\") pod \"kuadrant-operator-catalog-69ggg\" (UID: \"c1454f4a-3daa-4d8a-a206-f6e887416476\") " pod="kuadrant-system/kuadrant-operator-catalog-69ggg" Jun 09 12:06:01.543094 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:01.543062 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qs84w\" (UniqueName: \"kubernetes.io/projected/c1454f4a-3daa-4d8a-a206-f6e887416476-kube-api-access-qs84w\") pod \"kuadrant-operator-catalog-69ggg\" (UID: \"c1454f4a-3daa-4d8a-a206-f6e887416476\") " pod="kuadrant-system/kuadrant-operator-catalog-69ggg" Jun 09 12:06:01.622771 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:01.622741 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-69ggg"] Jun 09 12:06:01.623085 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:01.623069 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-69ggg" Jun 09 12:06:01.753679 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:01.753653 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-69ggg"] Jun 09 12:06:01.756254 ip-10-0-133-80 kubenswrapper[2577]: W0609 12:06:01.756223 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1454f4a_3daa_4d8a_a206_f6e887416476.slice/crio-444a562651e92767af3158edc8b53c9b6a1e0ab8819310ccbdf7a079f440ed6f WatchSource:0}: Error finding container 444a562651e92767af3158edc8b53c9b6a1e0ab8819310ccbdf7a079f440ed6f: Status 404 returned error can't find the container with id 444a562651e92767af3158edc8b53c9b6a1e0ab8819310ccbdf7a079f440ed6f Jun 09 12:06:01.833894 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:01.833861 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nkvsx"] Jun 09 12:06:01.838630 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:01.838595 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nkvsx" Jun 09 12:06:01.846140 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:01.846081 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nkvsx"] Jun 09 12:06:01.938538 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:01.938454 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrr44\" (UniqueName: \"kubernetes.io/projected/ec85f769-09c6-4fa4-bb55-0a6d8f8b77c4-kube-api-access-jrr44\") pod \"kuadrant-operator-catalog-nkvsx\" (UID: \"ec85f769-09c6-4fa4-bb55-0a6d8f8b77c4\") " pod="kuadrant-system/kuadrant-operator-catalog-nkvsx" Jun 09 12:06:02.039066 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:02.039017 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrr44\" (UniqueName: \"kubernetes.io/projected/ec85f769-09c6-4fa4-bb55-0a6d8f8b77c4-kube-api-access-jrr44\") pod \"kuadrant-operator-catalog-nkvsx\" (UID: \"ec85f769-09c6-4fa4-bb55-0a6d8f8b77c4\") " pod="kuadrant-system/kuadrant-operator-catalog-nkvsx" Jun 09 12:06:02.048474 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:02.048449 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrr44\" (UniqueName: \"kubernetes.io/projected/ec85f769-09c6-4fa4-bb55-0a6d8f8b77c4-kube-api-access-jrr44\") pod \"kuadrant-operator-catalog-nkvsx\" (UID: \"ec85f769-09c6-4fa4-bb55-0a6d8f8b77c4\") " pod="kuadrant-system/kuadrant-operator-catalog-nkvsx" Jun 09 12:06:02.149893 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:02.149864 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nkvsx" Jun 09 12:06:02.379657 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:02.379602 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nkvsx"] Jun 09 12:06:02.443221 ip-10-0-133-80 kubenswrapper[2577]: W0609 12:06:02.443184 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec85f769_09c6_4fa4_bb55_0a6d8f8b77c4.slice/crio-63df51b96a93e93f8319627502ecbd8a61154b97acdf1087b15a06ca2b1d9915 WatchSource:0}: Error finding container 63df51b96a93e93f8319627502ecbd8a61154b97acdf1087b15a06ca2b1d9915: Status 404 returned error can't find the container with id 63df51b96a93e93f8319627502ecbd8a61154b97acdf1087b15a06ca2b1d9915 Jun 09 12:06:02.472490 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:02.472462 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-69ggg" event={"ID":"c1454f4a-3daa-4d8a-a206-f6e887416476","Type":"ContainerStarted","Data":"444a562651e92767af3158edc8b53c9b6a1e0ab8819310ccbdf7a079f440ed6f"} Jun 09 12:06:02.473773 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:02.473745 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nkvsx" event={"ID":"ec85f769-09c6-4fa4-bb55-0a6d8f8b77c4","Type":"ContainerStarted","Data":"63df51b96a93e93f8319627502ecbd8a61154b97acdf1087b15a06ca2b1d9915"} Jun 09 12:06:04.486110 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:04.486055 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nkvsx" event={"ID":"ec85f769-09c6-4fa4-bb55-0a6d8f8b77c4","Type":"ContainerStarted","Data":"cf207c83b5fde13a48dcbc14630a5698f4001788fb3e990ae0cf950c899bf257"} Jun 09 12:06:04.487479 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:04.487457 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-69ggg" event={"ID":"c1454f4a-3daa-4d8a-a206-f6e887416476","Type":"ContainerStarted","Data":"f21e9791ba52a97509376eee7a6cc8f55f10bc6941cdfd2f2f1facdec59b35af"} Jun 09 12:06:04.487579 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:04.487530 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-69ggg" podUID="c1454f4a-3daa-4d8a-a206-f6e887416476" containerName="registry-server" containerID="cri-o://f21e9791ba52a97509376eee7a6cc8f55f10bc6941cdfd2f2f1facdec59b35af" gracePeriod=2 Jun 09 12:06:04.503496 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:04.503085 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-nkvsx" podStartSLOduration=1.8884039449999999 podStartE2EDuration="3.503066069s" totalImagesPullingTime="1.614662124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:06:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:06:04.501967747 +0000 UTC m=+660.924525545" watchObservedRunningTime="2026-06-09 12:06:04.503066069 +0000 UTC m=+660.925623841" Jun 09 12:06:04.518876 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:04.518812 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-69ggg" podStartSLOduration=1.220063855 podStartE2EDuration="3.518795247s" totalImagesPullingTime="2.298731392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:06:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:06:04.517657237 +0000 UTC m=+660.940215031" watchObservedRunningTime="2026-06-09 12:06:04.518795247 +0000 UTC m=+660.941353021" Jun 09 12:06:04.746917 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:04.746837 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-69ggg" Jun 09 12:06:04.865417 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:04.865378 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qs84w\" (UniqueName: \"kubernetes.io/projected/c1454f4a-3daa-4d8a-a206-f6e887416476-kube-api-access-qs84w\") pod \"c1454f4a-3daa-4d8a-a206-f6e887416476\" (UID: \"c1454f4a-3daa-4d8a-a206-f6e887416476\") " Jun 09 12:06:04.867635 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:04.867586 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1454f4a-3daa-4d8a-a206-f6e887416476-kube-api-access-qs84w" (OuterVolumeSpecName: "kube-api-access-qs84w") pod "c1454f4a-3daa-4d8a-a206-f6e887416476" (UID: "c1454f4a-3daa-4d8a-a206-f6e887416476"). InnerVolumeSpecName "kube-api-access-qs84w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:06:04.966545 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:04.966504 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qs84w\" (UniqueName: \"kubernetes.io/projected/c1454f4a-3daa-4d8a-a206-f6e887416476-kube-api-access-qs84w\") on node \"ip-10-0-133-80.ec2.internal\" DevicePath \"\"" Jun 09 12:06:05.493369 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:05.493333 2577 generic.go:356] "Generic (PLEG): container finished" podID="c1454f4a-3daa-4d8a-a206-f6e887416476" containerID="f21e9791ba52a97509376eee7a6cc8f55f10bc6941cdfd2f2f1facdec59b35af" exitCode=0 Jun 09 12:06:05.493796 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:05.493388 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-69ggg" Jun 09 12:06:05.493796 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:05.493426 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-69ggg" event={"ID":"c1454f4a-3daa-4d8a-a206-f6e887416476","Type":"ContainerDied","Data":"f21e9791ba52a97509376eee7a6cc8f55f10bc6941cdfd2f2f1facdec59b35af"} Jun 09 12:06:05.493796 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:05.493494 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-69ggg" event={"ID":"c1454f4a-3daa-4d8a-a206-f6e887416476","Type":"ContainerDied","Data":"444a562651e92767af3158edc8b53c9b6a1e0ab8819310ccbdf7a079f440ed6f"} Jun 09 12:06:05.493796 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:05.493515 2577 scope.go:117] "RemoveContainer" containerID="f21e9791ba52a97509376eee7a6cc8f55f10bc6941cdfd2f2f1facdec59b35af" Jun 09 12:06:05.502596 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:05.502578 2577 scope.go:117] "RemoveContainer" containerID="f21e9791ba52a97509376eee7a6cc8f55f10bc6941cdfd2f2f1facdec59b35af" Jun 09 12:06:05.502890 ip-10-0-133-80 kubenswrapper[2577]: E0609 12:06:05.502871 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f21e9791ba52a97509376eee7a6cc8f55f10bc6941cdfd2f2f1facdec59b35af\": container with ID starting with f21e9791ba52a97509376eee7a6cc8f55f10bc6941cdfd2f2f1facdec59b35af not found: ID does not exist" containerID="f21e9791ba52a97509376eee7a6cc8f55f10bc6941cdfd2f2f1facdec59b35af" Jun 09 12:06:05.502958 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:05.502898 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f21e9791ba52a97509376eee7a6cc8f55f10bc6941cdfd2f2f1facdec59b35af"} err="failed to get container status \"f21e9791ba52a97509376eee7a6cc8f55f10bc6941cdfd2f2f1facdec59b35af\": rpc error: code = NotFound desc = could not find container \"f21e9791ba52a97509376eee7a6cc8f55f10bc6941cdfd2f2f1facdec59b35af\": container with ID starting with f21e9791ba52a97509376eee7a6cc8f55f10bc6941cdfd2f2f1facdec59b35af not found: ID does not exist" Jun 09 12:06:05.514296 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:05.514265 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-69ggg"] Jun 09 12:06:05.518307 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:05.518286 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-69ggg"] Jun 09 12:06:06.044416 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:06.044384 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1454f4a-3daa-4d8a-a206-f6e887416476" path="/var/lib/kubelet/pods/c1454f4a-3daa-4d8a-a206-f6e887416476/volumes" Jun 09 12:06:12.150963 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:12.150924 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-nkvsx" Jun 09 12:06:12.151412 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:12.150985 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-nkvsx" Jun 09 12:06:12.173032 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:12.173005 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-nkvsx" Jun 09 12:06:12.555675 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:12.555582 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-nkvsx" Jun 09 12:06:33.096188 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:33.096151 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-rdtrl"] Jun 09 12:06:33.096680 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:33.096510 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1454f4a-3daa-4d8a-a206-f6e887416476" containerName="registry-server" Jun 09 12:06:33.096680 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:33.096521 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1454f4a-3daa-4d8a-a206-f6e887416476" containerName="registry-server" Jun 09 12:06:33.096680 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:33.096582 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1454f4a-3daa-4d8a-a206-f6e887416476" containerName="registry-server" Jun 09 12:06:33.101762 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:33.101744 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rdtrl" Jun 09 12:06:33.109605 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:33.109583 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-gphnz\"" Jun 09 12:06:33.120807 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:33.120769 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nx5hc\" (UniqueName: \"kubernetes.io/projected/04216f97-2ec4-447e-b879-c5faac1ff1ab-kube-api-access-nx5hc\") pod \"authorino-operator-75cc8d5cb7-rdtrl\" (UID: \"04216f97-2ec4-447e-b879-c5faac1ff1ab\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-rdtrl" Jun 09 12:06:33.124320 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:33.124289 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-rdtrl"] Jun 09 12:06:33.221808 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:33.221770 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nx5hc\" (UniqueName: \"kubernetes.io/projected/04216f97-2ec4-447e-b879-c5faac1ff1ab-kube-api-access-nx5hc\") pod \"authorino-operator-75cc8d5cb7-rdtrl\" (UID: \"04216f97-2ec4-447e-b879-c5faac1ff1ab\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-rdtrl" Jun 09 12:06:33.252492 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:33.252465 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nx5hc\" (UniqueName: \"kubernetes.io/projected/04216f97-2ec4-447e-b879-c5faac1ff1ab-kube-api-access-nx5hc\") pod \"authorino-operator-75cc8d5cb7-rdtrl\" (UID: \"04216f97-2ec4-447e-b879-c5faac1ff1ab\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-rdtrl" Jun 09 12:06:33.411762 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:33.411712 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rdtrl" Jun 09 12:06:33.567687 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:33.567662 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-rdtrl"] Jun 09 12:06:33.570328 ip-10-0-133-80 kubenswrapper[2577]: W0609 12:06:33.570297 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04216f97_2ec4_447e_b879_c5faac1ff1ab.slice/crio-64a1e1bcacdf0ac2a8d800f62005320d38b4ed8b0b988403719dfc6d26f14eea WatchSource:0}: Error finding container 64a1e1bcacdf0ac2a8d800f62005320d38b4ed8b0b988403719dfc6d26f14eea: Status 404 returned error can't find the container with id 64a1e1bcacdf0ac2a8d800f62005320d38b4ed8b0b988403719dfc6d26f14eea Jun 09 12:06:33.572549 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:33.572528 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 12:06:33.629463 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:33.629425 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rdtrl" event={"ID":"04216f97-2ec4-447e-b879-c5faac1ff1ab","Type":"ContainerStarted","Data":"64a1e1bcacdf0ac2a8d800f62005320d38b4ed8b0b988403719dfc6d26f14eea"} Jun 09 12:06:35.859118 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:35.859085 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-76bwh"] Jun 09 12:06:35.861902 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:35.861880 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-76bwh" Jun 09 12:06:35.865665 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:35.865628 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 09 12:06:35.872972 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:35.872954 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-5g5xt\"" Jun 09 12:06:35.879775 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:35.879752 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-76bwh"] Jun 09 12:06:35.948705 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:35.948667 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psvwg\" (UniqueName: \"kubernetes.io/projected/c3f56561-1cfa-4ab7-92da-380ff627d758-kube-api-access-psvwg\") pod \"dns-operator-controller-manager-864dd78c4c-76bwh\" (UID: \"c3f56561-1cfa-4ab7-92da-380ff627d758\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-76bwh" Jun 09 12:06:36.050073 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:36.050041 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psvwg\" (UniqueName: \"kubernetes.io/projected/c3f56561-1cfa-4ab7-92da-380ff627d758-kube-api-access-psvwg\") pod \"dns-operator-controller-manager-864dd78c4c-76bwh\" (UID: \"c3f56561-1cfa-4ab7-92da-380ff627d758\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-76bwh" Jun 09 12:06:36.067783 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:36.067747 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psvwg\" (UniqueName: \"kubernetes.io/projected/c3f56561-1cfa-4ab7-92da-380ff627d758-kube-api-access-psvwg\") pod \"dns-operator-controller-manager-864dd78c4c-76bwh\" (UID: \"c3f56561-1cfa-4ab7-92da-380ff627d758\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-76bwh" Jun 09 12:06:36.173149 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:36.173126 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-76bwh" Jun 09 12:06:36.327489 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:36.327463 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-76bwh"] Jun 09 12:06:36.329178 ip-10-0-133-80 kubenswrapper[2577]: W0609 12:06:36.329150 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3f56561_1cfa_4ab7_92da_380ff627d758.slice/crio-714e5755f17792f0061da3a86c0105c10fb294cc81463eb687cc53a3b7ba46ca WatchSource:0}: Error finding container 714e5755f17792f0061da3a86c0105c10fb294cc81463eb687cc53a3b7ba46ca: Status 404 returned error can't find the container with id 714e5755f17792f0061da3a86c0105c10fb294cc81463eb687cc53a3b7ba46ca Jun 09 12:06:36.647983 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:36.647948 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rdtrl" event={"ID":"04216f97-2ec4-447e-b879-c5faac1ff1ab","Type":"ContainerStarted","Data":"89d9d00cee84b082d736466a358774183b4cea924f813bb55420189739921bce"} Jun 09 12:06:36.648167 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:36.648057 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rdtrl" Jun 09 12:06:36.649265 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:36.649239 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-76bwh" event={"ID":"c3f56561-1cfa-4ab7-92da-380ff627d758","Type":"ContainerStarted","Data":"714e5755f17792f0061da3a86c0105c10fb294cc81463eb687cc53a3b7ba46ca"} Jun 09 12:06:36.684719 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:36.684669 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rdtrl" podStartSLOduration=1.108231276 podStartE2EDuration="3.684650465s" totalImagesPullingTime="2.576419189s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:06:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:06:36.682948481 +0000 UTC m=+693.105506257" watchObservedRunningTime="2026-06-09 12:06:36.684650465 +0000 UTC m=+693.107208242" Jun 09 12:06:38.669696 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:38.669653 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-76bwh" event={"ID":"c3f56561-1cfa-4ab7-92da-380ff627d758","Type":"ContainerStarted","Data":"54f04857a28de317ce2e69d62dcfbcbb2ac16894815de6dcd40a9341abb7d103"} Jun 09 12:06:38.670165 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:38.669792 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-76bwh" Jun 09 12:06:38.705526 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:38.705472 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-76bwh" podStartSLOduration=1.539015792 podStartE2EDuration="3.705456421s" totalImagesPullingTime="2.166440629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:06:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:06:38.703955756 +0000 UTC m=+695.126513592" watchObservedRunningTime="2026-06-09 12:06:38.705456421 +0000 UTC m=+695.128014195" Jun 09 12:06:40.092758 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:40.092720 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9mvr"] Jun 09 12:06:40.095127 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:40.095110 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9mvr" Jun 09 12:06:40.097877 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:40.097856 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-vs6bt\"" Jun 09 12:06:40.143219 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:40.143186 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9mvr"] Jun 09 12:06:40.188337 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:40.188307 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zz8fp\" (UniqueName: \"kubernetes.io/projected/a76cdf55-5d9d-459a-afcd-370494724b9c-kube-api-access-zz8fp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v9mvr\" (UID: \"a76cdf55-5d9d-459a-afcd-370494724b9c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9mvr" Jun 09 12:06:40.188497 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:40.188350 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a76cdf55-5d9d-459a-afcd-370494724b9c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v9mvr\" (UID: \"a76cdf55-5d9d-459a-afcd-370494724b9c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9mvr" Jun 09 12:06:40.289143 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:40.289103 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zz8fp\" (UniqueName: \"kubernetes.io/projected/a76cdf55-5d9d-459a-afcd-370494724b9c-kube-api-access-zz8fp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v9mvr\" (UID: \"a76cdf55-5d9d-459a-afcd-370494724b9c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9mvr" Jun 09 12:06:40.289332 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:40.289166 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a76cdf55-5d9d-459a-afcd-370494724b9c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v9mvr\" (UID: \"a76cdf55-5d9d-459a-afcd-370494724b9c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9mvr" Jun 09 12:06:40.289528 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:40.289507 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a76cdf55-5d9d-459a-afcd-370494724b9c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v9mvr\" (UID: \"a76cdf55-5d9d-459a-afcd-370494724b9c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9mvr" Jun 09 12:06:40.305666 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:40.305633 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zz8fp\" (UniqueName: \"kubernetes.io/projected/a76cdf55-5d9d-459a-afcd-370494724b9c-kube-api-access-zz8fp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v9mvr\" (UID: \"a76cdf55-5d9d-459a-afcd-370494724b9c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9mvr" Jun 09 12:06:40.405493 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:40.405460 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9mvr" Jun 09 12:06:40.566225 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:40.566164 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9mvr"] Jun 09 12:06:40.568421 ip-10-0-133-80 kubenswrapper[2577]: W0609 12:06:40.568393 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda76cdf55_5d9d_459a_afcd_370494724b9c.slice/crio-abcd7b29c72dd5f8f6d8f443b0ec5814ae5e9b54ebd5688b41635785dc1b6bc1 WatchSource:0}: Error finding container abcd7b29c72dd5f8f6d8f443b0ec5814ae5e9b54ebd5688b41635785dc1b6bc1: Status 404 returned error can't find the container with id abcd7b29c72dd5f8f6d8f443b0ec5814ae5e9b54ebd5688b41635785dc1b6bc1 Jun 09 12:06:40.682973 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:40.682885 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9mvr" event={"ID":"a76cdf55-5d9d-459a-afcd-370494724b9c","Type":"ContainerStarted","Data":"abcd7b29c72dd5f8f6d8f443b0ec5814ae5e9b54ebd5688b41635785dc1b6bc1"} Jun 09 12:06:47.657453 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:47.657407 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rdtrl" Jun 09 12:06:48.726925 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:48.726881 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9mvr" event={"ID":"a76cdf55-5d9d-459a-afcd-370494724b9c","Type":"ContainerStarted","Data":"bc15893d075ae4540b3e0e5cf3d9630a04821b9926a7a8bd226550bfbd4e6612"} Jun 09 12:06:48.727350 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:48.727022 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9mvr" Jun 09 12:06:48.757576 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:48.757514 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9mvr" podStartSLOduration=1.616289234 podStartE2EDuration="8.757493718s" totalImagesPullingTime="7.141204484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:06:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:06:48.755009938 +0000 UTC m=+705.177567733" watchObservedRunningTime="2026-06-09 12:06:48.757493718 +0000 UTC m=+705.180051494" Jun 09 12:06:49.680421 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:49.680392 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-76bwh" Jun 09 12:06:50.797082 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:50.797041 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-v2kr9"] Jun 09 12:06:50.799976 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:50.799957 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-v2kr9" Jun 09 12:06:50.802847 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:50.802822 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 09 12:06:50.802973 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:50.802865 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vkqf9\"" Jun 09 12:06:50.803107 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:50.803090 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 09 12:06:50.821327 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:50.818190 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-v2kr9"] Jun 09 12:06:50.892100 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:50.892061 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trcvj\" (UniqueName: \"kubernetes.io/projected/f0a61940-0bc7-4ddc-a81f-a51b136aaf2e-kube-api-access-trcvj\") pod \"kuadrant-console-plugin-66b5774985-v2kr9\" (UID: \"f0a61940-0bc7-4ddc-a81f-a51b136aaf2e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-v2kr9" Jun 09 12:06:50.892100 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:50.892106 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f0a61940-0bc7-4ddc-a81f-a51b136aaf2e-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-v2kr9\" (UID: \"f0a61940-0bc7-4ddc-a81f-a51b136aaf2e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-v2kr9" Jun 09 12:06:50.892317 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:50.892124 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f0a61940-0bc7-4ddc-a81f-a51b136aaf2e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-v2kr9\" (UID: \"f0a61940-0bc7-4ddc-a81f-a51b136aaf2e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-v2kr9" Jun 09 12:06:50.993392 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:50.993357 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trcvj\" (UniqueName: \"kubernetes.io/projected/f0a61940-0bc7-4ddc-a81f-a51b136aaf2e-kube-api-access-trcvj\") pod \"kuadrant-console-plugin-66b5774985-v2kr9\" (UID: \"f0a61940-0bc7-4ddc-a81f-a51b136aaf2e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-v2kr9" Jun 09 12:06:50.993565 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:50.993403 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f0a61940-0bc7-4ddc-a81f-a51b136aaf2e-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-v2kr9\" (UID: \"f0a61940-0bc7-4ddc-a81f-a51b136aaf2e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-v2kr9" Jun 09 12:06:50.993565 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:50.993422 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f0a61940-0bc7-4ddc-a81f-a51b136aaf2e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-v2kr9\" (UID: \"f0a61940-0bc7-4ddc-a81f-a51b136aaf2e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-v2kr9" Jun 09 12:06:50.994097 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:50.994070 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f0a61940-0bc7-4ddc-a81f-a51b136aaf2e-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-v2kr9\" (UID: \"f0a61940-0bc7-4ddc-a81f-a51b136aaf2e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-v2kr9" Jun 09 12:06:50.995952 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:50.995930 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f0a61940-0bc7-4ddc-a81f-a51b136aaf2e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-v2kr9\" (UID: \"f0a61940-0bc7-4ddc-a81f-a51b136aaf2e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-v2kr9" Jun 09 12:06:51.006809 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:51.006783 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trcvj\" (UniqueName: \"kubernetes.io/projected/f0a61940-0bc7-4ddc-a81f-a51b136aaf2e-kube-api-access-trcvj\") pod \"kuadrant-console-plugin-66b5774985-v2kr9\" (UID: \"f0a61940-0bc7-4ddc-a81f-a51b136aaf2e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-v2kr9" Jun 09 12:06:51.109742 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:51.109649 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-v2kr9" Jun 09 12:06:51.255380 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:51.255357 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-v2kr9"] Jun 09 12:06:51.256970 ip-10-0-133-80 kubenswrapper[2577]: W0609 12:06:51.256942 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0a61940_0bc7_4ddc_a81f_a51b136aaf2e.slice/crio-656ef93d79f8e86172acd5b12f8d3ed9ecc869fefabab2fa44e413cf0f7938dd WatchSource:0}: Error finding container 656ef93d79f8e86172acd5b12f8d3ed9ecc869fefabab2fa44e413cf0f7938dd: Status 404 returned error can't find the container with id 656ef93d79f8e86172acd5b12f8d3ed9ecc869fefabab2fa44e413cf0f7938dd Jun 09 12:06:51.742784 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:51.742746 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-v2kr9" event={"ID":"f0a61940-0bc7-4ddc-a81f-a51b136aaf2e","Type":"ContainerStarted","Data":"656ef93d79f8e86172acd5b12f8d3ed9ecc869fefabab2fa44e413cf0f7938dd"} Jun 09 12:06:59.735089 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:06:59.735008 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9mvr" Jun 09 12:07:01.708148 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:01.708108 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9mvr"] Jun 09 12:07:01.708595 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:01.708364 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9mvr" podUID="a76cdf55-5d9d-459a-afcd-370494724b9c" containerName="manager" containerID="cri-o://bc15893d075ae4540b3e0e5cf3d9630a04821b9926a7a8bd226550bfbd4e6612" gracePeriod=2 Jun 09 12:07:01.726857 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:01.726793 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9mvr"] Jun 09 12:07:01.785508 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:01.785462 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mvks8"] Jun 09 12:07:01.786223 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:01.786197 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a76cdf55-5d9d-459a-afcd-370494724b9c" containerName="manager" Jun 09 12:07:01.786352 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:01.786239 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a76cdf55-5d9d-459a-afcd-370494724b9c" containerName="manager" Jun 09 12:07:01.786444 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:01.786422 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a76cdf55-5d9d-459a-afcd-370494724b9c" containerName="manager" Jun 09 12:07:01.794303 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:01.794275 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mvks8" Jun 09 12:07:01.817806 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:01.817776 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mvks8"] Jun 09 12:07:01.846064 ip-10-0-133-80 kubenswrapper[2577]: E0609 12:07:01.846001 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-v9mvr\" is forbidden: User \"system:node:ip-10-0-133-80.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-80.ec2.internal' and this object" podUID="a76cdf55-5d9d-459a-afcd-370494724b9c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9mvr" Jun 09 12:07:01.901164 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:01.901124 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7db7af6e-629c-4f7f-a467-3aa74ee45c87-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mvks8\" (UID: \"7db7af6e-629c-4f7f-a467-3aa74ee45c87\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mvks8" Jun 09 12:07:01.901350 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:01.901184 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf65c\" (UniqueName: \"kubernetes.io/projected/7db7af6e-629c-4f7f-a467-3aa74ee45c87-kube-api-access-bf65c\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mvks8\" (UID: \"7db7af6e-629c-4f7f-a467-3aa74ee45c87\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mvks8" Jun 09 12:07:02.002723 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:02.002638 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7db7af6e-629c-4f7f-a467-3aa74ee45c87-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mvks8\" (UID: \"7db7af6e-629c-4f7f-a467-3aa74ee45c87\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mvks8" Jun 09 12:07:02.002723 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:02.002703 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf65c\" (UniqueName: \"kubernetes.io/projected/7db7af6e-629c-4f7f-a467-3aa74ee45c87-kube-api-access-bf65c\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mvks8\" (UID: \"7db7af6e-629c-4f7f-a467-3aa74ee45c87\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mvks8" Jun 09 12:07:02.003110 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:02.003086 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7db7af6e-629c-4f7f-a467-3aa74ee45c87-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mvks8\" (UID: \"7db7af6e-629c-4f7f-a467-3aa74ee45c87\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mvks8" Jun 09 12:07:02.027045 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:02.027018 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf65c\" (UniqueName: \"kubernetes.io/projected/7db7af6e-629c-4f7f-a467-3aa74ee45c87-kube-api-access-bf65c\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mvks8\" (UID: \"7db7af6e-629c-4f7f-a467-3aa74ee45c87\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mvks8" Jun 09 12:07:02.107540 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:02.107500 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mvks8" Jun 09 12:07:04.112107 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:04.111968 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fzpfb"] Jun 09 12:07:04.130840 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:04.130812 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fzpfb" Jun 09 12:07:04.156789 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:04.156703 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fzpfb"] Jun 09 12:07:04.231242 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:04.231200 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2bea75de-8445-44e6-a86e-54fc653d0af4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fzpfb\" (UID: \"2bea75de-8445-44e6-a86e-54fc653d0af4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fzpfb" Jun 09 12:07:04.231242 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:04.231250 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crc2z\" (UniqueName: \"kubernetes.io/projected/2bea75de-8445-44e6-a86e-54fc653d0af4-kube-api-access-crc2z\") pod \"kuadrant-operator-controller-manager-86878c769f-fzpfb\" (UID: \"2bea75de-8445-44e6-a86e-54fc653d0af4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fzpfb" Jun 09 12:07:04.331929 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:04.331832 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2bea75de-8445-44e6-a86e-54fc653d0af4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fzpfb\" (UID: \"2bea75de-8445-44e6-a86e-54fc653d0af4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fzpfb" Jun 09 12:07:04.331929 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:04.331882 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crc2z\" (UniqueName: \"kubernetes.io/projected/2bea75de-8445-44e6-a86e-54fc653d0af4-kube-api-access-crc2z\") pod \"kuadrant-operator-controller-manager-86878c769f-fzpfb\" (UID: \"2bea75de-8445-44e6-a86e-54fc653d0af4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fzpfb" Jun 09 12:07:04.332309 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:04.332276 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2bea75de-8445-44e6-a86e-54fc653d0af4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fzpfb\" (UID: \"2bea75de-8445-44e6-a86e-54fc653d0af4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fzpfb" Jun 09 12:07:04.345383 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:04.345336 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crc2z\" (UniqueName: \"kubernetes.io/projected/2bea75de-8445-44e6-a86e-54fc653d0af4-kube-api-access-crc2z\") pod \"kuadrant-operator-controller-manager-86878c769f-fzpfb\" (UID: \"2bea75de-8445-44e6-a86e-54fc653d0af4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fzpfb" Jun 09 12:07:04.445117 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:04.445074 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fzpfb" Jun 09 12:07:16.235430 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:16.235401 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9mvr" Jun 09 12:07:16.235897 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:16.235777 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mvks8"] Jun 09 12:07:16.237596 ip-10-0-133-80 kubenswrapper[2577]: W0609 12:07:16.237566 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7db7af6e_629c_4f7f_a467_3aa74ee45c87.slice/crio-372f8ec94b710f7080373d9f8894bd58a5c29ed3e58b1d6a3ca165faf4f915d9 WatchSource:0}: Error finding container 372f8ec94b710f7080373d9f8894bd58a5c29ed3e58b1d6a3ca165faf4f915d9: Status 404 returned error can't find the container with id 372f8ec94b710f7080373d9f8894bd58a5c29ed3e58b1d6a3ca165faf4f915d9 Jun 09 12:07:16.240320 ip-10-0-133-80 kubenswrapper[2577]: E0609 12:07:16.240283 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-v9mvr\" is forbidden: User \"system:node:ip-10-0-133-80.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-80.ec2.internal' and this object" podUID="a76cdf55-5d9d-459a-afcd-370494724b9c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9mvr" Jun 09 12:07:16.270429 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:16.270350 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fzpfb"] Jun 09 12:07:16.272451 ip-10-0-133-80 kubenswrapper[2577]: W0609 12:07:16.272423 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bea75de_8445_44e6_a86e_54fc653d0af4.slice/crio-5dc4e91223e00548b909fc138e72a5ec371ecbe9ae25ae313b1c9d4df5083781 WatchSource:0}: Error finding container 5dc4e91223e00548b909fc138e72a5ec371ecbe9ae25ae313b1c9d4df5083781: Status 404 returned error can't find the container with id 5dc4e91223e00548b909fc138e72a5ec371ecbe9ae25ae313b1c9d4df5083781 Jun 09 12:07:16.347633 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:16.347530 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a76cdf55-5d9d-459a-afcd-370494724b9c-extensions-socket-volume\") pod \"a76cdf55-5d9d-459a-afcd-370494724b9c\" (UID: \"a76cdf55-5d9d-459a-afcd-370494724b9c\") " Jun 09 12:07:16.347633 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:16.347594 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zz8fp\" (UniqueName: \"kubernetes.io/projected/a76cdf55-5d9d-459a-afcd-370494724b9c-kube-api-access-zz8fp\") pod \"a76cdf55-5d9d-459a-afcd-370494724b9c\" (UID: \"a76cdf55-5d9d-459a-afcd-370494724b9c\") " Jun 09 12:07:16.348095 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:16.348071 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a76cdf55-5d9d-459a-afcd-370494724b9c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a76cdf55-5d9d-459a-afcd-370494724b9c" (UID: "a76cdf55-5d9d-459a-afcd-370494724b9c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:07:16.349582 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:16.349562 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a76cdf55-5d9d-459a-afcd-370494724b9c-kube-api-access-zz8fp" (OuterVolumeSpecName: "kube-api-access-zz8fp") pod "a76cdf55-5d9d-459a-afcd-370494724b9c" (UID: "a76cdf55-5d9d-459a-afcd-370494724b9c"). InnerVolumeSpecName "kube-api-access-zz8fp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:07:16.448596 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:16.448554 2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a76cdf55-5d9d-459a-afcd-370494724b9c-extensions-socket-volume\") on node \"ip-10-0-133-80.ec2.internal\" DevicePath \"\"" Jun 09 12:07:16.448596 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:16.448586 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zz8fp\" (UniqueName: \"kubernetes.io/projected/a76cdf55-5d9d-459a-afcd-370494724b9c-kube-api-access-zz8fp\") on node \"ip-10-0-133-80.ec2.internal\" DevicePath \"\"" Jun 09 12:07:16.896502 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:16.896468 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fzpfb" event={"ID":"2bea75de-8445-44e6-a86e-54fc653d0af4","Type":"ContainerStarted","Data":"cb11210a8d9bb6f3bdcadcf498cb26186f03ff25835cc12b782bd53bef4f6656"} Jun 09 12:07:16.896735 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:16.896526 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fzpfb" event={"ID":"2bea75de-8445-44e6-a86e-54fc653d0af4","Type":"ContainerStarted","Data":"5dc4e91223e00548b909fc138e72a5ec371ecbe9ae25ae313b1c9d4df5083781"} Jun 09 12:07:16.896735 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:16.896585 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fzpfb" Jun 09 12:07:16.898176 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:16.898150 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mvks8" event={"ID":"7db7af6e-629c-4f7f-a467-3aa74ee45c87","Type":"ContainerStarted","Data":"f9068bab57795802d04875929e5e225a7888642702246249308f373f513633c7"} Jun 09 12:07:16.898301 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:16.898192 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mvks8" event={"ID":"7db7af6e-629c-4f7f-a467-3aa74ee45c87","Type":"ContainerStarted","Data":"372f8ec94b710f7080373d9f8894bd58a5c29ed3e58b1d6a3ca165faf4f915d9"} Jun 09 12:07:16.898301 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:16.898248 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mvks8" Jun 09 12:07:16.899449 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:16.899426 2577 generic.go:356] "Generic (PLEG): container finished" podID="a76cdf55-5d9d-459a-afcd-370494724b9c" containerID="bc15893d075ae4540b3e0e5cf3d9630a04821b9926a7a8bd226550bfbd4e6612" exitCode=0 Jun 09 12:07:16.899537 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:16.899460 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9mvr" Jun 09 12:07:16.899537 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:16.899495 2577 scope.go:117] "RemoveContainer" containerID="bc15893d075ae4540b3e0e5cf3d9630a04821b9926a7a8bd226550bfbd4e6612" Jun 09 12:07:16.901108 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:16.901082 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-v2kr9" event={"ID":"f0a61940-0bc7-4ddc-a81f-a51b136aaf2e","Type":"ContainerStarted","Data":"211248616aea4a647681d6a5b7de058b6f64a4579ed7bd502e308f96b66afcb7"} Jun 09 12:07:16.908675 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:16.908656 2577 scope.go:117] "RemoveContainer" containerID="bc15893d075ae4540b3e0e5cf3d9630a04821b9926a7a8bd226550bfbd4e6612" Jun 09 12:07:16.908968 ip-10-0-133-80 kubenswrapper[2577]: E0609 12:07:16.908949 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc15893d075ae4540b3e0e5cf3d9630a04821b9926a7a8bd226550bfbd4e6612\": container with ID starting with bc15893d075ae4540b3e0e5cf3d9630a04821b9926a7a8bd226550bfbd4e6612 not found: ID does not exist" containerID="bc15893d075ae4540b3e0e5cf3d9630a04821b9926a7a8bd226550bfbd4e6612" Jun 09 12:07:16.909027 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:16.908977 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc15893d075ae4540b3e0e5cf3d9630a04821b9926a7a8bd226550bfbd4e6612"} err="failed to get container status \"bc15893d075ae4540b3e0e5cf3d9630a04821b9926a7a8bd226550bfbd4e6612\": rpc error: code = NotFound desc = could not find container \"bc15893d075ae4540b3e0e5cf3d9630a04821b9926a7a8bd226550bfbd4e6612\": container with ID starting with bc15893d075ae4540b3e0e5cf3d9630a04821b9926a7a8bd226550bfbd4e6612 not found: ID does not exist" Jun 09 12:07:16.924041 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:16.923996 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fzpfb" podStartSLOduration=12.923980773 podStartE2EDuration="12.923980773s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:07:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:07:16.920722594 +0000 UTC m=+733.343280382" watchObservedRunningTime="2026-06-09 12:07:16.923980773 +0000 UTC m=+733.346538548" Jun 09 12:07:16.926695 ip-10-0-133-80 kubenswrapper[2577]: E0609 12:07:16.926673 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-v9mvr\" is forbidden: User \"system:node:ip-10-0-133-80.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-80.ec2.internal' and this object" podUID="a76cdf55-5d9d-459a-afcd-370494724b9c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9mvr" Jun 09 12:07:16.929500 ip-10-0-133-80 kubenswrapper[2577]: E0609 12:07:16.929480 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-v9mvr\" is forbidden: User \"system:node:ip-10-0-133-80.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-80.ec2.internal' and this object" podUID="a76cdf55-5d9d-459a-afcd-370494724b9c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9mvr" Jun 09 12:07:16.948478 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:16.948430 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-v2kr9" podStartSLOduration=2.040075631 podStartE2EDuration="26.948416531s" totalImagesPullingTime="24.9083409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:06:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:07:16.946045274 +0000 UTC m=+733.368603046" watchObservedRunningTime="2026-06-09 12:07:16.948416531 +0000 UTC m=+733.370974305" Jun 09 12:07:16.985211 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:16.985150 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mvks8" podStartSLOduration=15.985130299 podStartE2EDuration="15.985130299s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:07:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:07:16.982868668 +0000 UTC m=+733.405426501" watchObservedRunningTime="2026-06-09 12:07:16.985130299 +0000 UTC m=+733.407688078" Jun 09 12:07:18.044357 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:18.044324 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a76cdf55-5d9d-459a-afcd-370494724b9c" path="/var/lib/kubelet/pods/a76cdf55-5d9d-459a-afcd-370494724b9c/volumes" Jun 09 12:07:27.909961 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:27.909926 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fzpfb" Jun 09 12:07:27.910441 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:27.910004 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mvks8" Jun 09 12:07:28.000893 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:27.996112 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mvks8"] Jun 09 12:07:28.000893 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:27.996360 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mvks8" podUID="7db7af6e-629c-4f7f-a467-3aa74ee45c87" containerName="manager" containerID="cri-o://f9068bab57795802d04875929e5e225a7888642702246249308f373f513633c7" gracePeriod=10 Jun 09 12:07:28.261154 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:28.261128 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mvks8" Jun 09 12:07:28.355652 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:28.355591 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7db7af6e-629c-4f7f-a467-3aa74ee45c87-extensions-socket-volume\") pod \"7db7af6e-629c-4f7f-a467-3aa74ee45c87\" (UID: \"7db7af6e-629c-4f7f-a467-3aa74ee45c87\") " Jun 09 12:07:28.355652 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:28.355651 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bf65c\" (UniqueName: \"kubernetes.io/projected/7db7af6e-629c-4f7f-a467-3aa74ee45c87-kube-api-access-bf65c\") pod \"7db7af6e-629c-4f7f-a467-3aa74ee45c87\" (UID: \"7db7af6e-629c-4f7f-a467-3aa74ee45c87\") " Jun 09 12:07:28.355973 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:28.355946 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7db7af6e-629c-4f7f-a467-3aa74ee45c87-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7db7af6e-629c-4f7f-a467-3aa74ee45c87" (UID: "7db7af6e-629c-4f7f-a467-3aa74ee45c87"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:07:28.357681 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:28.357658 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7db7af6e-629c-4f7f-a467-3aa74ee45c87-kube-api-access-bf65c" (OuterVolumeSpecName: "kube-api-access-bf65c") pod "7db7af6e-629c-4f7f-a467-3aa74ee45c87" (UID: "7db7af6e-629c-4f7f-a467-3aa74ee45c87"). InnerVolumeSpecName "kube-api-access-bf65c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:07:28.456860 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:28.456778 2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7db7af6e-629c-4f7f-a467-3aa74ee45c87-extensions-socket-volume\") on node \"ip-10-0-133-80.ec2.internal\" DevicePath \"\"" Jun 09 12:07:28.456860 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:28.456803 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bf65c\" (UniqueName: \"kubernetes.io/projected/7db7af6e-629c-4f7f-a467-3aa74ee45c87-kube-api-access-bf65c\") on node \"ip-10-0-133-80.ec2.internal\" DevicePath \"\"" Jun 09 12:07:28.963063 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:28.963025 2577 generic.go:356] "Generic (PLEG): container finished" podID="7db7af6e-629c-4f7f-a467-3aa74ee45c87" containerID="f9068bab57795802d04875929e5e225a7888642702246249308f373f513633c7" exitCode=0 Jun 09 12:07:28.963473 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:28.963072 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mvks8" Jun 09 12:07:28.963473 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:28.963104 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mvks8" event={"ID":"7db7af6e-629c-4f7f-a467-3aa74ee45c87","Type":"ContainerDied","Data":"f9068bab57795802d04875929e5e225a7888642702246249308f373f513633c7"} Jun 09 12:07:28.963473 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:28.963155 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mvks8" event={"ID":"7db7af6e-629c-4f7f-a467-3aa74ee45c87","Type":"ContainerDied","Data":"372f8ec94b710f7080373d9f8894bd58a5c29ed3e58b1d6a3ca165faf4f915d9"} Jun 09 12:07:28.963473 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:28.963179 2577 scope.go:117] "RemoveContainer" containerID="f9068bab57795802d04875929e5e225a7888642702246249308f373f513633c7" Jun 09 12:07:28.972843 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:28.972825 2577 scope.go:117] "RemoveContainer" containerID="f9068bab57795802d04875929e5e225a7888642702246249308f373f513633c7" Jun 09 12:07:28.973174 ip-10-0-133-80 kubenswrapper[2577]: E0609 12:07:28.973150 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9068bab57795802d04875929e5e225a7888642702246249308f373f513633c7\": container with ID starting with f9068bab57795802d04875929e5e225a7888642702246249308f373f513633c7 not found: ID does not exist" containerID="f9068bab57795802d04875929e5e225a7888642702246249308f373f513633c7" Jun 09 12:07:28.973272 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:28.973179 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9068bab57795802d04875929e5e225a7888642702246249308f373f513633c7"} err="failed to get container status \"f9068bab57795802d04875929e5e225a7888642702246249308f373f513633c7\": rpc error: code = NotFound desc = could not find container \"f9068bab57795802d04875929e5e225a7888642702246249308f373f513633c7\": container with ID starting with f9068bab57795802d04875929e5e225a7888642702246249308f373f513633c7 not found: ID does not exist" Jun 09 12:07:28.985696 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:28.985662 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mvks8"] Jun 09 12:07:28.993687 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:28.993654 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mvks8"] Jun 09 12:07:30.045048 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:30.045011 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7db7af6e-629c-4f7f-a467-3aa74ee45c87" path="/var/lib/kubelet/pods/7db7af6e-629c-4f7f-a467-3aa74ee45c87/volumes" Jun 09 12:07:44.263850 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:44.263821 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4466p"] Jun 09 12:07:44.264258 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:44.264244 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7db7af6e-629c-4f7f-a467-3aa74ee45c87" containerName="manager" Jun 09 12:07:44.264258 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:44.264258 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7db7af6e-629c-4f7f-a467-3aa74ee45c87" containerName="manager" Jun 09 12:07:44.264361 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:44.264332 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7db7af6e-629c-4f7f-a467-3aa74ee45c87" containerName="manager" Jun 09 12:07:44.387027 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:44.386995 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4466p"] Jun 09 12:07:44.387201 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:44.387136 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4466p" Jun 09 12:07:44.389517 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:44.389493 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-zm8h6\"" Jun 09 12:07:44.505956 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:44.505923 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/584bfad5-351d-45e4-9d93-fe15c50f3552-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-4466p\" (UID: \"584bfad5-351d-45e4-9d93-fe15c50f3552\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4466p" Jun 09 12:07:44.506135 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:44.505988 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/584bfad5-351d-45e4-9d93-fe15c50f3552-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-4466p\" (UID: \"584bfad5-351d-45e4-9d93-fe15c50f3552\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4466p" Jun 09 12:07:44.506135 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:44.506018 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/584bfad5-351d-45e4-9d93-fe15c50f3552-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-4466p\" (UID: \"584bfad5-351d-45e4-9d93-fe15c50f3552\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4466p" Jun 09 12:07:44.506135 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:44.506040 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/584bfad5-351d-45e4-9d93-fe15c50f3552-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-4466p\" (UID: \"584bfad5-351d-45e4-9d93-fe15c50f3552\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4466p" Jun 09 12:07:44.506237 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:44.506132 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr9sk\" (UniqueName: \"kubernetes.io/projected/584bfad5-351d-45e4-9d93-fe15c50f3552-kube-api-access-pr9sk\") pod \"maas-default-gateway-openshift-default-687ff6996-4466p\" (UID: \"584bfad5-351d-45e4-9d93-fe15c50f3552\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4466p" Jun 09 12:07:44.506237 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:44.506172 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/584bfad5-351d-45e4-9d93-fe15c50f3552-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-4466p\" (UID: \"584bfad5-351d-45e4-9d93-fe15c50f3552\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4466p" Jun 09 12:07:44.506237 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:44.506188 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/584bfad5-351d-45e4-9d93-fe15c50f3552-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-4466p\" (UID: \"584bfad5-351d-45e4-9d93-fe15c50f3552\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4466p" Jun 09 12:07:44.506237 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:44.506203 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/584bfad5-351d-45e4-9d93-fe15c50f3552-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-4466p\" (UID: \"584bfad5-351d-45e4-9d93-fe15c50f3552\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4466p" Jun 09 12:07:44.506359 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:44.506256 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/584bfad5-351d-45e4-9d93-fe15c50f3552-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-4466p\" (UID: \"584bfad5-351d-45e4-9d93-fe15c50f3552\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4466p" Jun 09 12:07:44.607588 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:44.607507 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/584bfad5-351d-45e4-9d93-fe15c50f3552-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-4466p\" (UID: \"584bfad5-351d-45e4-9d93-fe15c50f3552\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4466p" Jun 09 12:07:44.607588 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:44.607549 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/584bfad5-351d-45e4-9d93-fe15c50f3552-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-4466p\" (UID: \"584bfad5-351d-45e4-9d93-fe15c50f3552\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4466p" Jun 09 12:07:44.607588 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:44.607577 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/584bfad5-351d-45e4-9d93-fe15c50f3552-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-4466p\" (UID: \"584bfad5-351d-45e4-9d93-fe15c50f3552\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4466p" Jun 09 12:07:44.607903 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:44.607823 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr9sk\" (UniqueName: \"kubernetes.io/projected/584bfad5-351d-45e4-9d93-fe15c50f3552-kube-api-access-pr9sk\") pod \"maas-default-gateway-openshift-default-687ff6996-4466p\" (UID: \"584bfad5-351d-45e4-9d93-fe15c50f3552\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4466p" Jun 09 12:07:44.608059 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:44.608034 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/584bfad5-351d-45e4-9d93-fe15c50f3552-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-4466p\" (UID: \"584bfad5-351d-45e4-9d93-fe15c50f3552\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4466p" Jun 09 12:07:44.608132 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:44.608059 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/584bfad5-351d-45e4-9d93-fe15c50f3552-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-4466p\" (UID: \"584bfad5-351d-45e4-9d93-fe15c50f3552\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4466p" Jun 09 12:07:44.608132 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:44.608073 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/584bfad5-351d-45e4-9d93-fe15c50f3552-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-4466p\" (UID: \"584bfad5-351d-45e4-9d93-fe15c50f3552\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4466p" Jun 09 12:07:44.608132 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:44.608044 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/584bfad5-351d-45e4-9d93-fe15c50f3552-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-4466p\" (UID: \"584bfad5-351d-45e4-9d93-fe15c50f3552\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4466p" Jun 09 12:07:44.608132 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:44.608100 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/584bfad5-351d-45e4-9d93-fe15c50f3552-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-4466p\" (UID: \"584bfad5-351d-45e4-9d93-fe15c50f3552\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4466p" Jun 09 12:07:44.608327 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:44.608160 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/584bfad5-351d-45e4-9d93-fe15c50f3552-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-4466p\" (UID: \"584bfad5-351d-45e4-9d93-fe15c50f3552\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4466p" Jun 09 12:07:44.608327 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:44.608207 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/584bfad5-351d-45e4-9d93-fe15c50f3552-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-4466p\" (UID: \"584bfad5-351d-45e4-9d93-fe15c50f3552\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4466p" Jun 09 12:07:44.608430 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:44.608416 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/584bfad5-351d-45e4-9d93-fe15c50f3552-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-4466p\" (UID: \"584bfad5-351d-45e4-9d93-fe15c50f3552\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4466p" Jun 09 12:07:44.608585 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:44.608561 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/584bfad5-351d-45e4-9d93-fe15c50f3552-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-4466p\" (UID: \"584bfad5-351d-45e4-9d93-fe15c50f3552\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4466p" Jun 09 12:07:44.609109 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:44.609085 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/584bfad5-351d-45e4-9d93-fe15c50f3552-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-4466p\" (UID: \"584bfad5-351d-45e4-9d93-fe15c50f3552\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4466p" Jun 09 12:07:44.610321 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:44.610297 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/584bfad5-351d-45e4-9d93-fe15c50f3552-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-4466p\" (UID: \"584bfad5-351d-45e4-9d93-fe15c50f3552\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4466p" Jun 09 12:07:44.610785 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:44.610768 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/584bfad5-351d-45e4-9d93-fe15c50f3552-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-4466p\" (UID: \"584bfad5-351d-45e4-9d93-fe15c50f3552\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4466p" Jun 09 12:07:44.621506 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:44.621481 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/584bfad5-351d-45e4-9d93-fe15c50f3552-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-4466p\" (UID: \"584bfad5-351d-45e4-9d93-fe15c50f3552\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4466p" Jun 09 12:07:44.625157 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:44.625129 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr9sk\" (UniqueName: \"kubernetes.io/projected/584bfad5-351d-45e4-9d93-fe15c50f3552-kube-api-access-pr9sk\") pod \"maas-default-gateway-openshift-default-687ff6996-4466p\" (UID: \"584bfad5-351d-45e4-9d93-fe15c50f3552\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4466p" Jun 09 12:07:44.697114 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:44.697080 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4466p" Jun 09 12:07:44.899711 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:44.899670 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4466p"] Jun 09 12:07:44.902847 ip-10-0-133-80 kubenswrapper[2577]: W0609 12:07:44.902816 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod584bfad5_351d_45e4_9d93_fe15c50f3552.slice/crio-163b284b28f1f43e2f94f27b568bb20e5b7b34869ce318ee1c02bf216c32ab55 WatchSource:0}: Error finding container 163b284b28f1f43e2f94f27b568bb20e5b7b34869ce318ee1c02bf216c32ab55: Status 404 returned error can't find the container with id 163b284b28f1f43e2f94f27b568bb20e5b7b34869ce318ee1c02bf216c32ab55 Jun 09 12:07:44.904845 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:44.904811 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 09 12:07:44.904930 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:44.904879 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 09 12:07:44.904930 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:44.904914 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 09 12:07:45.049378 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:45.049344 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4466p" event={"ID":"584bfad5-351d-45e4-9d93-fe15c50f3552","Type":"ContainerStarted","Data":"01b3757c321446273aa425c27d5285e374a0079a0621f3f198a1f1cf17743b92"} Jun 09 12:07:45.049529 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:45.049509 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4466p" event={"ID":"584bfad5-351d-45e4-9d93-fe15c50f3552","Type":"ContainerStarted","Data":"163b284b28f1f43e2f94f27b568bb20e5b7b34869ce318ee1c02bf216c32ab55"} Jun 09 12:07:45.070137 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:45.070077 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4466p" podStartSLOduration=1.070055738 podStartE2EDuration="1.070055738s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:07:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:07:45.069084159 +0000 UTC m=+761.491641928" watchObservedRunningTime="2026-06-09 12:07:45.070055738 +0000 UTC m=+761.492613513" Jun 09 12:07:45.697711 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:45.697675 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4466p" Jun 09 12:07:46.701821 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:46.701792 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4466p" Jun 09 12:07:47.059905 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:47.059823 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4466p" Jun 09 12:07:47.060712 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:47.060695 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4466p" Jun 09 12:07:48.829292 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:48.829257 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n75ws"] Jun 09 12:07:48.866053 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:48.866019 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n75ws"] Jun 09 12:07:48.866053 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:48.866059 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n75ws"] Jun 09 12:07:48.866277 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:48.866138 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-n75ws" Jun 09 12:07:48.868781 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:48.868758 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 09 12:07:49.052444 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:49.052404 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vgm2\" (UniqueName: \"kubernetes.io/projected/644740c4-9c21-44ed-b1df-1e916a928ec4-kube-api-access-6vgm2\") pod \"limitador-limitador-54d6d988d5-n75ws\" (UID: \"644740c4-9c21-44ed-b1df-1e916a928ec4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-n75ws" Jun 09 12:07:49.052661 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:49.052456 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/644740c4-9c21-44ed-b1df-1e916a928ec4-config-file\") pod \"limitador-limitador-54d6d988d5-n75ws\" (UID: \"644740c4-9c21-44ed-b1df-1e916a928ec4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-n75ws" Jun 09 12:07:49.153076 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:49.153037 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vgm2\" (UniqueName: \"kubernetes.io/projected/644740c4-9c21-44ed-b1df-1e916a928ec4-kube-api-access-6vgm2\") pod \"limitador-limitador-54d6d988d5-n75ws\" (UID: \"644740c4-9c21-44ed-b1df-1e916a928ec4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-n75ws" Jun 09 12:07:49.153284 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:49.153087 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/644740c4-9c21-44ed-b1df-1e916a928ec4-config-file\") pod \"limitador-limitador-54d6d988d5-n75ws\" (UID: \"644740c4-9c21-44ed-b1df-1e916a928ec4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-n75ws" Jun 09 12:07:49.153911 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:49.153885 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/644740c4-9c21-44ed-b1df-1e916a928ec4-config-file\") pod \"limitador-limitador-54d6d988d5-n75ws\" (UID: \"644740c4-9c21-44ed-b1df-1e916a928ec4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-n75ws" Jun 09 12:07:49.161703 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:49.161674 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vgm2\" (UniqueName: \"kubernetes.io/projected/644740c4-9c21-44ed-b1df-1e916a928ec4-kube-api-access-6vgm2\") pod \"limitador-limitador-54d6d988d5-n75ws\" (UID: \"644740c4-9c21-44ed-b1df-1e916a928ec4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-n75ws" Jun 09 12:07:49.177384 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:49.177353 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-n75ws" Jun 09 12:07:49.319356 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:49.319327 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n75ws"] Jun 09 12:07:49.321780 ip-10-0-133-80 kubenswrapper[2577]: W0609 12:07:49.321749 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod644740c4_9c21_44ed_b1df_1e916a928ec4.slice/crio-3177670949be1ab4eeecbe81a7074896f2ff5b4d47ee282a462672ff49cedcae WatchSource:0}: Error finding container 3177670949be1ab4eeecbe81a7074896f2ff5b4d47ee282a462672ff49cedcae: Status 404 returned error can't find the container with id 3177670949be1ab4eeecbe81a7074896f2ff5b4d47ee282a462672ff49cedcae Jun 09 12:07:50.077898 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:50.077858 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-n75ws" event={"ID":"644740c4-9c21-44ed-b1df-1e916a928ec4","Type":"ContainerStarted","Data":"3177670949be1ab4eeecbe81a7074896f2ff5b4d47ee282a462672ff49cedcae"} Jun 09 12:07:52.095724 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:52.095630 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-n75ws" event={"ID":"644740c4-9c21-44ed-b1df-1e916a928ec4","Type":"ContainerStarted","Data":"a8f4e681f1cafce13a9fcab1c9eff9f530694f43ea5d2ae427cfaf7c5c629dde"} Jun 09 12:07:52.095724 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:52.095715 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-n75ws" Jun 09 12:07:52.111997 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:07:52.111946 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-n75ws" podStartSLOduration=1.63610938 podStartE2EDuration="4.111908781s" totalImagesPullingTime="2.475799401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:07:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:07:52.110875002 +0000 UTC m=+768.533432777" watchObservedRunningTime="2026-06-09 12:07:52.111908781 +0000 UTC m=+768.534466555" Jun 09 12:08:03.102243 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:08:03.102214 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-n75ws" Jun 09 12:09:51.743411 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:09:51.743373 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n75ws"] Jun 09 12:09:59.727972 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:09:59.727936 2577 generic.go:356] "Generic (PLEG): container finished" podID="584bfad5-351d-45e4-9d93-fe15c50f3552" containerID="01b3757c321446273aa425c27d5285e374a0079a0621f3f198a1f1cf17743b92" exitCode=0 Jun 09 12:09:59.728388 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:09:59.728009 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4466p" event={"ID":"584bfad5-351d-45e4-9d93-fe15c50f3552","Type":"ContainerDied","Data":"01b3757c321446273aa425c27d5285e374a0079a0621f3f198a1f1cf17743b92"} Jun 09 12:09:59.728431 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:09:59.728402 2577 scope.go:117] "RemoveContainer" containerID="01b3757c321446273aa425c27d5285e374a0079a0621f3f198a1f1cf17743b92" Jun 09 12:09:59.729454 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:09:59.729430 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 09 12:09:59.729513 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:09:59.729496 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 09 12:09:59.729547 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:09:59.729525 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 09 12:10:00.734859 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:10:00.734811 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4466p" event={"ID":"584bfad5-351d-45e4-9d93-fe15c50f3552","Type":"ContainerStarted","Data":"9f6586de7f33ce4f411bc962d1ad0856a06b84ff18845c096ed9681639b8d257"} Jun 09 12:10:01.697428 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:10:01.697387 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4466p" Jun 09 12:10:01.698654 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:10:01.698598 2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-4466p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jun 09 12:10:01.698780 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:10:01.698690 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4466p" podUID="584bfad5-351d-45e4-9d93-fe15c50f3552" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jun 09 12:10:02.060673 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:10:02.060573 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4466p" Jun 09 12:10:02.697938 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:10:02.697900 2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-4466p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jun 09 12:10:02.698137 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:10:02.697977 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4466p" podUID="584bfad5-351d-45e4-9d93-fe15c50f3552" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jun 09 12:10:03.698563 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:10:03.698521 2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-4466p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jun 09 12:10:03.699014 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:10:03.698589 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4466p" podUID="584bfad5-351d-45e4-9d93-fe15c50f3552" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jun 09 12:10:04.698408 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:10:04.698353 2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-4466p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jun 09 12:10:04.698605 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:10:04.698448 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4466p" podUID="584bfad5-351d-45e4-9d93-fe15c50f3552" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jun 09 12:10:05.702578 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:10:05.702541 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4466p" Jun 09 12:10:05.703435 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:10:05.703414 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4466p" Jun 09 12:10:48.888095 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:10:48.888054 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxmg4"] Jun 09 12:10:48.900498 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:10:48.900465 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxmg4" Jun 09 12:10:48.903738 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:10:48.903707 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxmg4"] Jun 09 12:10:48.903999 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:10:48.903981 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 09 12:10:48.904094 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:10:48.904031 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 09 12:10:48.904094 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:10:48.904043 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 09 12:10:48.904204 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:10:48.904107 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-7lhz9\"" Jun 09 12:10:48.939506 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:10:48.939459 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l44kc\" (UniqueName: \"kubernetes.io/projected/7e5e4f12-1c08-448d-98bc-9aac91e0f4c5-kube-api-access-l44kc\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vxmg4\" (UID: \"7e5e4f12-1c08-448d-98bc-9aac91e0f4c5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxmg4" Jun 09 12:10:48.939799 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:10:48.939566 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e5e4f12-1c08-448d-98bc-9aac91e0f4c5-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vxmg4\" (UID: \"7e5e4f12-1c08-448d-98bc-9aac91e0f4c5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxmg4" Jun 09 12:10:48.939799 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:10:48.939653 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e5e4f12-1c08-448d-98bc-9aac91e0f4c5-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vxmg4\" (UID: \"7e5e4f12-1c08-448d-98bc-9aac91e0f4c5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxmg4" Jun 09 12:10:48.939799 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:10:48.939683 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7e5e4f12-1c08-448d-98bc-9aac91e0f4c5-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vxmg4\" (UID: \"7e5e4f12-1c08-448d-98bc-9aac91e0f4c5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxmg4" Jun 09 12:10:48.939988 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:10:48.939798 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e5e4f12-1c08-448d-98bc-9aac91e0f4c5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vxmg4\" (UID: \"7e5e4f12-1c08-448d-98bc-9aac91e0f4c5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxmg4" Jun 09 12:10:48.939988 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:10:48.939854 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e5e4f12-1c08-448d-98bc-9aac91e0f4c5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vxmg4\" (UID: \"7e5e4f12-1c08-448d-98bc-9aac91e0f4c5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxmg4" Jun 09 12:10:49.040492 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:10:49.040453 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e5e4f12-1c08-448d-98bc-9aac91e0f4c5-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vxmg4\" (UID: \"7e5e4f12-1c08-448d-98bc-9aac91e0f4c5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxmg4" Jun 09 12:10:49.040492 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:10:49.040500 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e5e4f12-1c08-448d-98bc-9aac91e0f4c5-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vxmg4\" (UID: \"7e5e4f12-1c08-448d-98bc-9aac91e0f4c5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxmg4" Jun 09 12:10:49.040818 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:10:49.040519 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7e5e4f12-1c08-448d-98bc-9aac91e0f4c5-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vxmg4\" (UID: \"7e5e4f12-1c08-448d-98bc-9aac91e0f4c5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxmg4" Jun 09 12:10:49.040818 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:10:49.040631 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e5e4f12-1c08-448d-98bc-9aac91e0f4c5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vxmg4\" (UID: \"7e5e4f12-1c08-448d-98bc-9aac91e0f4c5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxmg4" Jun 09 12:10:49.040818 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:10:49.040682 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e5e4f12-1c08-448d-98bc-9aac91e0f4c5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vxmg4\" (UID: \"7e5e4f12-1c08-448d-98bc-9aac91e0f4c5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxmg4" Jun 09 12:10:49.040818 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:10:49.040737 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l44kc\" (UniqueName: \"kubernetes.io/projected/7e5e4f12-1c08-448d-98bc-9aac91e0f4c5-kube-api-access-l44kc\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vxmg4\" (UID: \"7e5e4f12-1c08-448d-98bc-9aac91e0f4c5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxmg4" Jun 09 12:10:49.041130 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:10:49.040932 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e5e4f12-1c08-448d-98bc-9aac91e0f4c5-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vxmg4\" (UID: \"7e5e4f12-1c08-448d-98bc-9aac91e0f4c5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxmg4" Jun 09 12:10:49.041130 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:10:49.041011 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7e5e4f12-1c08-448d-98bc-9aac91e0f4c5-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vxmg4\" (UID: \"7e5e4f12-1c08-448d-98bc-9aac91e0f4c5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxmg4" Jun 09 12:10:49.041130 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:10:49.041122 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e5e4f12-1c08-448d-98bc-9aac91e0f4c5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vxmg4\" (UID: \"7e5e4f12-1c08-448d-98bc-9aac91e0f4c5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxmg4" Jun 09 12:10:49.042847 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:10:49.042820 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e5e4f12-1c08-448d-98bc-9aac91e0f4c5-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vxmg4\" (UID: \"7e5e4f12-1c08-448d-98bc-9aac91e0f4c5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxmg4" Jun 09 12:10:49.043180 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:10:49.043161 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e5e4f12-1c08-448d-98bc-9aac91e0f4c5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vxmg4\" (UID: \"7e5e4f12-1c08-448d-98bc-9aac91e0f4c5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxmg4" Jun 09 12:10:49.048480 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:10:49.048450 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l44kc\" (UniqueName: \"kubernetes.io/projected/7e5e4f12-1c08-448d-98bc-9aac91e0f4c5-kube-api-access-l44kc\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vxmg4\" (UID: \"7e5e4f12-1c08-448d-98bc-9aac91e0f4c5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxmg4" Jun 09 12:10:49.213466 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:10:49.213377 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxmg4" Jun 09 12:10:49.326739 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:10:49.326703 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n75ws"] Jun 09 12:10:49.358499 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:10:49.358463 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxmg4"] Jun 09 12:10:49.361670 ip-10-0-133-80 kubenswrapper[2577]: W0609 12:10:49.361637 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e5e4f12_1c08_448d_98bc_9aac91e0f4c5.slice/crio-d8cf4f2b5a52352061c884ba2042e0155dea3cb17aa25d59cdf9087a5c2c9394 WatchSource:0}: Error finding container d8cf4f2b5a52352061c884ba2042e0155dea3cb17aa25d59cdf9087a5c2c9394: Status 404 returned error can't find the container with id d8cf4f2b5a52352061c884ba2042e0155dea3cb17aa25d59cdf9087a5c2c9394 Jun 09 12:10:49.974914 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:10:49.974872 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxmg4" event={"ID":"7e5e4f12-1c08-448d-98bc-9aac91e0f4c5","Type":"ContainerStarted","Data":"d8cf4f2b5a52352061c884ba2042e0155dea3cb17aa25d59cdf9087a5c2c9394"} Jun 09 12:10:52.924193 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:10:52.924152 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n75ws"] Jun 09 12:10:54.002061 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:10:54.002024 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxmg4" event={"ID":"7e5e4f12-1c08-448d-98bc-9aac91e0f4c5","Type":"ContainerStarted","Data":"77958da9239bc3a866152ada39bb530157d1b7f65e4f6dfbdca54a4979581d58"} Jun 09 12:10:56.014238 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:10:56.014207 2577 generic.go:356] "Generic (PLEG): container finished" podID="7e5e4f12-1c08-448d-98bc-9aac91e0f4c5" containerID="77958da9239bc3a866152ada39bb530157d1b7f65e4f6dfbdca54a4979581d58" exitCode=0 Jun 09 12:10:56.014630 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:10:56.014277 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxmg4" event={"ID":"7e5e4f12-1c08-448d-98bc-9aac91e0f4c5","Type":"ContainerDied","Data":"77958da9239bc3a866152ada39bb530157d1b7f65e4f6dfbdca54a4979581d58"} Jun 09 12:10:58.025234 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:10:58.025204 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxmg4" event={"ID":"7e5e4f12-1c08-448d-98bc-9aac91e0f4c5","Type":"ContainerStarted","Data":"6caa52c495bc37b43cbb50596435d4c5907e6755980a67bcf19eb48d6524a9be"} Jun 09 12:10:58.045975 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:10:58.045924 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxmg4" podStartSLOduration=2.8887614470000003 podStartE2EDuration="10.045908097s" totalImagesPullingTime="5.855610161s" totalInitContainerRuntime="1.301536489s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:10:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:10:58.044645506 +0000 UTC m=+954.467203303" watchObservedRunningTime="2026-06-09 12:10:58.045908097 +0000 UTC m=+954.468465872" Jun 09 12:10:59.213949 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:10:59.213905 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxmg4" Jun 09 12:10:59.214352 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:10:59.213969 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxmg4" Jun 09 12:10:59.226789 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:10:59.226761 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxmg4" Jun 09 12:11:00.046545 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:00.046518 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vxmg4" Jun 09 12:11:20.534310 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:20.534274 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n75ws"] Jun 09 12:11:22.732661 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:22.732629 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n75ws"] Jun 09 12:11:36.375269 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:36.375053 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-8qfd8"] Jun 09 12:11:36.379393 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:36.379366 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8qfd8" Jun 09 12:11:36.381941 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:36.381916 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 09 12:11:36.390884 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:36.390856 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-8qfd8"] Jun 09 12:11:36.497701 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:36.497664 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd659f46-9cc8-4cec-ba83-9bc45eebdb9b-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8qfd8\" (UID: \"bd659f46-9cc8-4cec-ba83-9bc45eebdb9b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8qfd8" Jun 09 12:11:36.497903 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:36.497713 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bd659f46-9cc8-4cec-ba83-9bc45eebdb9b-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8qfd8\" (UID: \"bd659f46-9cc8-4cec-ba83-9bc45eebdb9b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8qfd8" Jun 09 12:11:36.497903 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:36.497791 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd659f46-9cc8-4cec-ba83-9bc45eebdb9b-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8qfd8\" (UID: \"bd659f46-9cc8-4cec-ba83-9bc45eebdb9b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8qfd8" Jun 09 12:11:36.497903 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:36.497835 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd659f46-9cc8-4cec-ba83-9bc45eebdb9b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8qfd8\" (UID: \"bd659f46-9cc8-4cec-ba83-9bc45eebdb9b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8qfd8" Jun 09 12:11:36.497903 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:36.497866 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd659f46-9cc8-4cec-ba83-9bc45eebdb9b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8qfd8\" (UID: \"bd659f46-9cc8-4cec-ba83-9bc45eebdb9b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8qfd8" Jun 09 12:11:36.498077 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:36.497927 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6crp\" (UniqueName: \"kubernetes.io/projected/bd659f46-9cc8-4cec-ba83-9bc45eebdb9b-kube-api-access-l6crp\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8qfd8\" (UID: \"bd659f46-9cc8-4cec-ba83-9bc45eebdb9b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8qfd8" Jun 09 12:11:36.598932 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:36.598890 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bd659f46-9cc8-4cec-ba83-9bc45eebdb9b-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8qfd8\" (UID: \"bd659f46-9cc8-4cec-ba83-9bc45eebdb9b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8qfd8" Jun 09 12:11:36.599152 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:36.598960 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd659f46-9cc8-4cec-ba83-9bc45eebdb9b-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8qfd8\" (UID: \"bd659f46-9cc8-4cec-ba83-9bc45eebdb9b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8qfd8" Jun 09 12:11:36.599152 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:36.599007 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd659f46-9cc8-4cec-ba83-9bc45eebdb9b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8qfd8\" (UID: \"bd659f46-9cc8-4cec-ba83-9bc45eebdb9b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8qfd8" Jun 09 12:11:36.599152 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:36.599038 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd659f46-9cc8-4cec-ba83-9bc45eebdb9b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8qfd8\" (UID: \"bd659f46-9cc8-4cec-ba83-9bc45eebdb9b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8qfd8" Jun 09 12:11:36.599152 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:36.599078 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6crp\" (UniqueName: \"kubernetes.io/projected/bd659f46-9cc8-4cec-ba83-9bc45eebdb9b-kube-api-access-l6crp\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8qfd8\" (UID: \"bd659f46-9cc8-4cec-ba83-9bc45eebdb9b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8qfd8" Jun 09 12:11:36.599371 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:36.599163 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd659f46-9cc8-4cec-ba83-9bc45eebdb9b-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8qfd8\" (UID: \"bd659f46-9cc8-4cec-ba83-9bc45eebdb9b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8qfd8" Jun 09 12:11:36.599443 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:36.599400 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bd659f46-9cc8-4cec-ba83-9bc45eebdb9b-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8qfd8\" (UID: \"bd659f46-9cc8-4cec-ba83-9bc45eebdb9b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8qfd8" Jun 09 12:11:36.599513 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:36.599491 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd659f46-9cc8-4cec-ba83-9bc45eebdb9b-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8qfd8\" (UID: \"bd659f46-9cc8-4cec-ba83-9bc45eebdb9b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8qfd8" Jun 09 12:11:36.599567 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:36.599524 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd659f46-9cc8-4cec-ba83-9bc45eebdb9b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8qfd8\" (UID: \"bd659f46-9cc8-4cec-ba83-9bc45eebdb9b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8qfd8" Jun 09 12:11:36.601485 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:36.601460 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd659f46-9cc8-4cec-ba83-9bc45eebdb9b-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8qfd8\" (UID: \"bd659f46-9cc8-4cec-ba83-9bc45eebdb9b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8qfd8" Jun 09 12:11:36.601657 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:36.601641 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd659f46-9cc8-4cec-ba83-9bc45eebdb9b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8qfd8\" (UID: \"bd659f46-9cc8-4cec-ba83-9bc45eebdb9b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8qfd8" Jun 09 12:11:36.607976 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:36.607951 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6crp\" (UniqueName: \"kubernetes.io/projected/bd659f46-9cc8-4cec-ba83-9bc45eebdb9b-kube-api-access-l6crp\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8qfd8\" (UID: \"bd659f46-9cc8-4cec-ba83-9bc45eebdb9b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8qfd8" Jun 09 12:11:36.693766 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:36.693664 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8qfd8" Jun 09 12:11:36.833013 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:36.832979 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-8qfd8"] Jun 09 12:11:36.836062 ip-10-0-133-80 kubenswrapper[2577]: W0609 12:11:36.836034 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd659f46_9cc8_4cec_ba83_9bc45eebdb9b.slice/crio-b4324c96bedcf838c8c32162ab14dd100ea928cdce39d14452d28c7c4cca114a WatchSource:0}: Error finding container b4324c96bedcf838c8c32162ab14dd100ea928cdce39d14452d28c7c4cca114a: Status 404 returned error can't find the container with id b4324c96bedcf838c8c32162ab14dd100ea928cdce39d14452d28c7c4cca114a Jun 09 12:11:37.127905 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:37.127875 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n75ws"] Jun 09 12:11:37.217170 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:37.217131 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8qfd8" event={"ID":"bd659f46-9cc8-4cec-ba83-9bc45eebdb9b","Type":"ContainerStarted","Data":"d9aec5f49ffeecb24a9cfa9cce9b46bd0377bd799824d5c1f8fae93a9add6277"} Jun 09 12:11:37.217336 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:37.217198 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8qfd8" event={"ID":"bd659f46-9cc8-4cec-ba83-9bc45eebdb9b","Type":"ContainerStarted","Data":"b4324c96bedcf838c8c32162ab14dd100ea928cdce39d14452d28c7c4cca114a"} Jun 09 12:11:39.230385 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:39.230349 2577 generic.go:356] "Generic (PLEG): container finished" podID="bd659f46-9cc8-4cec-ba83-9bc45eebdb9b" containerID="d9aec5f49ffeecb24a9cfa9cce9b46bd0377bd799824d5c1f8fae93a9add6277" exitCode=0 Jun 09 12:11:39.230812 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:39.230420 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8qfd8" event={"ID":"bd659f46-9cc8-4cec-ba83-9bc45eebdb9b","Type":"ContainerDied","Data":"d9aec5f49ffeecb24a9cfa9cce9b46bd0377bd799824d5c1f8fae93a9add6277"} Jun 09 12:11:39.231168 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:39.231152 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 12:11:40.236792 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:40.236753 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8qfd8" event={"ID":"bd659f46-9cc8-4cec-ba83-9bc45eebdb9b","Type":"ContainerStarted","Data":"3de4363366168c22c18114f5d9bd2e78de631e1758b7e4c37cf3100f3dedfc86"} Jun 09 12:11:40.258550 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:40.258498 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8qfd8" podStartSLOduration=2.628402642 podStartE2EDuration="4.2584837s" totalImagesPullingTime="287.578082ms" totalInitContainerRuntime="1.342502976s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:11:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:11:40.257352688 +0000 UTC m=+996.679910483" watchObservedRunningTime="2026-06-09 12:11:40.2584837 +0000 UTC m=+996.681041469" Jun 09 12:11:46.694384 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:46.694332 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8qfd8" Jun 09 12:11:46.695038 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:46.694421 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8qfd8" Jun 09 12:11:46.707136 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:46.707110 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8qfd8" Jun 09 12:11:47.291322 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:47.291287 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8qfd8" Jun 09 12:11:52.387085 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:52.387043 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-lpdm7"] Jun 09 12:11:52.390980 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:52.390962 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lpdm7" Jun 09 12:11:52.393423 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:52.393400 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 09 12:11:52.402551 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:52.402526 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-lpdm7"] Jun 09 12:11:52.548526 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:52.548484 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ea37a3d0-5bcb-4653-bd51-56467795fa49-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lpdm7\" (UID: \"ea37a3d0-5bcb-4653-bd51-56467795fa49\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lpdm7" Jun 09 12:11:52.548723 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:52.548533 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea37a3d0-5bcb-4653-bd51-56467795fa49-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lpdm7\" (UID: \"ea37a3d0-5bcb-4653-bd51-56467795fa49\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lpdm7" Jun 09 12:11:52.548723 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:52.548570 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea37a3d0-5bcb-4653-bd51-56467795fa49-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lpdm7\" (UID: \"ea37a3d0-5bcb-4653-bd51-56467795fa49\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lpdm7" Jun 09 12:11:52.548723 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:52.548701 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea37a3d0-5bcb-4653-bd51-56467795fa49-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lpdm7\" (UID: \"ea37a3d0-5bcb-4653-bd51-56467795fa49\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lpdm7" Jun 09 12:11:52.548889 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:52.548743 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea37a3d0-5bcb-4653-bd51-56467795fa49-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lpdm7\" (UID: \"ea37a3d0-5bcb-4653-bd51-56467795fa49\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lpdm7" Jun 09 12:11:52.548889 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:52.548853 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzssh\" (UniqueName: \"kubernetes.io/projected/ea37a3d0-5bcb-4653-bd51-56467795fa49-kube-api-access-hzssh\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lpdm7\" (UID: \"ea37a3d0-5bcb-4653-bd51-56467795fa49\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lpdm7" Jun 09 12:11:52.649698 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:52.649597 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzssh\" (UniqueName: \"kubernetes.io/projected/ea37a3d0-5bcb-4653-bd51-56467795fa49-kube-api-access-hzssh\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lpdm7\" (UID: \"ea37a3d0-5bcb-4653-bd51-56467795fa49\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lpdm7" Jun 09 12:11:52.649698 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:52.649689 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ea37a3d0-5bcb-4653-bd51-56467795fa49-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lpdm7\" (UID: \"ea37a3d0-5bcb-4653-bd51-56467795fa49\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lpdm7" Jun 09 12:11:52.649899 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:52.649729 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea37a3d0-5bcb-4653-bd51-56467795fa49-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lpdm7\" (UID: \"ea37a3d0-5bcb-4653-bd51-56467795fa49\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lpdm7" Jun 09 12:11:52.649899 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:52.649758 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea37a3d0-5bcb-4653-bd51-56467795fa49-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lpdm7\" (UID: \"ea37a3d0-5bcb-4653-bd51-56467795fa49\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lpdm7" Jun 09 12:11:52.649899 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:52.649806 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea37a3d0-5bcb-4653-bd51-56467795fa49-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lpdm7\" (UID: \"ea37a3d0-5bcb-4653-bd51-56467795fa49\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lpdm7" Jun 09 12:11:52.649899 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:52.649837 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea37a3d0-5bcb-4653-bd51-56467795fa49-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lpdm7\" (UID: \"ea37a3d0-5bcb-4653-bd51-56467795fa49\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lpdm7" Jun 09 12:11:52.650094 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:52.650074 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ea37a3d0-5bcb-4653-bd51-56467795fa49-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lpdm7\" (UID: \"ea37a3d0-5bcb-4653-bd51-56467795fa49\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lpdm7" Jun 09 12:11:52.650146 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:52.650125 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea37a3d0-5bcb-4653-bd51-56467795fa49-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lpdm7\" (UID: \"ea37a3d0-5bcb-4653-bd51-56467795fa49\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lpdm7" Jun 09 12:11:52.650241 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:52.650219 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea37a3d0-5bcb-4653-bd51-56467795fa49-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lpdm7\" (UID: \"ea37a3d0-5bcb-4653-bd51-56467795fa49\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lpdm7" Jun 09 12:11:52.651992 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:52.651968 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea37a3d0-5bcb-4653-bd51-56467795fa49-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lpdm7\" (UID: \"ea37a3d0-5bcb-4653-bd51-56467795fa49\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lpdm7" Jun 09 12:11:52.652384 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:52.652367 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea37a3d0-5bcb-4653-bd51-56467795fa49-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lpdm7\" (UID: \"ea37a3d0-5bcb-4653-bd51-56467795fa49\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lpdm7" Jun 09 12:11:52.657924 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:52.657903 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzssh\" (UniqueName: \"kubernetes.io/projected/ea37a3d0-5bcb-4653-bd51-56467795fa49-kube-api-access-hzssh\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lpdm7\" (UID: \"ea37a3d0-5bcb-4653-bd51-56467795fa49\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lpdm7" Jun 09 12:11:52.700043 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:52.700005 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lpdm7" Jun 09 12:11:52.847346 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:52.847307 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-lpdm7"] Jun 09 12:11:52.848592 ip-10-0-133-80 kubenswrapper[2577]: W0609 12:11:52.848567 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea37a3d0_5bcb_4653_bd51_56467795fa49.slice/crio-db5c875bdff52687f34290706083f873755706d3fa12faae1ec5b0abefc480dd WatchSource:0}: Error finding container db5c875bdff52687f34290706083f873755706d3fa12faae1ec5b0abefc480dd: Status 404 returned error can't find the container with id db5c875bdff52687f34290706083f873755706d3fa12faae1ec5b0abefc480dd Jun 09 12:11:53.306983 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:53.306887 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lpdm7" event={"ID":"ea37a3d0-5bcb-4653-bd51-56467795fa49","Type":"ContainerStarted","Data":"8c20d4c9ba79c5a411046105dc5ffa04d510d158bba5f9135cbaf62eb72e91d4"} Jun 09 12:11:53.306983 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:53.306936 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lpdm7" event={"ID":"ea37a3d0-5bcb-4653-bd51-56467795fa49","Type":"ContainerStarted","Data":"db5c875bdff52687f34290706083f873755706d3fa12faae1ec5b0abefc480dd"} Jun 09 12:11:53.536739 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:53.536696 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n75ws"] Jun 09 12:11:56.325008 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:56.324976 2577 generic.go:356] "Generic (PLEG): container finished" podID="ea37a3d0-5bcb-4653-bd51-56467795fa49" containerID="8c20d4c9ba79c5a411046105dc5ffa04d510d158bba5f9135cbaf62eb72e91d4" exitCode=0 Jun 09 12:11:56.325402 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:56.325052 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lpdm7" event={"ID":"ea37a3d0-5bcb-4653-bd51-56467795fa49","Type":"ContainerDied","Data":"8c20d4c9ba79c5a411046105dc5ffa04d510d158bba5f9135cbaf62eb72e91d4"} Jun 09 12:11:57.331734 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:57.331701 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lpdm7" event={"ID":"ea37a3d0-5bcb-4653-bd51-56467795fa49","Type":"ContainerStarted","Data":"46337e3dd3867282be6def9c325bbff8b2d914428eeb36cdc22405186c37bc55"} Jun 09 12:11:57.351928 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:11:57.351880 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lpdm7" podStartSLOduration=1.784870242 podStartE2EDuration="5.351864824s" totalImagesPullingTime="248.367289ms" totalInitContainerRuntime="3.318627293s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:11:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:11:57.349857784 +0000 UTC m=+1013.772415558" watchObservedRunningTime="2026-06-09 12:11:57.351864824 +0000 UTC m=+1013.774422600" Jun 09 12:12:02.700816 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:12:02.700771 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lpdm7" Jun 09 12:12:02.701233 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:12:02.700838 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lpdm7" Jun 09 12:12:02.713548 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:12:02.713516 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lpdm7" Jun 09 12:12:03.378856 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:12:03.378825 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lpdm7" Jun 09 12:13:23.730945 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:13:23.730911 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n75ws"] Jun 09 12:13:26.729502 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:13:26.729469 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n75ws"] Jun 09 12:13:33.322811 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:13:33.322771 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n75ws"] Jun 09 12:13:42.834507 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:13:42.834468 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n75ws"] Jun 09 12:13:52.524451 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:13:52.524416 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n75ws"] Jun 09 12:14:02.521605 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:14:02.521571 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n75ws"] Jun 09 12:14:11.732772 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:14:11.732731 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n75ws"] Jun 09 12:14:21.436515 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:14:21.436468 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n75ws"] Jun 09 12:14:54.623081 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:14:54.623042 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n75ws"] Jun 09 12:14:58.023310 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:14:58.023265 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n75ws"] Jun 09 12:15:34.622411 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:15:34.622367 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n75ws"] Jun 09 12:15:50.627670 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:15:50.627630 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n75ws"] Jun 09 12:16:29.143787 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:16:29.143751 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n75ws"] Jun 09 12:16:46.218097 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:16:46.218063 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n75ws"] Jun 09 12:17:00.325648 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:17:00.325600 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n75ws"] Jun 09 12:17:16.021557 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:17:16.021520 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n75ws"] Jun 09 12:17:19.025474 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:17:19.025434 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n75ws"] Jun 09 12:17:55.219158 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:17:55.219071 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n75ws"] Jun 09 12:17:58.419728 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:17:58.419694 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n75ws"] Jun 09 12:18:22.225251 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:18:22.225210 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n75ws"] Jun 09 12:18:31.846633 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:18:31.846575 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n75ws"] Jun 09 12:18:48.133601 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:18:48.133560 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n75ws"] Jun 09 12:18:56.821771 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:18:56.821689 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n75ws"] Jun 09 12:19:04.925424 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:19:04.925382 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n75ws"] Jun 09 12:19:33.557877 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:19:33.557839 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n75ws"] Jun 09 12:19:43.031827 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:19:43.031780 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n75ws"] Jun 09 12:19:50.834119 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:19:50.834082 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n75ws"] Jun 09 12:20:23.234658 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:20:23.234606 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n75ws"] Jun 09 12:20:31.241073 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:20:31.241033 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n75ws"] Jun 09 12:20:34.031846 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:20:34.031805 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n75ws"] Jun 09 12:20:40.021154 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:20:40.021113 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n75ws"] Jun 09 12:20:48.335434 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:20:48.335398 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n75ws"] Jun 09 12:20:56.840417 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:20:56.840379 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n75ws"] Jun 09 12:21:05.032346 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:05.032303 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n75ws"] Jun 09 12:21:07.950373 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:07.950334 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n75ws"] Jun 09 12:21:14.034910 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:14.034870 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n75ws"] Jun 09 12:21:22.629630 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:22.629570 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n75ws"] Jun 09 12:21:34.982932 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:34.982898 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-76df79655d-6gdtz_1bdc1578-d20c-446a-9cb6-e407bcb6dde9/nginx/0.log" Jun 09 12:21:36.153105 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:36.153076 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86976b546f-g4hct_a0595757-f346-4f57-b2f2-369e482db615/copy-manifests/0.log" Jun 09 12:21:36.171069 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:36.171040 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86976b546f-g4hct_a0595757-f346-4f57-b2f2-369e482db615/manager/0.log" Jun 09 12:21:37.816710 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:37.816678 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-rdtrl_04216f97-2ec4-447e-b879-c5faac1ff1ab/manager/0.log" Jun 09 12:21:37.928601 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:37.928573 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-76bwh_c3f56561-1cfa-4ab7-92da-380ff627d758/manager/0.log" Jun 09 12:21:38.039145 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:38.039112 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-v2kr9_f0a61940-0bc7-4ddc-a81f-a51b136aaf2e/kuadrant-console-plugin/0.log" Jun 09 12:21:38.156333 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:38.156301 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-nkvsx_ec85f769-09c6-4fa4-bb55-0a6d8f8b77c4/registry-server/0.log" Jun 09 12:21:38.281375 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:38.281343 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-fzpfb_2bea75de-8445-44e6-a86e-54fc653d0af4/manager/0.log" Jun 09 12:21:38.389043 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:38.389012 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-n75ws_644740c4-9c21-44ed-b1df-1e916a928ec4/limitador/0.log" Jun 09 12:21:38.853724 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:38.853686 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795tbv74_07ce6663-7517-45b4-9dcd-b3aa260934f3/istio-proxy/0.log" Jun 09 12:21:39.338273 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:39.338247 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-4466p_584bfad5-351d-45e4-9d93-fe15c50f3552/istio-proxy/1.log" Jun 09 12:21:40.035183 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:40.035148 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-vxmg4_7e5e4f12-1c08-448d-98bc-9aac91e0f4c5/storage-initializer/0.log" Jun 09 12:21:40.044679 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:40.044651 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-vxmg4_7e5e4f12-1c08-448d-98bc-9aac91e0f4c5/main/0.log" Jun 09 12:21:40.515854 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:40.515826 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-8qfd8_bd659f46-9cc8-4cec-ba83-9bc45eebdb9b/storage-initializer/0.log" Jun 09 12:21:40.523840 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:40.523817 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-8qfd8_bd659f46-9cc8-4cec-ba83-9bc45eebdb9b/main/0.log" Jun 09 12:21:40.637125 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:40.637086 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-lpdm7_ea37a3d0-5bcb-4653-bd51-56467795fa49/storage-initializer/0.log" Jun 09 12:21:40.646645 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:40.646597 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-lpdm7_ea37a3d0-5bcb-4653-bd51-56467795fa49/main/0.log" Jun 09 12:21:47.791807 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:47.791777 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6hkq6_52890875-2219-4d5e-ae66-1b004a5c2cca/global-pull-secret-syncer/0.log" Jun 09 12:21:48.006159 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:48.006119 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nkhzs_3ef53ac3-35c1-47b3-902e-c34733bf2aa7/konnectivity-agent/0.log" Jun 09 12:21:48.032140 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:48.032108 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-80.ec2.internal_246a63a2537303c010a4ab50419f2e46/haproxy/0.log" Jun 09 12:21:53.089807 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:53.089713 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-rdtrl_04216f97-2ec4-447e-b879-c5faac1ff1ab/manager/0.log" Jun 09 12:21:53.116350 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:53.116324 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-76bwh_c3f56561-1cfa-4ab7-92da-380ff627d758/manager/0.log" Jun 09 12:21:53.152142 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:53.152113 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-v2kr9_f0a61940-0bc7-4ddc-a81f-a51b136aaf2e/kuadrant-console-plugin/0.log" Jun 09 12:21:53.196450 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:53.196415 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-nkvsx_ec85f769-09c6-4fa4-bb55-0a6d8f8b77c4/registry-server/0.log" Jun 09 12:21:53.278632 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:53.278574 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-fzpfb_2bea75de-8445-44e6-a86e-54fc653d0af4/manager/0.log" Jun 09 12:21:53.308185 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:53.308155 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-n75ws_644740c4-9c21-44ed-b1df-1e916a928ec4/limitador/0.log" Jun 09 12:21:55.065483 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:55.065393 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1c344855-dc3c-4772-9bba-8c6d19373038/alertmanager/0.log" Jun 09 12:21:55.091842 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:55.091809 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1c344855-dc3c-4772-9bba-8c6d19373038/config-reloader/0.log" Jun 09 12:21:55.120905 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:55.120876 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1c344855-dc3c-4772-9bba-8c6d19373038/kube-rbac-proxy-web/0.log" Jun 09 12:21:55.145215 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:55.145189 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1c344855-dc3c-4772-9bba-8c6d19373038/kube-rbac-proxy/0.log" Jun 09 12:21:55.172554 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:55.172529 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1c344855-dc3c-4772-9bba-8c6d19373038/kube-rbac-proxy-metric/0.log" Jun 09 12:21:55.196806 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:55.196783 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1c344855-dc3c-4772-9bba-8c6d19373038/prom-label-proxy/0.log" Jun 09 12:21:55.223536 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:55.223508 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1c344855-dc3c-4772-9bba-8c6d19373038/init-config-reloader/0.log" Jun 09 12:21:55.272540 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:55.272515 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-xb86r_852bcbc1-0bb1-440d-b031-180317de8131/cluster-monitoring-operator/0.log" Jun 09 12:21:55.312306 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:55.312273 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-fjqt7_e65dc36a-35ca-489d-9089-7d1416b51b4f/kube-state-metrics/0.log" Jun 09 12:21:55.417308 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:55.417279 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-fjqt7_e65dc36a-35ca-489d-9089-7d1416b51b4f/kube-rbac-proxy-main/0.log" Jun 09 12:21:55.512437 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:55.512405 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-fjqt7_e65dc36a-35ca-489d-9089-7d1416b51b4f/kube-rbac-proxy-self/0.log" Jun 09 12:21:55.990647 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:55.990605 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xcnkg_c600f4e7-0884-4162-80c9-c6d94565c70c/node-exporter/0.log" Jun 09 12:21:56.033357 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:56.033330 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xcnkg_c600f4e7-0884-4162-80c9-c6d94565c70c/kube-rbac-proxy/0.log" Jun 09 12:21:56.081249 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:56.081176 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xcnkg_c600f4e7-0884-4162-80c9-c6d94565c70c/init-textfile/0.log" Jun 09 12:21:56.142473 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:56.142443 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-jgdbp_30ecf080-3b8f-4137-83c3-50565d54bf82/kube-rbac-proxy-main/0.log" Jun 09 12:21:56.231875 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:56.231842 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-jgdbp_30ecf080-3b8f-4137-83c3-50565d54bf82/kube-rbac-proxy-self/0.log" Jun 09 12:21:56.319733 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:56.319705 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-jgdbp_30ecf080-3b8f-4137-83c3-50565d54bf82/openshift-state-metrics/0.log" Jun 09 12:21:56.393532 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:56.393504 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_40a361ed-5da8-4eb9-8c55-f6228cea9974/prometheus/0.log" Jun 09 12:21:56.441357 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:56.441330 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_40a361ed-5da8-4eb9-8c55-f6228cea9974/config-reloader/0.log" Jun 09 12:21:56.485513 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:56.485488 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_40a361ed-5da8-4eb9-8c55-f6228cea9974/thanos-sidecar/0.log" Jun 09 12:21:56.533512 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:56.533483 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_40a361ed-5da8-4eb9-8c55-f6228cea9974/kube-rbac-proxy-web/0.log" Jun 09 12:21:56.574261 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:56.574230 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_40a361ed-5da8-4eb9-8c55-f6228cea9974/kube-rbac-proxy/0.log" Jun 09 12:21:56.619400 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:56.619372 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_40a361ed-5da8-4eb9-8c55-f6228cea9974/kube-rbac-proxy-thanos/0.log" Jun 09 12:21:56.669379 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:56.669296 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_40a361ed-5da8-4eb9-8c55-f6228cea9974/init-config-reloader/0.log" Jun 09 12:21:56.717483 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:56.717452 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-2kbd5_a40eb224-264b-469f-b87d-c92452e16872/prometheus-operator/0.log" Jun 09 12:21:56.758289 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:56.758254 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-2kbd5_a40eb224-264b-469f-b87d-c92452e16872/kube-rbac-proxy/0.log" Jun 09 12:21:58.545936 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:58.545899 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bn8ls/perf-node-gather-daemonset-g698n"] Jun 09 12:21:58.549972 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:58.549952 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bn8ls/perf-node-gather-daemonset-g698n" Jun 09 12:21:58.553252 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:58.553230 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bn8ls\"/\"kube-root-ca.crt\"" Jun 09 12:21:58.554128 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:58.554107 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bn8ls\"/\"default-dockercfg-pl9tb\"" Jun 09 12:21:58.554235 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:58.554136 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bn8ls\"/\"openshift-service-ca.crt\"" Jun 09 12:21:58.562579 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:58.562555 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bn8ls/perf-node-gather-daemonset-g698n"] Jun 09 12:21:58.658167 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:58.658114 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84f6cdf2-53b2-4c5e-aa85-6b339ab78b88-lib-modules\") pod \"perf-node-gather-daemonset-g698n\" (UID: \"84f6cdf2-53b2-4c5e-aa85-6b339ab78b88\") " pod="openshift-must-gather-bn8ls/perf-node-gather-daemonset-g698n" Jun 09 12:21:58.658167 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:58.658169 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84f6cdf2-53b2-4c5e-aa85-6b339ab78b88-sys\") pod \"perf-node-gather-daemonset-g698n\" (UID: \"84f6cdf2-53b2-4c5e-aa85-6b339ab78b88\") " pod="openshift-must-gather-bn8ls/perf-node-gather-daemonset-g698n" Jun 09 12:21:58.658391 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:58.658312 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44h5l\" (UniqueName: \"kubernetes.io/projected/84f6cdf2-53b2-4c5e-aa85-6b339ab78b88-kube-api-access-44h5l\") pod \"perf-node-gather-daemonset-g698n\" (UID: \"84f6cdf2-53b2-4c5e-aa85-6b339ab78b88\") " pod="openshift-must-gather-bn8ls/perf-node-gather-daemonset-g698n" Jun 09 12:21:58.658391 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:58.658343 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/84f6cdf2-53b2-4c5e-aa85-6b339ab78b88-proc\") pod \"perf-node-gather-daemonset-g698n\" (UID: \"84f6cdf2-53b2-4c5e-aa85-6b339ab78b88\") " pod="openshift-must-gather-bn8ls/perf-node-gather-daemonset-g698n" Jun 09 12:21:58.658391 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:58.658382 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/84f6cdf2-53b2-4c5e-aa85-6b339ab78b88-podres\") pod \"perf-node-gather-daemonset-g698n\" (UID: \"84f6cdf2-53b2-4c5e-aa85-6b339ab78b88\") " pod="openshift-must-gather-bn8ls/perf-node-gather-daemonset-g698n" Jun 09 12:21:58.759350 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:58.759314 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84f6cdf2-53b2-4c5e-aa85-6b339ab78b88-lib-modules\") pod \"perf-node-gather-daemonset-g698n\" (UID: \"84f6cdf2-53b2-4c5e-aa85-6b339ab78b88\") " pod="openshift-must-gather-bn8ls/perf-node-gather-daemonset-g698n" Jun 09 12:21:58.759540 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:58.759355 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84f6cdf2-53b2-4c5e-aa85-6b339ab78b88-sys\") pod \"perf-node-gather-daemonset-g698n\" (UID: \"84f6cdf2-53b2-4c5e-aa85-6b339ab78b88\") " pod="openshift-must-gather-bn8ls/perf-node-gather-daemonset-g698n" Jun 09 12:21:58.759540 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:58.759428 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44h5l\" (UniqueName: \"kubernetes.io/projected/84f6cdf2-53b2-4c5e-aa85-6b339ab78b88-kube-api-access-44h5l\") pod \"perf-node-gather-daemonset-g698n\" (UID: \"84f6cdf2-53b2-4c5e-aa85-6b339ab78b88\") " pod="openshift-must-gather-bn8ls/perf-node-gather-daemonset-g698n" Jun 09 12:21:58.759540 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:58.759446 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/84f6cdf2-53b2-4c5e-aa85-6b339ab78b88-proc\") pod \"perf-node-gather-daemonset-g698n\" (UID: \"84f6cdf2-53b2-4c5e-aa85-6b339ab78b88\") " pod="openshift-must-gather-bn8ls/perf-node-gather-daemonset-g698n" Jun 09 12:21:58.759540 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:58.759490 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/84f6cdf2-53b2-4c5e-aa85-6b339ab78b88-podres\") pod \"perf-node-gather-daemonset-g698n\" (UID: \"84f6cdf2-53b2-4c5e-aa85-6b339ab78b88\") " pod="openshift-must-gather-bn8ls/perf-node-gather-daemonset-g698n" Jun 09 12:21:58.759540 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:58.759510 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84f6cdf2-53b2-4c5e-aa85-6b339ab78b88-lib-modules\") pod \"perf-node-gather-daemonset-g698n\" (UID: \"84f6cdf2-53b2-4c5e-aa85-6b339ab78b88\") " pod="openshift-must-gather-bn8ls/perf-node-gather-daemonset-g698n" Jun 09 12:21:58.759540 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:58.759529 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84f6cdf2-53b2-4c5e-aa85-6b339ab78b88-sys\") pod \"perf-node-gather-daemonset-g698n\" (UID: \"84f6cdf2-53b2-4c5e-aa85-6b339ab78b88\") " pod="openshift-must-gather-bn8ls/perf-node-gather-daemonset-g698n" Jun 09 12:21:58.759824 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:58.759564 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/84f6cdf2-53b2-4c5e-aa85-6b339ab78b88-proc\") pod \"perf-node-gather-daemonset-g698n\" (UID: \"84f6cdf2-53b2-4c5e-aa85-6b339ab78b88\") " pod="openshift-must-gather-bn8ls/perf-node-gather-daemonset-g698n" Jun 09 12:21:58.759824 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:58.759657 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/84f6cdf2-53b2-4c5e-aa85-6b339ab78b88-podres\") pod \"perf-node-gather-daemonset-g698n\" (UID: \"84f6cdf2-53b2-4c5e-aa85-6b339ab78b88\") " pod="openshift-must-gather-bn8ls/perf-node-gather-daemonset-g698n" Jun 09 12:21:58.769334 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:58.769311 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44h5l\" (UniqueName: \"kubernetes.io/projected/84f6cdf2-53b2-4c5e-aa85-6b339ab78b88-kube-api-access-44h5l\") pod \"perf-node-gather-daemonset-g698n\" (UID: \"84f6cdf2-53b2-4c5e-aa85-6b339ab78b88\") " pod="openshift-must-gather-bn8ls/perf-node-gather-daemonset-g698n" Jun 09 12:21:58.860446 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:58.860349 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bn8ls/perf-node-gather-daemonset-g698n" Jun 09 12:21:59.001028 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:59.000993 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bn8ls/perf-node-gather-daemonset-g698n"] Jun 09 12:21:59.003267 ip-10-0-133-80 kubenswrapper[2577]: W0609 12:21:59.003236 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod84f6cdf2_53b2_4c5e_aa85_6b339ab78b88.slice/crio-83d772bd5080df1102c81f37f8256208fde3bc8b0b4017f6e73bd453ec0bff75 WatchSource:0}: Error finding container 83d772bd5080df1102c81f37f8256208fde3bc8b0b4017f6e73bd453ec0bff75: Status 404 returned error can't find the container with id 83d772bd5080df1102c81f37f8256208fde3bc8b0b4017f6e73bd453ec0bff75 Jun 09 12:21:59.453383 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:59.453337 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bn8ls/perf-node-gather-daemonset-g698n" event={"ID":"84f6cdf2-53b2-4c5e-aa85-6b339ab78b88","Type":"ContainerStarted","Data":"9f74cd2d65f18adf6c4164e1f43bd063f94d4a7387e5c0b888e0cd992179a29c"} Jun 09 12:21:59.453561 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:59.453545 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bn8ls/perf-node-gather-daemonset-g698n" Jun 09 12:21:59.453628 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:59.453577 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bn8ls/perf-node-gather-daemonset-g698n" event={"ID":"84f6cdf2-53b2-4c5e-aa85-6b339ab78b88","Type":"ContainerStarted","Data":"83d772bd5080df1102c81f37f8256208fde3bc8b0b4017f6e73bd453ec0bff75"} Jun 09 12:21:59.474305 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:21:59.474252 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bn8ls/perf-node-gather-daemonset-g698n" podStartSLOduration=1.47423688 podStartE2EDuration="1.47423688s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:21:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:21:59.471454187 +0000 UTC m=+1615.894011959" watchObservedRunningTime="2026-06-09 12:21:59.47423688 +0000 UTC m=+1615.896794655" Jun 09 12:22:01.395103 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:22:01.395078 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pdlth_447b1c43-1b2e-442c-b9ba-13e5b175df87/dns/0.log" Jun 09 12:22:01.417625 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:22:01.417578 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pdlth_447b1c43-1b2e-442c-b9ba-13e5b175df87/kube-rbac-proxy/0.log" Jun 09 12:22:01.569548 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:22:01.569517 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z728s_01f9bafd-cb94-4a81-a033-1baef2ace912/dns-node-resolver/0.log" Jun 09 12:22:02.230848 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:22:02.230821 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vhxvf_ab0c9312-14d5-40ed-9840-b89f7637bf85/node-ca/0.log" Jun 09 12:22:03.185124 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:22:03.185092 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795tbv74_07ce6663-7517-45b4-9dcd-b3aa260934f3/istio-proxy/0.log" Jun 09 12:22:03.338640 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:22:03.338576 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-4466p_584bfad5-351d-45e4-9d93-fe15c50f3552/istio-proxy/0.log" Jun 09 12:22:03.369632 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:22:03.369585 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-4466p_584bfad5-351d-45e4-9d93-fe15c50f3552/istio-proxy/1.log" Jun 09 12:22:04.095398 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:22:04.095367 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6l8jt_44157499-35a9-4824-a79c-daa659f4b622/serve-healthcheck-canary/0.log" Jun 09 12:22:04.703713 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:22:04.703675 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8k6gr_a2ce5048-fe61-42a6-b869-bd1c7afc0a67/kube-rbac-proxy/0.log" Jun 09 12:22:04.727260 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:22:04.727234 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8k6gr_a2ce5048-fe61-42a6-b869-bd1c7afc0a67/exporter/0.log" Jun 09 12:22:04.749190 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:22:04.749159 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8k6gr_a2ce5048-fe61-42a6-b869-bd1c7afc0a67/extractor/0.log" Jun 09 12:22:05.468976 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:22:05.468948 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bn8ls/perf-node-gather-daemonset-g698n" Jun 09 12:22:07.467354 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:22:07.467325 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-76df79655d-6gdtz_1bdc1578-d20c-446a-9cb6-e407bcb6dde9/nginx/0.log" Jun 09 12:22:07.943011 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:22:07.942978 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86976b546f-g4hct_a0595757-f346-4f57-b2f2-369e482db615/manager/0.log" Jun 09 12:22:07.970170 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:22:07.970142 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86976b546f-g4hct_a0595757-f346-4f57-b2f2-369e482db615/copy-manifests/0.log" Jun 09 12:22:09.725715 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:22:09.725674 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-57f7d46b46-lgfhc_0fcd5095-af3d-4fa7-9c2d-0977725f9ce1/manager/0.log" Jun 09 12:22:09.792510 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:22:09.792421 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-z54j4_65b46f49-d89d-4308-8447-3ad6fe54e377/openshift-lws-operator/0.log" Jun 09 12:22:12.698355 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:22:12.698321 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795tbv74_07ce6663-7517-45b4-9dcd-b3aa260934f3/istio-proxy/0.log" Jun 09 12:22:12.805991 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:22:12.805955 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-4466p_584bfad5-351d-45e4-9d93-fe15c50f3552/istio-proxy/0.log" Jun 09 12:22:12.839031 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:22:12.838995 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-4466p_584bfad5-351d-45e4-9d93-fe15c50f3552/istio-proxy/1.log" Jun 09 12:22:14.026755 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:22:14.026719 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795tbv74_07ce6663-7517-45b4-9dcd-b3aa260934f3/istio-proxy/0.log" Jun 09 12:22:14.132124 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:22:14.132087 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-4466p_584bfad5-351d-45e4-9d93-fe15c50f3552/istio-proxy/0.log" Jun 09 12:22:14.165510 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:22:14.165480 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-4466p_584bfad5-351d-45e4-9d93-fe15c50f3552/istio-proxy/1.log" Jun 09 12:22:15.786569 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:22:15.786529 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-b8mrg_35890da8-8ba3-4a9c-b524-4130ae63284c/kube-storage-version-migrator-operator/1.log" Jun 09 12:22:15.788165 ip-10-0-133-80 kubenswrapper[2577]: I0609 12:22:15.788112 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-b8mrg_35890da8-8ba3-4a9c-b524-4130ae63284c/kube-storage-version-migrator-operator/0.log"