Jun 03 23:21:57.270309 ip-10-0-135-242 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 03 23:21:57.270320 ip-10-0-135-242 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 03 23:21:57.270327 ip-10-0-135-242 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 03 23:21:57.270510 ip-10-0-135-242 systemd[1]: Failed to start Kubernetes Kubelet. Jun 03 23:22:07.501348 ip-10-0-135-242 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 03 23:22:07.501366 ip-10-0-135-242 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot b03631f1f9af4d289ccb32a7d4009a7c -- Jun 03 23:24:39.069646 ip-10-0-135-242 systemd[1]: Starting Kubernetes Kubelet... Jun 03 23:24:39.500454 ip-10-0-135-242 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 23:24:39.500454 ip-10-0-135-242 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 23:24:39.500454 ip-10-0-135-242 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 23:24:39.500454 ip-10-0-135-242 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 23:24:39.500454 ip-10-0-135-242 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 23:24:39.501699 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.501258 2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 23:24:39.506116 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506099 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 23:24:39.506116 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506114 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 23:24:39.506116 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506118 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 23:24:39.506208 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506121 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 23:24:39.506208 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506124 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 23:24:39.506208 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506127 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 23:24:39.506208 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506131 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 23:24:39.506208 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506139 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 23:24:39.506208 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506141 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 23:24:39.506208 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506144 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 23:24:39.506208 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506147 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 23:24:39.506208 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506149 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 23:24:39.506208 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506152 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 23:24:39.506208 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506155 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 23:24:39.506208 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506157 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 23:24:39.506208 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506160 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 23:24:39.506208 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506162 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 23:24:39.506208 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506165 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 23:24:39.506208 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506168 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 23:24:39.506208 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506171 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 23:24:39.506208 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506174 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 23:24:39.506208 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506176 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 23:24:39.506208 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506179 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 23:24:39.506857 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506181 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 23:24:39.506857 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506184 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 23:24:39.506857 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506187 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 23:24:39.506857 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506189 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 23:24:39.506857 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506192 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 23:24:39.506857 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506195 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 03 23:24:39.506857 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506197 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 23:24:39.506857 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506200 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 23:24:39.506857 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506202 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 23:24:39.506857 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506205 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 23:24:39.506857 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506208 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 23:24:39.506857 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506211 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 23:24:39.506857 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506213 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 23:24:39.506857 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506216 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 23:24:39.506857 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506219 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 23:24:39.506857 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506222 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 23:24:39.506857 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506226 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 23:24:39.506857 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506228 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 23:24:39.506857 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506231 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 23:24:39.507501 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506234 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 23:24:39.507501 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506236 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 23:24:39.507501 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506239 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 23:24:39.507501 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506242 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 23:24:39.507501 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506245 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 23:24:39.507501 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506248 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 23:24:39.507501 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506252 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 23:24:39.507501 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506256 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 23:24:39.507501 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506259 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 23:24:39.507501 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506262 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 23:24:39.507501 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506265 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 23:24:39.507501 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506268 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 23:24:39.507501 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506271 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 23:24:39.507501 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506274 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 23:24:39.507501 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506277 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 23:24:39.507501 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506280 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 23:24:39.507501 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506284 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 23:24:39.507501 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506300 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 23:24:39.507501 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506303 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 23:24:39.507975 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506308 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 23:24:39.507975 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506310 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 23:24:39.507975 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506313 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 23:24:39.507975 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506316 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 23:24:39.507975 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506319 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 23:24:39.507975 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506322 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 23:24:39.507975 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506325 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 23:24:39.507975 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506327 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 23:24:39.507975 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506330 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 23:24:39.507975 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506333 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 23:24:39.507975 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506335 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 23:24:39.507975 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506338 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 23:24:39.507975 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506340 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 23:24:39.507975 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506343 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 23:24:39.507975 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506346 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 23:24:39.507975 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506350 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 23:24:39.507975 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506353 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 23:24:39.507975 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506356 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 23:24:39.507975 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506358 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 23:24:39.507975 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506361 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 23:24:39.508469 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506363 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 23:24:39.508469 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506366 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 23:24:39.508469 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506368 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 23:24:39.508469 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506371 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 23:24:39.508469 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506374 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 23:24:39.508469 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506376 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 23:24:39.508469 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506379 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 23:24:39.508469 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506383 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 23:24:39.508469 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506386 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 23:24:39.508469 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506388 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 23:24:39.508469 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506391 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 23:24:39.508469 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506394 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 23:24:39.508469 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506396 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 23:24:39.508469 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506399 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 23:24:39.508469 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506401 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 23:24:39.508469 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506404 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 23:24:39.508469 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.506406 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 23:24:39.510995 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.510979 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 23:24:39.510995 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.510993 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 23:24:39.510995 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.510996 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 23:24:39.510995 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.510999 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 23:24:39.511142 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511002 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 23:24:39.511142 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511005 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 23:24:39.511142 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511008 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 23:24:39.511142 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511010 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 23:24:39.511142 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511013 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 23:24:39.511142 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511016 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 23:24:39.511142 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511018 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 23:24:39.511142 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511021 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 23:24:39.511142 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511023 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 23:24:39.511142 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511029 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 23:24:39.511142 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511034 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 23:24:39.511142 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511037 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 23:24:39.511142 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511040 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 23:24:39.511142 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511043 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 23:24:39.511142 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511046 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 23:24:39.511142 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511049 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 23:24:39.511142 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511051 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 23:24:39.511142 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511054 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 23:24:39.511142 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511057 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 23:24:39.511666 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511059 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 23:24:39.511666 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511062 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 23:24:39.511666 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511064 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 23:24:39.511666 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511066 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 23:24:39.511666 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511069 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 23:24:39.511666 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511072 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 23:24:39.511666 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511075 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 23:24:39.511666 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511078 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 23:24:39.511666 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511081 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 23:24:39.511666 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511084 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 23:24:39.511666 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511087 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 23:24:39.511666 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511089 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 23:24:39.511666 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511092 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 23:24:39.511666 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511094 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 23:24:39.511666 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511097 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 23:24:39.511666 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511100 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 23:24:39.511666 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511102 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 23:24:39.511666 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511105 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 23:24:39.511666 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511109 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 23:24:39.512127 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511111 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 23:24:39.512127 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511114 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 23:24:39.512127 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511117 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 23:24:39.512127 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511119 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 23:24:39.512127 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511122 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 23:24:39.512127 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511124 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 23:24:39.512127 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511127 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 23:24:39.512127 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511129 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 23:24:39.512127 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511132 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 23:24:39.512127 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511134 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 23:24:39.512127 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511137 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 23:24:39.512127 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511139 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 23:24:39.512127 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511142 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 23:24:39.512127 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511145 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 23:24:39.512127 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511148 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 23:24:39.512127 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511153 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 23:24:39.512127 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511157 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 23:24:39.512127 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511160 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 23:24:39.512127 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511163 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 23:24:39.512606 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511167 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 23:24:39.512606 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511171 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 23:24:39.512606 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511175 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 23:24:39.512606 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511178 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 23:24:39.512606 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511180 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 23:24:39.512606 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511183 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 23:24:39.512606 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511186 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 23:24:39.512606 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511188 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 23:24:39.512606 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511191 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 23:24:39.512606 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511194 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 23:24:39.512606 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511196 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 23:24:39.512606 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511199 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 23:24:39.512606 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511202 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 23:24:39.512606 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511204 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 23:24:39.512606 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511207 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 23:24:39.512606 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511210 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 23:24:39.512606 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511212 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 23:24:39.512606 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511215 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 23:24:39.512606 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511218 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 23:24:39.512606 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511221 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 23:24:39.513094 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511224 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 23:24:39.513094 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511227 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 23:24:39.513094 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511231 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 23:24:39.513094 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511233 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 23:24:39.513094 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511236 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 23:24:39.513094 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511239 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 23:24:39.513094 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511242 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 23:24:39.513094 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511244 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 23:24:39.513094 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511247 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 23:24:39.513094 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511250 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 23:24:39.513094 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511252 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 23:24:39.513094 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511255 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 23:24:39.513094 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511258 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 23:24:39.513094 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511260 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 23:24:39.513094 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511263 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 03 23:24:39.513094 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511265 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 23:24:39.513094 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511268 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 23:24:39.513094 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511686 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 23:24:39.513094 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511691 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 23:24:39.513094 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511694 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 03 23:24:39.513596 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511698 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 23:24:39.513596 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511701 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 23:24:39.513596 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511704 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 23:24:39.513596 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511707 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 23:24:39.513596 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511710 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 23:24:39.513596 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511713 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 23:24:39.513596 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511715 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 23:24:39.513596 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511718 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 23:24:39.513596 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511720 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 23:24:39.513596 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511723 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 23:24:39.513596 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511727 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 23:24:39.513596 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511730 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 23:24:39.513596 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511732 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 23:24:39.513596 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511735 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 23:24:39.513596 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511738 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 23:24:39.513596 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511741 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 23:24:39.513596 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511743 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 23:24:39.513596 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511746 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 23:24:39.513596 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511749 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 23:24:39.513596 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511751 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 23:24:39.514102 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511754 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 23:24:39.514102 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511757 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 23:24:39.514102 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511760 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 23:24:39.514102 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511762 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 23:24:39.514102 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511765 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 23:24:39.514102 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511767 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 23:24:39.514102 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511770 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 23:24:39.514102 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511773 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 23:24:39.514102 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511775 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 23:24:39.514102 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511778 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 23:24:39.514102 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511780 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 23:24:39.514102 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511785 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 23:24:39.514102 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511789 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 23:24:39.514102 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511792 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 23:24:39.514102 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511795 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 23:24:39.514102 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511798 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 23:24:39.514102 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511800 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 23:24:39.514102 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511803 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 23:24:39.514102 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511806 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 23:24:39.514585 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511809 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 23:24:39.514585 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511812 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 23:24:39.514585 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511814 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 23:24:39.514585 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511818 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 23:24:39.514585 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511820 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 23:24:39.514585 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511823 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 23:24:39.514585 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511825 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 23:24:39.514585 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511828 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 23:24:39.514585 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511834 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 23:24:39.514585 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511837 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 23:24:39.514585 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511840 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 23:24:39.514585 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511842 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 23:24:39.514585 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511845 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 23:24:39.514585 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511847 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 23:24:39.514585 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511850 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 23:24:39.514585 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511852 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 23:24:39.514585 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511855 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 23:24:39.514585 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511857 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 23:24:39.514585 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511860 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 23:24:39.515047 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511864 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 23:24:39.515047 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511867 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 23:24:39.515047 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511870 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 23:24:39.515047 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511872 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 23:24:39.515047 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511875 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 23:24:39.515047 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511878 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 23:24:39.515047 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511880 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 23:24:39.515047 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511883 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 23:24:39.515047 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511886 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 23:24:39.515047 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511888 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 23:24:39.515047 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511891 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 23:24:39.515047 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511893 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 23:24:39.515047 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511896 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 23:24:39.515047 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511898 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 23:24:39.515047 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511901 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 23:24:39.515047 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511903 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 23:24:39.515047 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511907 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 23:24:39.515047 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511910 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 23:24:39.515047 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511912 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 23:24:39.515047 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511915 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 23:24:39.515543 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511917 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 23:24:39.515543 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511919 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 23:24:39.515543 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511923 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 23:24:39.515543 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511925 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 23:24:39.515543 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511928 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 23:24:39.515543 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511930 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 23:24:39.515543 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511933 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 23:24:39.515543 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511935 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 23:24:39.515543 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511938 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 23:24:39.515543 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511940 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 23:24:39.515543 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511943 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 23:24:39.515543 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511945 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 23:24:39.515543 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511948 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 23:24:39.515543 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511951 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 23:24:39.515543 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511953 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 23:24:39.515543 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511955 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 23:24:39.515543 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.511959 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 23:24:39.515543 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512030 2574 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 23:24:39.515543 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512036 2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 23:24:39.515543 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512044 2574 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 23:24:39.515543 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512057 2574 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 23:24:39.516049 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512062 2574 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 23:24:39.516049 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512065 2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 23:24:39.516049 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512069 2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 23:24:39.516049 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512073 2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 23:24:39.516049 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512076 2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 23:24:39.516049 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512079 2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 23:24:39.516049 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512082 2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 23:24:39.516049 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512086 2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 23:24:39.516049 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512089 2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 23:24:39.516049 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512092 2574 flags.go:64] FLAG: --cgroup-root="" Jun 03 23:24:39.516049 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512095 2574 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 23:24:39.516049 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512099 2574 flags.go:64] FLAG: --client-ca-file="" Jun 03 23:24:39.516049 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512101 2574 flags.go:64] FLAG: --cloud-provider="external" Jun 03 23:24:39.516049 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512104 2574 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 23:24:39.516049 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512110 2574 flags.go:64] FLAG: --cluster-domain="" Jun 03 23:24:39.516049 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512112 2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 23:24:39.516049 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512116 2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 03 23:24:39.516049 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512119 2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 23:24:39.516049 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512122 2574 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 23:24:39.516049 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512126 2574 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 23:24:39.516049 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512129 2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 23:24:39.516049 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512132 2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 23:24:39.516049 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512136 2574 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 23:24:39.516621 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512139 2574 flags.go:64] FLAG: --contention-profiling="false" Jun 03 23:24:39.516621 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512142 2574 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 23:24:39.516621 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512145 2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 23:24:39.516621 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512148 2574 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 23:24:39.516621 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512151 2574 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 23:24:39.516621 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512155 2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 23:24:39.516621 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512158 2574 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 23:24:39.516621 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512161 2574 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 23:24:39.516621 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512164 2574 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 23:24:39.516621 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512167 2574 flags.go:64] FLAG: --enable-server="true" Jun 03 23:24:39.516621 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512170 2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 23:24:39.516621 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512173 2574 flags.go:64] FLAG: --event-burst="100" Jun 03 23:24:39.516621 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512176 2574 flags.go:64] FLAG: --event-qps="50" Jun 03 23:24:39.516621 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512179 2574 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 23:24:39.516621 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512182 2574 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 23:24:39.516621 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512185 2574 flags.go:64] FLAG: --eviction-hard="" Jun 03 23:24:39.516621 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512189 2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 23:24:39.516621 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512192 2574 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 23:24:39.516621 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512195 2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 23:24:39.516621 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512198 2574 flags.go:64] FLAG: --eviction-soft="" Jun 03 23:24:39.516621 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512201 2574 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 23:24:39.516621 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512204 2574 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 23:24:39.516621 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512207 2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 23:24:39.516621 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512210 2574 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 23:24:39.516621 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512213 2574 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 23:24:39.517240 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512216 2574 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 23:24:39.517240 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512219 2574 flags.go:64] FLAG: --feature-gates="" Jun 03 23:24:39.517240 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512222 2574 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 23:24:39.517240 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512225 2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 23:24:39.517240 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512228 2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 23:24:39.517240 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512231 2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 23:24:39.517240 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512234 2574 flags.go:64] FLAG: --healthz-port="10248" Jun 03 23:24:39.517240 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512237 2574 flags.go:64] FLAG: --help="false" Jun 03 23:24:39.517240 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512240 2574 flags.go:64] FLAG: --hostname-override="ip-10-0-135-242.ec2.internal" Jun 03 23:24:39.517240 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512243 2574 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 23:24:39.517240 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512246 2574 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 23:24:39.517240 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512249 2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 23:24:39.517240 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512253 2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 23:24:39.517240 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512256 2574 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 23:24:39.517240 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512259 2574 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 23:24:39.517240 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512262 2574 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 23:24:39.517240 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512265 2574 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 23:24:39.517240 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512268 2574 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 23:24:39.517240 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512271 2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 23:24:39.517240 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512274 2574 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 23:24:39.517240 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512277 2574 flags.go:64] FLAG: --kube-reserved="" Jun 03 23:24:39.517240 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512280 2574 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 23:24:39.517240 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512283 2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 23:24:39.517240 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512286 2574 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 23:24:39.517852 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512301 2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 23:24:39.517852 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512304 2574 flags.go:64] FLAG: --lock-file="" Jun 03 23:24:39.517852 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512307 2574 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 23:24:39.517852 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512310 2574 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 23:24:39.517852 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512313 2574 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 23:24:39.517852 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512319 2574 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 23:24:39.517852 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512322 2574 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 23:24:39.517852 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512324 2574 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 23:24:39.517852 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512328 2574 flags.go:64] FLAG: --logging-format="text" Jun 03 23:24:39.517852 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512335 2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 23:24:39.517852 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512338 2574 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 23:24:39.517852 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512341 2574 flags.go:64] FLAG: --manifest-url="" Jun 03 23:24:39.517852 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512344 2574 flags.go:64] FLAG: --manifest-url-header="" Jun 03 23:24:39.517852 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512348 2574 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 23:24:39.517852 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512352 2574 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 23:24:39.517852 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512356 2574 flags.go:64] FLAG: --max-pods="110" Jun 03 23:24:39.517852 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512359 2574 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 23:24:39.517852 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512362 2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 23:24:39.517852 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512365 2574 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 23:24:39.517852 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512368 2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 23:24:39.517852 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512371 2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 23:24:39.517852 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512374 2574 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 23:24:39.517852 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512377 2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 23:24:39.517852 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512385 2574 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 23:24:39.517852 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512387 2574 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 23:24:39.518504 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512391 2574 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 23:24:39.518504 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512394 2574 flags.go:64] FLAG: --pod-cidr="" Jun 03 23:24:39.518504 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512397 2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 03 23:24:39.518504 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512402 2574 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 23:24:39.518504 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512405 2574 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 23:24:39.518504 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512408 2574 flags.go:64] FLAG: --pods-per-core="0" Jun 03 23:24:39.518504 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512411 2574 flags.go:64] FLAG: --port="10250" Jun 03 23:24:39.518504 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512414 2574 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 23:24:39.518504 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512417 2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0cdd1b3b8aa504857" Jun 03 23:24:39.518504 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512420 2574 flags.go:64] FLAG: --qos-reserved="" Jun 03 23:24:39.518504 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512423 2574 flags.go:64] FLAG: --read-only-port="10255" Jun 03 23:24:39.518504 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512426 2574 flags.go:64] FLAG: --register-node="true" Jun 03 23:24:39.518504 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512429 2574 flags.go:64] FLAG: --register-with-taints="" Jun 03 23:24:39.518504 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512432 2574 flags.go:64] FLAG: --registry-burst="10" Jun 03 23:24:39.518504 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512435 2574 flags.go:64] FLAG: --registry-qps="5" Jun 03 23:24:39.518504 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512438 2574 flags.go:64] FLAG: --reserved-cpus="" Jun 03 23:24:39.518504 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512442 2574 flags.go:64] FLAG: --reserved-memory="" Jun 03 23:24:39.518504 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512447 2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 23:24:39.518504 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512450 2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 23:24:39.518504 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512453 2574 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 23:24:39.518504 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512456 2574 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 23:24:39.518504 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512459 2574 flags.go:64] FLAG: --runonce="false" Jun 03 23:24:39.518504 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512462 2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 23:24:39.518504 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512465 2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 23:24:39.518504 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512468 2574 flags.go:64] FLAG: --seccomp-default="false" Jun 03 23:24:39.519349 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512471 2574 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 23:24:39.519349 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512473 2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 23:24:39.519349 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512476 2574 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 23:24:39.519349 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512479 2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 23:24:39.519349 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512482 2574 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 23:24:39.519349 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512485 2574 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 23:24:39.519349 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512488 2574 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 23:24:39.519349 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512491 2574 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 23:24:39.519349 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512493 2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 23:24:39.519349 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512496 2574 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 23:24:39.519349 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512500 2574 flags.go:64] FLAG: --system-cgroups="" Jun 03 23:24:39.519349 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512502 2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 23:24:39.519349 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512508 2574 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 23:24:39.519349 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512510 2574 flags.go:64] FLAG: --tls-cert-file="" Jun 03 23:24:39.519349 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512513 2574 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 23:24:39.519349 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512517 2574 flags.go:64] FLAG: --tls-min-version="" Jun 03 23:24:39.519349 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512520 2574 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 23:24:39.519349 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512523 2574 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 23:24:39.519349 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512526 2574 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 23:24:39.519349 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512529 2574 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 23:24:39.519349 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512531 2574 flags.go:64] FLAG: --v="2" Jun 03 23:24:39.519349 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512535 2574 flags.go:64] FLAG: --version="false" Jun 03 23:24:39.519349 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512539 2574 flags.go:64] FLAG: --vmodule="" Jun 03 23:24:39.519349 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512543 2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 23:24:39.519349 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.512547 2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 23:24:39.520023 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512681 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 23:24:39.520023 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512685 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 23:24:39.520023 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512688 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 23:24:39.520023 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512691 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 23:24:39.520023 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512694 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 23:24:39.520023 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512698 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 23:24:39.520023 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512701 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 23:24:39.520023 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512703 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 23:24:39.520023 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512706 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 23:24:39.520023 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512709 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 23:24:39.520023 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512711 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 23:24:39.520023 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512714 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 23:24:39.520023 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512717 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 23:24:39.520023 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512720 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 23:24:39.520023 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512722 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 23:24:39.520023 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512725 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 23:24:39.520023 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512727 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 23:24:39.520023 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512730 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 23:24:39.520023 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512733 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 23:24:39.520023 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512735 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 23:24:39.520023 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512738 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 23:24:39.520929 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512741 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 23:24:39.520929 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512743 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 23:24:39.520929 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512746 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 23:24:39.520929 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512749 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 23:24:39.520929 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512752 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 23:24:39.520929 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512754 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 23:24:39.520929 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512757 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 23:24:39.520929 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512760 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 23:24:39.520929 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512762 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 23:24:39.520929 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512764 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 23:24:39.520929 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512768 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 23:24:39.520929 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512771 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 23:24:39.520929 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512774 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 23:24:39.520929 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512777 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 23:24:39.520929 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512779 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 23:24:39.520929 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512782 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 23:24:39.520929 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512786 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 23:24:39.520929 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512788 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 23:24:39.520929 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512791 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 23:24:39.521757 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512793 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 23:24:39.521757 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512796 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 23:24:39.521757 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512798 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 23:24:39.521757 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512801 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 23:24:39.521757 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512804 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 23:24:39.521757 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512806 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 23:24:39.521757 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512809 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 23:24:39.521757 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512811 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 23:24:39.521757 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512814 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 23:24:39.521757 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512817 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 23:24:39.521757 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512819 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 23:24:39.521757 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512822 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 23:24:39.521757 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512824 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 23:24:39.521757 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512827 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 23:24:39.521757 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512829 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 23:24:39.521757 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512832 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 23:24:39.521757 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512834 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 23:24:39.521757 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512838 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 23:24:39.521757 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512842 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 23:24:39.521757 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512845 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 23:24:39.522690 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512848 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 23:24:39.522690 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512851 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 23:24:39.522690 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512853 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 23:24:39.522690 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512857 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 23:24:39.522690 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512861 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 23:24:39.522690 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512866 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 23:24:39.522690 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512869 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 23:24:39.522690 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512872 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 23:24:39.522690 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512875 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 23:24:39.522690 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512880 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 03 23:24:39.522690 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512883 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 23:24:39.522690 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512886 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 23:24:39.522690 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512889 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 23:24:39.522690 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512892 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 23:24:39.522690 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512895 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 23:24:39.522690 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512898 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 23:24:39.522690 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512901 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 23:24:39.522690 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512903 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 23:24:39.522690 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512906 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 23:24:39.523551 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512909 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 23:24:39.523551 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512911 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 23:24:39.523551 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512914 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 23:24:39.523551 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512916 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 23:24:39.523551 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512919 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 23:24:39.523551 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512921 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 23:24:39.523551 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512924 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 23:24:39.523551 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512927 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 23:24:39.523551 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512929 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 23:24:39.523551 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512932 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 23:24:39.523551 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512935 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 23:24:39.523551 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512937 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 23:24:39.523551 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512940 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 23:24:39.523551 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512944 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 23:24:39.523551 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512947 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 23:24:39.523551 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512950 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 23:24:39.523551 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512954 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 23:24:39.523551 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512956 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 23:24:39.523551 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.512959 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 23:24:39.524124 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.513507 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 23:24:39.524124 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.521874 2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 03 23:24:39.524124 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.521893 2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 23:24:39.524124 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.521922 2574 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 03 23:24:39.524124 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.521935 2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 23:24:39.524124 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522018 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 23:24:39.524124 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522026 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 23:24:39.524124 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522032 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 23:24:39.524124 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522036 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 23:24:39.524124 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522040 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 23:24:39.524124 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522044 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 23:24:39.524124 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522049 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 23:24:39.524124 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522057 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 23:24:39.524124 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522063 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 23:24:39.524751 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522068 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 23:24:39.524751 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522073 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 23:24:39.524751 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522077 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 23:24:39.524751 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522081 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 23:24:39.524751 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522086 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 23:24:39.524751 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522090 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 23:24:39.524751 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522094 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 23:24:39.524751 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522099 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 23:24:39.524751 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522104 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 23:24:39.524751 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522108 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 23:24:39.524751 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522112 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 23:24:39.524751 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522116 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 23:24:39.524751 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522121 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 23:24:39.524751 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522125 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 23:24:39.524751 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522130 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 23:24:39.524751 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522134 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 23:24:39.524751 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522138 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 23:24:39.524751 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522143 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 23:24:39.524751 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522148 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 23:24:39.524751 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522152 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 23:24:39.525642 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522157 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 23:24:39.525642 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522162 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 23:24:39.525642 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522166 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 23:24:39.525642 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522170 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 23:24:39.525642 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522174 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 23:24:39.525642 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522178 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 23:24:39.525642 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522183 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 23:24:39.525642 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522187 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 23:24:39.525642 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522191 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 23:24:39.525642 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522195 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 23:24:39.525642 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522199 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 23:24:39.525642 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522204 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 23:24:39.525642 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522208 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 23:24:39.525642 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522212 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 23:24:39.525642 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522218 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 23:24:39.525642 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522224 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 23:24:39.525642 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522228 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 23:24:39.525642 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522233 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 23:24:39.525642 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522238 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 23:24:39.525642 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522243 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 23:24:39.526216 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522247 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 23:24:39.526216 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522251 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 23:24:39.526216 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522256 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 23:24:39.526216 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522260 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 23:24:39.526216 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522265 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 23:24:39.526216 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522269 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 23:24:39.526216 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522274 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 23:24:39.526216 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522281 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 23:24:39.526216 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522303 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 23:24:39.526216 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522309 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 23:24:39.526216 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522313 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 23:24:39.526216 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522318 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 23:24:39.526216 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522322 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 23:24:39.526216 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522327 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 23:24:39.526216 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522331 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 23:24:39.526216 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522336 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 23:24:39.526216 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522340 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 23:24:39.526216 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522344 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 23:24:39.526216 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522348 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 23:24:39.526920 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522352 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 23:24:39.526920 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522356 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 23:24:39.526920 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522360 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 23:24:39.526920 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522364 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 03 23:24:39.526920 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522369 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 23:24:39.526920 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522373 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 23:24:39.526920 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522377 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 23:24:39.526920 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522382 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 23:24:39.526920 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522386 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 23:24:39.526920 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522390 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 23:24:39.526920 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522394 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 23:24:39.526920 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522399 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 23:24:39.526920 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522403 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 23:24:39.526920 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522407 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 23:24:39.526920 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522411 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 23:24:39.526920 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522414 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 23:24:39.526920 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522419 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 23:24:39.526920 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522423 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 23:24:39.526920 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522428 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 23:24:39.526920 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522432 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 23:24:39.527491 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522437 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 23:24:39.527491 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522441 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 23:24:39.527491 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522445 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 23:24:39.527491 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522449 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 23:24:39.527491 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522453 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 23:24:39.527491 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522460 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 23:24:39.527491 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522464 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 23:24:39.527491 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522468 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 23:24:39.527491 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522473 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 23:24:39.527491 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522477 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 23:24:39.527491 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.522485 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 23:24:39.527491 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522672 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 23:24:39.527491 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522679 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 23:24:39.527491 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522684 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 23:24:39.527491 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522689 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 23:24:39.527893 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522693 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 23:24:39.527893 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522697 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 23:24:39.527893 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522701 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 23:24:39.527893 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522705 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 23:24:39.527893 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522710 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 23:24:39.527893 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522714 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 23:24:39.527893 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522718 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 03 23:24:39.527893 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522722 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 23:24:39.527893 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522727 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 23:24:39.527893 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522732 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 23:24:39.527893 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522736 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 23:24:39.527893 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522740 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 23:24:39.527893 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522744 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 23:24:39.527893 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522749 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 23:24:39.527893 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522754 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 23:24:39.527893 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522758 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 23:24:39.527893 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522762 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 23:24:39.527893 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522767 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 23:24:39.527893 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522771 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 23:24:39.527893 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522776 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 23:24:39.528427 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522780 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 23:24:39.528427 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522784 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 23:24:39.528427 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522789 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 23:24:39.528427 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522799 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 23:24:39.528427 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522803 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 23:24:39.528427 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522808 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 23:24:39.528427 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522812 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 23:24:39.528427 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522816 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 23:24:39.528427 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522821 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 23:24:39.528427 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522825 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 23:24:39.528427 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522829 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 23:24:39.528427 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522833 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 23:24:39.528427 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522837 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 23:24:39.528427 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522841 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 23:24:39.528427 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522846 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 23:24:39.528427 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522850 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 23:24:39.528427 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522853 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 23:24:39.528427 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522858 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 23:24:39.528427 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522862 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 23:24:39.528427 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522866 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 23:24:39.528962 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522870 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 23:24:39.528962 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522875 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 23:24:39.528962 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522879 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 23:24:39.528962 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522883 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 23:24:39.528962 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522887 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 23:24:39.528962 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522891 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 23:24:39.528962 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522896 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 23:24:39.528962 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522900 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 23:24:39.528962 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522905 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 23:24:39.528962 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522910 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 23:24:39.528962 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522914 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 23:24:39.528962 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522919 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 23:24:39.528962 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522926 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 23:24:39.528962 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522932 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 23:24:39.528962 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522936 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 23:24:39.528962 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522941 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 23:24:39.528962 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522948 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 23:24:39.528962 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522954 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 23:24:39.529463 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522959 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 23:24:39.529463 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522963 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 23:24:39.529463 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522967 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 23:24:39.529463 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522972 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 23:24:39.529463 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522976 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 23:24:39.529463 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522980 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 23:24:39.529463 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522985 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 23:24:39.529463 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522989 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 23:24:39.529463 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522993 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 23:24:39.529463 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.522997 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 23:24:39.529463 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.523001 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 23:24:39.529463 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.523005 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 23:24:39.529463 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.523010 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 23:24:39.529463 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.523014 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 23:24:39.529463 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.523018 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 23:24:39.529463 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.523022 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 23:24:39.529463 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.523027 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 23:24:39.529463 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.523031 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 23:24:39.529463 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.523035 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 23:24:39.529463 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.523040 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 23:24:39.529980 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.523044 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 23:24:39.529980 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.523048 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 23:24:39.529980 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.523052 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 23:24:39.529980 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.523056 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 23:24:39.529980 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.523061 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 23:24:39.529980 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.523067 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 23:24:39.529980 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.523072 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 23:24:39.529980 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.523076 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 23:24:39.529980 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.523080 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 23:24:39.529980 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.523084 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 23:24:39.529980 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.523088 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 23:24:39.529980 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.523093 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 23:24:39.529980 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.523097 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 23:24:39.529980 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.523101 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 23:24:39.529980 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.523106 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 23:24:39.529980 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:39.523110 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 23:24:39.530477 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.523118 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 23:24:39.530477 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.523278 2574 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 23:24:39.530477 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.526347 2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 23:24:39.530477 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.527855 2574 server.go:1019] "Starting client certificate rotation" Jun 03 23:24:39.530477 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.527964 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 23:24:39.530477 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.527999 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 23:24:39.530891 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.530875 2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 23:24:39.532067 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.532045 2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 23:24:39.547571 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.547543 2574 log.go:25] "Validated CRI v1 runtime API" Jun 03 23:24:39.550494 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.550477 2574 log.go:25] "Validated CRI v1 image API" Jun 03 23:24:39.551219 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.551203 2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 23:24:39.553671 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.553651 2574 fs.go:135] Filesystem UUIDs: map[1a88df19-ad29-4145-ac79-3d1482b3abc6:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 dffd5b29-1dc1-4c31-a435-2f953f27b21a:/dev/nvme0n1p3] Jun 03 23:24:39.553731 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.553669 2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 23:24:39.558249 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.558137 2574 manager.go:216] Machine: {Timestamp:2026-06-03 23:24:39.557644908 +0000 UTC m=+0.364865366 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103473 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2de0e2dd289606150c033546e80974 SystemUUID:ec2de0e2-dd28-9606-150c-033546e80974 BootID:b03631f1-f9af-4d28-9ccb-32a7d4009a7c Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:cc:d0:20:38:cd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:cc:d0:20:38:cd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6a:bb:8c:37:f0:3d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 23:24:39.558249 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.558238 2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 23:24:39.558391 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.558365 2574 manager.go:232] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 23:24:39.559002 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.558986 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 23:24:39.562257 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.562233 2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 23:24:39.562400 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.562259 2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-242.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 23:24:39.563038 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.563028 2574 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 23:24:39.563067 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.563040 2574 container_manager_linux.go:309] "Creating device plugin manager" Jun 03 23:24:39.563067 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.563048 2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 23:24:39.563067 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.563058 2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 23:24:39.563990 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.563980 2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 03 23:24:39.567115 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.567104 2574 state_mem.go:36] "Initialized new in-memory state store" Jun 03 23:24:39.567472 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.567461 2574 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 03 23:24:39.567520 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.567494 2574 kubelet.go:486] "Attempting to sync node with API server" Jun 03 23:24:39.567520 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.567516 2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 23:24:39.567586 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.567531 2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 23:24:39.567586 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.567541 2574 kubelet.go:398] "Adding apiserver pod source" Jun 03 23:24:39.567586 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.567550 2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 23:24:39.567926 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.567914 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 23:24:39.567973 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.567932 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 23:24:39.570043 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.570024 2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 03 23:24:39.571671 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.571658 2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 23:24:39.571720 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.571687 2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 03 23:24:39.572651 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.572641 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 23:24:39.572695 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.572655 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 23:24:39.572695 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.572661 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 23:24:39.572695 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.572667 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 23:24:39.572695 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.572676 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 23:24:39.572695 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.572682 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 23:24:39.572695 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.572691 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 23:24:39.572695 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.572696 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 23:24:39.572909 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.572702 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 23:24:39.572909 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.572708 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 23:24:39.572909 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.572715 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 23:24:39.572909 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.572721 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 23:24:39.572909 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.572742 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 23:24:39.572909 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.572748 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 23:24:39.575482 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.575464 2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-242.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 23:24:39.575561 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:39.575476 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-242.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 23:24:39.575624 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:39.575594 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 23:24:39.575951 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.575940 2574 server.go:1268] "Started kubelet" Jun 03 23:24:39.576156 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.576044 2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 23:24:39.576156 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.576111 2574 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 03 23:24:39.576156 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.576125 2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 23:24:39.576978 ip-10-0-135-242 systemd[1]: Started Kubernetes Kubelet. Jun 03 23:24:39.581219 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.581031 2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 23:24:39.582055 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.582035 2574 server.go:310] "Adding debug handlers to kubelet server" Jun 03 23:24:39.582890 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.582866 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vczdd" Jun 03 23:24:39.584319 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:39.584301 2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 23:24:39.584717 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:39.583743 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-242.ec2.internal.18b5b5c3a4602177 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-242.ec2.internal,UID:ip-10-0-135-242.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-242.ec2.internal,},FirstTimestamp:2026-06-03 23:24:39.575912823 +0000 UTC m=+0.383133278,LastTimestamp:2026-06-03 23:24:39.575912823 +0000 UTC m=+0.383133278,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-242.ec2.internal,}" Jun 03 23:24:39.586503 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.586480 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 23:24:39.586590 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.586485 2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 23:24:39.586590 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:39.586569 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-242.ec2.internal\" not found" Jun 03 23:24:39.587105 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.587065 2574 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 03 23:24:39.587105 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.587064 2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 03 23:24:39.587105 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.587084 2574 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 03 23:24:39.587274 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.587231 2574 reconstruct.go:97] "Volume reconstruction finished" Jun 03 23:24:39.587274 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.587241 2574 reconciler.go:29] "Reconciler: start to sync state" Jun 03 23:24:39.587500 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.587483 2574 factory.go:55] Registering systemd factory Jun 03 23:24:39.587568 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.587506 2574 factory.go:223] Registration of the systemd container factory successfully Jun 03 23:24:39.587707 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.587690 2574 factory.go:153] Registering CRI-O factory Jun 03 23:24:39.587707 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.587708 2574 factory.go:223] Registration of the crio container factory successfully Jun 03 23:24:39.587813 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.587788 2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 23:24:39.587813 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.587809 2574 factory.go:103] Registering Raw factory Jun 03 23:24:39.587889 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.587823 2574 manager.go:1196] Started watching for new ooms in manager Jun 03 23:24:39.588252 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.588239 2574 manager.go:349] Starting recovery of all containers Jun 03 23:24:39.588764 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:39.588731 2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-242.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 03 23:24:39.588883 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:39.588861 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 03 23:24:39.591337 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.591315 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vczdd" Jun 03 23:24:39.598522 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.598504 2574 manager.go:354] Recovery completed Jun 03 23:24:39.602684 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.602669 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 23:24:39.604681 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.604663 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-242.ec2.internal" event="NodeHasSufficientMemory" Jun 03 23:24:39.604753 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.604701 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-242.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 23:24:39.604753 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.604713 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-242.ec2.internal" event="NodeHasSufficientPID" Jun 03 23:24:39.605246 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.605230 2574 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 23:24:39.605246 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.605245 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 23:24:39.605404 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.605245 2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 23:24:39.605404 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.605323 2574 state_mem.go:36] "Initialized new in-memory state store" Jun 03 23:24:39.605946 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.605931 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-242.ec2.internal" event="NodeHasSufficientMemory" Jun 03 23:24:39.606007 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.605956 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-242.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 23:24:39.606007 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.605967 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-242.ec2.internal" event="NodeHasSufficientPID" Jun 03 23:24:39.606440 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.606427 2574 policy_none.go:49] "None policy: Start" Jun 03 23:24:39.606499 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.606462 2574 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 03 23:24:39.606499 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.606476 2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 03 23:24:39.607493 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.607481 2574 policy_none.go:47] "Start" Jun 03 23:24:39.648868 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.648836 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 03 23:24:39.651788 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.650016 2574 manager.go:337] "Starting Device Plugin manager" Jun 03 23:24:39.651788 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:39.650090 2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 23:24:39.651788 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.650103 2574 server.go:87] "Starting device plugin registration server" Jun 03 23:24:39.651788 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.650204 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 03 23:24:39.651788 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.650239 2574 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 03 23:24:39.651788 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.650258 2574 kubelet.go:2448] "Starting kubelet main sync loop" Jun 03 23:24:39.651788 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:39.650315 2574 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Jun 03 23:24:39.651788 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.650398 2574 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 23:24:39.651788 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.650412 2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 23:24:39.651788 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.650536 2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 23:24:39.651788 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.650613 2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 23:24:39.651788 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.650622 2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 23:24:39.651788 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:39.651127 2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 23:24:39.651788 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:39.651178 2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-242.ec2.internal\" not found" Jun 03 23:24:39.652424 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.652410 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 23:24:39.751276 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.751193 2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-242.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-242.ec2.internal"] Jun 03 23:24:39.751276 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.751216 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 23:24:39.751451 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.751314 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 23:24:39.752429 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.752415 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-242.ec2.internal" event="NodeHasSufficientMemory" Jun 03 23:24:39.752491 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.752442 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-242.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 23:24:39.752491 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.752452 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-242.ec2.internal" event="NodeHasSufficientPID" Jun 03 23:24:39.752491 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.752473 2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-242.ec2.internal" Jun 03 23:24:39.752918 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.752904 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-242.ec2.internal" event="NodeHasSufficientMemory" Jun 03 23:24:39.752962 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.752930 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-242.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 23:24:39.752962 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.752942 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-242.ec2.internal" event="NodeHasSufficientPID" Jun 03 23:24:39.754132 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.754119 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 23:24:39.754246 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.754232 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-242.ec2.internal" Jun 03 23:24:39.754299 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.754267 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 23:24:39.754767 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.754748 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-242.ec2.internal" event="NodeHasSufficientMemory" Jun 03 23:24:39.754856 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.754774 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-242.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 23:24:39.754856 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.754789 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-242.ec2.internal" event="NodeHasSufficientPID" Jun 03 23:24:39.754856 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.754792 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-242.ec2.internal" event="NodeHasSufficientMemory" Jun 03 23:24:39.754856 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.754809 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-242.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 23:24:39.754856 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.754820 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-242.ec2.internal" event="NodeHasSufficientPID" Jun 03 23:24:39.756017 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.756001 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-242.ec2.internal" Jun 03 23:24:39.756067 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.756035 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 23:24:39.756662 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.756649 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-242.ec2.internal" event="NodeHasSufficientMemory" Jun 03 23:24:39.756728 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.756673 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-242.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 23:24:39.756728 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.756685 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-242.ec2.internal" event="NodeHasSufficientPID" Jun 03 23:24:39.759163 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.759149 2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-242.ec2.internal" Jun 03 23:24:39.759231 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:39.759168 2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-242.ec2.internal\": node \"ip-10-0-135-242.ec2.internal\" not found" Jun 03 23:24:39.774858 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:39.774835 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-242.ec2.internal\" not found" node="ip-10-0-135-242.ec2.internal" Jun 03 23:24:39.777941 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:39.777924 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-242.ec2.internal\" not found" Jun 03 23:24:39.779267 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:39.779250 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-242.ec2.internal\" not found" node="ip-10-0-135-242.ec2.internal" Jun 03 23:24:39.788906 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.788869 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c29f618fd87963fa6849c0e453c58d0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-242.ec2.internal\" (UID: \"4c29f618fd87963fa6849c0e453c58d0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-242.ec2.internal" Jun 03 23:24:39.788992 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.788911 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9695b6e50d763a28dd89fc1a733fbc23-config\") pod \"kube-apiserver-proxy-ip-10-0-135-242.ec2.internal\" (UID: \"9695b6e50d763a28dd89fc1a733fbc23\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-242.ec2.internal" Jun 03 23:24:39.788992 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.788943 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4c29f618fd87963fa6849c0e453c58d0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-242.ec2.internal\" (UID: \"4c29f618fd87963fa6849c0e453c58d0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-242.ec2.internal" Jun 03 23:24:39.878010 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:39.877971 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-242.ec2.internal\" not found" Jun 03 23:24:39.889241 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.889163 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9695b6e50d763a28dd89fc1a733fbc23-config\") pod \"kube-apiserver-proxy-ip-10-0-135-242.ec2.internal\" (UID: \"9695b6e50d763a28dd89fc1a733fbc23\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-242.ec2.internal" Jun 03 23:24:39.889335 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.889267 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4c29f618fd87963fa6849c0e453c58d0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-242.ec2.internal\" (UID: \"4c29f618fd87963fa6849c0e453c58d0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-242.ec2.internal" Jun 03 23:24:39.889335 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.889311 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c29f618fd87963fa6849c0e453c58d0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-242.ec2.internal\" (UID: \"4c29f618fd87963fa6849c0e453c58d0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-242.ec2.internal" Jun 03 23:24:39.889335 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.889222 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9695b6e50d763a28dd89fc1a733fbc23-config\") pod \"kube-apiserver-proxy-ip-10-0-135-242.ec2.internal\" (UID: \"9695b6e50d763a28dd89fc1a733fbc23\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-242.ec2.internal" Jun 03 23:24:39.889439 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.889360 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4c29f618fd87963fa6849c0e453c58d0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-242.ec2.internal\" (UID: \"4c29f618fd87963fa6849c0e453c58d0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-242.ec2.internal" Jun 03 23:24:39.889439 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:39.889367 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c29f618fd87963fa6849c0e453c58d0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-242.ec2.internal\" (UID: \"4c29f618fd87963fa6849c0e453c58d0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-242.ec2.internal" Jun 03 23:24:39.978510 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:39.978480 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-242.ec2.internal\" not found" Jun 03 23:24:40.078227 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:40.078140 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-242.ec2.internal" Jun 03 23:24:40.079220 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:40.079203 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-242.ec2.internal\" not found" Jun 03 23:24:40.083764 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:40.083738 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-242.ec2.internal" Jun 03 23:24:40.179955 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:40.179914 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-242.ec2.internal\" not found" Jun 03 23:24:40.280545 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:40.280508 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-242.ec2.internal\" not found" Jun 03 23:24:40.381070 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:40.380993 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-242.ec2.internal\" not found" Jun 03 23:24:40.481653 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:40.481620 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-242.ec2.internal\" not found" Jun 03 23:24:40.505795 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:40.505765 2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 23:24:40.527756 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:40.527730 2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 23:24:40.527898 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:40.527875 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 23:24:40.527961 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:40.527915 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 23:24:40.546591 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:40.546555 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9695b6e50d763a28dd89fc1a733fbc23.slice/crio-05427e2e8719bf659765e088407ecbc433e199bf5330c8be0022a8577f680fb5 WatchSource:0}: Error finding container 05427e2e8719bf659765e088407ecbc433e199bf5330c8be0022a8577f680fb5: Status 404 returned error can't find the container with id 05427e2e8719bf659765e088407ecbc433e199bf5330c8be0022a8577f680fb5 Jun 03 23:24:40.546828 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:40.546805 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c29f618fd87963fa6849c0e453c58d0.slice/crio-87fe690783a43489adf53bdb2f844caa0c92d42b55ffe35847aee6f1d67f0d0a WatchSource:0}: Error finding container 87fe690783a43489adf53bdb2f844caa0c92d42b55ffe35847aee6f1d67f0d0a: Status 404 returned error can't find the container with id 87fe690783a43489adf53bdb2f844caa0c92d42b55ffe35847aee6f1d67f0d0a Jun 03 23:24:40.547179 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:40.547162 2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 23:24:40.551229 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:40.551214 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 23:24:40.582033 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:40.582010 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-242.ec2.internal\" not found" Jun 03 23:24:40.593911 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:40.593883 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 23:19:39 +0000 UTC" deadline="2027-11-27 21:22:27.306577541 +0000 UTC" Jun 03 23:24:40.593911 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:40.593907 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13005h57m46.712673164s" Jun 03 23:24:40.654244 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:40.654157 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-242.ec2.internal" event={"ID":"9695b6e50d763a28dd89fc1a733fbc23","Type":"ContainerStarted","Data":"05427e2e8719bf659765e088407ecbc433e199bf5330c8be0022a8577f680fb5"} Jun 03 23:24:40.655111 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:40.655088 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-242.ec2.internal" event={"ID":"4c29f618fd87963fa6849c0e453c58d0","Type":"ContainerStarted","Data":"87fe690783a43489adf53bdb2f844caa0c92d42b55ffe35847aee6f1d67f0d0a"} Jun 03 23:24:40.682268 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:40.682241 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-242.ec2.internal\" not found" Jun 03 23:24:40.712783 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:40.712761 2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 23:24:40.787187 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:40.787155 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-242.ec2.internal" Jun 03 23:24:40.800199 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:40.800175 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 23:24:40.801377 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:40.801364 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-242.ec2.internal" Jun 03 23:24:40.808280 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:40.808265 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 23:24:41.569301 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.569208 2574 apiserver.go:52] "Watching apiserver" Jun 03 23:24:41.582419 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.582393 2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 23:24:41.583514 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.583492 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-z7b5v","openshift-multus/multus-jcmsv","openshift-multus/network-metrics-daemon-58jkf","openshift-network-diagnostics/network-check-target-lxpnk","kube-system/global-pull-secret-syncer-4jp9j","kube-system/konnectivity-agent-wx4t4","kube-system/kube-apiserver-proxy-ip-10-0-135-242.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlr5p","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-242.ec2.internal","openshift-network-operator/iptables-alerter-hgjd8","openshift-ovn-kubernetes/ovnkube-node-849cq","openshift-cluster-node-tuning-operator/tuned-v9qlk","openshift-dns/node-resolver-qptg9","openshift-image-registry/node-ca-dnwpn"] Jun 03 23:24:41.585007 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.584983 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hgjd8" Jun 03 23:24:41.586084 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.586062 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qptg9" Jun 03 23:24:41.587207 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.587186 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 23:24:41.587332 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.587268 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58jkf" Jun 03 23:24:41.587390 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:41.587365 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58jkf" podUID="38c2283b-dc88-4292-9e56-50e1e5da9064" Jun 03 23:24:41.587815 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.587795 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 23:24:41.587909 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.587824 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 23:24:41.587968 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.587824 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 23:24:41.587968 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.587928 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-w8259\"" Jun 03 23:24:41.588584 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.588567 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 23:24:41.588773 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.588746 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxpnk" Jun 03 23:24:41.588858 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:41.588812 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxpnk" podUID="0a3d3d7c-0aa1-4223-9892-ed05eaf7062f" Jun 03 23:24:41.589161 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.589144 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9x8hg\"" Jun 03 23:24:41.589251 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.589165 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 23:24:41.590064 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.590046 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jp9j" Jun 03 23:24:41.590159 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:41.590111 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jp9j" podUID="83566a98-4a00-49eb-8108-30162d78adc8" Jun 03 23:24:41.591272 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.591198 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wx4t4" Jun 03 23:24:41.592452 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.592436 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dnwpn" Jun 03 23:24:41.593995 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.593976 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 23:24:41.594086 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.594014 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 23:24:41.594086 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.594071 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlr5p" Jun 03 23:24:41.594193 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.594127 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rmxns\"" Jun 03 23:24:41.595324 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.595307 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jcmsv" Jun 03 23:24:41.595430 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.595412 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 23:24:41.595785 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.595771 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zhz7d\"" Jun 03 23:24:41.595863 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.595826 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 23:24:41.596000 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.595980 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 23:24:41.596254 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.596213 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 23:24:41.596724 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.596704 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 23:24:41.596806 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.596725 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 23:24:41.596863 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.596704 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gf5bl\"" Jun 03 23:24:41.597230 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.597210 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z7b5v" Jun 03 23:24:41.597993 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.597966 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 23:24:41.598074 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.598012 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 23:24:41.598262 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.598233 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-q2x7q\"" Jun 03 23:24:41.598262 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.598250 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 23:24:41.598814 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.598790 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.599015 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.598997 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 23:24:41.599082 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.599025 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a356b3d4-861f-42af-992c-a984488ad7f0-host-slash\") pod \"iptables-alerter-hgjd8\" (UID: \"a356b3d4-861f-42af-992c-a984488ad7f0\") " pod="openshift-network-operator/iptables-alerter-hgjd8" Jun 03 23:24:41.599135 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.599080 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e8eb806c-295f-4b08-ad92-6ceef3b2a7b8-hosts-file\") pod \"node-resolver-qptg9\" (UID: \"e8eb806c-295f-4b08-ad92-6ceef3b2a7b8\") " pod="openshift-dns/node-resolver-qptg9" Jun 03 23:24:41.599135 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.599114 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nkhk\" (UniqueName: \"kubernetes.io/projected/0a3d3d7c-0aa1-4223-9892-ed05eaf7062f-kube-api-access-6nkhk\") pod \"network-check-target-lxpnk\" (UID: \"0a3d3d7c-0aa1-4223-9892-ed05eaf7062f\") " pod="openshift-network-diagnostics/network-check-target-lxpnk" Jun 03 23:24:41.599230 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.599142 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvtvd\" (UniqueName: \"kubernetes.io/projected/a356b3d4-861f-42af-992c-a984488ad7f0-kube-api-access-mvtvd\") pod \"iptables-alerter-hgjd8\" (UID: \"a356b3d4-861f-42af-992c-a984488ad7f0\") " pod="openshift-network-operator/iptables-alerter-hgjd8" Jun 03 23:24:41.599230 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.599171 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8eb806c-295f-4b08-ad92-6ceef3b2a7b8-tmp-dir\") pod \"node-resolver-qptg9\" (UID: \"e8eb806c-295f-4b08-ad92-6ceef3b2a7b8\") " pod="openshift-dns/node-resolver-qptg9" Jun 03 23:24:41.599230 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.599198 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r4gk\" (UniqueName: \"kubernetes.io/projected/e8eb806c-295f-4b08-ad92-6ceef3b2a7b8-kube-api-access-2r4gk\") pod \"node-resolver-qptg9\" (UID: \"e8eb806c-295f-4b08-ad92-6ceef3b2a7b8\") " pod="openshift-dns/node-resolver-qptg9" Jun 03 23:24:41.599230 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.599224 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38c2283b-dc88-4292-9e56-50e1e5da9064-metrics-certs\") pod \"network-metrics-daemon-58jkf\" (UID: \"38c2283b-dc88-4292-9e56-50e1e5da9064\") " pod="openshift-multus/network-metrics-daemon-58jkf" Jun 03 23:24:41.599446 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.599250 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcrn6\" (UniqueName: \"kubernetes.io/projected/38c2283b-dc88-4292-9e56-50e1e5da9064-kube-api-access-qcrn6\") pod \"network-metrics-daemon-58jkf\" (UID: \"38c2283b-dc88-4292-9e56-50e1e5da9064\") " pod="openshift-multus/network-metrics-daemon-58jkf" Jun 03 23:24:41.599446 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.599356 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a356b3d4-861f-42af-992c-a984488ad7f0-iptables-alerter-script\") pod \"iptables-alerter-hgjd8\" (UID: \"a356b3d4-861f-42af-992c-a984488ad7f0\") " pod="openshift-network-operator/iptables-alerter-hgjd8" Jun 03 23:24:41.600385 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.600206 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 23:24:41.600385 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.600242 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 23:24:41.600549 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.600478 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-v9qlk" Jun 03 23:24:41.600717 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.600549 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 23:24:41.600942 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.600924 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-t6xsr\"" Jun 03 23:24:41.601336 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.601316 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 23:24:41.601732 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.601690 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 23:24:41.601732 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.601731 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8mp4b\"" Jun 03 23:24:41.602008 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.601988 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 23:24:41.602071 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.601991 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 23:24:41.602071 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.601996 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 23:24:41.602337 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.602321 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 23:24:41.603416 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.603399 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 23:24:41.607232 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.604879 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 23:24:41.607232 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.604963 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 23:24:41.607232 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.606803 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qcz9h\"" Jun 03 23:24:41.623087 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.623066 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-lmsfd" Jun 03 23:24:41.631372 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.631342 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-lmsfd" Jun 03 23:24:41.688631 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.688604 2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 03 23:24:41.699940 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.699911 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/11967a41-0e69-4bbf-b847-a3d252607410-host-var-lib-cni-bin\") pod \"multus-jcmsv\" (UID: \"11967a41-0e69-4bbf-b847-a3d252607410\") " pod="openshift-multus/multus-jcmsv" Jun 03 23:24:41.700111 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.699951 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11967a41-0e69-4bbf-b847-a3d252607410-etc-kubernetes\") pod \"multus-jcmsv\" (UID: \"11967a41-0e69-4bbf-b847-a3d252607410\") " pod="openshift-multus/multus-jcmsv" Jun 03 23:24:41.700111 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.699978 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0c0ffebc-b272-4e11-892a-08a3acb3f38f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wlr5p\" (UID: \"0c0ffebc-b272-4e11-892a-08a3acb3f38f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlr5p" Jun 03 23:24:41.700111 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.700005 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k5lf\" (UniqueName: \"kubernetes.io/projected/0c0ffebc-b272-4e11-892a-08a3acb3f38f-kube-api-access-4k5lf\") pod \"aws-ebs-csi-driver-node-wlr5p\" (UID: \"0c0ffebc-b272-4e11-892a-08a3acb3f38f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlr5p" Jun 03 23:24:41.700111 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.700041 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ef7191e9-242f-489c-bb31-a2d21da56948-log-socket\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.700111 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.700088 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a356b3d4-861f-42af-992c-a984488ad7f0-iptables-alerter-script\") pod \"iptables-alerter-hgjd8\" (UID: \"a356b3d4-861f-42af-992c-a984488ad7f0\") " pod="openshift-network-operator/iptables-alerter-hgjd8" Jun 03 23:24:41.700111 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.700109 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d5046da1-6cac-4c88-9646-5f473d81cf36-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z7b5v\" (UID: \"d5046da1-6cac-4c88-9646-5f473d81cf36\") " pod="openshift-multus/multus-additional-cni-plugins-z7b5v" Jun 03 23:24:41.700440 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.700126 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef7191e9-242f-489c-bb31-a2d21da56948-run-openvswitch\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.700440 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.700148 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8aea005b-187c-4420-aa1f-aaee5e65b264-etc-kubernetes\") pod \"tuned-v9qlk\" (UID: \"8aea005b-187c-4420-aa1f-aaee5e65b264\") " pod="openshift-cluster-node-tuning-operator/tuned-v9qlk" Jun 03 23:24:41.700440 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.700169 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8aea005b-187c-4420-aa1f-aaee5e65b264-sys\") pod \"tuned-v9qlk\" (UID: \"8aea005b-187c-4420-aa1f-aaee5e65b264\") " pod="openshift-cluster-node-tuning-operator/tuned-v9qlk" Jun 03 23:24:41.700440 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.700191 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8aea005b-187c-4420-aa1f-aaee5e65b264-host\") pod \"tuned-v9qlk\" (UID: \"8aea005b-187c-4420-aa1f-aaee5e65b264\") " pod="openshift-cluster-node-tuning-operator/tuned-v9qlk" Jun 03 23:24:41.700440 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.700211 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m26bl\" (UniqueName: \"kubernetes.io/projected/8aea005b-187c-4420-aa1f-aaee5e65b264-kube-api-access-m26bl\") pod \"tuned-v9qlk\" (UID: \"8aea005b-187c-4420-aa1f-aaee5e65b264\") " pod="openshift-cluster-node-tuning-operator/tuned-v9qlk" Jun 03 23:24:41.700440 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.700253 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/11967a41-0e69-4bbf-b847-a3d252607410-cni-binary-copy\") pod \"multus-jcmsv\" (UID: \"11967a41-0e69-4bbf-b847-a3d252607410\") " pod="openshift-multus/multus-jcmsv" Jun 03 23:24:41.700440 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.700280 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvtvd\" (UniqueName: \"kubernetes.io/projected/a356b3d4-861f-42af-992c-a984488ad7f0-kube-api-access-mvtvd\") pod \"iptables-alerter-hgjd8\" (UID: \"a356b3d4-861f-42af-992c-a984488ad7f0\") " pod="openshift-network-operator/iptables-alerter-hgjd8" Jun 03 23:24:41.700440 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.700341 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38c2283b-dc88-4292-9e56-50e1e5da9064-metrics-certs\") pod \"network-metrics-daemon-58jkf\" (UID: \"38c2283b-dc88-4292-9e56-50e1e5da9064\") " pod="openshift-multus/network-metrics-daemon-58jkf" Jun 03 23:24:41.700813 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.700439 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9fec56be-cb0f-4e01-9e51-aa62afa1499d-konnectivity-ca\") pod \"konnectivity-agent-wx4t4\" (UID: \"9fec56be-cb0f-4e01-9e51-aa62afa1499d\") " pod="kube-system/konnectivity-agent-wx4t4" Jun 03 23:24:41.700813 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:41.700507 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:24:41.700813 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.700550 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/35356266-b28e-48fb-b508-a661319c50b1-serviceca\") pod \"node-ca-dnwpn\" (UID: \"35356266-b28e-48fb-b508-a661319c50b1\") " pod="openshift-image-registry/node-ca-dnwpn" Jun 03 23:24:41.700813 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:41.700596 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38c2283b-dc88-4292-9e56-50e1e5da9064-metrics-certs podName:38c2283b-dc88-4292-9e56-50e1e5da9064 nodeName:}" failed. No retries permitted until 2026-06-03 23:24:42.200573164 +0000 UTC m=+3.007793617 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38c2283b-dc88-4292-9e56-50e1e5da9064-metrics-certs") pod "network-metrics-daemon-58jkf" (UID: "38c2283b-dc88-4292-9e56-50e1e5da9064") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:24:41.700813 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.700620 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/83566a98-4a00-49eb-8108-30162d78adc8-kubelet-config\") pod \"global-pull-secret-syncer-4jp9j\" (UID: \"83566a98-4a00-49eb-8108-30162d78adc8\") " pod="kube-system/global-pull-secret-syncer-4jp9j" Jun 03 23:24:41.700813 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.700642 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/83566a98-4a00-49eb-8108-30162d78adc8-original-pull-secret\") pod \"global-pull-secret-syncer-4jp9j\" (UID: \"83566a98-4a00-49eb-8108-30162d78adc8\") " pod="kube-system/global-pull-secret-syncer-4jp9j" Jun 03 23:24:41.700813 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.700659 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d5046da1-6cac-4c88-9646-5f473d81cf36-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z7b5v\" (UID: \"d5046da1-6cac-4c88-9646-5f473d81cf36\") " pod="openshift-multus/multus-additional-cni-plugins-z7b5v" Jun 03 23:24:41.700813 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.700680 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/11967a41-0e69-4bbf-b847-a3d252607410-system-cni-dir\") pod \"multus-jcmsv\" (UID: \"11967a41-0e69-4bbf-b847-a3d252607410\") " pod="openshift-multus/multus-jcmsv" Jun 03 23:24:41.700813 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.700704 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/11967a41-0e69-4bbf-b847-a3d252607410-cnibin\") pod \"multus-jcmsv\" (UID: \"11967a41-0e69-4bbf-b847-a3d252607410\") " pod="openshift-multus/multus-jcmsv" Jun 03 23:24:41.700813 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.700721 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a356b3d4-861f-42af-992c-a984488ad7f0-iptables-alerter-script\") pod \"iptables-alerter-hgjd8\" (UID: \"a356b3d4-861f-42af-992c-a984488ad7f0\") " pod="openshift-network-operator/iptables-alerter-hgjd8" Jun 03 23:24:41.700813 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.700727 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d5046da1-6cac-4c88-9646-5f473d81cf36-cni-binary-copy\") pod \"multus-additional-cni-plugins-z7b5v\" (UID: \"d5046da1-6cac-4c88-9646-5f473d81cf36\") " pod="openshift-multus/multus-additional-cni-plugins-z7b5v" Jun 03 23:24:41.700813 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.700742 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef7191e9-242f-489c-bb31-a2d21da56948-host-cni-bin\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.700813 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.700774 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ef7191e9-242f-489c-bb31-a2d21da56948-host-cni-netd\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.700813 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.700806 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ef7191e9-242f-489c-bb31-a2d21da56948-ovn-node-metrics-cert\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.701488 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.700838 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8aea005b-187c-4420-aa1f-aaee5e65b264-etc-sysctl-conf\") pod \"tuned-v9qlk\" (UID: \"8aea005b-187c-4420-aa1f-aaee5e65b264\") " pod="openshift-cluster-node-tuning-operator/tuned-v9qlk" Jun 03 23:24:41.701488 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.700861 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8aea005b-187c-4420-aa1f-aaee5e65b264-tmp\") pod \"tuned-v9qlk\" (UID: \"8aea005b-187c-4420-aa1f-aaee5e65b264\") " pod="openshift-cluster-node-tuning-operator/tuned-v9qlk" Jun 03 23:24:41.701488 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.700885 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/11967a41-0e69-4bbf-b847-a3d252607410-host-var-lib-kubelet\") pod \"multus-jcmsv\" (UID: \"11967a41-0e69-4bbf-b847-a3d252607410\") " pod="openshift-multus/multus-jcmsv" Jun 03 23:24:41.701488 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.700924 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5046da1-6cac-4c88-9646-5f473d81cf36-system-cni-dir\") pod \"multus-additional-cni-plugins-z7b5v\" (UID: \"d5046da1-6cac-4c88-9646-5f473d81cf36\") " pod="openshift-multus/multus-additional-cni-plugins-z7b5v" Jun 03 23:24:41.701488 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.700962 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d5046da1-6cac-4c88-9646-5f473d81cf36-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z7b5v\" (UID: \"d5046da1-6cac-4c88-9646-5f473d81cf36\") " pod="openshift-multus/multus-additional-cni-plugins-z7b5v" Jun 03 23:24:41.701488 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.700991 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ef7191e9-242f-489c-bb31-a2d21da56948-run-systemd\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.701488 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.701009 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ef7191e9-242f-489c-bb31-a2d21da56948-env-overrides\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.701488 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.701031 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8aea005b-187c-4420-aa1f-aaee5e65b264-etc-modprobe-d\") pod \"tuned-v9qlk\" (UID: \"8aea005b-187c-4420-aa1f-aaee5e65b264\") " pod="openshift-cluster-node-tuning-operator/tuned-v9qlk" Jun 03 23:24:41.701488 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.701047 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9fec56be-cb0f-4e01-9e51-aa62afa1499d-agent-certs\") pod \"konnectivity-agent-wx4t4\" (UID: \"9fec56be-cb0f-4e01-9e51-aa62afa1499d\") " pod="kube-system/konnectivity-agent-wx4t4" Jun 03 23:24:41.701488 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.701061 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/35356266-b28e-48fb-b508-a661319c50b1-host\") pod \"node-ca-dnwpn\" (UID: \"35356266-b28e-48fb-b508-a661319c50b1\") " pod="openshift-image-registry/node-ca-dnwpn" Jun 03 23:24:41.701488 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.701075 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/11967a41-0e69-4bbf-b847-a3d252607410-hostroot\") pod \"multus-jcmsv\" (UID: \"11967a41-0e69-4bbf-b847-a3d252607410\") " pod="openshift-multus/multus-jcmsv" Jun 03 23:24:41.701488 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.701090 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tm48v\" (UniqueName: \"kubernetes.io/projected/11967a41-0e69-4bbf-b847-a3d252607410-kube-api-access-tm48v\") pod \"multus-jcmsv\" (UID: \"11967a41-0e69-4bbf-b847-a3d252607410\") " pod="openshift-multus/multus-jcmsv" Jun 03 23:24:41.701488 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.701111 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef7191e9-242f-489c-bb31-a2d21da56948-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.701488 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.701165 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ef7191e9-242f-489c-bb31-a2d21da56948-ovnkube-script-lib\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.701488 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.701211 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r4gk\" (UniqueName: \"kubernetes.io/projected/e8eb806c-295f-4b08-ad92-6ceef3b2a7b8-kube-api-access-2r4gk\") pod \"node-resolver-qptg9\" (UID: \"e8eb806c-295f-4b08-ad92-6ceef3b2a7b8\") " pod="openshift-dns/node-resolver-qptg9" Jun 03 23:24:41.701488 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.701236 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/11967a41-0e69-4bbf-b847-a3d252607410-host-run-multus-certs\") pod \"multus-jcmsv\" (UID: \"11967a41-0e69-4bbf-b847-a3d252607410\") " pod="openshift-multus/multus-jcmsv" Jun 03 23:24:41.702226 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.701256 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0c0ffebc-b272-4e11-892a-08a3acb3f38f-device-dir\") pod \"aws-ebs-csi-driver-node-wlr5p\" (UID: \"0c0ffebc-b272-4e11-892a-08a3acb3f38f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlr5p" Jun 03 23:24:41.702226 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.701278 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0c0ffebc-b272-4e11-892a-08a3acb3f38f-sys-fs\") pod \"aws-ebs-csi-driver-node-wlr5p\" (UID: \"0c0ffebc-b272-4e11-892a-08a3acb3f38f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlr5p" Jun 03 23:24:41.702226 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.701315 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ef7191e9-242f-489c-bb31-a2d21da56948-systemd-units\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.702226 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.701341 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8aea005b-187c-4420-aa1f-aaee5e65b264-etc-sysconfig\") pod \"tuned-v9qlk\" (UID: \"8aea005b-187c-4420-aa1f-aaee5e65b264\") " pod="openshift-cluster-node-tuning-operator/tuned-v9qlk" Jun 03 23:24:41.702226 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.701360 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/11967a41-0e69-4bbf-b847-a3d252607410-host-run-netns\") pod \"multus-jcmsv\" (UID: \"11967a41-0e69-4bbf-b847-a3d252607410\") " pod="openshift-multus/multus-jcmsv" Jun 03 23:24:41.702226 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.701385 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e8eb806c-295f-4b08-ad92-6ceef3b2a7b8-hosts-file\") pod \"node-resolver-qptg9\" (UID: \"e8eb806c-295f-4b08-ad92-6ceef3b2a7b8\") " pod="openshift-dns/node-resolver-qptg9" Jun 03 23:24:41.702226 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.701404 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef7191e9-242f-489c-bb31-a2d21da56948-host-run-netns\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.702226 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.701419 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxp7t\" (UniqueName: \"kubernetes.io/projected/ef7191e9-242f-489c-bb31-a2d21da56948-kube-api-access-lxp7t\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.702226 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.701461 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8aea005b-187c-4420-aa1f-aaee5e65b264-etc-sysctl-d\") pod \"tuned-v9qlk\" (UID: \"8aea005b-187c-4420-aa1f-aaee5e65b264\") " pod="openshift-cluster-node-tuning-operator/tuned-v9qlk" Jun 03 23:24:41.702226 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.701483 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8aea005b-187c-4420-aa1f-aaee5e65b264-var-lib-kubelet\") pod \"tuned-v9qlk\" (UID: \"8aea005b-187c-4420-aa1f-aaee5e65b264\") " pod="openshift-cluster-node-tuning-operator/tuned-v9qlk" Jun 03 23:24:41.702226 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.701486 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e8eb806c-295f-4b08-ad92-6ceef3b2a7b8-hosts-file\") pod \"node-resolver-qptg9\" (UID: \"e8eb806c-295f-4b08-ad92-6ceef3b2a7b8\") " pod="openshift-dns/node-resolver-qptg9" Jun 03 23:24:41.702226 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.701505 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8eb806c-295f-4b08-ad92-6ceef3b2a7b8-tmp-dir\") pod \"node-resolver-qptg9\" (UID: \"e8eb806c-295f-4b08-ad92-6ceef3b2a7b8\") " pod="openshift-dns/node-resolver-qptg9" Jun 03 23:24:41.702226 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.701541 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/11967a41-0e69-4bbf-b847-a3d252607410-host-run-k8s-cni-cncf-io\") pod \"multus-jcmsv\" (UID: \"11967a41-0e69-4bbf-b847-a3d252607410\") " pod="openshift-multus/multus-jcmsv" Jun 03 23:24:41.702226 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.701564 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/11967a41-0e69-4bbf-b847-a3d252607410-multus-daemon-config\") pod \"multus-jcmsv\" (UID: \"11967a41-0e69-4bbf-b847-a3d252607410\") " pod="openshift-multus/multus-jcmsv" Jun 03 23:24:41.702226 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.701586 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0c0ffebc-b272-4e11-892a-08a3acb3f38f-socket-dir\") pod \"aws-ebs-csi-driver-node-wlr5p\" (UID: \"0c0ffebc-b272-4e11-892a-08a3acb3f38f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlr5p" Jun 03 23:24:41.702226 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.701616 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d5046da1-6cac-4c88-9646-5f473d81cf36-os-release\") pod \"multus-additional-cni-plugins-z7b5v\" (UID: \"d5046da1-6cac-4c88-9646-5f473d81cf36\") " pod="openshift-multus/multus-additional-cni-plugins-z7b5v" Jun 03 23:24:41.702226 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.701635 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef7191e9-242f-489c-bb31-a2d21da56948-host-kubelet\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.702919 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.701655 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef7191e9-242f-489c-bb31-a2d21da56948-var-lib-openvswitch\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.702919 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.701676 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/11967a41-0e69-4bbf-b847-a3d252607410-multus-socket-dir-parent\") pod \"multus-jcmsv\" (UID: \"11967a41-0e69-4bbf-b847-a3d252607410\") " pod="openshift-multus/multus-jcmsv" Jun 03 23:24:41.702919 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.701709 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/11967a41-0e69-4bbf-b847-a3d252607410-host-var-lib-cni-multus\") pod \"multus-jcmsv\" (UID: \"11967a41-0e69-4bbf-b847-a3d252607410\") " pod="openshift-multus/multus-jcmsv" Jun 03 23:24:41.702919 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.701746 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8aea005b-187c-4420-aa1f-aaee5e65b264-etc-tuned\") pod \"tuned-v9qlk\" (UID: \"8aea005b-187c-4420-aa1f-aaee5e65b264\") " pod="openshift-cluster-node-tuning-operator/tuned-v9qlk" Jun 03 23:24:41.702919 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.701774 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcrn6\" (UniqueName: \"kubernetes.io/projected/38c2283b-dc88-4292-9e56-50e1e5da9064-kube-api-access-qcrn6\") pod \"network-metrics-daemon-58jkf\" (UID: \"38c2283b-dc88-4292-9e56-50e1e5da9064\") " pod="openshift-multus/network-metrics-daemon-58jkf" Jun 03 23:24:41.702919 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.701823 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8eb806c-295f-4b08-ad92-6ceef3b2a7b8-tmp-dir\") pod \"node-resolver-qptg9\" (UID: \"e8eb806c-295f-4b08-ad92-6ceef3b2a7b8\") " pod="openshift-dns/node-resolver-qptg9" Jun 03 23:24:41.702919 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.701833 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/11967a41-0e69-4bbf-b847-a3d252607410-os-release\") pod \"multus-jcmsv\" (UID: \"11967a41-0e69-4bbf-b847-a3d252607410\") " pod="openshift-multus/multus-jcmsv" Jun 03 23:24:41.702919 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.701951 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/83566a98-4a00-49eb-8108-30162d78adc8-dbus\") pod \"global-pull-secret-syncer-4jp9j\" (UID: \"83566a98-4a00-49eb-8108-30162d78adc8\") " pod="kube-system/global-pull-secret-syncer-4jp9j" Jun 03 23:24:41.702919 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.701993 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwrcm\" (UniqueName: \"kubernetes.io/projected/d5046da1-6cac-4c88-9646-5f473d81cf36-kube-api-access-gwrcm\") pod \"multus-additional-cni-plugins-z7b5v\" (UID: \"d5046da1-6cac-4c88-9646-5f473d81cf36\") " pod="openshift-multus/multus-additional-cni-plugins-z7b5v" Jun 03 23:24:41.702919 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.702021 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a356b3d4-861f-42af-992c-a984488ad7f0-host-slash\") pod \"iptables-alerter-hgjd8\" (UID: \"a356b3d4-861f-42af-992c-a984488ad7f0\") " pod="openshift-network-operator/iptables-alerter-hgjd8" Jun 03 23:24:41.702919 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.702059 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0c0ffebc-b272-4e11-892a-08a3acb3f38f-registration-dir\") pod \"aws-ebs-csi-driver-node-wlr5p\" (UID: \"0c0ffebc-b272-4e11-892a-08a3acb3f38f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlr5p" Jun 03 23:24:41.702919 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.702093 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ef7191e9-242f-489c-bb31-a2d21da56948-host-slash\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.702919 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.702115 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a356b3d4-861f-42af-992c-a984488ad7f0-host-slash\") pod \"iptables-alerter-hgjd8\" (UID: \"a356b3d4-861f-42af-992c-a984488ad7f0\") " pod="openshift-network-operator/iptables-alerter-hgjd8" Jun 03 23:24:41.702919 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.702121 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ef7191e9-242f-489c-bb31-a2d21da56948-run-ovn\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.702919 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.702157 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0c0ffebc-b272-4e11-892a-08a3acb3f38f-etc-selinux\") pod \"aws-ebs-csi-driver-node-wlr5p\" (UID: \"0c0ffebc-b272-4e11-892a-08a3acb3f38f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlr5p" Jun 03 23:24:41.702919 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.702184 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d5046da1-6cac-4c88-9646-5f473d81cf36-cnibin\") pod \"multus-additional-cni-plugins-z7b5v\" (UID: \"d5046da1-6cac-4c88-9646-5f473d81cf36\") " pod="openshift-multus/multus-additional-cni-plugins-z7b5v" Jun 03 23:24:41.703391 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.702199 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef7191e9-242f-489c-bb31-a2d21da56948-host-run-ovn-kubernetes\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.703391 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.702213 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ef7191e9-242f-489c-bb31-a2d21da56948-ovnkube-config\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.703391 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.702228 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8aea005b-187c-4420-aa1f-aaee5e65b264-run\") pod \"tuned-v9qlk\" (UID: \"8aea005b-187c-4420-aa1f-aaee5e65b264\") " pod="openshift-cluster-node-tuning-operator/tuned-v9qlk" Jun 03 23:24:41.703391 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.702256 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ef7191e9-242f-489c-bb31-a2d21da56948-node-log\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.703391 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.702279 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nkhk\" (UniqueName: \"kubernetes.io/projected/0a3d3d7c-0aa1-4223-9892-ed05eaf7062f-kube-api-access-6nkhk\") pod \"network-check-target-lxpnk\" (UID: \"0a3d3d7c-0aa1-4223-9892-ed05eaf7062f\") " pod="openshift-network-diagnostics/network-check-target-lxpnk" Jun 03 23:24:41.703391 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.702314 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef7191e9-242f-489c-bb31-a2d21da56948-etc-openvswitch\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.703391 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.702332 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8aea005b-187c-4420-aa1f-aaee5e65b264-lib-modules\") pod \"tuned-v9qlk\" (UID: \"8aea005b-187c-4420-aa1f-aaee5e65b264\") " pod="openshift-cluster-node-tuning-operator/tuned-v9qlk" Jun 03 23:24:41.703391 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.702346 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8j7c2\" (UniqueName: \"kubernetes.io/projected/35356266-b28e-48fb-b508-a661319c50b1-kube-api-access-8j7c2\") pod \"node-ca-dnwpn\" (UID: \"35356266-b28e-48fb-b508-a661319c50b1\") " pod="openshift-image-registry/node-ca-dnwpn" Jun 03 23:24:41.703391 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.702377 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/11967a41-0e69-4bbf-b847-a3d252607410-multus-cni-dir\") pod \"multus-jcmsv\" (UID: \"11967a41-0e69-4bbf-b847-a3d252607410\") " pod="openshift-multus/multus-jcmsv" Jun 03 23:24:41.703391 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.702421 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/11967a41-0e69-4bbf-b847-a3d252607410-multus-conf-dir\") pod \"multus-jcmsv\" (UID: \"11967a41-0e69-4bbf-b847-a3d252607410\") " pod="openshift-multus/multus-jcmsv" Jun 03 23:24:41.703391 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.702443 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8aea005b-187c-4420-aa1f-aaee5e65b264-etc-systemd\") pod \"tuned-v9qlk\" (UID: \"8aea005b-187c-4420-aa1f-aaee5e65b264\") " pod="openshift-cluster-node-tuning-operator/tuned-v9qlk" Jun 03 23:24:41.707056 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.707022 2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 23:24:41.708005 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:41.707986 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 23:24:41.708109 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:41.708011 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 23:24:41.708109 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:41.708025 2574 projected.go:196] Error preparing data for projected volume kube-api-access-6nkhk for pod openshift-network-diagnostics/network-check-target-lxpnk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:24:41.708109 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:41.708084 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a3d3d7c-0aa1-4223-9892-ed05eaf7062f-kube-api-access-6nkhk podName:0a3d3d7c-0aa1-4223-9892-ed05eaf7062f nodeName:}" failed. No retries permitted until 2026-06-03 23:24:42.208067 +0000 UTC m=+3.015287446 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6nkhk" (UniqueName: "kubernetes.io/projected/0a3d3d7c-0aa1-4223-9892-ed05eaf7062f-kube-api-access-6nkhk") pod "network-check-target-lxpnk" (UID: "0a3d3d7c-0aa1-4223-9892-ed05eaf7062f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:24:41.710107 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.710073 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvtvd\" (UniqueName: \"kubernetes.io/projected/a356b3d4-861f-42af-992c-a984488ad7f0-kube-api-access-mvtvd\") pod \"iptables-alerter-hgjd8\" (UID: \"a356b3d4-861f-42af-992c-a984488ad7f0\") " pod="openshift-network-operator/iptables-alerter-hgjd8" Jun 03 23:24:41.710107 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.710090 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r4gk\" (UniqueName: \"kubernetes.io/projected/e8eb806c-295f-4b08-ad92-6ceef3b2a7b8-kube-api-access-2r4gk\") pod \"node-resolver-qptg9\" (UID: \"e8eb806c-295f-4b08-ad92-6ceef3b2a7b8\") " pod="openshift-dns/node-resolver-qptg9" Jun 03 23:24:41.710275 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.710063 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcrn6\" (UniqueName: \"kubernetes.io/projected/38c2283b-dc88-4292-9e56-50e1e5da9064-kube-api-access-qcrn6\") pod \"network-metrics-daemon-58jkf\" (UID: \"38c2283b-dc88-4292-9e56-50e1e5da9064\") " pod="openshift-multus/network-metrics-daemon-58jkf" Jun 03 23:24:41.802817 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.802775 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/11967a41-0e69-4bbf-b847-a3d252607410-multus-conf-dir\") pod \"multus-jcmsv\" (UID: \"11967a41-0e69-4bbf-b847-a3d252607410\") " pod="openshift-multus/multus-jcmsv" Jun 03 23:24:41.802817 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.802811 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8aea005b-187c-4420-aa1f-aaee5e65b264-etc-systemd\") pod \"tuned-v9qlk\" (UID: \"8aea005b-187c-4420-aa1f-aaee5e65b264\") " pod="openshift-cluster-node-tuning-operator/tuned-v9qlk" Jun 03 23:24:41.803058 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.802838 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/11967a41-0e69-4bbf-b847-a3d252607410-host-var-lib-cni-bin\") pod \"multus-jcmsv\" (UID: \"11967a41-0e69-4bbf-b847-a3d252607410\") " pod="openshift-multus/multus-jcmsv" Jun 03 23:24:41.803058 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.802863 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11967a41-0e69-4bbf-b847-a3d252607410-etc-kubernetes\") pod \"multus-jcmsv\" (UID: \"11967a41-0e69-4bbf-b847-a3d252607410\") " pod="openshift-multus/multus-jcmsv" Jun 03 23:24:41.803058 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.802877 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/11967a41-0e69-4bbf-b847-a3d252607410-multus-conf-dir\") pod \"multus-jcmsv\" (UID: \"11967a41-0e69-4bbf-b847-a3d252607410\") " pod="openshift-multus/multus-jcmsv" Jun 03 23:24:41.803058 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.802918 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/11967a41-0e69-4bbf-b847-a3d252607410-host-var-lib-cni-bin\") pod \"multus-jcmsv\" (UID: \"11967a41-0e69-4bbf-b847-a3d252607410\") " pod="openshift-multus/multus-jcmsv" Jun 03 23:24:41.803058 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.802933 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8aea005b-187c-4420-aa1f-aaee5e65b264-etc-systemd\") pod \"tuned-v9qlk\" (UID: \"8aea005b-187c-4420-aa1f-aaee5e65b264\") " pod="openshift-cluster-node-tuning-operator/tuned-v9qlk" Jun 03 23:24:41.803058 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.802940 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0c0ffebc-b272-4e11-892a-08a3acb3f38f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wlr5p\" (UID: \"0c0ffebc-b272-4e11-892a-08a3acb3f38f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlr5p" Jun 03 23:24:41.803058 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.802887 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0c0ffebc-b272-4e11-892a-08a3acb3f38f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wlr5p\" (UID: \"0c0ffebc-b272-4e11-892a-08a3acb3f38f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlr5p" Jun 03 23:24:41.803058 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.803003 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k5lf\" (UniqueName: \"kubernetes.io/projected/0c0ffebc-b272-4e11-892a-08a3acb3f38f-kube-api-access-4k5lf\") pod \"aws-ebs-csi-driver-node-wlr5p\" (UID: \"0c0ffebc-b272-4e11-892a-08a3acb3f38f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlr5p" Jun 03 23:24:41.803058 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.802946 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11967a41-0e69-4bbf-b847-a3d252607410-etc-kubernetes\") pod \"multus-jcmsv\" (UID: \"11967a41-0e69-4bbf-b847-a3d252607410\") " pod="openshift-multus/multus-jcmsv" Jun 03 23:24:41.803058 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.803029 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ef7191e9-242f-489c-bb31-a2d21da56948-log-socket\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.803058 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.803055 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d5046da1-6cac-4c88-9646-5f473d81cf36-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z7b5v\" (UID: \"d5046da1-6cac-4c88-9646-5f473d81cf36\") " pod="openshift-multus/multus-additional-cni-plugins-z7b5v" Jun 03 23:24:41.803600 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.803083 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef7191e9-242f-489c-bb31-a2d21da56948-run-openvswitch\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.803600 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.803105 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8aea005b-187c-4420-aa1f-aaee5e65b264-etc-kubernetes\") pod \"tuned-v9qlk\" (UID: \"8aea005b-187c-4420-aa1f-aaee5e65b264\") " pod="openshift-cluster-node-tuning-operator/tuned-v9qlk" Jun 03 23:24:41.803600 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.803126 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8aea005b-187c-4420-aa1f-aaee5e65b264-sys\") pod \"tuned-v9qlk\" (UID: \"8aea005b-187c-4420-aa1f-aaee5e65b264\") " pod="openshift-cluster-node-tuning-operator/tuned-v9qlk" Jun 03 23:24:41.803600 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.803148 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8aea005b-187c-4420-aa1f-aaee5e65b264-host\") pod \"tuned-v9qlk\" (UID: \"8aea005b-187c-4420-aa1f-aaee5e65b264\") " pod="openshift-cluster-node-tuning-operator/tuned-v9qlk" Jun 03 23:24:41.803600 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.803191 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef7191e9-242f-489c-bb31-a2d21da56948-run-openvswitch\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.803600 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.803209 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8aea005b-187c-4420-aa1f-aaee5e65b264-host\") pod \"tuned-v9qlk\" (UID: \"8aea005b-187c-4420-aa1f-aaee5e65b264\") " pod="openshift-cluster-node-tuning-operator/tuned-v9qlk" Jun 03 23:24:41.803600 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.803218 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m26bl\" (UniqueName: \"kubernetes.io/projected/8aea005b-187c-4420-aa1f-aaee5e65b264-kube-api-access-m26bl\") pod \"tuned-v9qlk\" (UID: \"8aea005b-187c-4420-aa1f-aaee5e65b264\") " pod="openshift-cluster-node-tuning-operator/tuned-v9qlk" Jun 03 23:24:41.803600 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.803236 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/11967a41-0e69-4bbf-b847-a3d252607410-cni-binary-copy\") pod \"multus-jcmsv\" (UID: \"11967a41-0e69-4bbf-b847-a3d252607410\") " pod="openshift-multus/multus-jcmsv" Jun 03 23:24:41.803600 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.803268 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9fec56be-cb0f-4e01-9e51-aa62afa1499d-konnectivity-ca\") pod \"konnectivity-agent-wx4t4\" (UID: \"9fec56be-cb0f-4e01-9e51-aa62afa1499d\") " pod="kube-system/konnectivity-agent-wx4t4" Jun 03 23:24:41.803600 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.803271 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8aea005b-187c-4420-aa1f-aaee5e65b264-sys\") pod \"tuned-v9qlk\" (UID: \"8aea005b-187c-4420-aa1f-aaee5e65b264\") " pod="openshift-cluster-node-tuning-operator/tuned-v9qlk" Jun 03 23:24:41.803600 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.803284 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/35356266-b28e-48fb-b508-a661319c50b1-serviceca\") pod \"node-ca-dnwpn\" (UID: \"35356266-b28e-48fb-b508-a661319c50b1\") " pod="openshift-image-registry/node-ca-dnwpn" Jun 03 23:24:41.803600 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.803320 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/83566a98-4a00-49eb-8108-30162d78adc8-kubelet-config\") pod \"global-pull-secret-syncer-4jp9j\" (UID: \"83566a98-4a00-49eb-8108-30162d78adc8\") " pod="kube-system/global-pull-secret-syncer-4jp9j" Jun 03 23:24:41.803600 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.803324 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ef7191e9-242f-489c-bb31-a2d21da56948-log-socket\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.803600 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.803344 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/83566a98-4a00-49eb-8108-30162d78adc8-original-pull-secret\") pod \"global-pull-secret-syncer-4jp9j\" (UID: \"83566a98-4a00-49eb-8108-30162d78adc8\") " pod="kube-system/global-pull-secret-syncer-4jp9j" Jun 03 23:24:41.803600 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.803367 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d5046da1-6cac-4c88-9646-5f473d81cf36-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z7b5v\" (UID: \"d5046da1-6cac-4c88-9646-5f473d81cf36\") " pod="openshift-multus/multus-additional-cni-plugins-z7b5v" Jun 03 23:24:41.803600 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.803393 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/11967a41-0e69-4bbf-b847-a3d252607410-system-cni-dir\") pod \"multus-jcmsv\" (UID: \"11967a41-0e69-4bbf-b847-a3d252607410\") " pod="openshift-multus/multus-jcmsv" Jun 03 23:24:41.803600 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.803426 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/11967a41-0e69-4bbf-b847-a3d252607410-cnibin\") pod \"multus-jcmsv\" (UID: \"11967a41-0e69-4bbf-b847-a3d252607410\") " pod="openshift-multus/multus-jcmsv" Jun 03 23:24:41.803600 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.803449 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d5046da1-6cac-4c88-9646-5f473d81cf36-cni-binary-copy\") pod \"multus-additional-cni-plugins-z7b5v\" (UID: \"d5046da1-6cac-4c88-9646-5f473d81cf36\") " pod="openshift-multus/multus-additional-cni-plugins-z7b5v" Jun 03 23:24:41.804515 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.803464 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef7191e9-242f-489c-bb31-a2d21da56948-host-cni-bin\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.804515 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.803480 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ef7191e9-242f-489c-bb31-a2d21da56948-host-cni-netd\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.804515 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.803496 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ef7191e9-242f-489c-bb31-a2d21da56948-ovn-node-metrics-cert\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.804515 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.803503 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/83566a98-4a00-49eb-8108-30162d78adc8-kubelet-config\") pod \"global-pull-secret-syncer-4jp9j\" (UID: \"83566a98-4a00-49eb-8108-30162d78adc8\") " pod="kube-system/global-pull-secret-syncer-4jp9j" Jun 03 23:24:41.804515 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.803510 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8aea005b-187c-4420-aa1f-aaee5e65b264-etc-sysctl-conf\") pod \"tuned-v9qlk\" (UID: \"8aea005b-187c-4420-aa1f-aaee5e65b264\") " pod="openshift-cluster-node-tuning-operator/tuned-v9qlk" Jun 03 23:24:41.804515 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.803267 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8aea005b-187c-4420-aa1f-aaee5e65b264-etc-kubernetes\") pod \"tuned-v9qlk\" (UID: \"8aea005b-187c-4420-aa1f-aaee5e65b264\") " pod="openshift-cluster-node-tuning-operator/tuned-v9qlk" Jun 03 23:24:41.804515 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.803525 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8aea005b-187c-4420-aa1f-aaee5e65b264-tmp\") pod \"tuned-v9qlk\" (UID: \"8aea005b-187c-4420-aa1f-aaee5e65b264\") " pod="openshift-cluster-node-tuning-operator/tuned-v9qlk" Jun 03 23:24:41.804515 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.803540 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/11967a41-0e69-4bbf-b847-a3d252607410-host-var-lib-kubelet\") pod \"multus-jcmsv\" (UID: \"11967a41-0e69-4bbf-b847-a3d252607410\") " pod="openshift-multus/multus-jcmsv" Jun 03 23:24:41.804515 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.803554 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5046da1-6cac-4c88-9646-5f473d81cf36-system-cni-dir\") pod \"multus-additional-cni-plugins-z7b5v\" (UID: \"d5046da1-6cac-4c88-9646-5f473d81cf36\") " pod="openshift-multus/multus-additional-cni-plugins-z7b5v" Jun 03 23:24:41.804515 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.803570 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d5046da1-6cac-4c88-9646-5f473d81cf36-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z7b5v\" (UID: \"d5046da1-6cac-4c88-9646-5f473d81cf36\") " pod="openshift-multus/multus-additional-cni-plugins-z7b5v" Jun 03 23:24:41.804515 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.803585 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ef7191e9-242f-489c-bb31-a2d21da56948-run-systemd\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.804515 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.803600 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ef7191e9-242f-489c-bb31-a2d21da56948-env-overrides\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.804515 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.803620 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8aea005b-187c-4420-aa1f-aaee5e65b264-etc-modprobe-d\") pod \"tuned-v9qlk\" (UID: \"8aea005b-187c-4420-aa1f-aaee5e65b264\") " pod="openshift-cluster-node-tuning-operator/tuned-v9qlk" Jun 03 23:24:41.804515 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.803642 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9fec56be-cb0f-4e01-9e51-aa62afa1499d-agent-certs\") pod \"konnectivity-agent-wx4t4\" (UID: \"9fec56be-cb0f-4e01-9e51-aa62afa1499d\") " pod="kube-system/konnectivity-agent-wx4t4" Jun 03 23:24:41.804515 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.803655 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d5046da1-6cac-4c88-9646-5f473d81cf36-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z7b5v\" (UID: \"d5046da1-6cac-4c88-9646-5f473d81cf36\") " pod="openshift-multus/multus-additional-cni-plugins-z7b5v" Jun 03 23:24:41.804515 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.803663 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/35356266-b28e-48fb-b508-a661319c50b1-host\") pod \"node-ca-dnwpn\" (UID: \"35356266-b28e-48fb-b508-a661319c50b1\") " pod="openshift-image-registry/node-ca-dnwpn" Jun 03 23:24:41.804515 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.803696 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/11967a41-0e69-4bbf-b847-a3d252607410-hostroot\") pod \"multus-jcmsv\" (UID: \"11967a41-0e69-4bbf-b847-a3d252607410\") " pod="openshift-multus/multus-jcmsv" Jun 03 23:24:41.805262 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.803699 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/35356266-b28e-48fb-b508-a661319c50b1-host\") pod \"node-ca-dnwpn\" (UID: \"35356266-b28e-48fb-b508-a661319c50b1\") " pod="openshift-image-registry/node-ca-dnwpn" Jun 03 23:24:41.805262 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.803727 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm48v\" (UniqueName: \"kubernetes.io/projected/11967a41-0e69-4bbf-b847-a3d252607410-kube-api-access-tm48v\") pod \"multus-jcmsv\" (UID: \"11967a41-0e69-4bbf-b847-a3d252607410\") " pod="openshift-multus/multus-jcmsv" Jun 03 23:24:41.805262 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.803757 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef7191e9-242f-489c-bb31-a2d21da56948-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.805262 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.803785 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ef7191e9-242f-489c-bb31-a2d21da56948-ovnkube-script-lib\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.805262 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.803803 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/11967a41-0e69-4bbf-b847-a3d252607410-host-run-multus-certs\") pod \"multus-jcmsv\" (UID: \"11967a41-0e69-4bbf-b847-a3d252607410\") " pod="openshift-multus/multus-jcmsv" Jun 03 23:24:41.805262 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.803825 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0c0ffebc-b272-4e11-892a-08a3acb3f38f-device-dir\") pod \"aws-ebs-csi-driver-node-wlr5p\" (UID: \"0c0ffebc-b272-4e11-892a-08a3acb3f38f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlr5p" Jun 03 23:24:41.805262 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.803840 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0c0ffebc-b272-4e11-892a-08a3acb3f38f-sys-fs\") pod \"aws-ebs-csi-driver-node-wlr5p\" (UID: \"0c0ffebc-b272-4e11-892a-08a3acb3f38f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlr5p" Jun 03 23:24:41.805262 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.803855 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ef7191e9-242f-489c-bb31-a2d21da56948-systemd-units\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.805262 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.803869 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8aea005b-187c-4420-aa1f-aaee5e65b264-etc-sysconfig\") pod \"tuned-v9qlk\" (UID: \"8aea005b-187c-4420-aa1f-aaee5e65b264\") " pod="openshift-cluster-node-tuning-operator/tuned-v9qlk" Jun 03 23:24:41.805262 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:41.803764 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 23:24:41.805262 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.803924 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/11967a41-0e69-4bbf-b847-a3d252607410-host-run-netns\") pod \"multus-jcmsv\" (UID: \"11967a41-0e69-4bbf-b847-a3d252607410\") " pod="openshift-multus/multus-jcmsv" Jun 03 23:24:41.805262 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.803946 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/11967a41-0e69-4bbf-b847-a3d252607410-hostroot\") pod \"multus-jcmsv\" (UID: \"11967a41-0e69-4bbf-b847-a3d252607410\") " pod="openshift-multus/multus-jcmsv" Jun 03 23:24:41.805262 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:41.803969 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83566a98-4a00-49eb-8108-30162d78adc8-original-pull-secret podName:83566a98-4a00-49eb-8108-30162d78adc8 nodeName:}" failed. No retries permitted until 2026-06-03 23:24:42.303949726 +0000 UTC m=+3.111170170 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/83566a98-4a00-49eb-8108-30162d78adc8-original-pull-secret") pod "global-pull-secret-syncer-4jp9j" (UID: "83566a98-4a00-49eb-8108-30162d78adc8") : object "kube-system"/"original-pull-secret" not registered Jun 03 23:24:41.805262 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.803988 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef7191e9-242f-489c-bb31-a2d21da56948-host-run-netns\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.805262 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.804014 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef7191e9-242f-489c-bb31-a2d21da56948-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.805262 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.803908 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/11967a41-0e69-4bbf-b847-a3d252607410-cni-binary-copy\") pod \"multus-jcmsv\" (UID: \"11967a41-0e69-4bbf-b847-a3d252607410\") " pod="openshift-multus/multus-jcmsv" Jun 03 23:24:41.805262 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.804030 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/11967a41-0e69-4bbf-b847-a3d252607410-host-run-multus-certs\") pod \"multus-jcmsv\" (UID: \"11967a41-0e69-4bbf-b847-a3d252607410\") " pod="openshift-multus/multus-jcmsv" Jun 03 23:24:41.806081 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.804062 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0c0ffebc-b272-4e11-892a-08a3acb3f38f-device-dir\") pod \"aws-ebs-csi-driver-node-wlr5p\" (UID: \"0c0ffebc-b272-4e11-892a-08a3acb3f38f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlr5p" Jun 03 23:24:41.806081 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.804099 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0c0ffebc-b272-4e11-892a-08a3acb3f38f-sys-fs\") pod \"aws-ebs-csi-driver-node-wlr5p\" (UID: \"0c0ffebc-b272-4e11-892a-08a3acb3f38f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlr5p" Jun 03 23:24:41.806081 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.804121 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ef7191e9-242f-489c-bb31-a2d21da56948-systemd-units\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.806081 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.804149 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8aea005b-187c-4420-aa1f-aaee5e65b264-etc-sysconfig\") pod \"tuned-v9qlk\" (UID: \"8aea005b-187c-4420-aa1f-aaee5e65b264\") " pod="openshift-cluster-node-tuning-operator/tuned-v9qlk" Jun 03 23:24:41.806081 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.804185 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/11967a41-0e69-4bbf-b847-a3d252607410-host-run-netns\") pod \"multus-jcmsv\" (UID: \"11967a41-0e69-4bbf-b847-a3d252607410\") " pod="openshift-multus/multus-jcmsv" Jun 03 23:24:41.806081 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.803947 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef7191e9-242f-489c-bb31-a2d21da56948-host-run-netns\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.806081 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.804227 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxp7t\" (UniqueName: \"kubernetes.io/projected/ef7191e9-242f-489c-bb31-a2d21da56948-kube-api-access-lxp7t\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.806081 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.804252 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8aea005b-187c-4420-aa1f-aaee5e65b264-etc-sysctl-d\") pod \"tuned-v9qlk\" (UID: \"8aea005b-187c-4420-aa1f-aaee5e65b264\") " pod="openshift-cluster-node-tuning-operator/tuned-v9qlk" Jun 03 23:24:41.806081 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.804278 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8aea005b-187c-4420-aa1f-aaee5e65b264-var-lib-kubelet\") pod \"tuned-v9qlk\" (UID: \"8aea005b-187c-4420-aa1f-aaee5e65b264\") " pod="openshift-cluster-node-tuning-operator/tuned-v9qlk" Jun 03 23:24:41.806081 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.804312 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/11967a41-0e69-4bbf-b847-a3d252607410-host-run-k8s-cni-cncf-io\") pod \"multus-jcmsv\" (UID: \"11967a41-0e69-4bbf-b847-a3d252607410\") " pod="openshift-multus/multus-jcmsv" Jun 03 23:24:41.806081 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.804329 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/11967a41-0e69-4bbf-b847-a3d252607410-multus-daemon-config\") pod \"multus-jcmsv\" (UID: \"11967a41-0e69-4bbf-b847-a3d252607410\") " pod="openshift-multus/multus-jcmsv" Jun 03 23:24:41.806081 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.804345 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0c0ffebc-b272-4e11-892a-08a3acb3f38f-socket-dir\") pod \"aws-ebs-csi-driver-node-wlr5p\" (UID: \"0c0ffebc-b272-4e11-892a-08a3acb3f38f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlr5p" Jun 03 23:24:41.806081 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.804367 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d5046da1-6cac-4c88-9646-5f473d81cf36-os-release\") pod \"multus-additional-cni-plugins-z7b5v\" (UID: \"d5046da1-6cac-4c88-9646-5f473d81cf36\") " pod="openshift-multus/multus-additional-cni-plugins-z7b5v" Jun 03 23:24:41.806081 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.804387 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef7191e9-242f-489c-bb31-a2d21da56948-host-kubelet\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.806081 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.804388 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/35356266-b28e-48fb-b508-a661319c50b1-serviceca\") pod \"node-ca-dnwpn\" (UID: \"35356266-b28e-48fb-b508-a661319c50b1\") " pod="openshift-image-registry/node-ca-dnwpn" Jun 03 23:24:41.806081 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.804403 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef7191e9-242f-489c-bb31-a2d21da56948-var-lib-openvswitch\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.806081 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.804420 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/11967a41-0e69-4bbf-b847-a3d252607410-multus-socket-dir-parent\") pod \"multus-jcmsv\" (UID: \"11967a41-0e69-4bbf-b847-a3d252607410\") " pod="openshift-multus/multus-jcmsv" Jun 03 23:24:41.806873 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.804436 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/11967a41-0e69-4bbf-b847-a3d252607410-host-var-lib-cni-multus\") pod \"multus-jcmsv\" (UID: \"11967a41-0e69-4bbf-b847-a3d252607410\") " pod="openshift-multus/multus-jcmsv" Jun 03 23:24:41.806873 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.804450 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8aea005b-187c-4420-aa1f-aaee5e65b264-etc-tuned\") pod \"tuned-v9qlk\" (UID: \"8aea005b-187c-4420-aa1f-aaee5e65b264\") " pod="openshift-cluster-node-tuning-operator/tuned-v9qlk" Jun 03 23:24:41.806873 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.804471 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/11967a41-0e69-4bbf-b847-a3d252607410-os-release\") pod \"multus-jcmsv\" (UID: \"11967a41-0e69-4bbf-b847-a3d252607410\") " pod="openshift-multus/multus-jcmsv" Jun 03 23:24:41.806873 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.804495 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/83566a98-4a00-49eb-8108-30162d78adc8-dbus\") pod \"global-pull-secret-syncer-4jp9j\" (UID: \"83566a98-4a00-49eb-8108-30162d78adc8\") " pod="kube-system/global-pull-secret-syncer-4jp9j" Jun 03 23:24:41.806873 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.804521 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwrcm\" (UniqueName: \"kubernetes.io/projected/d5046da1-6cac-4c88-9646-5f473d81cf36-kube-api-access-gwrcm\") pod \"multus-additional-cni-plugins-z7b5v\" (UID: \"d5046da1-6cac-4c88-9646-5f473d81cf36\") " pod="openshift-multus/multus-additional-cni-plugins-z7b5v" Jun 03 23:24:41.806873 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.804549 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0c0ffebc-b272-4e11-892a-08a3acb3f38f-registration-dir\") pod \"aws-ebs-csi-driver-node-wlr5p\" (UID: \"0c0ffebc-b272-4e11-892a-08a3acb3f38f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlr5p" Jun 03 23:24:41.806873 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.804574 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ef7191e9-242f-489c-bb31-a2d21da56948-host-slash\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.806873 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.804596 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ef7191e9-242f-489c-bb31-a2d21da56948-run-ovn\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.806873 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.804627 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0c0ffebc-b272-4e11-892a-08a3acb3f38f-etc-selinux\") pod \"aws-ebs-csi-driver-node-wlr5p\" (UID: \"0c0ffebc-b272-4e11-892a-08a3acb3f38f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlr5p" Jun 03 23:24:41.806873 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.804665 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ef7191e9-242f-489c-bb31-a2d21da56948-run-systemd\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.806873 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.804712 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/11967a41-0e69-4bbf-b847-a3d252607410-cnibin\") pod \"multus-jcmsv\" (UID: \"11967a41-0e69-4bbf-b847-a3d252607410\") " pod="openshift-multus/multus-jcmsv" Jun 03 23:24:41.806873 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.804726 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/11967a41-0e69-4bbf-b847-a3d252607410-host-var-lib-kubelet\") pod \"multus-jcmsv\" (UID: \"11967a41-0e69-4bbf-b847-a3d252607410\") " pod="openshift-multus/multus-jcmsv" Jun 03 23:24:41.806873 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.804726 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef7191e9-242f-489c-bb31-a2d21da56948-host-cni-bin\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.806873 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.804780 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0c0ffebc-b272-4e11-892a-08a3acb3f38f-etc-selinux\") pod \"aws-ebs-csi-driver-node-wlr5p\" (UID: \"0c0ffebc-b272-4e11-892a-08a3acb3f38f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlr5p" Jun 03 23:24:41.806873 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.804789 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8aea005b-187c-4420-aa1f-aaee5e65b264-var-lib-kubelet\") pod \"tuned-v9qlk\" (UID: \"8aea005b-187c-4420-aa1f-aaee5e65b264\") " pod="openshift-cluster-node-tuning-operator/tuned-v9qlk" Jun 03 23:24:41.806873 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.804825 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/11967a41-0e69-4bbf-b847-a3d252607410-system-cni-dir\") pod \"multus-jcmsv\" (UID: \"11967a41-0e69-4bbf-b847-a3d252607410\") " pod="openshift-multus/multus-jcmsv" Jun 03 23:24:41.806873 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.804865 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/11967a41-0e69-4bbf-b847-a3d252607410-host-var-lib-cni-multus\") pod \"multus-jcmsv\" (UID: \"11967a41-0e69-4bbf-b847-a3d252607410\") " pod="openshift-multus/multus-jcmsv" Jun 03 23:24:41.806873 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.804875 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5046da1-6cac-4c88-9646-5f473d81cf36-system-cni-dir\") pod \"multus-additional-cni-plugins-z7b5v\" (UID: \"d5046da1-6cac-4c88-9646-5f473d81cf36\") " pod="openshift-multus/multus-additional-cni-plugins-z7b5v" Jun 03 23:24:41.807739 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.804875 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8aea005b-187c-4420-aa1f-aaee5e65b264-etc-sysctl-d\") pod \"tuned-v9qlk\" (UID: \"8aea005b-187c-4420-aa1f-aaee5e65b264\") " pod="openshift-cluster-node-tuning-operator/tuned-v9qlk" Jun 03 23:24:41.807739 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.804965 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8aea005b-187c-4420-aa1f-aaee5e65b264-etc-modprobe-d\") pod \"tuned-v9qlk\" (UID: \"8aea005b-187c-4420-aa1f-aaee5e65b264\") " pod="openshift-cluster-node-tuning-operator/tuned-v9qlk" Jun 03 23:24:41.807739 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.805250 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ef7191e9-242f-489c-bb31-a2d21da56948-env-overrides\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.807739 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.805271 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8aea005b-187c-4420-aa1f-aaee5e65b264-etc-sysctl-conf\") pod \"tuned-v9qlk\" (UID: \"8aea005b-187c-4420-aa1f-aaee5e65b264\") " pod="openshift-cluster-node-tuning-operator/tuned-v9qlk" Jun 03 23:24:41.807739 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.805277 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d5046da1-6cac-4c88-9646-5f473d81cf36-cnibin\") pod \"multus-additional-cni-plugins-z7b5v\" (UID: \"d5046da1-6cac-4c88-9646-5f473d81cf36\") " pod="openshift-multus/multus-additional-cni-plugins-z7b5v" Jun 03 23:24:41.807739 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.805337 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef7191e9-242f-489c-bb31-a2d21da56948-host-run-ovn-kubernetes\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.807739 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.805340 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d5046da1-6cac-4c88-9646-5f473d81cf36-cnibin\") pod \"multus-additional-cni-plugins-z7b5v\" (UID: \"d5046da1-6cac-4c88-9646-5f473d81cf36\") " pod="openshift-multus/multus-additional-cni-plugins-z7b5v" Jun 03 23:24:41.807739 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.805365 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ef7191e9-242f-489c-bb31-a2d21da56948-ovnkube-config\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.807739 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.805390 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8aea005b-187c-4420-aa1f-aaee5e65b264-run\") pod \"tuned-v9qlk\" (UID: \"8aea005b-187c-4420-aa1f-aaee5e65b264\") " pod="openshift-cluster-node-tuning-operator/tuned-v9qlk" Jun 03 23:24:41.807739 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.805414 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ef7191e9-242f-489c-bb31-a2d21da56948-node-log\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.807739 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.805442 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/83566a98-4a00-49eb-8108-30162d78adc8-dbus\") pod \"global-pull-secret-syncer-4jp9j\" (UID: \"83566a98-4a00-49eb-8108-30162d78adc8\") " pod="kube-system/global-pull-secret-syncer-4jp9j" Jun 03 23:24:41.807739 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.805451 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef7191e9-242f-489c-bb31-a2d21da56948-etc-openvswitch\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.807739 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.805474 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8aea005b-187c-4420-aa1f-aaee5e65b264-lib-modules\") pod \"tuned-v9qlk\" (UID: \"8aea005b-187c-4420-aa1f-aaee5e65b264\") " pod="openshift-cluster-node-tuning-operator/tuned-v9qlk" Jun 03 23:24:41.807739 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.805499 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/11967a41-0e69-4bbf-b847-a3d252607410-os-release\") pod \"multus-jcmsv\" (UID: \"11967a41-0e69-4bbf-b847-a3d252607410\") " pod="openshift-multus/multus-jcmsv" Jun 03 23:24:41.807739 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.805511 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8j7c2\" (UniqueName: \"kubernetes.io/projected/35356266-b28e-48fb-b508-a661319c50b1-kube-api-access-8j7c2\") pod \"node-ca-dnwpn\" (UID: \"35356266-b28e-48fb-b508-a661319c50b1\") " pod="openshift-image-registry/node-ca-dnwpn" Jun 03 23:24:41.807739 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.805521 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ef7191e9-242f-489c-bb31-a2d21da56948-host-cni-netd\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.807739 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.805537 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/11967a41-0e69-4bbf-b847-a3d252607410-multus-cni-dir\") pod \"multus-jcmsv\" (UID: \"11967a41-0e69-4bbf-b847-a3d252607410\") " pod="openshift-multus/multus-jcmsv" Jun 03 23:24:41.807739 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.805607 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8aea005b-187c-4420-aa1f-aaee5e65b264-run\") pod \"tuned-v9qlk\" (UID: \"8aea005b-187c-4420-aa1f-aaee5e65b264\") " pod="openshift-cluster-node-tuning-operator/tuned-v9qlk" Jun 03 23:24:41.808502 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.805718 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/11967a41-0e69-4bbf-b847-a3d252607410-multus-cni-dir\") pod \"multus-jcmsv\" (UID: \"11967a41-0e69-4bbf-b847-a3d252607410\") " pod="openshift-multus/multus-jcmsv" Jun 03 23:24:41.808502 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.805754 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ef7191e9-242f-489c-bb31-a2d21da56948-node-log\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.808502 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.805789 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef7191e9-242f-489c-bb31-a2d21da56948-etc-openvswitch\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.808502 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.805877 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8aea005b-187c-4420-aa1f-aaee5e65b264-lib-modules\") pod \"tuned-v9qlk\" (UID: \"8aea005b-187c-4420-aa1f-aaee5e65b264\") " pod="openshift-cluster-node-tuning-operator/tuned-v9qlk" Jun 03 23:24:41.808502 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.806161 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0c0ffebc-b272-4e11-892a-08a3acb3f38f-registration-dir\") pod \"aws-ebs-csi-driver-node-wlr5p\" (UID: \"0c0ffebc-b272-4e11-892a-08a3acb3f38f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlr5p" Jun 03 23:24:41.808502 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.806216 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ef7191e9-242f-489c-bb31-a2d21da56948-host-slash\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.808502 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.806270 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ef7191e9-242f-489c-bb31-a2d21da56948-run-ovn\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.808502 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.806390 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ef7191e9-242f-489c-bb31-a2d21da56948-ovnkube-script-lib\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.808502 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.806422 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d5046da1-6cac-4c88-9646-5f473d81cf36-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z7b5v\" (UID: \"d5046da1-6cac-4c88-9646-5f473d81cf36\") " pod="openshift-multus/multus-additional-cni-plugins-z7b5v" Jun 03 23:24:41.808502 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.806456 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d5046da1-6cac-4c88-9646-5f473d81cf36-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z7b5v\" (UID: \"d5046da1-6cac-4c88-9646-5f473d81cf36\") " pod="openshift-multus/multus-additional-cni-plugins-z7b5v" Jun 03 23:24:41.808502 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.806610 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d5046da1-6cac-4c88-9646-5f473d81cf36-cni-binary-copy\") pod \"multus-additional-cni-plugins-z7b5v\" (UID: \"d5046da1-6cac-4c88-9646-5f473d81cf36\") " pod="openshift-multus/multus-additional-cni-plugins-z7b5v" Jun 03 23:24:41.808502 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.806685 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/11967a41-0e69-4bbf-b847-a3d252607410-multus-socket-dir-parent\") pod \"multus-jcmsv\" (UID: \"11967a41-0e69-4bbf-b847-a3d252607410\") " pod="openshift-multus/multus-jcmsv" Jun 03 23:24:41.808502 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.806756 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef7191e9-242f-489c-bb31-a2d21da56948-host-run-ovn-kubernetes\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.808502 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.807104 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ef7191e9-242f-489c-bb31-a2d21da56948-ovnkube-config\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.808502 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.807210 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d5046da1-6cac-4c88-9646-5f473d81cf36-os-release\") pod \"multus-additional-cni-plugins-z7b5v\" (UID: \"d5046da1-6cac-4c88-9646-5f473d81cf36\") " pod="openshift-multus/multus-additional-cni-plugins-z7b5v" Jun 03 23:24:41.808502 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.807256 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/11967a41-0e69-4bbf-b847-a3d252607410-multus-daemon-config\") pod \"multus-jcmsv\" (UID: \"11967a41-0e69-4bbf-b847-a3d252607410\") " pod="openshift-multus/multus-jcmsv" Jun 03 23:24:41.808502 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.807317 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0c0ffebc-b272-4e11-892a-08a3acb3f38f-socket-dir\") pod \"aws-ebs-csi-driver-node-wlr5p\" (UID: \"0c0ffebc-b272-4e11-892a-08a3acb3f38f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlr5p" Jun 03 23:24:41.809036 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.807375 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef7191e9-242f-489c-bb31-a2d21da56948-host-kubelet\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.809036 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.807399 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef7191e9-242f-489c-bb31-a2d21da56948-var-lib-openvswitch\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.809036 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.807410 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/11967a41-0e69-4bbf-b847-a3d252607410-host-run-k8s-cni-cncf-io\") pod \"multus-jcmsv\" (UID: \"11967a41-0e69-4bbf-b847-a3d252607410\") " pod="openshift-multus/multus-jcmsv" Jun 03 23:24:41.809036 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.807449 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8aea005b-187c-4420-aa1f-aaee5e65b264-etc-tuned\") pod \"tuned-v9qlk\" (UID: \"8aea005b-187c-4420-aa1f-aaee5e65b264\") " pod="openshift-cluster-node-tuning-operator/tuned-v9qlk" Jun 03 23:24:41.809036 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.807590 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9fec56be-cb0f-4e01-9e51-aa62afa1499d-konnectivity-ca\") pod \"konnectivity-agent-wx4t4\" (UID: \"9fec56be-cb0f-4e01-9e51-aa62afa1499d\") " pod="kube-system/konnectivity-agent-wx4t4" Jun 03 23:24:41.809036 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.808036 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9fec56be-cb0f-4e01-9e51-aa62afa1499d-agent-certs\") pod \"konnectivity-agent-wx4t4\" (UID: \"9fec56be-cb0f-4e01-9e51-aa62afa1499d\") " pod="kube-system/konnectivity-agent-wx4t4" Jun 03 23:24:41.809036 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.808122 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ef7191e9-242f-489c-bb31-a2d21da56948-ovn-node-metrics-cert\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.809036 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.808188 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8aea005b-187c-4420-aa1f-aaee5e65b264-tmp\") pod \"tuned-v9qlk\" (UID: \"8aea005b-187c-4420-aa1f-aaee5e65b264\") " pod="openshift-cluster-node-tuning-operator/tuned-v9qlk" Jun 03 23:24:41.812667 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.812478 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m26bl\" (UniqueName: \"kubernetes.io/projected/8aea005b-187c-4420-aa1f-aaee5e65b264-kube-api-access-m26bl\") pod \"tuned-v9qlk\" (UID: \"8aea005b-187c-4420-aa1f-aaee5e65b264\") " pod="openshift-cluster-node-tuning-operator/tuned-v9qlk" Jun 03 23:24:41.812667 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.812623 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k5lf\" (UniqueName: \"kubernetes.io/projected/0c0ffebc-b272-4e11-892a-08a3acb3f38f-kube-api-access-4k5lf\") pod \"aws-ebs-csi-driver-node-wlr5p\" (UID: \"0c0ffebc-b272-4e11-892a-08a3acb3f38f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlr5p" Jun 03 23:24:41.813829 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.813797 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxp7t\" (UniqueName: \"kubernetes.io/projected/ef7191e9-242f-489c-bb31-a2d21da56948-kube-api-access-lxp7t\") pod \"ovnkube-node-849cq\" (UID: \"ef7191e9-242f-489c-bb31-a2d21da56948\") " pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.813829 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.813816 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwrcm\" (UniqueName: \"kubernetes.io/projected/d5046da1-6cac-4c88-9646-5f473d81cf36-kube-api-access-gwrcm\") pod \"multus-additional-cni-plugins-z7b5v\" (UID: \"d5046da1-6cac-4c88-9646-5f473d81cf36\") " pod="openshift-multus/multus-additional-cni-plugins-z7b5v" Jun 03 23:24:41.814129 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.814106 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm48v\" (UniqueName: \"kubernetes.io/projected/11967a41-0e69-4bbf-b847-a3d252607410-kube-api-access-tm48v\") pod \"multus-jcmsv\" (UID: \"11967a41-0e69-4bbf-b847-a3d252607410\") " pod="openshift-multus/multus-jcmsv" Jun 03 23:24:41.815966 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.815944 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8j7c2\" (UniqueName: \"kubernetes.io/projected/35356266-b28e-48fb-b508-a661319c50b1-kube-api-access-8j7c2\") pod \"node-ca-dnwpn\" (UID: \"35356266-b28e-48fb-b508-a661319c50b1\") " pod="openshift-image-registry/node-ca-dnwpn" Jun 03 23:24:41.898586 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.898516 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hgjd8" Jun 03 23:24:41.904123 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.904103 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qptg9" Jun 03 23:24:41.912605 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.912582 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wx4t4" Jun 03 23:24:41.918321 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.918300 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dnwpn" Jun 03 23:24:41.924004 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.923981 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlr5p" Jun 03 23:24:41.930659 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.930639 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jcmsv" Jun 03 23:24:41.937176 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.937159 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z7b5v" Jun 03 23:24:41.943771 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.943755 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:24:41.948458 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:41.948432 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-v9qlk" Jun 03 23:24:42.208425 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:42.208341 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nkhk\" (UniqueName: \"kubernetes.io/projected/0a3d3d7c-0aa1-4223-9892-ed05eaf7062f-kube-api-access-6nkhk\") pod \"network-check-target-lxpnk\" (UID: \"0a3d3d7c-0aa1-4223-9892-ed05eaf7062f\") " pod="openshift-network-diagnostics/network-check-target-lxpnk" Jun 03 23:24:42.208425 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:42.208404 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38c2283b-dc88-4292-9e56-50e1e5da9064-metrics-certs\") pod \"network-metrics-daemon-58jkf\" (UID: \"38c2283b-dc88-4292-9e56-50e1e5da9064\") " pod="openshift-multus/network-metrics-daemon-58jkf" Jun 03 23:24:42.208641 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:42.208512 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:24:42.208641 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:42.208582 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38c2283b-dc88-4292-9e56-50e1e5da9064-metrics-certs podName:38c2283b-dc88-4292-9e56-50e1e5da9064 nodeName:}" failed. No retries permitted until 2026-06-03 23:24:43.208561464 +0000 UTC m=+4.015781908 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38c2283b-dc88-4292-9e56-50e1e5da9064-metrics-certs") pod "network-metrics-daemon-58jkf" (UID: "38c2283b-dc88-4292-9e56-50e1e5da9064") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:24:42.208641 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:42.208582 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 23:24:42.208641 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:42.208605 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 23:24:42.208641 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:42.208616 2574 projected.go:196] Error preparing data for projected volume kube-api-access-6nkhk for pod openshift-network-diagnostics/network-check-target-lxpnk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:24:42.208889 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:42.208646 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a3d3d7c-0aa1-4223-9892-ed05eaf7062f-kube-api-access-6nkhk podName:0a3d3d7c-0aa1-4223-9892-ed05eaf7062f nodeName:}" failed. No retries permitted until 2026-06-03 23:24:43.208638948 +0000 UTC m=+4.015859390 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6nkhk" (UniqueName: "kubernetes.io/projected/0a3d3d7c-0aa1-4223-9892-ed05eaf7062f-kube-api-access-6nkhk") pod "network-check-target-lxpnk" (UID: "0a3d3d7c-0aa1-4223-9892-ed05eaf7062f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:24:42.214967 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:42.214939 2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 23:24:42.309197 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:42.309162 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/83566a98-4a00-49eb-8108-30162d78adc8-original-pull-secret\") pod \"global-pull-secret-syncer-4jp9j\" (UID: \"83566a98-4a00-49eb-8108-30162d78adc8\") " pod="kube-system/global-pull-secret-syncer-4jp9j" Jun 03 23:24:42.309310 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:42.309267 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 23:24:42.309348 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:42.309340 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83566a98-4a00-49eb-8108-30162d78adc8-original-pull-secret podName:83566a98-4a00-49eb-8108-30162d78adc8 nodeName:}" failed. No retries permitted until 2026-06-03 23:24:43.309320937 +0000 UTC m=+4.116541381 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/83566a98-4a00-49eb-8108-30162d78adc8-original-pull-secret") pod "global-pull-secret-syncer-4jp9j" (UID: "83566a98-4a00-49eb-8108-30162d78adc8") : object "kube-system"/"original-pull-secret" not registered Jun 03 23:24:42.321342 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:42.321174 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda356b3d4_861f_42af_992c_a984488ad7f0.slice/crio-6a403c9478080d9aedb0971093be27c81daf9f63ee4cefa28209ceb175d83bf9 WatchSource:0}: Error finding container 6a403c9478080d9aedb0971093be27c81daf9f63ee4cefa28209ceb175d83bf9: Status 404 returned error can't find the container with id 6a403c9478080d9aedb0971093be27c81daf9f63ee4cefa28209ceb175d83bf9 Jun 03 23:24:42.322259 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:42.322233 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11967a41_0e69_4bbf_b847_a3d252607410.slice/crio-a2fa62f2ae99ad1996dfc391a11525e6f77741c8154fd738e1d80971f1446237 WatchSource:0}: Error finding container a2fa62f2ae99ad1996dfc391a11525e6f77741c8154fd738e1d80971f1446237: Status 404 returned error can't find the container with id a2fa62f2ae99ad1996dfc391a11525e6f77741c8154fd738e1d80971f1446237 Jun 03 23:24:42.323425 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:42.323400 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35356266_b28e_48fb_b508_a661319c50b1.slice/crio-ba99c1c5d37b93470d3d95095ca9cf7b178153b2cfe919ba121b458a1cd27f68 WatchSource:0}: Error finding container ba99c1c5d37b93470d3d95095ca9cf7b178153b2cfe919ba121b458a1cd27f68: Status 404 returned error can't find the container with id ba99c1c5d37b93470d3d95095ca9cf7b178153b2cfe919ba121b458a1cd27f68 Jun 03 23:24:42.325650 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:42.325632 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c0ffebc_b272_4e11_892a_08a3acb3f38f.slice/crio-95398788d2626fa3dd88426c4879737fa51a97acea8c709509a7c8f484af93a3 WatchSource:0}: Error finding container 95398788d2626fa3dd88426c4879737fa51a97acea8c709509a7c8f484af93a3: Status 404 returned error can't find the container with id 95398788d2626fa3dd88426c4879737fa51a97acea8c709509a7c8f484af93a3 Jun 03 23:24:42.326604 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:42.326587 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8aea005b_187c_4420_aa1f_aaee5e65b264.slice/crio-0040b4bf92ed51076157d694fe84f585642daeb0416bc8802f40c4bcf48ab1ca WatchSource:0}: Error finding container 0040b4bf92ed51076157d694fe84f585642daeb0416bc8802f40c4bcf48ab1ca: Status 404 returned error can't find the container with id 0040b4bf92ed51076157d694fe84f585642daeb0416bc8802f40c4bcf48ab1ca Jun 03 23:24:42.327536 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:42.327512 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef7191e9_242f_489c_bb31_a2d21da56948.slice/crio-829ed0a7ccebb803de6246669ac0e330836814875076ae92b9ecb7b20098f53e WatchSource:0}: Error finding container 829ed0a7ccebb803de6246669ac0e330836814875076ae92b9ecb7b20098f53e: Status 404 returned error can't find the container with id 829ed0a7ccebb803de6246669ac0e330836814875076ae92b9ecb7b20098f53e Jun 03 23:24:42.328759 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:42.328740 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8eb806c_295f_4b08_ad92_6ceef3b2a7b8.slice/crio-dcc05d8b304d1321de5e738eea98062209ef96fca5c53371ed973f1d8d4dbf8b WatchSource:0}: Error finding container dcc05d8b304d1321de5e738eea98062209ef96fca5c53371ed973f1d8d4dbf8b: Status 404 returned error can't find the container with id dcc05d8b304d1321de5e738eea98062209ef96fca5c53371ed973f1d8d4dbf8b Jun 03 23:24:42.329423 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:42.329387 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5046da1_6cac_4c88_9646_5f473d81cf36.slice/crio-d8bd1e8903a01bfa7e93b333b09c2d7e9925fb9242241aea01f1b7e76dbce8f9 WatchSource:0}: Error finding container d8bd1e8903a01bfa7e93b333b09c2d7e9925fb9242241aea01f1b7e76dbce8f9: Status 404 returned error can't find the container with id d8bd1e8903a01bfa7e93b333b09c2d7e9925fb9242241aea01f1b7e76dbce8f9 Jun 03 23:24:42.330797 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:24:42.330769 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fec56be_cb0f_4e01_9e51_aa62afa1499d.slice/crio-654a97ad692516f7e984880db9e6992d97798da321e62adebb6ab807fe43688a WatchSource:0}: Error finding container 654a97ad692516f7e984880db9e6992d97798da321e62adebb6ab807fe43688a: Status 404 returned error can't find the container with id 654a97ad692516f7e984880db9e6992d97798da321e62adebb6ab807fe43688a Jun 03 23:24:42.633501 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:42.633418 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 23:19:41 +0000 UTC" deadline="2027-12-12 11:16:38.482128205 +0000 UTC" Jun 03 23:24:42.633501 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:42.633452 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13355h51m55.848680329s" Jun 03 23:24:42.652345 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:42.650672 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxpnk" Jun 03 23:24:42.652345 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:42.650809 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxpnk" podUID="0a3d3d7c-0aa1-4223-9892-ed05eaf7062f" Jun 03 23:24:42.660252 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:42.660217 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-849cq" event={"ID":"ef7191e9-242f-489c-bb31-a2d21da56948","Type":"ContainerStarted","Data":"829ed0a7ccebb803de6246669ac0e330836814875076ae92b9ecb7b20098f53e"} Jun 03 23:24:42.662940 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:42.662687 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-v9qlk" event={"ID":"8aea005b-187c-4420-aa1f-aaee5e65b264","Type":"ContainerStarted","Data":"0040b4bf92ed51076157d694fe84f585642daeb0416bc8802f40c4bcf48ab1ca"} Jun 03 23:24:42.664005 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:42.663923 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlr5p" event={"ID":"0c0ffebc-b272-4e11-892a-08a3acb3f38f","Type":"ContainerStarted","Data":"95398788d2626fa3dd88426c4879737fa51a97acea8c709509a7c8f484af93a3"} Jun 03 23:24:42.665568 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:42.665499 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jcmsv" event={"ID":"11967a41-0e69-4bbf-b847-a3d252607410","Type":"ContainerStarted","Data":"a2fa62f2ae99ad1996dfc391a11525e6f77741c8154fd738e1d80971f1446237"} Jun 03 23:24:42.671274 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:42.668133 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hgjd8" event={"ID":"a356b3d4-861f-42af-992c-a984488ad7f0","Type":"ContainerStarted","Data":"6a403c9478080d9aedb0971093be27c81daf9f63ee4cefa28209ceb175d83bf9"} Jun 03 23:24:42.672379 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:42.672237 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wx4t4" event={"ID":"9fec56be-cb0f-4e01-9e51-aa62afa1499d","Type":"ContainerStarted","Data":"654a97ad692516f7e984880db9e6992d97798da321e62adebb6ab807fe43688a"} Jun 03 23:24:42.677053 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:42.677004 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qptg9" event={"ID":"e8eb806c-295f-4b08-ad92-6ceef3b2a7b8","Type":"ContainerStarted","Data":"dcc05d8b304d1321de5e738eea98062209ef96fca5c53371ed973f1d8d4dbf8b"} Jun 03 23:24:42.683190 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:42.683159 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dnwpn" event={"ID":"35356266-b28e-48fb-b508-a661319c50b1","Type":"ContainerStarted","Data":"ba99c1c5d37b93470d3d95095ca9cf7b178153b2cfe919ba121b458a1cd27f68"} Jun 03 23:24:42.685803 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:42.685777 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-242.ec2.internal" event={"ID":"9695b6e50d763a28dd89fc1a733fbc23","Type":"ContainerStarted","Data":"8489f4b4af8b55b1c8ffc237c10512494651fc48a0293b76d8bed8adf6cbfcac"} Jun 03 23:24:42.692105 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:42.691499 2574 generic.go:356] "Generic (PLEG): container finished" podID="4c29f618fd87963fa6849c0e453c58d0" containerID="ea67f1ac1ee7c091724e22e33d65e8582356af75d4bca8be462cf20adab58ac2" exitCode=0 Jun 03 23:24:42.692105 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:42.691569 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-242.ec2.internal" event={"ID":"4c29f618fd87963fa6849c0e453c58d0","Type":"ContainerDied","Data":"ea67f1ac1ee7c091724e22e33d65e8582356af75d4bca8be462cf20adab58ac2"} Jun 03 23:24:42.698893 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:42.698819 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z7b5v" event={"ID":"d5046da1-6cac-4c88-9646-5f473d81cf36","Type":"ContainerStarted","Data":"d8bd1e8903a01bfa7e93b333b09c2d7e9925fb9242241aea01f1b7e76dbce8f9"} Jun 03 23:24:42.706678 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:42.705589 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-242.ec2.internal" podStartSLOduration=2.705575172 podStartE2EDuration="2.705575172s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:24:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:24:42.705555795 +0000 UTC m=+3.512776262" watchObservedRunningTime="2026-06-03 23:24:42.705575172 +0000 UTC m=+3.512795636" Jun 03 23:24:43.218156 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:43.218066 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38c2283b-dc88-4292-9e56-50e1e5da9064-metrics-certs\") pod \"network-metrics-daemon-58jkf\" (UID: \"38c2283b-dc88-4292-9e56-50e1e5da9064\") " pod="openshift-multus/network-metrics-daemon-58jkf" Jun 03 23:24:43.218376 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:43.218163 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nkhk\" (UniqueName: \"kubernetes.io/projected/0a3d3d7c-0aa1-4223-9892-ed05eaf7062f-kube-api-access-6nkhk\") pod \"network-check-target-lxpnk\" (UID: \"0a3d3d7c-0aa1-4223-9892-ed05eaf7062f\") " pod="openshift-network-diagnostics/network-check-target-lxpnk" Jun 03 23:24:43.218376 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:43.218316 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 23:24:43.218376 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:43.218340 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 23:24:43.218376 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:43.218353 2574 projected.go:196] Error preparing data for projected volume kube-api-access-6nkhk for pod openshift-network-diagnostics/network-check-target-lxpnk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:24:43.218596 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:43.218411 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a3d3d7c-0aa1-4223-9892-ed05eaf7062f-kube-api-access-6nkhk podName:0a3d3d7c-0aa1-4223-9892-ed05eaf7062f nodeName:}" failed. No retries permitted until 2026-06-03 23:24:45.218391987 +0000 UTC m=+6.025612433 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6nkhk" (UniqueName: "kubernetes.io/projected/0a3d3d7c-0aa1-4223-9892-ed05eaf7062f-kube-api-access-6nkhk") pod "network-check-target-lxpnk" (UID: "0a3d3d7c-0aa1-4223-9892-ed05eaf7062f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:24:43.218831 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:43.218797 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:24:43.218908 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:43.218848 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38c2283b-dc88-4292-9e56-50e1e5da9064-metrics-certs podName:38c2283b-dc88-4292-9e56-50e1e5da9064 nodeName:}" failed. No retries permitted until 2026-06-03 23:24:45.218833467 +0000 UTC m=+6.026053912 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38c2283b-dc88-4292-9e56-50e1e5da9064-metrics-certs") pod "network-metrics-daemon-58jkf" (UID: "38c2283b-dc88-4292-9e56-50e1e5da9064") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:24:43.318775 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:43.318692 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/83566a98-4a00-49eb-8108-30162d78adc8-original-pull-secret\") pod \"global-pull-secret-syncer-4jp9j\" (UID: \"83566a98-4a00-49eb-8108-30162d78adc8\") " pod="kube-system/global-pull-secret-syncer-4jp9j" Jun 03 23:24:43.318965 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:43.318872 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 23:24:43.318965 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:43.318947 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83566a98-4a00-49eb-8108-30162d78adc8-original-pull-secret podName:83566a98-4a00-49eb-8108-30162d78adc8 nodeName:}" failed. No retries permitted until 2026-06-03 23:24:45.318927959 +0000 UTC m=+6.126148432 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/83566a98-4a00-49eb-8108-30162d78adc8-original-pull-secret") pod "global-pull-secret-syncer-4jp9j" (UID: "83566a98-4a00-49eb-8108-30162d78adc8") : object "kube-system"/"original-pull-secret" not registered Jun 03 23:24:43.633710 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:43.633561 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 23:19:41 +0000 UTC" deadline="2027-12-09 13:09:33.948900921 +0000 UTC" Jun 03 23:24:43.633710 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:43.633632 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13285h44m50.315273695s" Jun 03 23:24:43.653856 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:43.653144 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58jkf" Jun 03 23:24:43.653856 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:43.653286 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58jkf" podUID="38c2283b-dc88-4292-9e56-50e1e5da9064" Jun 03 23:24:43.653856 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:43.653672 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jp9j" Jun 03 23:24:43.653856 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:43.653759 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jp9j" podUID="83566a98-4a00-49eb-8108-30162d78adc8" Jun 03 23:24:43.721606 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:43.721473 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-242.ec2.internal" event={"ID":"4c29f618fd87963fa6849c0e453c58d0","Type":"ContainerStarted","Data":"aab65161a01aea9d0d79c8e54964c5e0ff9331a0bd4d7199262fc2251c8ca0f7"} Jun 03 23:24:43.740322 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:43.739727 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-242.ec2.internal" podStartSLOduration=3.7397056490000002 podStartE2EDuration="3.739705649s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:24:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:24:43.739233929 +0000 UTC m=+4.546454405" watchObservedRunningTime="2026-06-03 23:24:43.739705649 +0000 UTC m=+4.546926115" Jun 03 23:24:44.651269 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:44.650804 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxpnk" Jun 03 23:24:44.651269 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:44.650939 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxpnk" podUID="0a3d3d7c-0aa1-4223-9892-ed05eaf7062f" Jun 03 23:24:45.231664 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:45.231624 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38c2283b-dc88-4292-9e56-50e1e5da9064-metrics-certs\") pod \"network-metrics-daemon-58jkf\" (UID: \"38c2283b-dc88-4292-9e56-50e1e5da9064\") " pod="openshift-multus/network-metrics-daemon-58jkf" Jun 03 23:24:45.231856 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:45.231725 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nkhk\" (UniqueName: \"kubernetes.io/projected/0a3d3d7c-0aa1-4223-9892-ed05eaf7062f-kube-api-access-6nkhk\") pod \"network-check-target-lxpnk\" (UID: \"0a3d3d7c-0aa1-4223-9892-ed05eaf7062f\") " pod="openshift-network-diagnostics/network-check-target-lxpnk" Jun 03 23:24:45.231919 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:45.231889 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 23:24:45.231919 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:45.231907 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 23:24:45.231919 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:45.231920 2574 projected.go:196] Error preparing data for projected volume kube-api-access-6nkhk for pod openshift-network-diagnostics/network-check-target-lxpnk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:24:45.232071 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:45.231978 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a3d3d7c-0aa1-4223-9892-ed05eaf7062f-kube-api-access-6nkhk podName:0a3d3d7c-0aa1-4223-9892-ed05eaf7062f nodeName:}" failed. No retries permitted until 2026-06-03 23:24:49.231960263 +0000 UTC m=+10.039180705 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6nkhk" (UniqueName: "kubernetes.io/projected/0a3d3d7c-0aa1-4223-9892-ed05eaf7062f-kube-api-access-6nkhk") pod "network-check-target-lxpnk" (UID: "0a3d3d7c-0aa1-4223-9892-ed05eaf7062f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:24:45.232412 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:45.232396 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:24:45.232498 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:45.232479 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38c2283b-dc88-4292-9e56-50e1e5da9064-metrics-certs podName:38c2283b-dc88-4292-9e56-50e1e5da9064 nodeName:}" failed. No retries permitted until 2026-06-03 23:24:49.2324329 +0000 UTC m=+10.039653363 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38c2283b-dc88-4292-9e56-50e1e5da9064-metrics-certs") pod "network-metrics-daemon-58jkf" (UID: "38c2283b-dc88-4292-9e56-50e1e5da9064") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:24:45.332396 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:45.332353 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/83566a98-4a00-49eb-8108-30162d78adc8-original-pull-secret\") pod \"global-pull-secret-syncer-4jp9j\" (UID: \"83566a98-4a00-49eb-8108-30162d78adc8\") " pod="kube-system/global-pull-secret-syncer-4jp9j" Jun 03 23:24:45.332605 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:45.332586 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 23:24:45.332667 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:45.332656 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83566a98-4a00-49eb-8108-30162d78adc8-original-pull-secret podName:83566a98-4a00-49eb-8108-30162d78adc8 nodeName:}" failed. No retries permitted until 2026-06-03 23:24:49.332638017 +0000 UTC m=+10.139858461 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/83566a98-4a00-49eb-8108-30162d78adc8-original-pull-secret") pod "global-pull-secret-syncer-4jp9j" (UID: "83566a98-4a00-49eb-8108-30162d78adc8") : object "kube-system"/"original-pull-secret" not registered Jun 03 23:24:45.650909 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:45.650874 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jp9j" Jun 03 23:24:45.651095 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:45.650917 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58jkf" Jun 03 23:24:45.651095 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:45.651013 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jp9j" podUID="83566a98-4a00-49eb-8108-30162d78adc8" Jun 03 23:24:45.651376 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:45.651347 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58jkf" podUID="38c2283b-dc88-4292-9e56-50e1e5da9064" Jun 03 23:24:46.651184 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:46.651150 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxpnk" Jun 03 23:24:46.651396 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:46.651283 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxpnk" podUID="0a3d3d7c-0aa1-4223-9892-ed05eaf7062f" Jun 03 23:24:47.652663 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:47.651645 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58jkf" Jun 03 23:24:47.652663 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:47.651794 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58jkf" podUID="38c2283b-dc88-4292-9e56-50e1e5da9064" Jun 03 23:24:47.652663 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:47.652516 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jp9j" Jun 03 23:24:47.652663 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:47.652619 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jp9j" podUID="83566a98-4a00-49eb-8108-30162d78adc8" Jun 03 23:24:48.651645 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:48.651452 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxpnk" Jun 03 23:24:48.651645 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:48.651580 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxpnk" podUID="0a3d3d7c-0aa1-4223-9892-ed05eaf7062f" Jun 03 23:24:49.264914 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:49.264876 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nkhk\" (UniqueName: \"kubernetes.io/projected/0a3d3d7c-0aa1-4223-9892-ed05eaf7062f-kube-api-access-6nkhk\") pod \"network-check-target-lxpnk\" (UID: \"0a3d3d7c-0aa1-4223-9892-ed05eaf7062f\") " pod="openshift-network-diagnostics/network-check-target-lxpnk" Jun 03 23:24:49.265428 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:49.264933 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38c2283b-dc88-4292-9e56-50e1e5da9064-metrics-certs\") pod \"network-metrics-daemon-58jkf\" (UID: \"38c2283b-dc88-4292-9e56-50e1e5da9064\") " pod="openshift-multus/network-metrics-daemon-58jkf" Jun 03 23:24:49.265428 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:49.265059 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:24:49.265428 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:49.265120 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38c2283b-dc88-4292-9e56-50e1e5da9064-metrics-certs podName:38c2283b-dc88-4292-9e56-50e1e5da9064 nodeName:}" failed. No retries permitted until 2026-06-03 23:24:57.265102528 +0000 UTC m=+18.072322973 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38c2283b-dc88-4292-9e56-50e1e5da9064-metrics-certs") pod "network-metrics-daemon-58jkf" (UID: "38c2283b-dc88-4292-9e56-50e1e5da9064") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:24:49.265428 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:49.265416 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 23:24:49.265660 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:49.265441 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 23:24:49.265660 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:49.265454 2574 projected.go:196] Error preparing data for projected volume kube-api-access-6nkhk for pod openshift-network-diagnostics/network-check-target-lxpnk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:24:49.265660 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:49.265500 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a3d3d7c-0aa1-4223-9892-ed05eaf7062f-kube-api-access-6nkhk podName:0a3d3d7c-0aa1-4223-9892-ed05eaf7062f nodeName:}" failed. No retries permitted until 2026-06-03 23:24:57.265483453 +0000 UTC m=+18.072703909 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6nkhk" (UniqueName: "kubernetes.io/projected/0a3d3d7c-0aa1-4223-9892-ed05eaf7062f-kube-api-access-6nkhk") pod "network-check-target-lxpnk" (UID: "0a3d3d7c-0aa1-4223-9892-ed05eaf7062f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:24:49.366233 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:49.366142 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/83566a98-4a00-49eb-8108-30162d78adc8-original-pull-secret\") pod \"global-pull-secret-syncer-4jp9j\" (UID: \"83566a98-4a00-49eb-8108-30162d78adc8\") " pod="kube-system/global-pull-secret-syncer-4jp9j" Jun 03 23:24:49.366439 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:49.366320 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 23:24:49.366439 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:49.366400 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83566a98-4a00-49eb-8108-30162d78adc8-original-pull-secret podName:83566a98-4a00-49eb-8108-30162d78adc8 nodeName:}" failed. No retries permitted until 2026-06-03 23:24:57.366379134 +0000 UTC m=+18.173599589 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/83566a98-4a00-49eb-8108-30162d78adc8-original-pull-secret") pod "global-pull-secret-syncer-4jp9j" (UID: "83566a98-4a00-49eb-8108-30162d78adc8") : object "kube-system"/"original-pull-secret" not registered Jun 03 23:24:49.651660 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:49.651561 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58jkf" Jun 03 23:24:49.651810 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:49.651693 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58jkf" podUID="38c2283b-dc88-4292-9e56-50e1e5da9064" Jun 03 23:24:49.652330 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:49.652266 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jp9j" Jun 03 23:24:49.653477 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:49.653340 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jp9j" podUID="83566a98-4a00-49eb-8108-30162d78adc8" Jun 03 23:24:50.650739 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:50.650649 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxpnk" Jun 03 23:24:50.651122 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:50.650777 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxpnk" podUID="0a3d3d7c-0aa1-4223-9892-ed05eaf7062f" Jun 03 23:24:51.651187 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:51.651142 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58jkf" Jun 03 23:24:51.651622 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:51.651342 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58jkf" podUID="38c2283b-dc88-4292-9e56-50e1e5da9064" Jun 03 23:24:51.651622 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:51.651433 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jp9j" Jun 03 23:24:51.651622 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:51.651544 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jp9j" podUID="83566a98-4a00-49eb-8108-30162d78adc8" Jun 03 23:24:52.650759 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:52.650673 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxpnk" Jun 03 23:24:52.650893 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:52.650783 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxpnk" podUID="0a3d3d7c-0aa1-4223-9892-ed05eaf7062f" Jun 03 23:24:53.650576 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:53.650533 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jp9j" Jun 03 23:24:53.651003 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:53.650680 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jp9j" podUID="83566a98-4a00-49eb-8108-30162d78adc8" Jun 03 23:24:53.651003 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:53.650737 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58jkf" Jun 03 23:24:53.651003 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:53.650860 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58jkf" podUID="38c2283b-dc88-4292-9e56-50e1e5da9064" Jun 03 23:24:54.651302 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:54.651256 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxpnk" Jun 03 23:24:54.651688 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:54.651404 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxpnk" podUID="0a3d3d7c-0aa1-4223-9892-ed05eaf7062f" Jun 03 23:24:55.651069 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:55.651028 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58jkf" Jun 03 23:24:55.651246 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:55.651180 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58jkf" podUID="38c2283b-dc88-4292-9e56-50e1e5da9064" Jun 03 23:24:55.651246 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:55.651235 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jp9j" Jun 03 23:24:55.651690 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:55.651376 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jp9j" podUID="83566a98-4a00-49eb-8108-30162d78adc8" Jun 03 23:24:56.650971 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:56.650932 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxpnk" Jun 03 23:24:56.651200 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:56.651062 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxpnk" podUID="0a3d3d7c-0aa1-4223-9892-ed05eaf7062f" Jun 03 23:24:57.323978 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:57.323941 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nkhk\" (UniqueName: \"kubernetes.io/projected/0a3d3d7c-0aa1-4223-9892-ed05eaf7062f-kube-api-access-6nkhk\") pod \"network-check-target-lxpnk\" (UID: \"0a3d3d7c-0aa1-4223-9892-ed05eaf7062f\") " pod="openshift-network-diagnostics/network-check-target-lxpnk" Jun 03 23:24:57.324383 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:57.323987 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38c2283b-dc88-4292-9e56-50e1e5da9064-metrics-certs\") pod \"network-metrics-daemon-58jkf\" (UID: \"38c2283b-dc88-4292-9e56-50e1e5da9064\") " pod="openshift-multus/network-metrics-daemon-58jkf" Jun 03 23:24:57.324383 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:57.324095 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:24:57.324383 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:57.324117 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 23:24:57.324383 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:57.324143 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 23:24:57.324383 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:57.324153 2574 projected.go:196] Error preparing data for projected volume kube-api-access-6nkhk for pod openshift-network-diagnostics/network-check-target-lxpnk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:24:57.324383 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:57.324158 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38c2283b-dc88-4292-9e56-50e1e5da9064-metrics-certs podName:38c2283b-dc88-4292-9e56-50e1e5da9064 nodeName:}" failed. No retries permitted until 2026-06-03 23:25:13.324145343 +0000 UTC m=+34.131365785 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38c2283b-dc88-4292-9e56-50e1e5da9064-metrics-certs") pod "network-metrics-daemon-58jkf" (UID: "38c2283b-dc88-4292-9e56-50e1e5da9064") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:24:57.324383 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:57.324192 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a3d3d7c-0aa1-4223-9892-ed05eaf7062f-kube-api-access-6nkhk podName:0a3d3d7c-0aa1-4223-9892-ed05eaf7062f nodeName:}" failed. No retries permitted until 2026-06-03 23:25:13.324179975 +0000 UTC m=+34.131400417 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6nkhk" (UniqueName: "kubernetes.io/projected/0a3d3d7c-0aa1-4223-9892-ed05eaf7062f-kube-api-access-6nkhk") pod "network-check-target-lxpnk" (UID: "0a3d3d7c-0aa1-4223-9892-ed05eaf7062f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:24:57.425454 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:57.425419 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/83566a98-4a00-49eb-8108-30162d78adc8-original-pull-secret\") pod \"global-pull-secret-syncer-4jp9j\" (UID: \"83566a98-4a00-49eb-8108-30162d78adc8\") " pod="kube-system/global-pull-secret-syncer-4jp9j" Jun 03 23:24:57.425614 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:57.425584 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 23:24:57.425679 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:57.425663 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83566a98-4a00-49eb-8108-30162d78adc8-original-pull-secret podName:83566a98-4a00-49eb-8108-30162d78adc8 nodeName:}" failed. No retries permitted until 2026-06-03 23:25:13.425644279 +0000 UTC m=+34.232864724 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/83566a98-4a00-49eb-8108-30162d78adc8-original-pull-secret") pod "global-pull-secret-syncer-4jp9j" (UID: "83566a98-4a00-49eb-8108-30162d78adc8") : object "kube-system"/"original-pull-secret" not registered Jun 03 23:24:57.651616 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:57.651531 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58jkf" Jun 03 23:24:57.651755 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:57.651683 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58jkf" podUID="38c2283b-dc88-4292-9e56-50e1e5da9064" Jun 03 23:24:57.651755 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:57.651719 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jp9j" Jun 03 23:24:57.651863 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:57.651843 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jp9j" podUID="83566a98-4a00-49eb-8108-30162d78adc8" Jun 03 23:24:58.650930 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:58.650896 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxpnk" Jun 03 23:24:58.651367 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:58.651007 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxpnk" podUID="0a3d3d7c-0aa1-4223-9892-ed05eaf7062f" Jun 03 23:24:59.651633 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:59.651599 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58jkf" Jun 03 23:24:59.652064 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:59.651712 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58jkf" podUID="38c2283b-dc88-4292-9e56-50e1e5da9064" Jun 03 23:24:59.652064 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:24:59.651785 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jp9j" Jun 03 23:24:59.652064 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:24:59.651878 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jp9j" podUID="83566a98-4a00-49eb-8108-30162d78adc8" Jun 03 23:25:00.651368 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:00.651334 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxpnk" Jun 03 23:25:00.651508 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:25:00.651434 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxpnk" podUID="0a3d3d7c-0aa1-4223-9892-ed05eaf7062f" Jun 03 23:25:01.650903 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:01.650552 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58jkf" Jun 03 23:25:01.651563 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:01.650622 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jp9j" Jun 03 23:25:01.651563 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:25:01.651013 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58jkf" podUID="38c2283b-dc88-4292-9e56-50e1e5da9064" Jun 03 23:25:01.651563 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:25:01.651115 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jp9j" podUID="83566a98-4a00-49eb-8108-30162d78adc8" Jun 03 23:25:01.759990 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:01.759963 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wx4t4" event={"ID":"9fec56be-cb0f-4e01-9e51-aa62afa1499d","Type":"ContainerStarted","Data":"9ac75aba280661b869753a4a2bab88b014cd18fd0ce9a541abceba02c436317b"} Jun 03 23:25:01.761180 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:01.761150 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qptg9" event={"ID":"e8eb806c-295f-4b08-ad92-6ceef3b2a7b8","Type":"ContainerStarted","Data":"e4708a08a06c81c0263ce46feac0a60ed94062c3e53d20dba052df36e8a77d11"} Jun 03 23:25:01.762366 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:01.762337 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dnwpn" event={"ID":"35356266-b28e-48fb-b508-a661319c50b1","Type":"ContainerStarted","Data":"afc308a211a4a10f58b5a623d885d4fe64284550c81691fc9e4a0532e833b3d9"} Jun 03 23:25:01.763949 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:01.763923 2574 generic.go:356] "Generic (PLEG): container finished" podID="d5046da1-6cac-4c88-9646-5f473d81cf36" containerID="9d9897a8f82def5dbbceeb85fe71d12cd2c15e054da3d4c886fe4a2395301feb" exitCode=0 Jun 03 23:25:01.764052 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:01.764008 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z7b5v" event={"ID":"d5046da1-6cac-4c88-9646-5f473d81cf36","Type":"ContainerDied","Data":"9d9897a8f82def5dbbceeb85fe71d12cd2c15e054da3d4c886fe4a2395301feb"} Jun 03 23:25:01.767279 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:01.767255 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-849cq" event={"ID":"ef7191e9-242f-489c-bb31-a2d21da56948","Type":"ContainerStarted","Data":"16694247e9b92ecf8a6928a8b2a7807324d157e8aa19276634c974dfae714e72"} Jun 03 23:25:01.767382 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:01.767354 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-849cq" event={"ID":"ef7191e9-242f-489c-bb31-a2d21da56948","Type":"ContainerStarted","Data":"53b1802878d46e02edd9829c48d0ea90d86b3b7d0cdf4bba36aa563ead260a7e"} Jun 03 23:25:01.767428 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:01.767406 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-849cq" event={"ID":"ef7191e9-242f-489c-bb31-a2d21da56948","Type":"ContainerStarted","Data":"f2f58832ab5946d6cda429c131ed6b6f0d9c9f0f939e3a1ec14a62edf98cb9a2"} Jun 03 23:25:01.767469 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:01.767456 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-849cq" event={"ID":"ef7191e9-242f-489c-bb31-a2d21da56948","Type":"ContainerStarted","Data":"ddac7a77d2f5f6e6b8b1ed7ff9b7e37524493809979521cea212b19f9ee98804"} Jun 03 23:25:01.767514 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:01.767506 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-849cq" event={"ID":"ef7191e9-242f-489c-bb31-a2d21da56948","Type":"ContainerStarted","Data":"6fdabf5bcdd034d68ba7640dfb8a033a7ce0397bc258ada961ff99c22d9c4401"} Jun 03 23:25:01.767560 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:01.767550 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-849cq" event={"ID":"ef7191e9-242f-489c-bb31-a2d21da56948","Type":"ContainerStarted","Data":"2f7ba55dbf8d76a9d1214de1f41f411393490e5555bcec4ff9b5e23877095143"} Jun 03 23:25:01.768856 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:01.768813 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-v9qlk" event={"ID":"8aea005b-187c-4420-aa1f-aaee5e65b264","Type":"ContainerStarted","Data":"f365ac19c152b158b4220757703e7bccacd278b8e264b4c1adb7633e746a9d4f"} Jun 03 23:25:01.770630 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:01.770604 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlr5p" event={"ID":"0c0ffebc-b272-4e11-892a-08a3acb3f38f","Type":"ContainerStarted","Data":"958ce0e7aac6fe50575a1c097a7db726b8bb71444c1e040cc444aed81e88203d"} Jun 03 23:25:01.772069 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:01.772046 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jcmsv" event={"ID":"11967a41-0e69-4bbf-b847-a3d252607410","Type":"ContainerStarted","Data":"e56a89f1a7992e8eab765ad794bf14c18cbbd2f5ac6f4a4bac4419d01a17f01f"} Jun 03 23:25:01.778968 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:01.778929 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-wx4t4" podStartSLOduration=9.075307472 podStartE2EDuration="22.778914534s" totalImagesPullingTime="13.703607062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:24:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:25:01.778642237 +0000 UTC m=+22.585862703" watchObservedRunningTime="2026-06-03 23:25:01.778914534 +0000 UTC m=+22.586135000" Jun 03 23:25:01.796284 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:01.796242 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dnwpn" podStartSLOduration=4.391545555 podStartE2EDuration="22.796229034s" totalImagesPullingTime="18.404683479s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:24:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:25:01.796163864 +0000 UTC m=+22.603384341" watchObservedRunningTime="2026-06-03 23:25:01.796229034 +0000 UTC m=+22.603449498" Jun 03 23:25:01.816022 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:01.815968 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jcmsv" podStartSLOduration=4.400468449 podStartE2EDuration="22.815954009s" totalImagesPullingTime="18.41548556s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:24:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:25:01.814663216 +0000 UTC m=+22.621883680" watchObservedRunningTime="2026-06-03 23:25:01.815954009 +0000 UTC m=+22.623174472" Jun 03 23:25:01.854943 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:01.854854 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-v9qlk" podStartSLOduration=4.451971046 podStartE2EDuration="22.854840884s" totalImagesPullingTime="18.402869838s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:24:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:25:01.85440107 +0000 UTC m=+22.661621532" watchObservedRunningTime="2026-06-03 23:25:01.854840884 +0000 UTC m=+22.662061346" Jun 03 23:25:01.870381 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:01.870324 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qptg9" podStartSLOduration=4.470381594 podStartE2EDuration="22.87030467s" totalImagesPullingTime="18.399923076s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:24:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:25:01.869913637 +0000 UTC m=+22.677134100" watchObservedRunningTime="2026-06-03 23:25:01.87030467 +0000 UTC m=+22.677525132" Jun 03 23:25:02.011437 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:02.011411 2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 23:25:02.650972 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:02.650941 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxpnk" Jun 03 23:25:02.651469 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:25:02.651047 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxpnk" podUID="0a3d3d7c-0aa1-4223-9892-ed05eaf7062f" Jun 03 23:25:02.665809 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:02.665724 2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T23:25:02.011430969Z","UUID":"3b1f5bd5-23fe-4ed5-93b9-d82f3664898a","Handler":null,"Name":"","Endpoint":""} Jun 03 23:25:02.667561 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:02.667539 2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 23:25:02.667703 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:02.667576 2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 23:25:02.776618 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:02.776579 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlr5p" event={"ID":"0c0ffebc-b272-4e11-892a-08a3acb3f38f","Type":"ContainerStarted","Data":"6d0c6f6b4a0e73e57cd3796727ed406c9506da7dabc78b329661001623eefdb7"} Jun 03 23:25:02.779363 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:02.779327 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hgjd8" event={"ID":"a356b3d4-861f-42af-992c-a984488ad7f0","Type":"ContainerStarted","Data":"32153e0bef950522674c9f171b5e595009226670f1fa8dabaf1823171fab9ddf"} Jun 03 23:25:02.796266 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:02.796221 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hgjd8" podStartSLOduration=5.390058013 podStartE2EDuration="23.796201096s" totalImagesPullingTime="18.406143083s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:24:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:25:02.795383983 +0000 UTC m=+23.602604451" watchObservedRunningTime="2026-06-03 23:25:02.796201096 +0000 UTC m=+23.603421561" Jun 03 23:25:03.651423 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:03.651161 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58jkf" Jun 03 23:25:03.651920 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:03.651228 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jp9j" Jun 03 23:25:03.651920 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:25:03.651548 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58jkf" podUID="38c2283b-dc88-4292-9e56-50e1e5da9064" Jun 03 23:25:03.651920 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:25:03.651647 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jp9j" podUID="83566a98-4a00-49eb-8108-30162d78adc8" Jun 03 23:25:03.783451 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:03.783411 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlr5p" event={"ID":"0c0ffebc-b272-4e11-892a-08a3acb3f38f","Type":"ContainerStarted","Data":"ae1dbd5a13a159c13b32a688b366c14f803301f49b4ba4332fecc9e72c7e7cc3"} Jun 03 23:25:03.804759 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:03.804705 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wlr5p" podStartSLOduration=4.402577675 podStartE2EDuration="24.804684503s" totalImagesPullingTime="20.402106828s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:24:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:25:03.804105515 +0000 UTC m=+24.611325991" watchObservedRunningTime="2026-06-03 23:25:03.804684503 +0000 UTC m=+24.611904971" Jun 03 23:25:03.866308 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:03.866260 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-wx4t4" Jun 03 23:25:03.867100 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:03.866934 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-wx4t4" Jun 03 23:25:04.650731 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:04.650698 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxpnk" Jun 03 23:25:04.651010 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:25:04.650814 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxpnk" podUID="0a3d3d7c-0aa1-4223-9892-ed05eaf7062f" Jun 03 23:25:04.789039 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:04.789001 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-849cq" event={"ID":"ef7191e9-242f-489c-bb31-a2d21da56948","Type":"ContainerStarted","Data":"0f7dfd5afdf7c63430b75c88f65c4f08b454df24141e4a5f6c45a24f00f69362"} Jun 03 23:25:04.789621 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:04.789351 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-wx4t4" Jun 03 23:25:04.789860 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:04.789842 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-wx4t4" Jun 03 23:25:05.650779 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:05.650741 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58jkf" Jun 03 23:25:05.651001 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:05.650741 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jp9j" Jun 03 23:25:05.651001 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:25:05.650908 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58jkf" podUID="38c2283b-dc88-4292-9e56-50e1e5da9064" Jun 03 23:25:05.651001 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:25:05.650949 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jp9j" podUID="83566a98-4a00-49eb-8108-30162d78adc8" Jun 03 23:25:06.650642 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:06.650446 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxpnk" Jun 03 23:25:06.651465 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:25:06.650740 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxpnk" podUID="0a3d3d7c-0aa1-4223-9892-ed05eaf7062f" Jun 03 23:25:06.794436 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:06.794394 2574 generic.go:356] "Generic (PLEG): container finished" podID="d5046da1-6cac-4c88-9646-5f473d81cf36" containerID="499091c26e5e7a41e29b7e4ee439a0935a934f79f80c25c369e03eb7c17f71cc" exitCode=0 Jun 03 23:25:06.794593 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:06.794485 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z7b5v" event={"ID":"d5046da1-6cac-4c88-9646-5f473d81cf36","Type":"ContainerDied","Data":"499091c26e5e7a41e29b7e4ee439a0935a934f79f80c25c369e03eb7c17f71cc"} Jun 03 23:25:06.798209 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:06.798186 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-849cq" event={"ID":"ef7191e9-242f-489c-bb31-a2d21da56948","Type":"ContainerStarted","Data":"420d91b579e7a3888adc42fbf359131d785e8b13cb27e812b08b59cbddcb385e"} Jun 03 23:25:06.849021 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:06.848973 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-849cq" podStartSLOduration=9.256573188 podStartE2EDuration="27.848957311s" totalImagesPullingTime="18.592384123s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:24:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:25:06.848456381 +0000 UTC m=+27.655676846" watchObservedRunningTime="2026-06-03 23:25:06.848957311 +0000 UTC m=+27.656177775" Jun 03 23:25:07.650505 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:07.650479 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58jkf" Jun 03 23:25:07.650715 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:07.650529 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jp9j" Jun 03 23:25:07.650715 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:25:07.650619 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jp9j" podUID="83566a98-4a00-49eb-8108-30162d78adc8" Jun 03 23:25:07.651185 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:25:07.650703 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58jkf" podUID="38c2283b-dc88-4292-9e56-50e1e5da9064" Jun 03 23:25:07.803353 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:07.803056 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:25:07.803353 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:07.803227 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:25:07.803353 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:07.803311 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:25:07.819299 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:07.819252 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:25:07.819449 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:07.819403 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:25:08.299045 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:08.298974 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4jp9j"] Jun 03 23:25:08.299173 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:08.299085 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jp9j" Jun 03 23:25:08.299173 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:25:08.299164 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jp9j" podUID="83566a98-4a00-49eb-8108-30162d78adc8" Jun 03 23:25:08.301696 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:08.301674 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-58jkf"] Jun 03 23:25:08.301808 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:08.301763 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58jkf" Jun 03 23:25:08.301858 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:25:08.301838 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58jkf" podUID="38c2283b-dc88-4292-9e56-50e1e5da9064" Jun 03 23:25:08.314162 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:08.314138 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lxpnk"] Jun 03 23:25:08.314284 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:08.314243 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxpnk" Jun 03 23:25:08.314369 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:25:08.314352 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxpnk" podUID="0a3d3d7c-0aa1-4223-9892-ed05eaf7062f" Jun 03 23:25:08.804715 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:08.804684 2574 generic.go:356] "Generic (PLEG): container finished" podID="d5046da1-6cac-4c88-9646-5f473d81cf36" containerID="1aeabb08991650f474bab69d25cb7e315fe100d4095056853a7995ebf2bf35a0" exitCode=0 Jun 03 23:25:08.805047 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:08.804765 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z7b5v" event={"ID":"d5046da1-6cac-4c88-9646-5f473d81cf36","Type":"ContainerDied","Data":"1aeabb08991650f474bab69d25cb7e315fe100d4095056853a7995ebf2bf35a0"} Jun 03 23:25:10.651368 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:10.651331 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxpnk" Jun 03 23:25:10.651976 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:10.651372 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58jkf" Jun 03 23:25:10.651976 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:10.651372 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jp9j" Jun 03 23:25:10.651976 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:25:10.651451 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxpnk" podUID="0a3d3d7c-0aa1-4223-9892-ed05eaf7062f" Jun 03 23:25:10.651976 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:25:10.651535 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58jkf" podUID="38c2283b-dc88-4292-9e56-50e1e5da9064" Jun 03 23:25:10.651976 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:25:10.651613 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jp9j" podUID="83566a98-4a00-49eb-8108-30162d78adc8" Jun 03 23:25:10.812973 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:10.812940 2574 generic.go:356] "Generic (PLEG): container finished" podID="d5046da1-6cac-4c88-9646-5f473d81cf36" containerID="419af4cda59520e32d986c72786582260fc7d293675d73008ae5e5d5793100f5" exitCode=0 Jun 03 23:25:10.813107 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:10.813000 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z7b5v" event={"ID":"d5046da1-6cac-4c88-9646-5f473d81cf36","Type":"ContainerDied","Data":"419af4cda59520e32d986c72786582260fc7d293675d73008ae5e5d5793100f5"} Jun 03 23:25:12.650821 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:12.650784 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jp9j" Jun 03 23:25:12.651462 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:12.650838 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxpnk" Jun 03 23:25:12.651462 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:12.650918 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58jkf" Jun 03 23:25:12.651462 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:25:12.650920 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4jp9j" podUID="83566a98-4a00-49eb-8108-30162d78adc8" Jun 03 23:25:12.651462 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:25:12.650999 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxpnk" podUID="0a3d3d7c-0aa1-4223-9892-ed05eaf7062f" Jun 03 23:25:12.651462 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:25:12.651069 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58jkf" podUID="38c2283b-dc88-4292-9e56-50e1e5da9064" Jun 03 23:25:13.344260 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:13.344222 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nkhk\" (UniqueName: \"kubernetes.io/projected/0a3d3d7c-0aa1-4223-9892-ed05eaf7062f-kube-api-access-6nkhk\") pod \"network-check-target-lxpnk\" (UID: \"0a3d3d7c-0aa1-4223-9892-ed05eaf7062f\") " pod="openshift-network-diagnostics/network-check-target-lxpnk" Jun 03 23:25:13.344458 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:13.344283 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38c2283b-dc88-4292-9e56-50e1e5da9064-metrics-certs\") pod \"network-metrics-daemon-58jkf\" (UID: \"38c2283b-dc88-4292-9e56-50e1e5da9064\") " pod="openshift-multus/network-metrics-daemon-58jkf" Jun 03 23:25:13.344458 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:25:13.344414 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 23:25:13.344458 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:25:13.344438 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 23:25:13.344458 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:25:13.344451 2574 projected.go:196] Error preparing data for projected volume kube-api-access-6nkhk for pod openshift-network-diagnostics/network-check-target-lxpnk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:25:13.344743 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:25:13.344459 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:25:13.344743 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:25:13.344510 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a3d3d7c-0aa1-4223-9892-ed05eaf7062f-kube-api-access-6nkhk podName:0a3d3d7c-0aa1-4223-9892-ed05eaf7062f nodeName:}" failed. No retries permitted until 2026-06-03 23:25:45.344491618 +0000 UTC m=+66.151712073 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6nkhk" (UniqueName: "kubernetes.io/projected/0a3d3d7c-0aa1-4223-9892-ed05eaf7062f-kube-api-access-6nkhk") pod "network-check-target-lxpnk" (UID: "0a3d3d7c-0aa1-4223-9892-ed05eaf7062f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:25:13.344743 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:25:13.344542 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38c2283b-dc88-4292-9e56-50e1e5da9064-metrics-certs podName:38c2283b-dc88-4292-9e56-50e1e5da9064 nodeName:}" failed. No retries permitted until 2026-06-03 23:25:45.344532009 +0000 UTC m=+66.151752465 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38c2283b-dc88-4292-9e56-50e1e5da9064-metrics-certs") pod "network-metrics-daemon-58jkf" (UID: "38c2283b-dc88-4292-9e56-50e1e5da9064") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:25:13.445494 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:13.445462 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/83566a98-4a00-49eb-8108-30162d78adc8-original-pull-secret\") pod \"global-pull-secret-syncer-4jp9j\" (UID: \"83566a98-4a00-49eb-8108-30162d78adc8\") " pod="kube-system/global-pull-secret-syncer-4jp9j" Jun 03 23:25:13.445675 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:25:13.445634 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 23:25:13.445741 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:25:13.445704 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83566a98-4a00-49eb-8108-30162d78adc8-original-pull-secret podName:83566a98-4a00-49eb-8108-30162d78adc8 nodeName:}" failed. No retries permitted until 2026-06-03 23:25:45.445684834 +0000 UTC m=+66.252905292 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/83566a98-4a00-49eb-8108-30162d78adc8-original-pull-secret") pod "global-pull-secret-syncer-4jp9j" (UID: "83566a98-4a00-49eb-8108-30162d78adc8") : object "kube-system"/"original-pull-secret" not registered Jun 03 23:25:14.460774 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:14.460739 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-242.ec2.internal" event="NodeReady" Jun 03 23:25:14.461362 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:14.460878 2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 03 23:25:14.506947 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:14.506894 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wf5jt"] Jun 03 23:25:14.509482 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:14.509457 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vgpjr"] Jun 03 23:25:14.509621 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:14.509599 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wf5jt" Jun 03 23:25:14.511192 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:14.511173 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vgpjr" Jun 03 23:25:14.512232 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:14.512210 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 23:25:14.512369 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:14.512351 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 23:25:14.512631 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:14.512615 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tjp8n\"" Jun 03 23:25:14.513502 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:14.513481 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 23:25:14.513715 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:14.513698 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 23:25:14.513793 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:14.513773 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 23:25:14.513873 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:14.513851 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dr65q\"" Jun 03 23:25:14.519350 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:14.519328 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vgpjr"] Jun 03 23:25:14.520201 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:14.520181 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wf5jt"] Jun 03 23:25:14.650717 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:14.650627 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxpnk" Jun 03 23:25:14.650717 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:14.650658 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58jkf" Jun 03 23:25:14.650717 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:14.650668 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jp9j" Jun 03 23:25:14.653984 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:14.653806 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 23:25:14.654108 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:14.654007 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9ffbd581-2f34-45dd-a519-6e24200f8846-config-volume\") pod \"dns-default-wf5jt\" (UID: \"9ffbd581-2f34-45dd-a519-6e24200f8846\") " pod="openshift-dns/dns-default-wf5jt" Jun 03 23:25:14.654108 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:14.654035 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ffbd581-2f34-45dd-a519-6e24200f8846-metrics-tls\") pod \"dns-default-wf5jt\" (UID: \"9ffbd581-2f34-45dd-a519-6e24200f8846\") " pod="openshift-dns/dns-default-wf5jt" Jun 03 23:25:14.654108 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:14.654066 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee520e2e-86a3-461f-9914-0ccf3b449d6c-cert\") pod \"ingress-canary-vgpjr\" (UID: \"ee520e2e-86a3-461f-9914-0ccf3b449d6c\") " pod="openshift-ingress-canary/ingress-canary-vgpjr" Jun 03 23:25:14.654262 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:14.654117 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ffbd581-2f34-45dd-a519-6e24200f8846-tmp-dir\") pod \"dns-default-wf5jt\" (UID: \"9ffbd581-2f34-45dd-a519-6e24200f8846\") " pod="openshift-dns/dns-default-wf5jt" Jun 03 23:25:14.654262 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:14.654145 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwgld\" (UniqueName: \"kubernetes.io/projected/ee520e2e-86a3-461f-9914-0ccf3b449d6c-kube-api-access-hwgld\") pod \"ingress-canary-vgpjr\" (UID: \"ee520e2e-86a3-461f-9914-0ccf3b449d6c\") " pod="openshift-ingress-canary/ingress-canary-vgpjr" Jun 03 23:25:14.654262 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:14.654159 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f9b5l\"" Jun 03 23:25:14.654262 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:14.654182 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxgbc\" (UniqueName: \"kubernetes.io/projected/9ffbd581-2f34-45dd-a519-6e24200f8846-kube-api-access-zxgbc\") pod \"dns-default-wf5jt\" (UID: \"9ffbd581-2f34-45dd-a519-6e24200f8846\") " pod="openshift-dns/dns-default-wf5jt" Jun 03 23:25:14.654262 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:14.654217 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 23:25:14.654526 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:14.654318 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 23:25:14.654526 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:14.654470 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5mf7x\"" Jun 03 23:25:14.654526 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:14.654522 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 23:25:14.754847 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:14.754812 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9ffbd581-2f34-45dd-a519-6e24200f8846-config-volume\") pod \"dns-default-wf5jt\" (UID: \"9ffbd581-2f34-45dd-a519-6e24200f8846\") " pod="openshift-dns/dns-default-wf5jt" Jun 03 23:25:14.754847 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:14.754853 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ffbd581-2f34-45dd-a519-6e24200f8846-metrics-tls\") pod \"dns-default-wf5jt\" (UID: \"9ffbd581-2f34-45dd-a519-6e24200f8846\") " pod="openshift-dns/dns-default-wf5jt" Jun 03 23:25:14.755103 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:14.754887 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee520e2e-86a3-461f-9914-0ccf3b449d6c-cert\") pod \"ingress-canary-vgpjr\" (UID: \"ee520e2e-86a3-461f-9914-0ccf3b449d6c\") " pod="openshift-ingress-canary/ingress-canary-vgpjr" Jun 03 23:25:14.755103 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:14.754917 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ffbd581-2f34-45dd-a519-6e24200f8846-tmp-dir\") pod \"dns-default-wf5jt\" (UID: \"9ffbd581-2f34-45dd-a519-6e24200f8846\") " pod="openshift-dns/dns-default-wf5jt" Jun 03 23:25:14.755103 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:14.754937 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwgld\" (UniqueName: \"kubernetes.io/projected/ee520e2e-86a3-461f-9914-0ccf3b449d6c-kube-api-access-hwgld\") pod \"ingress-canary-vgpjr\" (UID: \"ee520e2e-86a3-461f-9914-0ccf3b449d6c\") " pod="openshift-ingress-canary/ingress-canary-vgpjr" Jun 03 23:25:14.755103 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:25:14.755007 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 23:25:14.755103 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:25:14.755080 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ffbd581-2f34-45dd-a519-6e24200f8846-metrics-tls podName:9ffbd581-2f34-45dd-a519-6e24200f8846 nodeName:}" failed. No retries permitted until 2026-06-03 23:25:15.255060248 +0000 UTC m=+36.062280698 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9ffbd581-2f34-45dd-a519-6e24200f8846-metrics-tls") pod "dns-default-wf5jt" (UID: "9ffbd581-2f34-45dd-a519-6e24200f8846") : secret "dns-default-metrics-tls" not found Jun 03 23:25:14.755367 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:14.755121 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxgbc\" (UniqueName: \"kubernetes.io/projected/9ffbd581-2f34-45dd-a519-6e24200f8846-kube-api-access-zxgbc\") pod \"dns-default-wf5jt\" (UID: \"9ffbd581-2f34-45dd-a519-6e24200f8846\") " pod="openshift-dns/dns-default-wf5jt" Jun 03 23:25:14.755367 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:14.755267 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ffbd581-2f34-45dd-a519-6e24200f8846-tmp-dir\") pod \"dns-default-wf5jt\" (UID: \"9ffbd581-2f34-45dd-a519-6e24200f8846\") " pod="openshift-dns/dns-default-wf5jt" Jun 03 23:25:14.755533 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:14.755508 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9ffbd581-2f34-45dd-a519-6e24200f8846-config-volume\") pod \"dns-default-wf5jt\" (UID: \"9ffbd581-2f34-45dd-a519-6e24200f8846\") " pod="openshift-dns/dns-default-wf5jt" Jun 03 23:25:14.760011 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:14.759978 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee520e2e-86a3-461f-9914-0ccf3b449d6c-cert\") pod \"ingress-canary-vgpjr\" (UID: \"ee520e2e-86a3-461f-9914-0ccf3b449d6c\") " pod="openshift-ingress-canary/ingress-canary-vgpjr" Jun 03 23:25:14.767206 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:14.767178 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxgbc\" (UniqueName: \"kubernetes.io/projected/9ffbd581-2f34-45dd-a519-6e24200f8846-kube-api-access-zxgbc\") pod \"dns-default-wf5jt\" (UID: \"9ffbd581-2f34-45dd-a519-6e24200f8846\") " pod="openshift-dns/dns-default-wf5jt" Jun 03 23:25:14.767515 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:14.767495 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwgld\" (UniqueName: \"kubernetes.io/projected/ee520e2e-86a3-461f-9914-0ccf3b449d6c-kube-api-access-hwgld\") pod \"ingress-canary-vgpjr\" (UID: \"ee520e2e-86a3-461f-9914-0ccf3b449d6c\") " pod="openshift-ingress-canary/ingress-canary-vgpjr" Jun 03 23:25:14.830603 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:14.830570 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vgpjr" Jun 03 23:25:15.080793 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:15.080765 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vgpjr"] Jun 03 23:25:15.084891 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:25:15.084869 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee520e2e_86a3_461f_9914_0ccf3b449d6c.slice/crio-f1f3bf6b46b7230feed09ef68c9c481d799bd339e8157513d82158ed5346070f WatchSource:0}: Error finding container f1f3bf6b46b7230feed09ef68c9c481d799bd339e8157513d82158ed5346070f: Status 404 returned error can't find the container with id f1f3bf6b46b7230feed09ef68c9c481d799bd339e8157513d82158ed5346070f Jun 03 23:25:15.260943 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:15.260859 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ffbd581-2f34-45dd-a519-6e24200f8846-metrics-tls\") pod \"dns-default-wf5jt\" (UID: \"9ffbd581-2f34-45dd-a519-6e24200f8846\") " pod="openshift-dns/dns-default-wf5jt" Jun 03 23:25:15.261115 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:25:15.261018 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 23:25:15.261115 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:25:15.261084 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ffbd581-2f34-45dd-a519-6e24200f8846-metrics-tls podName:9ffbd581-2f34-45dd-a519-6e24200f8846 nodeName:}" failed. No retries permitted until 2026-06-03 23:25:16.261067354 +0000 UTC m=+37.068287796 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9ffbd581-2f34-45dd-a519-6e24200f8846-metrics-tls") pod "dns-default-wf5jt" (UID: "9ffbd581-2f34-45dd-a519-6e24200f8846") : secret "dns-default-metrics-tls" not found Jun 03 23:25:15.828562 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:15.828523 2574 generic.go:356] "Generic (PLEG): container finished" podID="d5046da1-6cac-4c88-9646-5f473d81cf36" containerID="f012147035bab71525f93477204b8c956e68be070b41ca3dda7b9a057cc0bf43" exitCode=0 Jun 03 23:25:15.829102 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:15.828617 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z7b5v" event={"ID":"d5046da1-6cac-4c88-9646-5f473d81cf36","Type":"ContainerDied","Data":"f012147035bab71525f93477204b8c956e68be070b41ca3dda7b9a057cc0bf43"} Jun 03 23:25:15.830424 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:15.830388 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vgpjr" event={"ID":"ee520e2e-86a3-461f-9914-0ccf3b449d6c","Type":"ContainerStarted","Data":"f1f3bf6b46b7230feed09ef68c9c481d799bd339e8157513d82158ed5346070f"} Jun 03 23:25:16.268492 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:16.268459 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ffbd581-2f34-45dd-a519-6e24200f8846-metrics-tls\") pod \"dns-default-wf5jt\" (UID: \"9ffbd581-2f34-45dd-a519-6e24200f8846\") " pod="openshift-dns/dns-default-wf5jt" Jun 03 23:25:16.268669 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:25:16.268588 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 23:25:16.268669 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:25:16.268664 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ffbd581-2f34-45dd-a519-6e24200f8846-metrics-tls podName:9ffbd581-2f34-45dd-a519-6e24200f8846 nodeName:}" failed. No retries permitted until 2026-06-03 23:25:18.26863856 +0000 UTC m=+39.075859022 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9ffbd581-2f34-45dd-a519-6e24200f8846-metrics-tls") pod "dns-default-wf5jt" (UID: "9ffbd581-2f34-45dd-a519-6e24200f8846") : secret "dns-default-metrics-tls" not found Jun 03 23:25:16.836561 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:16.836320 2574 generic.go:356] "Generic (PLEG): container finished" podID="d5046da1-6cac-4c88-9646-5f473d81cf36" containerID="690b31d837343fc621e488d8c367932def92d8a718842ace85f1858c9f8dff15" exitCode=0 Jun 03 23:25:16.836962 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:16.836393 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z7b5v" event={"ID":"d5046da1-6cac-4c88-9646-5f473d81cf36","Type":"ContainerDied","Data":"690b31d837343fc621e488d8c367932def92d8a718842ace85f1858c9f8dff15"} Jun 03 23:25:16.838248 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:16.838209 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vgpjr" event={"ID":"ee520e2e-86a3-461f-9914-0ccf3b449d6c","Type":"ContainerStarted","Data":"8d87d42d89e33e87dbe9f50feecf21c71d5e7bc752f35dbdd70189454d14419b"} Jun 03 23:25:17.843458 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:17.843420 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z7b5v" event={"ID":"d5046da1-6cac-4c88-9646-5f473d81cf36","Type":"ContainerStarted","Data":"7aa58ba4b98cec2eb520f9822f21968a89da1bc1de6068f4f6ad95720ea9edfa"} Jun 03 23:25:17.866877 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:17.866828 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-z7b5v" podStartSLOduration=10.053350243 podStartE2EDuration="38.86681392s" totalImagesPullingTime="28.813463677s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:24:39 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:25:17.865336749 +0000 UTC m=+38.672557213" watchObservedRunningTime="2026-06-03 23:25:17.86681392 +0000 UTC m=+38.674034384" Jun 03 23:25:17.867477 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:17.867450 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vgpjr" podStartSLOduration=2.38636295 podStartE2EDuration="3.867439606s" totalImagesPullingTime="1.481076656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:25:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:25:16.881075492 +0000 UTC m=+37.688295956" watchObservedRunningTime="2026-06-03 23:25:17.867439606 +0000 UTC m=+38.674660070" Jun 03 23:25:18.285223 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:18.285191 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ffbd581-2f34-45dd-a519-6e24200f8846-metrics-tls\") pod \"dns-default-wf5jt\" (UID: \"9ffbd581-2f34-45dd-a519-6e24200f8846\") " pod="openshift-dns/dns-default-wf5jt" Jun 03 23:25:18.285408 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:25:18.285344 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 23:25:18.285408 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:25:18.285400 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ffbd581-2f34-45dd-a519-6e24200f8846-metrics-tls podName:9ffbd581-2f34-45dd-a519-6e24200f8846 nodeName:}" failed. No retries permitted until 2026-06-03 23:25:22.285385824 +0000 UTC m=+43.092606267 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9ffbd581-2f34-45dd-a519-6e24200f8846-metrics-tls") pod "dns-default-wf5jt" (UID: "9ffbd581-2f34-45dd-a519-6e24200f8846") : secret "dns-default-metrics-tls" not found Jun 03 23:25:22.312734 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:22.312698 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ffbd581-2f34-45dd-a519-6e24200f8846-metrics-tls\") pod \"dns-default-wf5jt\" (UID: \"9ffbd581-2f34-45dd-a519-6e24200f8846\") " pod="openshift-dns/dns-default-wf5jt" Jun 03 23:25:22.313196 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:25:22.312830 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 23:25:22.313196 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:25:22.312887 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ffbd581-2f34-45dd-a519-6e24200f8846-metrics-tls podName:9ffbd581-2f34-45dd-a519-6e24200f8846 nodeName:}" failed. No retries permitted until 2026-06-03 23:25:30.312870849 +0000 UTC m=+51.120091309 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9ffbd581-2f34-45dd-a519-6e24200f8846-metrics-tls") pod "dns-default-wf5jt" (UID: "9ffbd581-2f34-45dd-a519-6e24200f8846") : secret "dns-default-metrics-tls" not found Jun 03 23:25:30.366006 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:30.365944 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ffbd581-2f34-45dd-a519-6e24200f8846-metrics-tls\") pod \"dns-default-wf5jt\" (UID: \"9ffbd581-2f34-45dd-a519-6e24200f8846\") " pod="openshift-dns/dns-default-wf5jt" Jun 03 23:25:30.366501 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:25:30.366110 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 23:25:30.366501 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:25:30.366183 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ffbd581-2f34-45dd-a519-6e24200f8846-metrics-tls podName:9ffbd581-2f34-45dd-a519-6e24200f8846 nodeName:}" failed. No retries permitted until 2026-06-03 23:25:46.366163501 +0000 UTC m=+67.173383962 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9ffbd581-2f34-45dd-a519-6e24200f8846-metrics-tls") pod "dns-default-wf5jt" (UID: "9ffbd581-2f34-45dd-a519-6e24200f8846") : secret "dns-default-metrics-tls" not found Jun 03 23:25:39.817559 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:39.817532 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-849cq" Jun 03 23:25:45.370018 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:45.369977 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nkhk\" (UniqueName: \"kubernetes.io/projected/0a3d3d7c-0aa1-4223-9892-ed05eaf7062f-kube-api-access-6nkhk\") pod \"network-check-target-lxpnk\" (UID: \"0a3d3d7c-0aa1-4223-9892-ed05eaf7062f\") " pod="openshift-network-diagnostics/network-check-target-lxpnk" Jun 03 23:25:45.370468 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:45.370026 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38c2283b-dc88-4292-9e56-50e1e5da9064-metrics-certs\") pod \"network-metrics-daemon-58jkf\" (UID: \"38c2283b-dc88-4292-9e56-50e1e5da9064\") " pod="openshift-multus/network-metrics-daemon-58jkf" Jun 03 23:25:45.373153 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:45.373137 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 23:25:45.373214 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:45.373180 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 23:25:45.380731 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:25:45.380716 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 23:25:45.380806 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:25:45.380784 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38c2283b-dc88-4292-9e56-50e1e5da9064-metrics-certs podName:38c2283b-dc88-4292-9e56-50e1e5da9064 nodeName:}" failed. No retries permitted until 2026-06-03 23:26:49.380768377 +0000 UTC m=+130.187988819 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38c2283b-dc88-4292-9e56-50e1e5da9064-metrics-certs") pod "network-metrics-daemon-58jkf" (UID: "38c2283b-dc88-4292-9e56-50e1e5da9064") : secret "metrics-daemon-secret" not found Jun 03 23:25:45.383637 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:45.383619 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 23:25:45.395186 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:45.395156 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nkhk\" (UniqueName: \"kubernetes.io/projected/0a3d3d7c-0aa1-4223-9892-ed05eaf7062f-kube-api-access-6nkhk\") pod \"network-check-target-lxpnk\" (UID: \"0a3d3d7c-0aa1-4223-9892-ed05eaf7062f\") " pod="openshift-network-diagnostics/network-check-target-lxpnk" Jun 03 23:25:45.471327 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:45.471275 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/83566a98-4a00-49eb-8108-30162d78adc8-original-pull-secret\") pod \"global-pull-secret-syncer-4jp9j\" (UID: \"83566a98-4a00-49eb-8108-30162d78adc8\") " pod="kube-system/global-pull-secret-syncer-4jp9j" Jun 03 23:25:45.474401 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:45.474384 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 23:25:45.483948 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:45.483926 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/83566a98-4a00-49eb-8108-30162d78adc8-original-pull-secret\") pod \"global-pull-secret-syncer-4jp9j\" (UID: \"83566a98-4a00-49eb-8108-30162d78adc8\") " pod="kube-system/global-pull-secret-syncer-4jp9j" Jun 03 23:25:45.565800 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:45.565773 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f9b5l\"" Jun 03 23:25:45.573361 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:45.573342 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxpnk" Jun 03 23:25:45.575577 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:45.575561 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4jp9j" Jun 03 23:25:45.726327 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:45.726235 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lxpnk"] Jun 03 23:25:45.728442 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:25:45.728418 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a3d3d7c_0aa1_4223_9892_ed05eaf7062f.slice/crio-967cd262d9c21aaf2663655c79ed7130673b792d164330e5a22e810f39344571 WatchSource:0}: Error finding container 967cd262d9c21aaf2663655c79ed7130673b792d164330e5a22e810f39344571: Status 404 returned error can't find the container with id 967cd262d9c21aaf2663655c79ed7130673b792d164330e5a22e810f39344571 Jun 03 23:25:45.741537 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:45.741516 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4jp9j"] Jun 03 23:25:45.743927 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:25:45.743894 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83566a98_4a00_49eb_8108_30162d78adc8.slice/crio-08e6adfe8eb3432a3372eba4fc34996abf9b73a851081f91eb3a1bbf7ff261e7 WatchSource:0}: Error finding container 08e6adfe8eb3432a3372eba4fc34996abf9b73a851081f91eb3a1bbf7ff261e7: Status 404 returned error can't find the container with id 08e6adfe8eb3432a3372eba4fc34996abf9b73a851081f91eb3a1bbf7ff261e7 Jun 03 23:25:45.908929 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:45.908902 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4jp9j" event={"ID":"83566a98-4a00-49eb-8108-30162d78adc8","Type":"ContainerStarted","Data":"08e6adfe8eb3432a3372eba4fc34996abf9b73a851081f91eb3a1bbf7ff261e7"} Jun 03 23:25:45.909944 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:45.909914 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lxpnk" event={"ID":"0a3d3d7c-0aa1-4223-9892-ed05eaf7062f","Type":"ContainerStarted","Data":"967cd262d9c21aaf2663655c79ed7130673b792d164330e5a22e810f39344571"} Jun 03 23:25:46.378947 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:46.378865 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ffbd581-2f34-45dd-a519-6e24200f8846-metrics-tls\") pod \"dns-default-wf5jt\" (UID: \"9ffbd581-2f34-45dd-a519-6e24200f8846\") " pod="openshift-dns/dns-default-wf5jt" Jun 03 23:25:46.379471 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:25:46.379002 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 23:25:46.379471 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:25:46.379064 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ffbd581-2f34-45dd-a519-6e24200f8846-metrics-tls podName:9ffbd581-2f34-45dd-a519-6e24200f8846 nodeName:}" failed. No retries permitted until 2026-06-03 23:26:18.379044708 +0000 UTC m=+99.186265152 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9ffbd581-2f34-45dd-a519-6e24200f8846-metrics-tls") pod "dns-default-wf5jt" (UID: "9ffbd581-2f34-45dd-a519-6e24200f8846") : secret "dns-default-metrics-tls" not found Jun 03 23:25:50.925546 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:50.925507 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4jp9j" event={"ID":"83566a98-4a00-49eb-8108-30162d78adc8","Type":"ContainerStarted","Data":"ab600be166363a717c6090437bc3c72bdff0f546dc0c4f942fc3a5b28651661d"} Jun 03 23:25:50.926912 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:50.926889 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lxpnk" event={"ID":"0a3d3d7c-0aa1-4223-9892-ed05eaf7062f","Type":"ContainerStarted","Data":"93ee50f1d8337f905b18e5ae21c341166185452e4fa0d970a659ba2563cb81f2"} Jun 03 23:25:50.927034 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:50.927018 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lxpnk" Jun 03 23:25:50.941175 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:50.941129 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4jp9j" podStartSLOduration=67.637897709 podStartE2EDuration="1m11.941116465s" totalImagesPullingTime="4.303218756s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:24:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:25:50.940847468 +0000 UTC m=+71.748067932" watchObservedRunningTime="2026-06-03 23:25:50.941116465 +0000 UTC m=+71.748336928" Jun 03 23:25:50.956222 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:25:50.956178 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lxpnk" podStartSLOduration=67.64137529999999 podStartE2EDuration="1m11.956163485s" totalImagesPullingTime="4.314788185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:24:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:25:50.956065751 +0000 UTC m=+71.763286214" watchObservedRunningTime="2026-06-03 23:25:50.956163485 +0000 UTC m=+71.763383926" Jun 03 23:26:18.395115 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:26:18.395066 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ffbd581-2f34-45dd-a519-6e24200f8846-metrics-tls\") pod \"dns-default-wf5jt\" (UID: \"9ffbd581-2f34-45dd-a519-6e24200f8846\") " pod="openshift-dns/dns-default-wf5jt" Jun 03 23:26:18.395568 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:26:18.395200 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 23:26:18.395568 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:26:18.395253 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ffbd581-2f34-45dd-a519-6e24200f8846-metrics-tls podName:9ffbd581-2f34-45dd-a519-6e24200f8846 nodeName:}" failed. No retries permitted until 2026-06-03 23:27:22.395240263 +0000 UTC m=+163.202460707 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9ffbd581-2f34-45dd-a519-6e24200f8846-metrics-tls") pod "dns-default-wf5jt" (UID: "9ffbd581-2f34-45dd-a519-6e24200f8846") : secret "dns-default-metrics-tls" not found Jun 03 23:26:21.931982 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:26:21.931950 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lxpnk" Jun 03 23:26:49.400921 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:26:49.400885 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38c2283b-dc88-4292-9e56-50e1e5da9064-metrics-certs\") pod \"network-metrics-daemon-58jkf\" (UID: \"38c2283b-dc88-4292-9e56-50e1e5da9064\") " pod="openshift-multus/network-metrics-daemon-58jkf" Jun 03 23:26:49.401444 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:26:49.401042 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 23:26:49.401444 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:26:49.401118 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38c2283b-dc88-4292-9e56-50e1e5da9064-metrics-certs podName:38c2283b-dc88-4292-9e56-50e1e5da9064 nodeName:}" failed. No retries permitted until 2026-06-03 23:28:51.401102135 +0000 UTC m=+252.208322578 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38c2283b-dc88-4292-9e56-50e1e5da9064-metrics-certs") pod "network-metrics-daemon-58jkf" (UID: "38c2283b-dc88-4292-9e56-50e1e5da9064") : secret "metrics-daemon-secret" not found Jun 03 23:27:17.523858 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:27:17.523806 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-wf5jt" podUID="9ffbd581-2f34-45dd-a519-6e24200f8846" Jun 03 23:27:17.669050 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:27:17.669008 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-58jkf" podUID="38c2283b-dc88-4292-9e56-50e1e5da9064" Jun 03 23:27:18.129762 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:27:18.129729 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wf5jt" Jun 03 23:27:22.425238 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:27:22.425192 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ffbd581-2f34-45dd-a519-6e24200f8846-metrics-tls\") pod \"dns-default-wf5jt\" (UID: \"9ffbd581-2f34-45dd-a519-6e24200f8846\") " pod="openshift-dns/dns-default-wf5jt" Jun 03 23:27:22.425683 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:27:22.425327 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 23:27:22.425683 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:27:22.425388 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ffbd581-2f34-45dd-a519-6e24200f8846-metrics-tls podName:9ffbd581-2f34-45dd-a519-6e24200f8846 nodeName:}" failed. No retries permitted until 2026-06-03 23:29:24.425372283 +0000 UTC m=+285.232592725 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9ffbd581-2f34-45dd-a519-6e24200f8846-metrics-tls") pod "dns-default-wf5jt" (UID: "9ffbd581-2f34-45dd-a519-6e24200f8846") : secret "dns-default-metrics-tls" not found Jun 03 23:27:29.652343 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:27:29.652254 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58jkf" Jun 03 23:28:33.095806 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.095771 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-vwhcp"] Jun 03 23:28:33.097565 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.097548 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-vwhcp" Jun 03 23:28:33.099146 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.099127 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-69684796bc-ggcdl"] Jun 03 23:28:33.100387 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.100365 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 03 23:28:33.100500 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.100374 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 03 23:28:33.100500 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.100374 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 03 23:28:33.100641 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.100511 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-sxs9g\"" Jun 03 23:28:33.100911 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.100894 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-48q4x"] Jun 03 23:28:33.101008 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.100996 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-69684796bc-ggcdl" Jun 03 23:28:33.101616 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.101596 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 03 23:28:33.102870 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.102852 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-48q4x" Jun 03 23:28:33.103930 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.103910 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 03 23:28:33.104015 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.103981 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-gpcrj\"" Jun 03 23:28:33.104175 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.104161 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 23:28:33.104359 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.104342 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 23:28:33.104426 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.104342 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 03 23:28:33.105390 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.105371 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 03 23:28:33.105847 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.105832 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 03 23:28:33.105921 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.105832 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-rxf4r\"" Jun 03 23:28:33.110979 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.110960 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 03 23:28:33.114168 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.114149 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-vwhcp"] Jun 03 23:28:33.120153 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.120130 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-69684796bc-ggcdl"] Jun 03 23:28:33.121141 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.121107 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-48q4x"] Jun 03 23:28:33.191788 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.191754 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-57769895dd-xhccj"] Jun 03 23:28:33.193573 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.193557 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xhccj" Jun 03 23:28:33.197690 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.197661 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7df4975dfb-6gst8"] Jun 03 23:28:33.198550 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.198525 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 23:28:33.198675 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.198582 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 23:28:33.198675 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.198648 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 03 23:28:33.198675 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.198660 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 03 23:28:33.198835 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.198759 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-zsfl6\"" Jun 03 23:28:33.199517 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.199497 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7df4975dfb-6gst8" Jun 03 23:28:33.210446 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.210425 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8e27eeb5-c500-4da6-b469-ad64b2ddcfa1-serving-cert\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-vwhcp\" (UID: \"8e27eeb5-c500-4da6-b469-ad64b2ddcfa1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-vwhcp" Jun 03 23:28:33.210531 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.210451 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1d545fc1-b4f3-4d2c-9ed9-d04a4b3ab786-snapshots\") pod \"insights-operator-69684796bc-ggcdl\" (UID: \"1d545fc1-b4f3-4d2c-9ed9-d04a4b3ab786\") " pod="openshift-insights/insights-operator-69684796bc-ggcdl" Jun 03 23:28:33.210531 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.210474 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7l8sb\" (UniqueName: \"kubernetes.io/projected/8e27eeb5-c500-4da6-b469-ad64b2ddcfa1-kube-api-access-7l8sb\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-vwhcp\" (UID: \"8e27eeb5-c500-4da6-b469-ad64b2ddcfa1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-vwhcp" Jun 03 23:28:33.210531 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.210490 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1d545fc1-b4f3-4d2c-9ed9-d04a4b3ab786-serving-cert\") pod \"insights-operator-69684796bc-ggcdl\" (UID: \"1d545fc1-b4f3-4d2c-9ed9-d04a4b3ab786\") " pod="openshift-insights/insights-operator-69684796bc-ggcdl" Jun 03 23:28:33.210531 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.210516 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d545fc1-b4f3-4d2c-9ed9-d04a4b3ab786-trusted-ca-bundle\") pod \"insights-operator-69684796bc-ggcdl\" (UID: \"1d545fc1-b4f3-4d2c-9ed9-d04a4b3ab786\") " pod="openshift-insights/insights-operator-69684796bc-ggcdl" Jun 03 23:28:33.210696 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.210533 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw7ns\" (UniqueName: \"kubernetes.io/projected/1d545fc1-b4f3-4d2c-9ed9-d04a4b3ab786-kube-api-access-kw7ns\") pod \"insights-operator-69684796bc-ggcdl\" (UID: \"1d545fc1-b4f3-4d2c-9ed9-d04a4b3ab786\") " pod="openshift-insights/insights-operator-69684796bc-ggcdl" Jun 03 23:28:33.210696 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.210553 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d545fc1-b4f3-4d2c-9ed9-d04a4b3ab786-service-ca-bundle\") pod \"insights-operator-69684796bc-ggcdl\" (UID: \"1d545fc1-b4f3-4d2c-9ed9-d04a4b3ab786\") " pod="openshift-insights/insights-operator-69684796bc-ggcdl" Jun 03 23:28:33.210696 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.210577 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d545fc1-b4f3-4d2c-9ed9-d04a4b3ab786-tmp\") pod \"insights-operator-69684796bc-ggcdl\" (UID: \"1d545fc1-b4f3-4d2c-9ed9-d04a4b3ab786\") " pod="openshift-insights/insights-operator-69684796bc-ggcdl" Jun 03 23:28:33.210696 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.210614 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8e27eeb5-c500-4da6-b469-ad64b2ddcfa1-config\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-vwhcp\" (UID: \"8e27eeb5-c500-4da6-b469-ad64b2ddcfa1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-vwhcp" Jun 03 23:28:33.210696 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.210638 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qht9n\" (UniqueName: \"kubernetes.io/projected/60758e35-f856-44a0-b2a1-322fe75bc431-kube-api-access-qht9n\") pod \"volume-data-source-validator-78dd696465-48q4x\" (UID: \"60758e35-f856-44a0-b2a1-322fe75bc431\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-48q4x" Jun 03 23:28:33.218955 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.218935 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-57769895dd-xhccj"] Jun 03 23:28:33.220045 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.220033 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 03 23:28:33.226647 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.226632 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 03 23:28:33.226735 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.226635 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 03 23:28:33.229572 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.229554 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6lj9c\"" Jun 03 23:28:33.261853 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.261822 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 03 23:28:33.293817 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.293786 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7df4975dfb-6gst8"] Jun 03 23:28:33.305627 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.305600 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7bd5df7d89-2fp8d"] Jun 03 23:28:33.307465 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.307448 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7bd5df7d89-2fp8d" Jun 03 23:28:33.310090 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.310073 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 03 23:28:33.310172 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.310078 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-zznqw\"" Jun 03 23:28:33.310330 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.310314 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 03 23:28:33.310394 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.310379 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 03 23:28:33.310601 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.310585 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 23:28:33.310650 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.310597 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 23:28:33.310650 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.310626 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 03 23:28:33.310878 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.310862 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw7ns\" (UniqueName: \"kubernetes.io/projected/1d545fc1-b4f3-4d2c-9ed9-d04a4b3ab786-kube-api-access-kw7ns\") pod \"insights-operator-69684796bc-ggcdl\" (UID: \"1d545fc1-b4f3-4d2c-9ed9-d04a4b3ab786\") " pod="openshift-insights/insights-operator-69684796bc-ggcdl" Jun 03 23:28:33.310921 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.310900 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-image-registry-private-configuration\") pod \"image-registry-7df4975dfb-6gst8\" (UID: \"06ac1abb-a9ad-4ce2-af4a-4687869aa05d\") " pod="openshift-image-registry/image-registry-7df4975dfb-6gst8" Jun 03 23:28:33.310968 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.310927 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8e27eeb5-c500-4da6-b469-ad64b2ddcfa1-serving-cert\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-vwhcp\" (UID: \"8e27eeb5-c500-4da6-b469-ad64b2ddcfa1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-vwhcp" Jun 03 23:28:33.310968 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.310952 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-registry-certificates\") pod \"image-registry-7df4975dfb-6gst8\" (UID: \"06ac1abb-a9ad-4ce2-af4a-4687869aa05d\") " pod="openshift-image-registry/image-registry-7df4975dfb-6gst8" Jun 03 23:28:33.311061 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.310976 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7l8sb\" (UniqueName: \"kubernetes.io/projected/8e27eeb5-c500-4da6-b469-ad64b2ddcfa1-kube-api-access-7l8sb\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-vwhcp\" (UID: \"8e27eeb5-c500-4da6-b469-ad64b2ddcfa1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-vwhcp" Jun 03 23:28:33.311061 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.311002 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1d545fc1-b4f3-4d2c-9ed9-d04a4b3ab786-serving-cert\") pod \"insights-operator-69684796bc-ggcdl\" (UID: \"1d545fc1-b4f3-4d2c-9ed9-d04a4b3ab786\") " pod="openshift-insights/insights-operator-69684796bc-ggcdl" Jun 03 23:28:33.311061 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.311046 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-registry-tls\") pod \"image-registry-7df4975dfb-6gst8\" (UID: \"06ac1abb-a9ad-4ce2-af4a-4687869aa05d\") " pod="openshift-image-registry/image-registry-7df4975dfb-6gst8" Jun 03 23:28:33.311196 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.311083 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d545fc1-b4f3-4d2c-9ed9-d04a4b3ab786-trusted-ca-bundle\") pod \"insights-operator-69684796bc-ggcdl\" (UID: \"1d545fc1-b4f3-4d2c-9ed9-d04a4b3ab786\") " pod="openshift-insights/insights-operator-69684796bc-ggcdl" Jun 03 23:28:33.311577 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.311118 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-bound-sa-token\") pod \"image-registry-7df4975dfb-6gst8\" (UID: \"06ac1abb-a9ad-4ce2-af4a-4687869aa05d\") " pod="openshift-image-registry/image-registry-7df4975dfb-6gst8" Jun 03 23:28:33.311869 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.311707 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d545fc1-b4f3-4d2c-9ed9-d04a4b3ab786-service-ca-bundle\") pod \"insights-operator-69684796bc-ggcdl\" (UID: \"1d545fc1-b4f3-4d2c-9ed9-d04a4b3ab786\") " pod="openshift-insights/insights-operator-69684796bc-ggcdl" Jun 03 23:28:33.314980 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.314951 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/099633be-d81f-4570-8cfb-027c2132aa6f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-xhccj\" (UID: \"099633be-d81f-4570-8cfb-027c2132aa6f\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xhccj" Jun 03 23:28:33.315074 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.312701 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d545fc1-b4f3-4d2c-9ed9-d04a4b3ab786-service-ca-bundle\") pod \"insights-operator-69684796bc-ggcdl\" (UID: \"1d545fc1-b4f3-4d2c-9ed9-d04a4b3ab786\") " pod="openshift-insights/insights-operator-69684796bc-ggcdl" Jun 03 23:28:33.315074 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.315040 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2b772\" (UniqueName: \"kubernetes.io/projected/099633be-d81f-4570-8cfb-027c2132aa6f-kube-api-access-2b772\") pod \"cluster-monitoring-operator-57769895dd-xhccj\" (UID: \"099633be-d81f-4570-8cfb-027c2132aa6f\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xhccj" Jun 03 23:28:33.315169 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.315129 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/099633be-d81f-4570-8cfb-027c2132aa6f-telemetry-config\") pod \"cluster-monitoring-operator-57769895dd-xhccj\" (UID: \"099633be-d81f-4570-8cfb-027c2132aa6f\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xhccj" Jun 03 23:28:33.315216 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.315208 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvmcc\" (UniqueName: \"kubernetes.io/projected/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-kube-api-access-cvmcc\") pod \"image-registry-7df4975dfb-6gst8\" (UID: \"06ac1abb-a9ad-4ce2-af4a-4687869aa05d\") " pod="openshift-image-registry/image-registry-7df4975dfb-6gst8" Jun 03 23:28:33.315282 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.315268 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-trusted-ca\") pod \"image-registry-7df4975dfb-6gst8\" (UID: \"06ac1abb-a9ad-4ce2-af4a-4687869aa05d\") " pod="openshift-image-registry/image-registry-7df4975dfb-6gst8" Jun 03 23:28:33.315406 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.315363 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-installation-pull-secrets\") pod \"image-registry-7df4975dfb-6gst8\" (UID: \"06ac1abb-a9ad-4ce2-af4a-4687869aa05d\") " pod="openshift-image-registry/image-registry-7df4975dfb-6gst8" Jun 03 23:28:33.315656 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.315635 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d545fc1-b4f3-4d2c-9ed9-d04a4b3ab786-tmp\") pod \"insights-operator-69684796bc-ggcdl\" (UID: \"1d545fc1-b4f3-4d2c-9ed9-d04a4b3ab786\") " pod="openshift-insights/insights-operator-69684796bc-ggcdl" Jun 03 23:28:33.315835 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.315817 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8e27eeb5-c500-4da6-b469-ad64b2ddcfa1-config\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-vwhcp\" (UID: \"8e27eeb5-c500-4da6-b469-ad64b2ddcfa1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-vwhcp" Jun 03 23:28:33.316003 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.315985 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qht9n\" (UniqueName: \"kubernetes.io/projected/60758e35-f856-44a0-b2a1-322fe75bc431-kube-api-access-qht9n\") pod \"volume-data-source-validator-78dd696465-48q4x\" (UID: \"60758e35-f856-44a0-b2a1-322fe75bc431\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-48q4x" Jun 03 23:28:33.316168 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.316152 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-ca-trust-extracted\") pod \"image-registry-7df4975dfb-6gst8\" (UID: \"06ac1abb-a9ad-4ce2-af4a-4687869aa05d\") " pod="openshift-image-registry/image-registry-7df4975dfb-6gst8" Jun 03 23:28:33.316438 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.316414 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1d545fc1-b4f3-4d2c-9ed9-d04a4b3ab786-snapshots\") pod \"insights-operator-69684796bc-ggcdl\" (UID: \"1d545fc1-b4f3-4d2c-9ed9-d04a4b3ab786\") " pod="openshift-insights/insights-operator-69684796bc-ggcdl" Jun 03 23:28:33.317464 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.317358 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8e27eeb5-c500-4da6-b469-ad64b2ddcfa1-config\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-vwhcp\" (UID: \"8e27eeb5-c500-4da6-b469-ad64b2ddcfa1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-vwhcp" Jun 03 23:28:33.318726 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.318703 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1d545fc1-b4f3-4d2c-9ed9-d04a4b3ab786-serving-cert\") pod \"insights-operator-69684796bc-ggcdl\" (UID: \"1d545fc1-b4f3-4d2c-9ed9-d04a4b3ab786\") " pod="openshift-insights/insights-operator-69684796bc-ggcdl" Jun 03 23:28:33.318866 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.318820 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1d545fc1-b4f3-4d2c-9ed9-d04a4b3ab786-snapshots\") pod \"insights-operator-69684796bc-ggcdl\" (UID: \"1d545fc1-b4f3-4d2c-9ed9-d04a4b3ab786\") " pod="openshift-insights/insights-operator-69684796bc-ggcdl" Jun 03 23:28:33.318961 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.318904 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d545fc1-b4f3-4d2c-9ed9-d04a4b3ab786-tmp\") pod \"insights-operator-69684796bc-ggcdl\" (UID: \"1d545fc1-b4f3-4d2c-9ed9-d04a4b3ab786\") " pod="openshift-insights/insights-operator-69684796bc-ggcdl" Jun 03 23:28:33.319725 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.319643 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d545fc1-b4f3-4d2c-9ed9-d04a4b3ab786-trusted-ca-bundle\") pod \"insights-operator-69684796bc-ggcdl\" (UID: \"1d545fc1-b4f3-4d2c-9ed9-d04a4b3ab786\") " pod="openshift-insights/insights-operator-69684796bc-ggcdl" Jun 03 23:28:33.321336 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.321256 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8e27eeb5-c500-4da6-b469-ad64b2ddcfa1-serving-cert\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-vwhcp\" (UID: \"8e27eeb5-c500-4da6-b469-ad64b2ddcfa1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-vwhcp" Jun 03 23:28:33.321478 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.321410 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7bd5df7d89-2fp8d"] Jun 03 23:28:33.323233 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.323213 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw7ns\" (UniqueName: \"kubernetes.io/projected/1d545fc1-b4f3-4d2c-9ed9-d04a4b3ab786-kube-api-access-kw7ns\") pod \"insights-operator-69684796bc-ggcdl\" (UID: \"1d545fc1-b4f3-4d2c-9ed9-d04a4b3ab786\") " pod="openshift-insights/insights-operator-69684796bc-ggcdl" Jun 03 23:28:33.323586 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.323569 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7l8sb\" (UniqueName: \"kubernetes.io/projected/8e27eeb5-c500-4da6-b469-ad64b2ddcfa1-kube-api-access-7l8sb\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-vwhcp\" (UID: \"8e27eeb5-c500-4da6-b469-ad64b2ddcfa1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-vwhcp" Jun 03 23:28:33.335175 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.335156 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qht9n\" (UniqueName: \"kubernetes.io/projected/60758e35-f856-44a0-b2a1-322fe75bc431-kube-api-access-qht9n\") pod \"volume-data-source-validator-78dd696465-48q4x\" (UID: \"60758e35-f856-44a0-b2a1-322fe75bc431\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-48q4x" Jun 03 23:28:33.408811 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.408771 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-vwhcp" Jun 03 23:28:33.416388 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.416365 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-69684796bc-ggcdl" Jun 03 23:28:33.417597 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.417573 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/099633be-d81f-4570-8cfb-027c2132aa6f-telemetry-config\") pod \"cluster-monitoring-operator-57769895dd-xhccj\" (UID: \"099633be-d81f-4570-8cfb-027c2132aa6f\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xhccj" Jun 03 23:28:33.417661 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.417610 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvmcc\" (UniqueName: \"kubernetes.io/projected/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-kube-api-access-cvmcc\") pod \"image-registry-7df4975dfb-6gst8\" (UID: \"06ac1abb-a9ad-4ce2-af4a-4687869aa05d\") " pod="openshift-image-registry/image-registry-7df4975dfb-6gst8" Jun 03 23:28:33.417661 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.417631 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-trusted-ca\") pod \"image-registry-7df4975dfb-6gst8\" (UID: \"06ac1abb-a9ad-4ce2-af4a-4687869aa05d\") " pod="openshift-image-registry/image-registry-7df4975dfb-6gst8" Jun 03 23:28:33.417770 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.417661 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/bfa864f5-28e9-4f1d-9515-e1ec120bdfc7-default-certificate\") pod \"router-default-7bd5df7d89-2fp8d\" (UID: \"bfa864f5-28e9-4f1d-9515-e1ec120bdfc7\") " pod="openshift-ingress/router-default-7bd5df7d89-2fp8d" Jun 03 23:28:33.417770 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.417687 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfa864f5-28e9-4f1d-9515-e1ec120bdfc7-metrics-certs\") pod \"router-default-7bd5df7d89-2fp8d\" (UID: \"bfa864f5-28e9-4f1d-9515-e1ec120bdfc7\") " pod="openshift-ingress/router-default-7bd5df7d89-2fp8d" Jun 03 23:28:33.417770 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.417714 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfa864f5-28e9-4f1d-9515-e1ec120bdfc7-service-ca-bundle\") pod \"router-default-7bd5df7d89-2fp8d\" (UID: \"bfa864f5-28e9-4f1d-9515-e1ec120bdfc7\") " pod="openshift-ingress/router-default-7bd5df7d89-2fp8d" Jun 03 23:28:33.417770 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.417740 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-installation-pull-secrets\") pod \"image-registry-7df4975dfb-6gst8\" (UID: \"06ac1abb-a9ad-4ce2-af4a-4687869aa05d\") " pod="openshift-image-registry/image-registry-7df4975dfb-6gst8" Jun 03 23:28:33.417959 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.417886 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq79x\" (UniqueName: \"kubernetes.io/projected/bfa864f5-28e9-4f1d-9515-e1ec120bdfc7-kube-api-access-dq79x\") pod \"router-default-7bd5df7d89-2fp8d\" (UID: \"bfa864f5-28e9-4f1d-9515-e1ec120bdfc7\") " pod="openshift-ingress/router-default-7bd5df7d89-2fp8d" Jun 03 23:28:33.417959 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.417919 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-ca-trust-extracted\") pod \"image-registry-7df4975dfb-6gst8\" (UID: \"06ac1abb-a9ad-4ce2-af4a-4687869aa05d\") " pod="openshift-image-registry/image-registry-7df4975dfb-6gst8" Jun 03 23:28:33.418064 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.417985 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-image-registry-private-configuration\") pod \"image-registry-7df4975dfb-6gst8\" (UID: \"06ac1abb-a9ad-4ce2-af4a-4687869aa05d\") " pod="openshift-image-registry/image-registry-7df4975dfb-6gst8" Jun 03 23:28:33.418064 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.418015 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-registry-certificates\") pod \"image-registry-7df4975dfb-6gst8\" (UID: \"06ac1abb-a9ad-4ce2-af4a-4687869aa05d\") " pod="openshift-image-registry/image-registry-7df4975dfb-6gst8" Jun 03 23:28:33.418064 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.418042 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-registry-tls\") pod \"image-registry-7df4975dfb-6gst8\" (UID: \"06ac1abb-a9ad-4ce2-af4a-4687869aa05d\") " pod="openshift-image-registry/image-registry-7df4975dfb-6gst8" Jun 03 23:28:33.418223 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.418074 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-bound-sa-token\") pod \"image-registry-7df4975dfb-6gst8\" (UID: \"06ac1abb-a9ad-4ce2-af4a-4687869aa05d\") " pod="openshift-image-registry/image-registry-7df4975dfb-6gst8" Jun 03 23:28:33.418223 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.418100 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/099633be-d81f-4570-8cfb-027c2132aa6f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-xhccj\" (UID: \"099633be-d81f-4570-8cfb-027c2132aa6f\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xhccj" Jun 03 23:28:33.418223 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.418156 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2b772\" (UniqueName: \"kubernetes.io/projected/099633be-d81f-4570-8cfb-027c2132aa6f-kube-api-access-2b772\") pod \"cluster-monitoring-operator-57769895dd-xhccj\" (UID: \"099633be-d81f-4570-8cfb-027c2132aa6f\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xhccj" Jun 03 23:28:33.418223 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.418186 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/bfa864f5-28e9-4f1d-9515-e1ec120bdfc7-stats-auth\") pod \"router-default-7bd5df7d89-2fp8d\" (UID: \"bfa864f5-28e9-4f1d-9515-e1ec120bdfc7\") " pod="openshift-ingress/router-default-7bd5df7d89-2fp8d" Jun 03 23:28:33.418446 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.418326 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-ca-trust-extracted\") pod \"image-registry-7df4975dfb-6gst8\" (UID: \"06ac1abb-a9ad-4ce2-af4a-4687869aa05d\") " pod="openshift-image-registry/image-registry-7df4975dfb-6gst8" Jun 03 23:28:33.418446 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.418402 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/099633be-d81f-4570-8cfb-027c2132aa6f-telemetry-config\") pod \"cluster-monitoring-operator-57769895dd-xhccj\" (UID: \"099633be-d81f-4570-8cfb-027c2132aa6f\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xhccj" Jun 03 23:28:33.418728 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:28:33.418530 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 23:28:33.418728 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:28:33.418623 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/099633be-d81f-4570-8cfb-027c2132aa6f-cluster-monitoring-operator-tls podName:099633be-d81f-4570-8cfb-027c2132aa6f nodeName:}" failed. No retries permitted until 2026-06-03 23:28:33.918596526 +0000 UTC m=+234.725816983 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/099633be-d81f-4570-8cfb-027c2132aa6f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-xhccj" (UID: "099633be-d81f-4570-8cfb-027c2132aa6f") : secret "cluster-monitoring-operator-tls" not found Jun 03 23:28:33.418939 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.418906 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-trusted-ca\") pod \"image-registry-7df4975dfb-6gst8\" (UID: \"06ac1abb-a9ad-4ce2-af4a-4687869aa05d\") " pod="openshift-image-registry/image-registry-7df4975dfb-6gst8" Jun 03 23:28:33.419041 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.419019 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-registry-certificates\") pod \"image-registry-7df4975dfb-6gst8\" (UID: \"06ac1abb-a9ad-4ce2-af4a-4687869aa05d\") " pod="openshift-image-registry/image-registry-7df4975dfb-6gst8" Jun 03 23:28:33.419397 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:28:33.419199 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 23:28:33.419397 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:28:33.419219 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7df4975dfb-6gst8: secret "image-registry-tls" not found Jun 03 23:28:33.419397 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:28:33.419266 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-registry-tls podName:06ac1abb-a9ad-4ce2-af4a-4687869aa05d nodeName:}" failed. No retries permitted until 2026-06-03 23:28:33.91925096 +0000 UTC m=+234.726471409 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-registry-tls") pod "image-registry-7df4975dfb-6gst8" (UID: "06ac1abb-a9ad-4ce2-af4a-4687869aa05d") : secret "image-registry-tls" not found Jun 03 23:28:33.422643 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.421403 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-installation-pull-secrets\") pod \"image-registry-7df4975dfb-6gst8\" (UID: \"06ac1abb-a9ad-4ce2-af4a-4687869aa05d\") " pod="openshift-image-registry/image-registry-7df4975dfb-6gst8" Jun 03 23:28:33.422643 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.422120 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-image-registry-private-configuration\") pod \"image-registry-7df4975dfb-6gst8\" (UID: \"06ac1abb-a9ad-4ce2-af4a-4687869aa05d\") " pod="openshift-image-registry/image-registry-7df4975dfb-6gst8" Jun 03 23:28:33.422643 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.422202 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-48q4x" Jun 03 23:28:33.430276 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.430251 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvmcc\" (UniqueName: \"kubernetes.io/projected/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-kube-api-access-cvmcc\") pod \"image-registry-7df4975dfb-6gst8\" (UID: \"06ac1abb-a9ad-4ce2-af4a-4687869aa05d\") " pod="openshift-image-registry/image-registry-7df4975dfb-6gst8" Jun 03 23:28:33.430400 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.430284 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-bound-sa-token\") pod \"image-registry-7df4975dfb-6gst8\" (UID: \"06ac1abb-a9ad-4ce2-af4a-4687869aa05d\") " pod="openshift-image-registry/image-registry-7df4975dfb-6gst8" Jun 03 23:28:33.430462 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.430447 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2b772\" (UniqueName: \"kubernetes.io/projected/099633be-d81f-4570-8cfb-027c2132aa6f-kube-api-access-2b772\") pod \"cluster-monitoring-operator-57769895dd-xhccj\" (UID: \"099633be-d81f-4570-8cfb-027c2132aa6f\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xhccj" Jun 03 23:28:33.518970 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.518934 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/bfa864f5-28e9-4f1d-9515-e1ec120bdfc7-stats-auth\") pod \"router-default-7bd5df7d89-2fp8d\" (UID: \"bfa864f5-28e9-4f1d-9515-e1ec120bdfc7\") " pod="openshift-ingress/router-default-7bd5df7d89-2fp8d" Jun 03 23:28:33.518970 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.518987 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/bfa864f5-28e9-4f1d-9515-e1ec120bdfc7-default-certificate\") pod \"router-default-7bd5df7d89-2fp8d\" (UID: \"bfa864f5-28e9-4f1d-9515-e1ec120bdfc7\") " pod="openshift-ingress/router-default-7bd5df7d89-2fp8d" Jun 03 23:28:33.519203 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.519006 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfa864f5-28e9-4f1d-9515-e1ec120bdfc7-metrics-certs\") pod \"router-default-7bd5df7d89-2fp8d\" (UID: \"bfa864f5-28e9-4f1d-9515-e1ec120bdfc7\") " pod="openshift-ingress/router-default-7bd5df7d89-2fp8d" Jun 03 23:28:33.519203 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.519028 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfa864f5-28e9-4f1d-9515-e1ec120bdfc7-service-ca-bundle\") pod \"router-default-7bd5df7d89-2fp8d\" (UID: \"bfa864f5-28e9-4f1d-9515-e1ec120bdfc7\") " pod="openshift-ingress/router-default-7bd5df7d89-2fp8d" Jun 03 23:28:33.519203 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.519067 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq79x\" (UniqueName: \"kubernetes.io/projected/bfa864f5-28e9-4f1d-9515-e1ec120bdfc7-kube-api-access-dq79x\") pod \"router-default-7bd5df7d89-2fp8d\" (UID: \"bfa864f5-28e9-4f1d-9515-e1ec120bdfc7\") " pod="openshift-ingress/router-default-7bd5df7d89-2fp8d" Jun 03 23:28:33.519866 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:28:33.519598 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 23:28:33.519866 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:28:33.519674 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfa864f5-28e9-4f1d-9515-e1ec120bdfc7-metrics-certs podName:bfa864f5-28e9-4f1d-9515-e1ec120bdfc7 nodeName:}" failed. No retries permitted until 2026-06-03 23:28:34.019650616 +0000 UTC m=+234.826871071 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bfa864f5-28e9-4f1d-9515-e1ec120bdfc7-metrics-certs") pod "router-default-7bd5df7d89-2fp8d" (UID: "bfa864f5-28e9-4f1d-9515-e1ec120bdfc7") : secret "router-metrics-certs-default" not found Jun 03 23:28:33.520045 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:28:33.519934 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bfa864f5-28e9-4f1d-9515-e1ec120bdfc7-service-ca-bundle podName:bfa864f5-28e9-4f1d-9515-e1ec120bdfc7 nodeName:}" failed. No retries permitted until 2026-06-03 23:28:34.019916481 +0000 UTC m=+234.827136930 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bfa864f5-28e9-4f1d-9515-e1ec120bdfc7-service-ca-bundle") pod "router-default-7bd5df7d89-2fp8d" (UID: "bfa864f5-28e9-4f1d-9515-e1ec120bdfc7") : configmap references non-existent config key: service-ca.crt Jun 03 23:28:33.522859 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.522833 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/bfa864f5-28e9-4f1d-9515-e1ec120bdfc7-stats-auth\") pod \"router-default-7bd5df7d89-2fp8d\" (UID: \"bfa864f5-28e9-4f1d-9515-e1ec120bdfc7\") " pod="openshift-ingress/router-default-7bd5df7d89-2fp8d" Jun 03 23:28:33.523598 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.523575 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/bfa864f5-28e9-4f1d-9515-e1ec120bdfc7-default-certificate\") pod \"router-default-7bd5df7d89-2fp8d\" (UID: \"bfa864f5-28e9-4f1d-9515-e1ec120bdfc7\") " pod="openshift-ingress/router-default-7bd5df7d89-2fp8d" Jun 03 23:28:33.527828 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.527773 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq79x\" (UniqueName: \"kubernetes.io/projected/bfa864f5-28e9-4f1d-9515-e1ec120bdfc7-kube-api-access-dq79x\") pod \"router-default-7bd5df7d89-2fp8d\" (UID: \"bfa864f5-28e9-4f1d-9515-e1ec120bdfc7\") " pod="openshift-ingress/router-default-7bd5df7d89-2fp8d" Jun 03 23:28:33.548378 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.548350 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-vwhcp"] Jun 03 23:28:33.551771 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:28:33.551738 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e27eeb5_c500_4da6_b469_ad64b2ddcfa1.slice/crio-6eaa1a9388902f549c25b541fd1976a0c57b5a5f6b0307f532db0d9caf79d3bf WatchSource:0}: Error finding container 6eaa1a9388902f549c25b541fd1976a0c57b5a5f6b0307f532db0d9caf79d3bf: Status 404 returned error can't find the container with id 6eaa1a9388902f549c25b541fd1976a0c57b5a5f6b0307f532db0d9caf79d3bf Jun 03 23:28:33.564782 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.564757 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-69684796bc-ggcdl"] Jun 03 23:28:33.566661 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:28:33.566635 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d545fc1_b4f3_4d2c_9ed9_d04a4b3ab786.slice/crio-2df4b3067ddfc226104bedef170c40bbcc88657c945ed766bca02bc6492f878c WatchSource:0}: Error finding container 2df4b3067ddfc226104bedef170c40bbcc88657c945ed766bca02bc6492f878c: Status 404 returned error can't find the container with id 2df4b3067ddfc226104bedef170c40bbcc88657c945ed766bca02bc6492f878c Jun 03 23:28:33.580639 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.580608 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-48q4x"] Jun 03 23:28:33.583614 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:28:33.583589 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60758e35_f856_44a0_b2a1_322fe75bc431.slice/crio-59c9e797b25aa96b1f30ea39b4305be858d46c4b6f5221269d835cb1f52ab5ea WatchSource:0}: Error finding container 59c9e797b25aa96b1f30ea39b4305be858d46c4b6f5221269d835cb1f52ab5ea: Status 404 returned error can't find the container with id 59c9e797b25aa96b1f30ea39b4305be858d46c4b6f5221269d835cb1f52ab5ea Jun 03 23:28:33.922278 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.922242 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-registry-tls\") pod \"image-registry-7df4975dfb-6gst8\" (UID: \"06ac1abb-a9ad-4ce2-af4a-4687869aa05d\") " pod="openshift-image-registry/image-registry-7df4975dfb-6gst8" Jun 03 23:28:33.922278 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:33.922286 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/099633be-d81f-4570-8cfb-027c2132aa6f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-xhccj\" (UID: \"099633be-d81f-4570-8cfb-027c2132aa6f\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xhccj" Jun 03 23:28:33.922530 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:28:33.922404 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 23:28:33.922530 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:28:33.922423 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7df4975dfb-6gst8: secret "image-registry-tls" not found Jun 03 23:28:33.922530 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:28:33.922424 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 23:28:33.922530 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:28:33.922480 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-registry-tls podName:06ac1abb-a9ad-4ce2-af4a-4687869aa05d nodeName:}" failed. No retries permitted until 2026-06-03 23:28:34.922463502 +0000 UTC m=+235.729683944 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-registry-tls") pod "image-registry-7df4975dfb-6gst8" (UID: "06ac1abb-a9ad-4ce2-af4a-4687869aa05d") : secret "image-registry-tls" not found Jun 03 23:28:33.922530 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:28:33.922495 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/099633be-d81f-4570-8cfb-027c2132aa6f-cluster-monitoring-operator-tls podName:099633be-d81f-4570-8cfb-027c2132aa6f nodeName:}" failed. No retries permitted until 2026-06-03 23:28:34.92248884 +0000 UTC m=+235.729709282 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/099633be-d81f-4570-8cfb-027c2132aa6f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-xhccj" (UID: "099633be-d81f-4570-8cfb-027c2132aa6f") : secret "cluster-monitoring-operator-tls" not found Jun 03 23:28:34.024328 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:34.023627 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfa864f5-28e9-4f1d-9515-e1ec120bdfc7-metrics-certs\") pod \"router-default-7bd5df7d89-2fp8d\" (UID: \"bfa864f5-28e9-4f1d-9515-e1ec120bdfc7\") " pod="openshift-ingress/router-default-7bd5df7d89-2fp8d" Jun 03 23:28:34.024328 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:34.023674 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfa864f5-28e9-4f1d-9515-e1ec120bdfc7-service-ca-bundle\") pod \"router-default-7bd5df7d89-2fp8d\" (UID: \"bfa864f5-28e9-4f1d-9515-e1ec120bdfc7\") " pod="openshift-ingress/router-default-7bd5df7d89-2fp8d" Jun 03 23:28:34.024328 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:28:34.023813 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bfa864f5-28e9-4f1d-9515-e1ec120bdfc7-service-ca-bundle podName:bfa864f5-28e9-4f1d-9515-e1ec120bdfc7 nodeName:}" failed. No retries permitted until 2026-06-03 23:28:35.023794463 +0000 UTC m=+235.831014912 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bfa864f5-28e9-4f1d-9515-e1ec120bdfc7-service-ca-bundle") pod "router-default-7bd5df7d89-2fp8d" (UID: "bfa864f5-28e9-4f1d-9515-e1ec120bdfc7") : configmap references non-existent config key: service-ca.crt Jun 03 23:28:34.024328 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:28:34.024230 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 23:28:34.024328 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:28:34.024276 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfa864f5-28e9-4f1d-9515-e1ec120bdfc7-metrics-certs podName:bfa864f5-28e9-4f1d-9515-e1ec120bdfc7 nodeName:}" failed. No retries permitted until 2026-06-03 23:28:35.024261447 +0000 UTC m=+235.831481894 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bfa864f5-28e9-4f1d-9515-e1ec120bdfc7-metrics-certs") pod "router-default-7bd5df7d89-2fp8d" (UID: "bfa864f5-28e9-4f1d-9515-e1ec120bdfc7") : secret "router-metrics-certs-default" not found Jun 03 23:28:34.311221 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:34.311139 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-69684796bc-ggcdl" event={"ID":"1d545fc1-b4f3-4d2c-9ed9-d04a4b3ab786","Type":"ContainerStarted","Data":"2df4b3067ddfc226104bedef170c40bbcc88657c945ed766bca02bc6492f878c"} Jun 03 23:28:34.312599 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:34.312530 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-vwhcp" event={"ID":"8e27eeb5-c500-4da6-b469-ad64b2ddcfa1","Type":"ContainerStarted","Data":"6eaa1a9388902f549c25b541fd1976a0c57b5a5f6b0307f532db0d9caf79d3bf"} Jun 03 23:28:34.313843 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:34.313793 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-48q4x" event={"ID":"60758e35-f856-44a0-b2a1-322fe75bc431","Type":"ContainerStarted","Data":"59c9e797b25aa96b1f30ea39b4305be858d46c4b6f5221269d835cb1f52ab5ea"} Jun 03 23:28:34.931016 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:34.930981 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-registry-tls\") pod \"image-registry-7df4975dfb-6gst8\" (UID: \"06ac1abb-a9ad-4ce2-af4a-4687869aa05d\") " pod="openshift-image-registry/image-registry-7df4975dfb-6gst8" Jun 03 23:28:34.931202 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:34.931031 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/099633be-d81f-4570-8cfb-027c2132aa6f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-xhccj\" (UID: \"099633be-d81f-4570-8cfb-027c2132aa6f\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xhccj" Jun 03 23:28:34.931202 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:28:34.931133 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 23:28:34.931202 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:28:34.931147 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7df4975dfb-6gst8: secret "image-registry-tls" not found Jun 03 23:28:34.931202 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:28:34.931200 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-registry-tls podName:06ac1abb-a9ad-4ce2-af4a-4687869aa05d nodeName:}" failed. No retries permitted until 2026-06-03 23:28:36.931183104 +0000 UTC m=+237.738403566 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-registry-tls") pod "image-registry-7df4975dfb-6gst8" (UID: "06ac1abb-a9ad-4ce2-af4a-4687869aa05d") : secret "image-registry-tls" not found Jun 03 23:28:34.931417 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:28:34.931212 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 23:28:34.931417 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:28:34.931282 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/099633be-d81f-4570-8cfb-027c2132aa6f-cluster-monitoring-operator-tls podName:099633be-d81f-4570-8cfb-027c2132aa6f nodeName:}" failed. No retries permitted until 2026-06-03 23:28:36.931264215 +0000 UTC m=+237.738484659 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/099633be-d81f-4570-8cfb-027c2132aa6f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-xhccj" (UID: "099633be-d81f-4570-8cfb-027c2132aa6f") : secret "cluster-monitoring-operator-tls" not found Jun 03 23:28:35.032542 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:35.032502 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfa864f5-28e9-4f1d-9515-e1ec120bdfc7-metrics-certs\") pod \"router-default-7bd5df7d89-2fp8d\" (UID: \"bfa864f5-28e9-4f1d-9515-e1ec120bdfc7\") " pod="openshift-ingress/router-default-7bd5df7d89-2fp8d" Jun 03 23:28:35.032542 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:35.032555 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfa864f5-28e9-4f1d-9515-e1ec120bdfc7-service-ca-bundle\") pod \"router-default-7bd5df7d89-2fp8d\" (UID: \"bfa864f5-28e9-4f1d-9515-e1ec120bdfc7\") " pod="openshift-ingress/router-default-7bd5df7d89-2fp8d" Jun 03 23:28:35.032778 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:28:35.032669 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 23:28:35.032778 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:28:35.032748 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfa864f5-28e9-4f1d-9515-e1ec120bdfc7-metrics-certs podName:bfa864f5-28e9-4f1d-9515-e1ec120bdfc7 nodeName:}" failed. No retries permitted until 2026-06-03 23:28:37.032730949 +0000 UTC m=+237.839951390 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bfa864f5-28e9-4f1d-9515-e1ec120bdfc7-metrics-certs") pod "router-default-7bd5df7d89-2fp8d" (UID: "bfa864f5-28e9-4f1d-9515-e1ec120bdfc7") : secret "router-metrics-certs-default" not found Jun 03 23:28:35.032778 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:28:35.032766 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bfa864f5-28e9-4f1d-9515-e1ec120bdfc7-service-ca-bundle podName:bfa864f5-28e9-4f1d-9515-e1ec120bdfc7 nodeName:}" failed. No retries permitted until 2026-06-03 23:28:37.032757542 +0000 UTC m=+237.839977984 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bfa864f5-28e9-4f1d-9515-e1ec120bdfc7-service-ca-bundle") pod "router-default-7bd5df7d89-2fp8d" (UID: "bfa864f5-28e9-4f1d-9515-e1ec120bdfc7") : configmap references non-existent config key: service-ca.crt Jun 03 23:28:35.318029 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:35.317944 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-48q4x" event={"ID":"60758e35-f856-44a0-b2a1-322fe75bc431","Type":"ContainerStarted","Data":"5cdb2fe46124b0e1841b3a0052e00afb8ec45f266998580c0d92c80832794770"} Jun 03 23:28:35.337591 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:35.337536 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-48q4x" podStartSLOduration=1.314222564 podStartE2EDuration="2.337515876s" totalImagesPullingTime="1.023293312s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:28:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:28:35.336014688 +0000 UTC m=+236.143235155" watchObservedRunningTime="2026-06-03 23:28:35.337515876 +0000 UTC m=+236.144736341" Jun 03 23:28:36.323560 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:36.323523 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-69684796bc-ggcdl" event={"ID":"1d545fc1-b4f3-4d2c-9ed9-d04a4b3ab786","Type":"ContainerStarted","Data":"9836cbd7daad9ac21b4c79178656e6a2bd3c32e46e9e5518d68ae14791f27281"} Jun 03 23:28:36.324966 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:36.324939 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-vwhcp" event={"ID":"8e27eeb5-c500-4da6-b469-ad64b2ddcfa1","Type":"ContainerStarted","Data":"e2f75d4fd18936cf4c214aa8cc03b71f62507c7deddf1b20e716678f98144956"} Jun 03 23:28:36.347000 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:36.346940 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-69684796bc-ggcdl" podStartSLOduration=1.203324723 podStartE2EDuration="3.34691987s" totalImagesPullingTime="2.143595147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:28:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:28:36.345843739 +0000 UTC m=+237.153064203" watchObservedRunningTime="2026-06-03 23:28:36.34691987 +0000 UTC m=+237.154140335" Jun 03 23:28:36.368658 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:36.367126 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-vwhcp" podStartSLOduration=1.210505 podStartE2EDuration="3.367103106s" totalImagesPullingTime="2.156598106s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:28:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:28:36.364442891 +0000 UTC m=+237.171663356" watchObservedRunningTime="2026-06-03 23:28:36.367103106 +0000 UTC m=+237.174323571" Jun 03 23:28:36.948212 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:36.948168 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/099633be-d81f-4570-8cfb-027c2132aa6f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-xhccj\" (UID: \"099633be-d81f-4570-8cfb-027c2132aa6f\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xhccj" Jun 03 23:28:36.948418 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:36.948272 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-registry-tls\") pod \"image-registry-7df4975dfb-6gst8\" (UID: \"06ac1abb-a9ad-4ce2-af4a-4687869aa05d\") " pod="openshift-image-registry/image-registry-7df4975dfb-6gst8" Jun 03 23:28:36.948418 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:28:36.948357 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 23:28:36.948418 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:28:36.948377 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 23:28:36.948418 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:28:36.948388 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7df4975dfb-6gst8: secret "image-registry-tls" not found Jun 03 23:28:36.948645 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:28:36.948442 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-registry-tls podName:06ac1abb-a9ad-4ce2-af4a-4687869aa05d nodeName:}" failed. No retries permitted until 2026-06-03 23:28:40.948428174 +0000 UTC m=+241.755648617 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-registry-tls") pod "image-registry-7df4975dfb-6gst8" (UID: "06ac1abb-a9ad-4ce2-af4a-4687869aa05d") : secret "image-registry-tls" not found Jun 03 23:28:36.948645 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:28:36.948455 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/099633be-d81f-4570-8cfb-027c2132aa6f-cluster-monitoring-operator-tls podName:099633be-d81f-4570-8cfb-027c2132aa6f nodeName:}" failed. No retries permitted until 2026-06-03 23:28:40.948449638 +0000 UTC m=+241.755670079 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/099633be-d81f-4570-8cfb-027c2132aa6f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-xhccj" (UID: "099633be-d81f-4570-8cfb-027c2132aa6f") : secret "cluster-monitoring-operator-tls" not found Jun 03 23:28:37.049260 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:37.049209 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfa864f5-28e9-4f1d-9515-e1ec120bdfc7-metrics-certs\") pod \"router-default-7bd5df7d89-2fp8d\" (UID: \"bfa864f5-28e9-4f1d-9515-e1ec120bdfc7\") " pod="openshift-ingress/router-default-7bd5df7d89-2fp8d" Jun 03 23:28:37.049260 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:37.049264 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfa864f5-28e9-4f1d-9515-e1ec120bdfc7-service-ca-bundle\") pod \"router-default-7bd5df7d89-2fp8d\" (UID: \"bfa864f5-28e9-4f1d-9515-e1ec120bdfc7\") " pod="openshift-ingress/router-default-7bd5df7d89-2fp8d" Jun 03 23:28:37.049528 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:28:37.049379 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 23:28:37.049528 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:28:37.049417 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bfa864f5-28e9-4f1d-9515-e1ec120bdfc7-service-ca-bundle podName:bfa864f5-28e9-4f1d-9515-e1ec120bdfc7 nodeName:}" failed. No retries permitted until 2026-06-03 23:28:41.049399992 +0000 UTC m=+241.856620433 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bfa864f5-28e9-4f1d-9515-e1ec120bdfc7-service-ca-bundle") pod "router-default-7bd5df7d89-2fp8d" (UID: "bfa864f5-28e9-4f1d-9515-e1ec120bdfc7") : configmap references non-existent config key: service-ca.crt Jun 03 23:28:37.049528 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:28:37.049438 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfa864f5-28e9-4f1d-9515-e1ec120bdfc7-metrics-certs podName:bfa864f5-28e9-4f1d-9515-e1ec120bdfc7 nodeName:}" failed. No retries permitted until 2026-06-03 23:28:41.049429053 +0000 UTC m=+241.856649496 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bfa864f5-28e9-4f1d-9515-e1ec120bdfc7-metrics-certs") pod "router-default-7bd5df7d89-2fp8d" (UID: "bfa864f5-28e9-4f1d-9515-e1ec120bdfc7") : secret "router-metrics-certs-default" not found Jun 03 23:28:38.482022 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:38.481992 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qptg9_e8eb806c-295f-4b08-ad92-6ceef3b2a7b8/dns-node-resolver/0.log" Jun 03 23:28:39.686402 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:39.686372 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dnwpn_35356266-b28e-48fb-b508-a661319c50b1/node-ca/0.log" Jun 03 23:28:40.483250 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:40.483223 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vgpjr_ee520e2e-86a3-461f-9914-0ccf3b449d6c/serve-healthcheck-canary/0.log" Jun 03 23:28:40.981649 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:40.981613 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-registry-tls\") pod \"image-registry-7df4975dfb-6gst8\" (UID: \"06ac1abb-a9ad-4ce2-af4a-4687869aa05d\") " pod="openshift-image-registry/image-registry-7df4975dfb-6gst8" Jun 03 23:28:40.982059 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:40.981657 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/099633be-d81f-4570-8cfb-027c2132aa6f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-xhccj\" (UID: \"099633be-d81f-4570-8cfb-027c2132aa6f\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xhccj" Jun 03 23:28:40.982059 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:28:40.981752 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 23:28:40.982059 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:28:40.981761 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 23:28:40.982059 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:28:40.981781 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7df4975dfb-6gst8: secret "image-registry-tls" not found Jun 03 23:28:40.982059 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:28:40.981805 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/099633be-d81f-4570-8cfb-027c2132aa6f-cluster-monitoring-operator-tls podName:099633be-d81f-4570-8cfb-027c2132aa6f nodeName:}" failed. No retries permitted until 2026-06-03 23:28:48.981791784 +0000 UTC m=+249.789012229 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/099633be-d81f-4570-8cfb-027c2132aa6f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-xhccj" (UID: "099633be-d81f-4570-8cfb-027c2132aa6f") : secret "cluster-monitoring-operator-tls" not found Jun 03 23:28:40.982059 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:28:40.981835 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-registry-tls podName:06ac1abb-a9ad-4ce2-af4a-4687869aa05d nodeName:}" failed. No retries permitted until 2026-06-03 23:28:48.981822182 +0000 UTC m=+249.789042623 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-registry-tls") pod "image-registry-7df4975dfb-6gst8" (UID: "06ac1abb-a9ad-4ce2-af4a-4687869aa05d") : secret "image-registry-tls" not found Jun 03 23:28:41.082698 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:41.082660 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfa864f5-28e9-4f1d-9515-e1ec120bdfc7-metrics-certs\") pod \"router-default-7bd5df7d89-2fp8d\" (UID: \"bfa864f5-28e9-4f1d-9515-e1ec120bdfc7\") " pod="openshift-ingress/router-default-7bd5df7d89-2fp8d" Jun 03 23:28:41.082698 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:41.082695 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfa864f5-28e9-4f1d-9515-e1ec120bdfc7-service-ca-bundle\") pod \"router-default-7bd5df7d89-2fp8d\" (UID: \"bfa864f5-28e9-4f1d-9515-e1ec120bdfc7\") " pod="openshift-ingress/router-default-7bd5df7d89-2fp8d" Jun 03 23:28:41.082902 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:28:41.082811 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bfa864f5-28e9-4f1d-9515-e1ec120bdfc7-service-ca-bundle podName:bfa864f5-28e9-4f1d-9515-e1ec120bdfc7 nodeName:}" failed. No retries permitted until 2026-06-03 23:28:49.082797269 +0000 UTC m=+249.890017711 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bfa864f5-28e9-4f1d-9515-e1ec120bdfc7-service-ca-bundle") pod "router-default-7bd5df7d89-2fp8d" (UID: "bfa864f5-28e9-4f1d-9515-e1ec120bdfc7") : configmap references non-existent config key: service-ca.crt Jun 03 23:28:41.082902 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:28:41.082810 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 23:28:41.082902 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:28:41.082837 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfa864f5-28e9-4f1d-9515-e1ec120bdfc7-metrics-certs podName:bfa864f5-28e9-4f1d-9515-e1ec120bdfc7 nodeName:}" failed. No retries permitted until 2026-06-03 23:28:49.082831206 +0000 UTC m=+249.890051649 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bfa864f5-28e9-4f1d-9515-e1ec120bdfc7-metrics-certs") pod "router-default-7bd5df7d89-2fp8d" (UID: "bfa864f5-28e9-4f1d-9515-e1ec120bdfc7") : secret "router-metrics-certs-default" not found Jun 03 23:28:49.047306 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:49.047258 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-registry-tls\") pod \"image-registry-7df4975dfb-6gst8\" (UID: \"06ac1abb-a9ad-4ce2-af4a-4687869aa05d\") " pod="openshift-image-registry/image-registry-7df4975dfb-6gst8" Jun 03 23:28:49.047802 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:49.047321 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/099633be-d81f-4570-8cfb-027c2132aa6f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-xhccj\" (UID: \"099633be-d81f-4570-8cfb-027c2132aa6f\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xhccj" Jun 03 23:28:49.049755 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:49.049728 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-registry-tls\") pod \"image-registry-7df4975dfb-6gst8\" (UID: \"06ac1abb-a9ad-4ce2-af4a-4687869aa05d\") " pod="openshift-image-registry/image-registry-7df4975dfb-6gst8" Jun 03 23:28:49.049851 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:49.049731 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/099633be-d81f-4570-8cfb-027c2132aa6f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-xhccj\" (UID: \"099633be-d81f-4570-8cfb-027c2132aa6f\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xhccj" Jun 03 23:28:49.105751 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:49.105718 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-zsfl6\"" Jun 03 23:28:49.110781 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:49.110762 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6lj9c\"" Jun 03 23:28:49.113894 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:49.113877 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xhccj" Jun 03 23:28:49.119108 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:49.119093 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7df4975dfb-6gst8" Jun 03 23:28:49.148217 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:49.148186 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfa864f5-28e9-4f1d-9515-e1ec120bdfc7-metrics-certs\") pod \"router-default-7bd5df7d89-2fp8d\" (UID: \"bfa864f5-28e9-4f1d-9515-e1ec120bdfc7\") " pod="openshift-ingress/router-default-7bd5df7d89-2fp8d" Jun 03 23:28:49.148391 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:49.148239 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfa864f5-28e9-4f1d-9515-e1ec120bdfc7-service-ca-bundle\") pod \"router-default-7bd5df7d89-2fp8d\" (UID: \"bfa864f5-28e9-4f1d-9515-e1ec120bdfc7\") " pod="openshift-ingress/router-default-7bd5df7d89-2fp8d" Jun 03 23:28:49.149025 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:49.149000 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfa864f5-28e9-4f1d-9515-e1ec120bdfc7-service-ca-bundle\") pod \"router-default-7bd5df7d89-2fp8d\" (UID: \"bfa864f5-28e9-4f1d-9515-e1ec120bdfc7\") " pod="openshift-ingress/router-default-7bd5df7d89-2fp8d" Jun 03 23:28:49.150556 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:49.150539 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfa864f5-28e9-4f1d-9515-e1ec120bdfc7-metrics-certs\") pod \"router-default-7bd5df7d89-2fp8d\" (UID: \"bfa864f5-28e9-4f1d-9515-e1ec120bdfc7\") " pod="openshift-ingress/router-default-7bd5df7d89-2fp8d" Jun 03 23:28:49.236026 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:49.235998 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-zznqw\"" Jun 03 23:28:49.243525 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:49.243497 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7bd5df7d89-2fp8d" Jun 03 23:28:49.255332 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:49.255309 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-57769895dd-xhccj"] Jun 03 23:28:49.257258 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:28:49.257228 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod099633be_d81f_4570_8cfb_027c2132aa6f.slice/crio-a479277ffdfad21d41e37dd456cdb8b268d9ea416a218d441ea7f767c69860a4 WatchSource:0}: Error finding container a479277ffdfad21d41e37dd456cdb8b268d9ea416a218d441ea7f767c69860a4: Status 404 returned error can't find the container with id a479277ffdfad21d41e37dd456cdb8b268d9ea416a218d441ea7f767c69860a4 Jun 03 23:28:49.274767 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:49.274731 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7df4975dfb-6gst8"] Jun 03 23:28:49.277734 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:28:49.277699 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06ac1abb_a9ad_4ce2_af4a_4687869aa05d.slice/crio-732a6e1c6701eb1d60d082d724cfc7e1f253d62f1ff9b20bdfeca5e90d0b2176 WatchSource:0}: Error finding container 732a6e1c6701eb1d60d082d724cfc7e1f253d62f1ff9b20bdfeca5e90d0b2176: Status 404 returned error can't find the container with id 732a6e1c6701eb1d60d082d724cfc7e1f253d62f1ff9b20bdfeca5e90d0b2176 Jun 03 23:28:49.363118 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:49.363088 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7df4975dfb-6gst8" event={"ID":"06ac1abb-a9ad-4ce2-af4a-4687869aa05d","Type":"ContainerStarted","Data":"21749b0ca204d22c65df2aea4b446a6322a4295a1ebc0cddd804dfbef1c3a415"} Jun 03 23:28:49.363317 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:49.363141 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7df4975dfb-6gst8" event={"ID":"06ac1abb-a9ad-4ce2-af4a-4687869aa05d","Type":"ContainerStarted","Data":"732a6e1c6701eb1d60d082d724cfc7e1f253d62f1ff9b20bdfeca5e90d0b2176"} Jun 03 23:28:49.363317 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:49.363202 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7df4975dfb-6gst8" Jun 03 23:28:49.364139 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:49.364119 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xhccj" event={"ID":"099633be-d81f-4570-8cfb-027c2132aa6f","Type":"ContainerStarted","Data":"a479277ffdfad21d41e37dd456cdb8b268d9ea416a218d441ea7f767c69860a4"} Jun 03 23:28:49.396654 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:49.396623 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7bd5df7d89-2fp8d"] Jun 03 23:28:49.399827 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:28:49.399800 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfa864f5_28e9_4f1d_9515_e1ec120bdfc7.slice/crio-4704056e9aa40d9e8a7a1f6b1fe8ecde513b310ed319078cae5b62e60fc2889a WatchSource:0}: Error finding container 4704056e9aa40d9e8a7a1f6b1fe8ecde513b310ed319078cae5b62e60fc2889a: Status 404 returned error can't find the container with id 4704056e9aa40d9e8a7a1f6b1fe8ecde513b310ed319078cae5b62e60fc2889a Jun 03 23:28:49.404653 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:49.404614 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7df4975dfb-6gst8" podStartSLOduration=16.404602575 podStartE2EDuration="16.404602575s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:28:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:28:49.403924462 +0000 UTC m=+250.211144925" watchObservedRunningTime="2026-06-03 23:28:49.404602575 +0000 UTC m=+250.211823038" Jun 03 23:28:50.369611 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:50.369577 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7bd5df7d89-2fp8d" event={"ID":"bfa864f5-28e9-4f1d-9515-e1ec120bdfc7","Type":"ContainerStarted","Data":"770dcab5cea8956023d3cebe0d1834a9190e4fca05c1edcace6f28fcb46c15c3"} Jun 03 23:28:50.370115 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:50.369633 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7bd5df7d89-2fp8d" event={"ID":"bfa864f5-28e9-4f1d-9515-e1ec120bdfc7","Type":"ContainerStarted","Data":"4704056e9aa40d9e8a7a1f6b1fe8ecde513b310ed319078cae5b62e60fc2889a"} Jun 03 23:28:50.408727 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:50.408668 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7bd5df7d89-2fp8d" podStartSLOduration=17.40864606 podStartE2EDuration="17.40864606s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:28:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:28:50.40738867 +0000 UTC m=+251.214609146" watchObservedRunningTime="2026-06-03 23:28:50.40864606 +0000 UTC m=+251.215866520" Jun 03 23:28:51.244439 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:51.244396 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7bd5df7d89-2fp8d" Jun 03 23:28:51.247218 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:51.247195 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7bd5df7d89-2fp8d" Jun 03 23:28:51.373990 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:51.373932 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xhccj" event={"ID":"099633be-d81f-4570-8cfb-027c2132aa6f","Type":"ContainerStarted","Data":"00b18e34f226b6d05efe0e54cc1a2607fa657aff4427399f62c1ca2a195e5ed6"} Jun 03 23:28:51.374477 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:51.374171 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7bd5df7d89-2fp8d" Jun 03 23:28:51.375400 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:51.375378 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7bd5df7d89-2fp8d" Jun 03 23:28:51.392310 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:51.392254 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-xhccj" podStartSLOduration=16.997141169 podStartE2EDuration="18.392240272s" totalImagesPullingTime="1.395099103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:28:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:28:51.391197195 +0000 UTC m=+252.198417671" watchObservedRunningTime="2026-06-03 23:28:51.392240272 +0000 UTC m=+252.199460761" Jun 03 23:28:51.469131 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:51.469091 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38c2283b-dc88-4292-9e56-50e1e5da9064-metrics-certs\") pod \"network-metrics-daemon-58jkf\" (UID: \"38c2283b-dc88-4292-9e56-50e1e5da9064\") " pod="openshift-multus/network-metrics-daemon-58jkf" Jun 03 23:28:51.471449 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:51.471422 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38c2283b-dc88-4292-9e56-50e1e5da9064-metrics-certs\") pod \"network-metrics-daemon-58jkf\" (UID: \"38c2283b-dc88-4292-9e56-50e1e5da9064\") " pod="openshift-multus/network-metrics-daemon-58jkf" Jun 03 23:28:51.556404 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:51.556327 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5mf7x\"" Jun 03 23:28:51.564040 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:51.564018 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58jkf" Jun 03 23:28:51.693131 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:51.693101 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-58jkf"] Jun 03 23:28:51.696861 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:28:51.696830 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38c2283b_dc88_4292_9e56_50e1e5da9064.slice/crio-71c5f8266ea2b6a5ffd0fe8079f0da59a9ec2a811b2f347c1e44bd596985a4fa WatchSource:0}: Error finding container 71c5f8266ea2b6a5ffd0fe8079f0da59a9ec2a811b2f347c1e44bd596985a4fa: Status 404 returned error can't find the container with id 71c5f8266ea2b6a5ffd0fe8079f0da59a9ec2a811b2f347c1e44bd596985a4fa Jun 03 23:28:52.378101 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:52.378064 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-58jkf" event={"ID":"38c2283b-dc88-4292-9e56-50e1e5da9064","Type":"ContainerStarted","Data":"71c5f8266ea2b6a5ffd0fe8079f0da59a9ec2a811b2f347c1e44bd596985a4fa"} Jun 03 23:28:53.382683 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:53.382647 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-58jkf" event={"ID":"38c2283b-dc88-4292-9e56-50e1e5da9064","Type":"ContainerStarted","Data":"d585fb74b4d53fa6475a2802321fec07e297c3855e67ad650b1d67751980359a"} Jun 03 23:28:53.383063 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:53.382699 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-58jkf" event={"ID":"38c2283b-dc88-4292-9e56-50e1e5da9064","Type":"ContainerStarted","Data":"ee1682d3e71ef8e322abbbd331771a98be32c96c296dc4e4df345008cd215424"} Jun 03 23:28:53.412912 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:28:53.412864 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-58jkf" podStartSLOduration=253.634019006 podStartE2EDuration="4m14.412850251s" totalImagesPullingTime="778.831245ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:24:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:28:53.412503656 +0000 UTC m=+254.219724120" watchObservedRunningTime="2026-06-03 23:28:53.412850251 +0000 UTC m=+254.220070757" Jun 03 23:29:03.143906 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.143830 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7df4975dfb-6gst8"] Jun 03 23:29:03.147311 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.147273 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-zf5r2"] Jun 03 23:29:03.150661 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.150635 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-zf5r2" Jun 03 23:29:03.153687 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.153658 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 03 23:29:03.153794 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.153714 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-p9nxj\"" Jun 03 23:29:03.167848 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.167820 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-zf5r2"] Jun 03 23:29:03.192904 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.192872 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-67f86dc978-2bf4z"] Jun 03 23:29:03.195601 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.195580 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67f86dc978-2bf4z" Jun 03 23:29:03.217193 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.217163 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67f86dc978-2bf4z"] Jun 03 23:29:03.238196 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.238164 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5226r"] Jun 03 23:29:03.241051 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.241030 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5226r" Jun 03 23:29:03.244260 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.244239 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tkll5\"" Jun 03 23:29:03.244417 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.244249 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 23:29:03.244417 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.244348 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 23:29:03.251625 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.251603 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/78c6584c-0498-4adb-b65b-9b882781fe01-registry-tls\") pod \"image-registry-67f86dc978-2bf4z\" (UID: \"78c6584c-0498-4adb-b65b-9b882781fe01\") " pod="openshift-image-registry/image-registry-67f86dc978-2bf4z" Jun 03 23:29:03.251723 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.251629 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4fcf2743-3bbd-4e8d-915c-c04e202c6a99-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5226r\" (UID: \"4fcf2743-3bbd-4e8d-915c-c04e202c6a99\") " pod="openshift-insights/insights-runtime-extractor-5226r" Jun 03 23:29:03.251723 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.251651 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4fcf2743-3bbd-4e8d-915c-c04e202c6a99-data-volume\") pod \"insights-runtime-extractor-5226r\" (UID: \"4fcf2743-3bbd-4e8d-915c-c04e202c6a99\") " pod="openshift-insights/insights-runtime-extractor-5226r" Jun 03 23:29:03.251723 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.251667 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/78c6584c-0498-4adb-b65b-9b882781fe01-trusted-ca\") pod \"image-registry-67f86dc978-2bf4z\" (UID: \"78c6584c-0498-4adb-b65b-9b882781fe01\") " pod="openshift-image-registry/image-registry-67f86dc978-2bf4z" Jun 03 23:29:03.251819 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.251720 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/78c6584c-0498-4adb-b65b-9b882781fe01-image-registry-private-configuration\") pod \"image-registry-67f86dc978-2bf4z\" (UID: \"78c6584c-0498-4adb-b65b-9b882781fe01\") " pod="openshift-image-registry/image-registry-67f86dc978-2bf4z" Jun 03 23:29:03.251819 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.251779 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/257f8ce4-e88a-4899-bf56-4a52f06c5b6a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-zf5r2\" (UID: \"257f8ce4-e88a-4899-bf56-4a52f06c5b6a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-zf5r2" Jun 03 23:29:03.251819 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.251811 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4fcf2743-3bbd-4e8d-915c-c04e202c6a99-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5226r\" (UID: \"4fcf2743-3bbd-4e8d-915c-c04e202c6a99\") " pod="openshift-insights/insights-runtime-extractor-5226r" Jun 03 23:29:03.251915 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.251831 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c68kq\" (UniqueName: \"kubernetes.io/projected/4fcf2743-3bbd-4e8d-915c-c04e202c6a99-kube-api-access-c68kq\") pod \"insights-runtime-extractor-5226r\" (UID: \"4fcf2743-3bbd-4e8d-915c-c04e202c6a99\") " pod="openshift-insights/insights-runtime-extractor-5226r" Jun 03 23:29:03.251915 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.251849 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/78c6584c-0498-4adb-b65b-9b882781fe01-installation-pull-secrets\") pod \"image-registry-67f86dc978-2bf4z\" (UID: \"78c6584c-0498-4adb-b65b-9b882781fe01\") " pod="openshift-image-registry/image-registry-67f86dc978-2bf4z" Jun 03 23:29:03.251915 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.251866 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/78c6584c-0498-4adb-b65b-9b882781fe01-registry-certificates\") pod \"image-registry-67f86dc978-2bf4z\" (UID: \"78c6584c-0498-4adb-b65b-9b882781fe01\") " pod="openshift-image-registry/image-registry-67f86dc978-2bf4z" Jun 03 23:29:03.251915 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.251900 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4fcf2743-3bbd-4e8d-915c-c04e202c6a99-crio-socket\") pod \"insights-runtime-extractor-5226r\" (UID: \"4fcf2743-3bbd-4e8d-915c-c04e202c6a99\") " pod="openshift-insights/insights-runtime-extractor-5226r" Jun 03 23:29:03.252036 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.251940 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/78c6584c-0498-4adb-b65b-9b882781fe01-bound-sa-token\") pod \"image-registry-67f86dc978-2bf4z\" (UID: \"78c6584c-0498-4adb-b65b-9b882781fe01\") " pod="openshift-image-registry/image-registry-67f86dc978-2bf4z" Jun 03 23:29:03.252036 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.251963 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/78c6584c-0498-4adb-b65b-9b882781fe01-ca-trust-extracted\") pod \"image-registry-67f86dc978-2bf4z\" (UID: \"78c6584c-0498-4adb-b65b-9b882781fe01\") " pod="openshift-image-registry/image-registry-67f86dc978-2bf4z" Jun 03 23:29:03.252036 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.252002 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55gl7\" (UniqueName: \"kubernetes.io/projected/78c6584c-0498-4adb-b65b-9b882781fe01-kube-api-access-55gl7\") pod \"image-registry-67f86dc978-2bf4z\" (UID: \"78c6584c-0498-4adb-b65b-9b882781fe01\") " pod="openshift-image-registry/image-registry-67f86dc978-2bf4z" Jun 03 23:29:03.264397 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.264374 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5226r"] Jun 03 23:29:03.353144 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.353106 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/78c6584c-0498-4adb-b65b-9b882781fe01-registry-tls\") pod \"image-registry-67f86dc978-2bf4z\" (UID: \"78c6584c-0498-4adb-b65b-9b882781fe01\") " pod="openshift-image-registry/image-registry-67f86dc978-2bf4z" Jun 03 23:29:03.353144 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.353149 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4fcf2743-3bbd-4e8d-915c-c04e202c6a99-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5226r\" (UID: \"4fcf2743-3bbd-4e8d-915c-c04e202c6a99\") " pod="openshift-insights/insights-runtime-extractor-5226r" Jun 03 23:29:03.353428 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.353181 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4fcf2743-3bbd-4e8d-915c-c04e202c6a99-data-volume\") pod \"insights-runtime-extractor-5226r\" (UID: \"4fcf2743-3bbd-4e8d-915c-c04e202c6a99\") " pod="openshift-insights/insights-runtime-extractor-5226r" Jun 03 23:29:03.353428 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.353205 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/78c6584c-0498-4adb-b65b-9b882781fe01-trusted-ca\") pod \"image-registry-67f86dc978-2bf4z\" (UID: \"78c6584c-0498-4adb-b65b-9b882781fe01\") " pod="openshift-image-registry/image-registry-67f86dc978-2bf4z" Jun 03 23:29:03.353428 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.353229 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/78c6584c-0498-4adb-b65b-9b882781fe01-image-registry-private-configuration\") pod \"image-registry-67f86dc978-2bf4z\" (UID: \"78c6584c-0498-4adb-b65b-9b882781fe01\") " pod="openshift-image-registry/image-registry-67f86dc978-2bf4z" Jun 03 23:29:03.353428 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.353252 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/257f8ce4-e88a-4899-bf56-4a52f06c5b6a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-zf5r2\" (UID: \"257f8ce4-e88a-4899-bf56-4a52f06c5b6a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-zf5r2" Jun 03 23:29:03.353428 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.353346 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4fcf2743-3bbd-4e8d-915c-c04e202c6a99-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5226r\" (UID: \"4fcf2743-3bbd-4e8d-915c-c04e202c6a99\") " pod="openshift-insights/insights-runtime-extractor-5226r" Jun 03 23:29:03.353428 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.353392 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c68kq\" (UniqueName: \"kubernetes.io/projected/4fcf2743-3bbd-4e8d-915c-c04e202c6a99-kube-api-access-c68kq\") pod \"insights-runtime-extractor-5226r\" (UID: \"4fcf2743-3bbd-4e8d-915c-c04e202c6a99\") " pod="openshift-insights/insights-runtime-extractor-5226r" Jun 03 23:29:03.353428 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.353425 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/78c6584c-0498-4adb-b65b-9b882781fe01-installation-pull-secrets\") pod \"image-registry-67f86dc978-2bf4z\" (UID: \"78c6584c-0498-4adb-b65b-9b882781fe01\") " pod="openshift-image-registry/image-registry-67f86dc978-2bf4z" Jun 03 23:29:03.353796 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.353619 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4fcf2743-3bbd-4e8d-915c-c04e202c6a99-data-volume\") pod \"insights-runtime-extractor-5226r\" (UID: \"4fcf2743-3bbd-4e8d-915c-c04e202c6a99\") " pod="openshift-insights/insights-runtime-extractor-5226r" Jun 03 23:29:03.353853 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.353811 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/78c6584c-0498-4adb-b65b-9b882781fe01-registry-certificates\") pod \"image-registry-67f86dc978-2bf4z\" (UID: \"78c6584c-0498-4adb-b65b-9b882781fe01\") " pod="openshift-image-registry/image-registry-67f86dc978-2bf4z" Jun 03 23:29:03.353853 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.353835 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4fcf2743-3bbd-4e8d-915c-c04e202c6a99-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5226r\" (UID: \"4fcf2743-3bbd-4e8d-915c-c04e202c6a99\") " pod="openshift-insights/insights-runtime-extractor-5226r" Jun 03 23:29:03.354277 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.354255 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4fcf2743-3bbd-4e8d-915c-c04e202c6a99-crio-socket\") pod \"insights-runtime-extractor-5226r\" (UID: \"4fcf2743-3bbd-4e8d-915c-c04e202c6a99\") " pod="openshift-insights/insights-runtime-extractor-5226r" Jun 03 23:29:03.354406 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.354323 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/78c6584c-0498-4adb-b65b-9b882781fe01-bound-sa-token\") pod \"image-registry-67f86dc978-2bf4z\" (UID: \"78c6584c-0498-4adb-b65b-9b882781fe01\") " pod="openshift-image-registry/image-registry-67f86dc978-2bf4z" Jun 03 23:29:03.354406 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.354395 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/78c6584c-0498-4adb-b65b-9b882781fe01-ca-trust-extracted\") pod \"image-registry-67f86dc978-2bf4z\" (UID: \"78c6584c-0498-4adb-b65b-9b882781fe01\") " pod="openshift-image-registry/image-registry-67f86dc978-2bf4z" Jun 03 23:29:03.354515 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.354438 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55gl7\" (UniqueName: \"kubernetes.io/projected/78c6584c-0498-4adb-b65b-9b882781fe01-kube-api-access-55gl7\") pod \"image-registry-67f86dc978-2bf4z\" (UID: \"78c6584c-0498-4adb-b65b-9b882781fe01\") " pod="openshift-image-registry/image-registry-67f86dc978-2bf4z" Jun 03 23:29:03.354570 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.354538 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/78c6584c-0498-4adb-b65b-9b882781fe01-trusted-ca\") pod \"image-registry-67f86dc978-2bf4z\" (UID: \"78c6584c-0498-4adb-b65b-9b882781fe01\") " pod="openshift-image-registry/image-registry-67f86dc978-2bf4z" Jun 03 23:29:03.354623 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.354603 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4fcf2743-3bbd-4e8d-915c-c04e202c6a99-crio-socket\") pod \"insights-runtime-extractor-5226r\" (UID: \"4fcf2743-3bbd-4e8d-915c-c04e202c6a99\") " pod="openshift-insights/insights-runtime-extractor-5226r" Jun 03 23:29:03.354911 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.354890 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/78c6584c-0498-4adb-b65b-9b882781fe01-ca-trust-extracted\") pod \"image-registry-67f86dc978-2bf4z\" (UID: \"78c6584c-0498-4adb-b65b-9b882781fe01\") " pod="openshift-image-registry/image-registry-67f86dc978-2bf4z" Jun 03 23:29:03.355355 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.355333 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/78c6584c-0498-4adb-b65b-9b882781fe01-registry-certificates\") pod \"image-registry-67f86dc978-2bf4z\" (UID: \"78c6584c-0498-4adb-b65b-9b882781fe01\") " pod="openshift-image-registry/image-registry-67f86dc978-2bf4z" Jun 03 23:29:03.356029 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.355999 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/257f8ce4-e88a-4899-bf56-4a52f06c5b6a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-zf5r2\" (UID: \"257f8ce4-e88a-4899-bf56-4a52f06c5b6a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-zf5r2" Jun 03 23:29:03.356133 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.356036 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4fcf2743-3bbd-4e8d-915c-c04e202c6a99-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5226r\" (UID: \"4fcf2743-3bbd-4e8d-915c-c04e202c6a99\") " pod="openshift-insights/insights-runtime-extractor-5226r" Jun 03 23:29:03.356195 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.356145 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/78c6584c-0498-4adb-b65b-9b882781fe01-registry-tls\") pod \"image-registry-67f86dc978-2bf4z\" (UID: \"78c6584c-0498-4adb-b65b-9b882781fe01\") " pod="openshift-image-registry/image-registry-67f86dc978-2bf4z" Jun 03 23:29:03.356231 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.356192 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/78c6584c-0498-4adb-b65b-9b882781fe01-image-registry-private-configuration\") pod \"image-registry-67f86dc978-2bf4z\" (UID: \"78c6584c-0498-4adb-b65b-9b882781fe01\") " pod="openshift-image-registry/image-registry-67f86dc978-2bf4z" Jun 03 23:29:03.356606 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.356587 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/78c6584c-0498-4adb-b65b-9b882781fe01-installation-pull-secrets\") pod \"image-registry-67f86dc978-2bf4z\" (UID: \"78c6584c-0498-4adb-b65b-9b882781fe01\") " pod="openshift-image-registry/image-registry-67f86dc978-2bf4z" Jun 03 23:29:03.366112 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.366083 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55gl7\" (UniqueName: \"kubernetes.io/projected/78c6584c-0498-4adb-b65b-9b882781fe01-kube-api-access-55gl7\") pod \"image-registry-67f86dc978-2bf4z\" (UID: \"78c6584c-0498-4adb-b65b-9b882781fe01\") " pod="openshift-image-registry/image-registry-67f86dc978-2bf4z" Jun 03 23:29:03.366365 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.366345 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/78c6584c-0498-4adb-b65b-9b882781fe01-bound-sa-token\") pod \"image-registry-67f86dc978-2bf4z\" (UID: \"78c6584c-0498-4adb-b65b-9b882781fe01\") " pod="openshift-image-registry/image-registry-67f86dc978-2bf4z" Jun 03 23:29:03.367457 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.367435 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c68kq\" (UniqueName: \"kubernetes.io/projected/4fcf2743-3bbd-4e8d-915c-c04e202c6a99-kube-api-access-c68kq\") pod \"insights-runtime-extractor-5226r\" (UID: \"4fcf2743-3bbd-4e8d-915c-c04e202c6a99\") " pod="openshift-insights/insights-runtime-extractor-5226r" Jun 03 23:29:03.461807 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.461764 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-zf5r2" Jun 03 23:29:03.503567 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.503531 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67f86dc978-2bf4z" Jun 03 23:29:03.552208 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.552168 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5226r" Jun 03 23:29:03.598398 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.598328 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-zf5r2"] Jun 03 23:29:03.604489 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:29:03.604459 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod257f8ce4_e88a_4899_bf56_4a52f06c5b6a.slice/crio-7354a016bea289f8f73e330918117018feb5d11a89dfca51a46fadfe3e21ad02 WatchSource:0}: Error finding container 7354a016bea289f8f73e330918117018feb5d11a89dfca51a46fadfe3e21ad02: Status 404 returned error can't find the container with id 7354a016bea289f8f73e330918117018feb5d11a89dfca51a46fadfe3e21ad02 Jun 03 23:29:03.678462 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.678435 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67f86dc978-2bf4z"] Jun 03 23:29:03.680380 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:29:03.680352 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78c6584c_0498_4adb_b65b_9b882781fe01.slice/crio-86debf7d5faf1130d6f3f5e4e9328d1904a9a06a568bdae750256f78a01c7f7f WatchSource:0}: Error finding container 86debf7d5faf1130d6f3f5e4e9328d1904a9a06a568bdae750256f78a01c7f7f: Status 404 returned error can't find the container with id 86debf7d5faf1130d6f3f5e4e9328d1904a9a06a568bdae750256f78a01c7f7f Jun 03 23:29:03.732877 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:03.732856 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5226r"] Jun 03 23:29:03.735109 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:29:03.735086 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fcf2743_3bbd_4e8d_915c_c04e202c6a99.slice/crio-f54b0c0fb2e6493ef51333e4337f470d671358ac895da5ee8c062c47c9321e76 WatchSource:0}: Error finding container f54b0c0fb2e6493ef51333e4337f470d671358ac895da5ee8c062c47c9321e76: Status 404 returned error can't find the container with id f54b0c0fb2e6493ef51333e4337f470d671358ac895da5ee8c062c47c9321e76 Jun 03 23:29:04.423012 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:04.422965 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5226r" event={"ID":"4fcf2743-3bbd-4e8d-915c-c04e202c6a99","Type":"ContainerStarted","Data":"71339157dea60232809b04dae0c2cd163e56035ad110468aac2b602405b3030a"} Jun 03 23:29:04.423463 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:04.423049 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5226r" event={"ID":"4fcf2743-3bbd-4e8d-915c-c04e202c6a99","Type":"ContainerStarted","Data":"f54b0c0fb2e6493ef51333e4337f470d671358ac895da5ee8c062c47c9321e76"} Jun 03 23:29:04.424599 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:04.424566 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67f86dc978-2bf4z" event={"ID":"78c6584c-0498-4adb-b65b-9b882781fe01","Type":"ContainerStarted","Data":"cd4e03551d1ac8049c1fd78f3f5a387d7a8e05c602026ac1185a627f678e3953"} Jun 03 23:29:04.424736 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:04.424615 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67f86dc978-2bf4z" event={"ID":"78c6584c-0498-4adb-b65b-9b882781fe01","Type":"ContainerStarted","Data":"86debf7d5faf1130d6f3f5e4e9328d1904a9a06a568bdae750256f78a01c7f7f"} Jun 03 23:29:04.424736 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:04.424659 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-67f86dc978-2bf4z" Jun 03 23:29:04.425885 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:04.425863 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-zf5r2" event={"ID":"257f8ce4-e88a-4899-bf56-4a52f06c5b6a","Type":"ContainerStarted","Data":"7354a016bea289f8f73e330918117018feb5d11a89dfca51a46fadfe3e21ad02"} Jun 03 23:29:04.456571 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:04.456502 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-67f86dc978-2bf4z" podStartSLOduration=1.456483615 podStartE2EDuration="1.456483615s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:29:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:29:04.455423847 +0000 UTC m=+265.262644323" watchObservedRunningTime="2026-06-03 23:29:04.456483615 +0000 UTC m=+265.263704084" Jun 03 23:29:05.431238 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:05.431190 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5226r" event={"ID":"4fcf2743-3bbd-4e8d-915c-c04e202c6a99","Type":"ContainerStarted","Data":"47ce5b8d541a14ffb95a831c1478bebf66122bb404503283933ec4a85bccff19"} Jun 03 23:29:05.432578 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:05.432553 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-zf5r2" event={"ID":"257f8ce4-e88a-4899-bf56-4a52f06c5b6a","Type":"ContainerStarted","Data":"c005b8840ae1613370a126cf94e46f8f9d1b7d09a036ea43072ee59539efa131"} Jun 03 23:29:05.432946 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:05.432924 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-zf5r2" Jun 03 23:29:05.437830 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:05.437802 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-zf5r2" Jun 03 23:29:05.449779 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:05.449729 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-zf5r2" podStartSLOduration=1.439719919 podStartE2EDuration="2.449715035s" totalImagesPullingTime="1.009995116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:29:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:29:05.448441633 +0000 UTC m=+266.255662100" watchObservedRunningTime="2026-06-03 23:29:05.449715035 +0000 UTC m=+266.256935499" Jun 03 23:29:06.438342 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:06.438306 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5226r" event={"ID":"4fcf2743-3bbd-4e8d-915c-c04e202c6a99","Type":"ContainerStarted","Data":"26a02c5dbd8284d83ce35b8dc1448cc77e91e7e76ba6bd49240b1c42302ca17c"} Jun 03 23:29:06.459822 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:06.459768 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5226r" podStartSLOduration=1.376857927 podStartE2EDuration="3.459752517s" totalImagesPullingTime="2.08289459s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:29:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:29:06.459114303 +0000 UTC m=+267.266334765" watchObservedRunningTime="2026-06-03 23:29:06.459752517 +0000 UTC m=+267.266972981" Jun 03 23:29:11.568593 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.568556 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ntmrl"] Jun 03 23:29:11.573166 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.573149 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ntmrl" Jun 03 23:29:11.576144 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.576122 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 23:29:11.576337 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.576318 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 23:29:11.576427 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.576355 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 23:29:11.576483 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.576355 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4qqpc\"" Jun 03 23:29:11.577444 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.577427 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 23:29:11.589713 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.589686 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-79fb7d47d4-274cp"] Jun 03 23:29:11.592762 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.592746 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-274cp" Jun 03 23:29:11.595358 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.595338 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 03 23:29:11.595484 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.595468 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 03 23:29:11.595650 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.595624 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-t5wc7\"" Jun 03 23:29:11.595701 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.595683 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 03 23:29:11.606649 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.606605 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-79fb7d47d4-274cp"] Jun 03 23:29:11.614052 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.614027 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9-metrics-client-ca\") pod \"node-exporter-ntmrl\" (UID: \"ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9\") " pod="openshift-monitoring/node-exporter-ntmrl" Jun 03 23:29:11.614157 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.614064 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9-node-exporter-tls\") pod \"node-exporter-ntmrl\" (UID: \"ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9\") " pod="openshift-monitoring/node-exporter-ntmrl" Jun 03 23:29:11.614157 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.614094 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9-node-exporter-wtmp\") pod \"node-exporter-ntmrl\" (UID: \"ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9\") " pod="openshift-monitoring/node-exporter-ntmrl" Jun 03 23:29:11.614157 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.614116 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9-node-exporter-accelerators-collector-config\") pod \"node-exporter-ntmrl\" (UID: \"ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9\") " pod="openshift-monitoring/node-exporter-ntmrl" Jun 03 23:29:11.614157 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.614135 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6deb7e30-1b05-48a2-921c-9aecfcc19448-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-79fb7d47d4-274cp\" (UID: \"6deb7e30-1b05-48a2-921c-9aecfcc19448\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-274cp" Jun 03 23:29:11.614157 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.614153 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9-sys\") pod \"node-exporter-ntmrl\" (UID: \"ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9\") " pod="openshift-monitoring/node-exporter-ntmrl" Jun 03 23:29:11.614341 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.614168 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6deb7e30-1b05-48a2-921c-9aecfcc19448-kube-state-metrics-tls\") pod \"kube-state-metrics-79fb7d47d4-274cp\" (UID: \"6deb7e30-1b05-48a2-921c-9aecfcc19448\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-274cp" Jun 03 23:29:11.614341 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.614234 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6deb7e30-1b05-48a2-921c-9aecfcc19448-metrics-client-ca\") pod \"kube-state-metrics-79fb7d47d4-274cp\" (UID: \"6deb7e30-1b05-48a2-921c-9aecfcc19448\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-274cp" Jun 03 23:29:11.614414 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.614335 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9-root\") pod \"node-exporter-ntmrl\" (UID: \"ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9\") " pod="openshift-monitoring/node-exporter-ntmrl" Jun 03 23:29:11.614414 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.614362 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zslgn\" (UniqueName: \"kubernetes.io/projected/6deb7e30-1b05-48a2-921c-9aecfcc19448-kube-api-access-zslgn\") pod \"kube-state-metrics-79fb7d47d4-274cp\" (UID: \"6deb7e30-1b05-48a2-921c-9aecfcc19448\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-274cp" Jun 03 23:29:11.614414 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.614389 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6deb7e30-1b05-48a2-921c-9aecfcc19448-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-79fb7d47d4-274cp\" (UID: \"6deb7e30-1b05-48a2-921c-9aecfcc19448\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-274cp" Jun 03 23:29:11.614505 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.614422 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ntmrl\" (UID: \"ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9\") " pod="openshift-monitoring/node-exporter-ntmrl" Jun 03 23:29:11.614505 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.614448 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4zg2\" (UniqueName: \"kubernetes.io/projected/ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9-kube-api-access-w4zg2\") pod \"node-exporter-ntmrl\" (UID: \"ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9\") " pod="openshift-monitoring/node-exporter-ntmrl" Jun 03 23:29:11.614505 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.614480 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6deb7e30-1b05-48a2-921c-9aecfcc19448-volume-directive-shadow\") pod \"kube-state-metrics-79fb7d47d4-274cp\" (UID: \"6deb7e30-1b05-48a2-921c-9aecfcc19448\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-274cp" Jun 03 23:29:11.614505 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.614498 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9-node-exporter-textfile\") pod \"node-exporter-ntmrl\" (UID: \"ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9\") " pod="openshift-monitoring/node-exporter-ntmrl" Jun 03 23:29:11.714847 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.714816 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9-root\") pod \"node-exporter-ntmrl\" (UID: \"ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9\") " pod="openshift-monitoring/node-exporter-ntmrl" Jun 03 23:29:11.714847 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.714849 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zslgn\" (UniqueName: \"kubernetes.io/projected/6deb7e30-1b05-48a2-921c-9aecfcc19448-kube-api-access-zslgn\") pod \"kube-state-metrics-79fb7d47d4-274cp\" (UID: \"6deb7e30-1b05-48a2-921c-9aecfcc19448\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-274cp" Jun 03 23:29:11.715057 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.714874 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6deb7e30-1b05-48a2-921c-9aecfcc19448-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-79fb7d47d4-274cp\" (UID: \"6deb7e30-1b05-48a2-921c-9aecfcc19448\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-274cp" Jun 03 23:29:11.715057 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.714929 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9-root\") pod \"node-exporter-ntmrl\" (UID: \"ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9\") " pod="openshift-monitoring/node-exporter-ntmrl" Jun 03 23:29:11.715057 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.714997 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ntmrl\" (UID: \"ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9\") " pod="openshift-monitoring/node-exporter-ntmrl" Jun 03 23:29:11.715057 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.715048 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4zg2\" (UniqueName: \"kubernetes.io/projected/ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9-kube-api-access-w4zg2\") pod \"node-exporter-ntmrl\" (UID: \"ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9\") " pod="openshift-monitoring/node-exporter-ntmrl" Jun 03 23:29:11.715252 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.715087 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6deb7e30-1b05-48a2-921c-9aecfcc19448-volume-directive-shadow\") pod \"kube-state-metrics-79fb7d47d4-274cp\" (UID: \"6deb7e30-1b05-48a2-921c-9aecfcc19448\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-274cp" Jun 03 23:29:11.715252 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.715114 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9-node-exporter-textfile\") pod \"node-exporter-ntmrl\" (UID: \"ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9\") " pod="openshift-monitoring/node-exporter-ntmrl" Jun 03 23:29:11.715252 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.715146 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9-metrics-client-ca\") pod \"node-exporter-ntmrl\" (UID: \"ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9\") " pod="openshift-monitoring/node-exporter-ntmrl" Jun 03 23:29:11.715252 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.715195 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9-node-exporter-tls\") pod \"node-exporter-ntmrl\" (UID: \"ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9\") " pod="openshift-monitoring/node-exporter-ntmrl" Jun 03 23:29:11.715252 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.715235 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9-node-exporter-wtmp\") pod \"node-exporter-ntmrl\" (UID: \"ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9\") " pod="openshift-monitoring/node-exporter-ntmrl" Jun 03 23:29:11.715525 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.715259 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9-node-exporter-accelerators-collector-config\") pod \"node-exporter-ntmrl\" (UID: \"ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9\") " pod="openshift-monitoring/node-exporter-ntmrl" Jun 03 23:29:11.715525 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.715285 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6deb7e30-1b05-48a2-921c-9aecfcc19448-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-79fb7d47d4-274cp\" (UID: \"6deb7e30-1b05-48a2-921c-9aecfcc19448\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-274cp" Jun 03 23:29:11.715525 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.715341 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9-sys\") pod \"node-exporter-ntmrl\" (UID: \"ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9\") " pod="openshift-monitoring/node-exporter-ntmrl" Jun 03 23:29:11.715525 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.715363 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6deb7e30-1b05-48a2-921c-9aecfcc19448-kube-state-metrics-tls\") pod \"kube-state-metrics-79fb7d47d4-274cp\" (UID: \"6deb7e30-1b05-48a2-921c-9aecfcc19448\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-274cp" Jun 03 23:29:11.715525 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.715418 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6deb7e30-1b05-48a2-921c-9aecfcc19448-metrics-client-ca\") pod \"kube-state-metrics-79fb7d47d4-274cp\" (UID: \"6deb7e30-1b05-48a2-921c-9aecfcc19448\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-274cp" Jun 03 23:29:11.715525 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.715489 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9-node-exporter-textfile\") pod \"node-exporter-ntmrl\" (UID: \"ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9\") " pod="openshift-monitoring/node-exporter-ntmrl" Jun 03 23:29:11.715829 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.715574 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6deb7e30-1b05-48a2-921c-9aecfcc19448-volume-directive-shadow\") pod \"kube-state-metrics-79fb7d47d4-274cp\" (UID: \"6deb7e30-1b05-48a2-921c-9aecfcc19448\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-274cp" Jun 03 23:29:11.715829 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.715658 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9-sys\") pod \"node-exporter-ntmrl\" (UID: \"ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9\") " pod="openshift-monitoring/node-exporter-ntmrl" Jun 03 23:29:11.715829 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.715717 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6deb7e30-1b05-48a2-921c-9aecfcc19448-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-79fb7d47d4-274cp\" (UID: \"6deb7e30-1b05-48a2-921c-9aecfcc19448\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-274cp" Jun 03 23:29:11.715829 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.715785 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9-metrics-client-ca\") pod \"node-exporter-ntmrl\" (UID: \"ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9\") " pod="openshift-monitoring/node-exporter-ntmrl" Jun 03 23:29:11.715998 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:29:11.715871 2574 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 03 23:29:11.715998 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.715875 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9-node-exporter-wtmp\") pod \"node-exporter-ntmrl\" (UID: \"ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9\") " pod="openshift-monitoring/node-exporter-ntmrl" Jun 03 23:29:11.715998 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.715873 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9-node-exporter-accelerators-collector-config\") pod \"node-exporter-ntmrl\" (UID: \"ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9\") " pod="openshift-monitoring/node-exporter-ntmrl" Jun 03 23:29:11.715998 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:29:11.715942 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6deb7e30-1b05-48a2-921c-9aecfcc19448-kube-state-metrics-tls podName:6deb7e30-1b05-48a2-921c-9aecfcc19448 nodeName:}" failed. No retries permitted until 2026-06-03 23:29:12.215920301 +0000 UTC m=+273.023140782 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/6deb7e30-1b05-48a2-921c-9aecfcc19448-kube-state-metrics-tls") pod "kube-state-metrics-79fb7d47d4-274cp" (UID: "6deb7e30-1b05-48a2-921c-9aecfcc19448") : secret "kube-state-metrics-tls" not found Jun 03 23:29:11.716140 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.716023 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6deb7e30-1b05-48a2-921c-9aecfcc19448-metrics-client-ca\") pod \"kube-state-metrics-79fb7d47d4-274cp\" (UID: \"6deb7e30-1b05-48a2-921c-9aecfcc19448\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-274cp" Jun 03 23:29:11.717571 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.717530 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ntmrl\" (UID: \"ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9\") " pod="openshift-monitoring/node-exporter-ntmrl" Jun 03 23:29:11.717729 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.717711 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9-node-exporter-tls\") pod \"node-exporter-ntmrl\" (UID: \"ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9\") " pod="openshift-monitoring/node-exporter-ntmrl" Jun 03 23:29:11.718084 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.718068 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6deb7e30-1b05-48a2-921c-9aecfcc19448-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-79fb7d47d4-274cp\" (UID: \"6deb7e30-1b05-48a2-921c-9aecfcc19448\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-274cp" Jun 03 23:29:11.724373 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.724339 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4zg2\" (UniqueName: \"kubernetes.io/projected/ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9-kube-api-access-w4zg2\") pod \"node-exporter-ntmrl\" (UID: \"ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9\") " pod="openshift-monitoring/node-exporter-ntmrl" Jun 03 23:29:11.724771 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.724752 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zslgn\" (UniqueName: \"kubernetes.io/projected/6deb7e30-1b05-48a2-921c-9aecfcc19448-kube-api-access-zslgn\") pod \"kube-state-metrics-79fb7d47d4-274cp\" (UID: \"6deb7e30-1b05-48a2-921c-9aecfcc19448\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-274cp" Jun 03 23:29:11.882598 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:11.882520 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ntmrl" Jun 03 23:29:11.896708 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:29:11.896678 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab03e1dd_cdf3_4beb_9bec_e9aa9ddd35f9.slice/crio-fdc6357026ba1a8acb261f74065086363fa0c5ec0fe3c23fa0a7ec1c4cd61ccf WatchSource:0}: Error finding container fdc6357026ba1a8acb261f74065086363fa0c5ec0fe3c23fa0a7ec1c4cd61ccf: Status 404 returned error can't find the container with id fdc6357026ba1a8acb261f74065086363fa0c5ec0fe3c23fa0a7ec1c4cd61ccf Jun 03 23:29:12.219819 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:12.219783 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6deb7e30-1b05-48a2-921c-9aecfcc19448-kube-state-metrics-tls\") pod \"kube-state-metrics-79fb7d47d4-274cp\" (UID: \"6deb7e30-1b05-48a2-921c-9aecfcc19448\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-274cp" Jun 03 23:29:12.222173 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:12.222154 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6deb7e30-1b05-48a2-921c-9aecfcc19448-kube-state-metrics-tls\") pod \"kube-state-metrics-79fb7d47d4-274cp\" (UID: \"6deb7e30-1b05-48a2-921c-9aecfcc19448\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-274cp" Jun 03 23:29:12.459451 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:12.459413 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ntmrl" event={"ID":"ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9","Type":"ContainerStarted","Data":"fdc6357026ba1a8acb261f74065086363fa0c5ec0fe3c23fa0a7ec1c4cd61ccf"} Jun 03 23:29:12.501671 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:12.501592 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-274cp" Jun 03 23:29:12.653236 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:12.653209 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-79fb7d47d4-274cp"] Jun 03 23:29:12.834329 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:29:12.834251 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6deb7e30_1b05_48a2_921c_9aecfcc19448.slice/crio-dba5e6bc38becc8a5d79482cf2ad5cfde0d910d91da39e5ad64dced1d0ab4d61 WatchSource:0}: Error finding container dba5e6bc38becc8a5d79482cf2ad5cfde0d910d91da39e5ad64dced1d0ab4d61: Status 404 returned error can't find the container with id dba5e6bc38becc8a5d79482cf2ad5cfde0d910d91da39e5ad64dced1d0ab4d61 Jun 03 23:29:13.149806 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:13.149720 2574 patch_prober.go:28] interesting pod/image-registry-7df4975dfb-6gst8 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 23:29:13.149806 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:13.149771 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7df4975dfb-6gst8" podUID="06ac1abb-a9ad-4ce2-af4a-4687869aa05d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 23:29:13.464427 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:13.464381 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-274cp" event={"ID":"6deb7e30-1b05-48a2-921c-9aecfcc19448","Type":"ContainerStarted","Data":"dba5e6bc38becc8a5d79482cf2ad5cfde0d910d91da39e5ad64dced1d0ab4d61"} Jun 03 23:29:13.466352 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:13.466322 2574 generic.go:356] "Generic (PLEG): container finished" podID="ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9" containerID="1c365e204a367bf15db02780155d946632ab468810a9684c1207aea107434217" exitCode=0 Jun 03 23:29:13.466497 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:13.466408 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ntmrl" event={"ID":"ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9","Type":"ContainerDied","Data":"1c365e204a367bf15db02780155d946632ab468810a9684c1207aea107434217"} Jun 03 23:29:13.885109 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:13.885079 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-fbdfd477d-hxqsp"] Jun 03 23:29:13.889207 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:13.889184 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fbdfd477d-hxqsp" Jun 03 23:29:13.892238 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:13.892216 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 03 23:29:13.892366 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:13.892224 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 03 23:29:13.892366 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:13.892320 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 03 23:29:13.892479 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:13.892371 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 03 23:29:13.893540 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:13.893523 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 03 23:29:13.893635 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:13.893542 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 03 23:29:13.893635 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:13.893550 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 03 23:29:13.893845 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:13.893831 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6dlps\"" Jun 03 23:29:13.898582 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:13.898559 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 03 23:29:13.899696 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:13.899672 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fbdfd477d-hxqsp"] Jun 03 23:29:13.937595 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:13.937564 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/739e4216-71d9-43ba-a5d1-cc4cbb3043e1-console-oauth-config\") pod \"console-fbdfd477d-hxqsp\" (UID: \"739e4216-71d9-43ba-a5d1-cc4cbb3043e1\") " pod="openshift-console/console-fbdfd477d-hxqsp" Jun 03 23:29:13.937703 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:13.937614 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjsbb\" (UniqueName: \"kubernetes.io/projected/739e4216-71d9-43ba-a5d1-cc4cbb3043e1-kube-api-access-cjsbb\") pod \"console-fbdfd477d-hxqsp\" (UID: \"739e4216-71d9-43ba-a5d1-cc4cbb3043e1\") " pod="openshift-console/console-fbdfd477d-hxqsp" Jun 03 23:29:13.937703 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:13.937665 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/739e4216-71d9-43ba-a5d1-cc4cbb3043e1-console-config\") pod \"console-fbdfd477d-hxqsp\" (UID: \"739e4216-71d9-43ba-a5d1-cc4cbb3043e1\") " pod="openshift-console/console-fbdfd477d-hxqsp" Jun 03 23:29:13.937811 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:13.937703 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/739e4216-71d9-43ba-a5d1-cc4cbb3043e1-trusted-ca-bundle\") pod \"console-fbdfd477d-hxqsp\" (UID: \"739e4216-71d9-43ba-a5d1-cc4cbb3043e1\") " pod="openshift-console/console-fbdfd477d-hxqsp" Jun 03 23:29:13.937811 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:13.937767 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/739e4216-71d9-43ba-a5d1-cc4cbb3043e1-console-serving-cert\") pod \"console-fbdfd477d-hxqsp\" (UID: \"739e4216-71d9-43ba-a5d1-cc4cbb3043e1\") " pod="openshift-console/console-fbdfd477d-hxqsp" Jun 03 23:29:13.937811 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:13.937792 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/739e4216-71d9-43ba-a5d1-cc4cbb3043e1-oauth-serving-cert\") pod \"console-fbdfd477d-hxqsp\" (UID: \"739e4216-71d9-43ba-a5d1-cc4cbb3043e1\") " pod="openshift-console/console-fbdfd477d-hxqsp" Jun 03 23:29:13.937940 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:13.937830 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/739e4216-71d9-43ba-a5d1-cc4cbb3043e1-service-ca\") pod \"console-fbdfd477d-hxqsp\" (UID: \"739e4216-71d9-43ba-a5d1-cc4cbb3043e1\") " pod="openshift-console/console-fbdfd477d-hxqsp" Jun 03 23:29:14.038462 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:14.038431 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/739e4216-71d9-43ba-a5d1-cc4cbb3043e1-console-oauth-config\") pod \"console-fbdfd477d-hxqsp\" (UID: \"739e4216-71d9-43ba-a5d1-cc4cbb3043e1\") " pod="openshift-console/console-fbdfd477d-hxqsp" Jun 03 23:29:14.038591 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:14.038476 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjsbb\" (UniqueName: \"kubernetes.io/projected/739e4216-71d9-43ba-a5d1-cc4cbb3043e1-kube-api-access-cjsbb\") pod \"console-fbdfd477d-hxqsp\" (UID: \"739e4216-71d9-43ba-a5d1-cc4cbb3043e1\") " pod="openshift-console/console-fbdfd477d-hxqsp" Jun 03 23:29:14.038591 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:14.038497 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/739e4216-71d9-43ba-a5d1-cc4cbb3043e1-console-config\") pod \"console-fbdfd477d-hxqsp\" (UID: \"739e4216-71d9-43ba-a5d1-cc4cbb3043e1\") " pod="openshift-console/console-fbdfd477d-hxqsp" Jun 03 23:29:14.038591 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:14.038540 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/739e4216-71d9-43ba-a5d1-cc4cbb3043e1-trusted-ca-bundle\") pod \"console-fbdfd477d-hxqsp\" (UID: \"739e4216-71d9-43ba-a5d1-cc4cbb3043e1\") " pod="openshift-console/console-fbdfd477d-hxqsp" Jun 03 23:29:14.038753 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:14.038597 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/739e4216-71d9-43ba-a5d1-cc4cbb3043e1-console-serving-cert\") pod \"console-fbdfd477d-hxqsp\" (UID: \"739e4216-71d9-43ba-a5d1-cc4cbb3043e1\") " pod="openshift-console/console-fbdfd477d-hxqsp" Jun 03 23:29:14.038753 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:14.038627 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/739e4216-71d9-43ba-a5d1-cc4cbb3043e1-oauth-serving-cert\") pod \"console-fbdfd477d-hxqsp\" (UID: \"739e4216-71d9-43ba-a5d1-cc4cbb3043e1\") " pod="openshift-console/console-fbdfd477d-hxqsp" Jun 03 23:29:14.038753 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:14.038663 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/739e4216-71d9-43ba-a5d1-cc4cbb3043e1-service-ca\") pod \"console-fbdfd477d-hxqsp\" (UID: \"739e4216-71d9-43ba-a5d1-cc4cbb3043e1\") " pod="openshift-console/console-fbdfd477d-hxqsp" Jun 03 23:29:14.039272 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:14.039240 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/739e4216-71d9-43ba-a5d1-cc4cbb3043e1-console-config\") pod \"console-fbdfd477d-hxqsp\" (UID: \"739e4216-71d9-43ba-a5d1-cc4cbb3043e1\") " pod="openshift-console/console-fbdfd477d-hxqsp" Jun 03 23:29:14.039455 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:14.039411 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/739e4216-71d9-43ba-a5d1-cc4cbb3043e1-oauth-serving-cert\") pod \"console-fbdfd477d-hxqsp\" (UID: \"739e4216-71d9-43ba-a5d1-cc4cbb3043e1\") " pod="openshift-console/console-fbdfd477d-hxqsp" Jun 03 23:29:14.039455 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:14.039443 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/739e4216-71d9-43ba-a5d1-cc4cbb3043e1-trusted-ca-bundle\") pod \"console-fbdfd477d-hxqsp\" (UID: \"739e4216-71d9-43ba-a5d1-cc4cbb3043e1\") " pod="openshift-console/console-fbdfd477d-hxqsp" Jun 03 23:29:14.039622 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:14.039515 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/739e4216-71d9-43ba-a5d1-cc4cbb3043e1-service-ca\") pod \"console-fbdfd477d-hxqsp\" (UID: \"739e4216-71d9-43ba-a5d1-cc4cbb3043e1\") " pod="openshift-console/console-fbdfd477d-hxqsp" Jun 03 23:29:14.040932 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:14.040914 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/739e4216-71d9-43ba-a5d1-cc4cbb3043e1-console-oauth-config\") pod \"console-fbdfd477d-hxqsp\" (UID: \"739e4216-71d9-43ba-a5d1-cc4cbb3043e1\") " pod="openshift-console/console-fbdfd477d-hxqsp" Jun 03 23:29:14.041143 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:14.041120 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/739e4216-71d9-43ba-a5d1-cc4cbb3043e1-console-serving-cert\") pod \"console-fbdfd477d-hxqsp\" (UID: \"739e4216-71d9-43ba-a5d1-cc4cbb3043e1\") " pod="openshift-console/console-fbdfd477d-hxqsp" Jun 03 23:29:14.046742 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:14.046716 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjsbb\" (UniqueName: \"kubernetes.io/projected/739e4216-71d9-43ba-a5d1-cc4cbb3043e1-kube-api-access-cjsbb\") pod \"console-fbdfd477d-hxqsp\" (UID: \"739e4216-71d9-43ba-a5d1-cc4cbb3043e1\") " pod="openshift-console/console-fbdfd477d-hxqsp" Jun 03 23:29:14.228201 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:14.228157 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fbdfd477d-hxqsp" Jun 03 23:29:14.371258 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:14.371234 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fbdfd477d-hxqsp"] Jun 03 23:29:14.372652 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:29:14.372630 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod739e4216_71d9_43ba_a5d1_cc4cbb3043e1.slice/crio-ebe7deda9e6ec99645170d39b60375d6e2866690f80a1f6a998913904db4b607 WatchSource:0}: Error finding container ebe7deda9e6ec99645170d39b60375d6e2866690f80a1f6a998913904db4b607: Status 404 returned error can't find the container with id ebe7deda9e6ec99645170d39b60375d6e2866690f80a1f6a998913904db4b607 Jun 03 23:29:14.471780 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:14.471745 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-274cp" event={"ID":"6deb7e30-1b05-48a2-921c-9aecfcc19448","Type":"ContainerStarted","Data":"c08ceb193c08a827fd569f8d871277315064959dc3cfaf599843cc46117ab48c"} Jun 03 23:29:14.472042 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:14.471815 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-274cp" event={"ID":"6deb7e30-1b05-48a2-921c-9aecfcc19448","Type":"ContainerStarted","Data":"0181c08afaf6ae874ed3eaa22ad2158da1d467c68b2a640a274b306cb0260ffd"} Jun 03 23:29:14.472042 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:14.471846 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-274cp" event={"ID":"6deb7e30-1b05-48a2-921c-9aecfcc19448","Type":"ContainerStarted","Data":"8be2c521aa0689ce83135b1f40b44b00ceb0f15c9718b99e652509bf698b1186"} Jun 03 23:29:14.473887 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:14.473861 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ntmrl" event={"ID":"ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9","Type":"ContainerStarted","Data":"c703d26b0ab243b9be15825d304836d02e837823aa6a76d0888c8ef4d27edd59"} Jun 03 23:29:14.474044 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:14.473909 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ntmrl" event={"ID":"ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9","Type":"ContainerStarted","Data":"07a1440943288616596e4545dc9f85025659983b838ed4eeb14f1c5df39cb038"} Jun 03 23:29:14.475227 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:14.475178 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fbdfd477d-hxqsp" event={"ID":"739e4216-71d9-43ba-a5d1-cc4cbb3043e1","Type":"ContainerStarted","Data":"ebe7deda9e6ec99645170d39b60375d6e2866690f80a1f6a998913904db4b607"} Jun 03 23:29:14.491753 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:14.491696 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-274cp" podStartSLOduration=2.403750785 podStartE2EDuration="3.491680712s" totalImagesPullingTime="1.087929927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:29:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:29:14.490884145 +0000 UTC m=+275.298104609" watchObservedRunningTime="2026-06-03 23:29:14.491680712 +0000 UTC m=+275.298901213" Jun 03 23:29:14.517668 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:14.513977 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ntmrl" podStartSLOduration=2.470152714 podStartE2EDuration="3.513947336s" totalImagesPullingTime="978.865822ms" totalInitContainerRuntime="64.9288ms" isStatefulPod=true podCreationTimestamp="2026-06-03 23:29:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:29:14.512583977 +0000 UTC m=+275.319804466" watchObservedRunningTime="2026-06-03 23:29:14.513947336 +0000 UTC m=+275.321167801" Jun 03 23:29:15.974582 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:15.974546 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5fdfc4f766-ftdp7"] Jun 03 23:29:15.977837 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:15.977812 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5fdfc4f766-ftdp7" Jun 03 23:29:15.980857 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:15.980831 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 03 23:29:15.980985 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:15.980840 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 03 23:29:15.982367 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:15.982345 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 03 23:29:15.982523 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:15.982350 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-j26f4\"" Jun 03 23:29:15.982523 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:15.982350 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 03 23:29:15.982686 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:15.982671 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-3j5a53u7p0sju\"" Jun 03 23:29:15.987215 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:15.987193 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5fdfc4f766-ftdp7"] Jun 03 23:29:16.060921 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.060863 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc68e35b-f32e-4032-a43a-78a1452fa36c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5fdfc4f766-ftdp7\" (UID: \"dc68e35b-f32e-4032-a43a-78a1452fa36c\") " pod="openshift-monitoring/metrics-server-5fdfc4f766-ftdp7" Jun 03 23:29:16.061095 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.060928 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc68e35b-f32e-4032-a43a-78a1452fa36c-client-ca-bundle\") pod \"metrics-server-5fdfc4f766-ftdp7\" (UID: \"dc68e35b-f32e-4032-a43a-78a1452fa36c\") " pod="openshift-monitoring/metrics-server-5fdfc4f766-ftdp7" Jun 03 23:29:16.061095 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.060979 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/dc68e35b-f32e-4032-a43a-78a1452fa36c-audit-log\") pod \"metrics-server-5fdfc4f766-ftdp7\" (UID: \"dc68e35b-f32e-4032-a43a-78a1452fa36c\") " pod="openshift-monitoring/metrics-server-5fdfc4f766-ftdp7" Jun 03 23:29:16.061095 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.061026 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/dc68e35b-f32e-4032-a43a-78a1452fa36c-metrics-server-audit-profiles\") pod \"metrics-server-5fdfc4f766-ftdp7\" (UID: \"dc68e35b-f32e-4032-a43a-78a1452fa36c\") " pod="openshift-monitoring/metrics-server-5fdfc4f766-ftdp7" Jun 03 23:29:16.061095 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.061051 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/dc68e35b-f32e-4032-a43a-78a1452fa36c-secret-metrics-server-client-certs\") pod \"metrics-server-5fdfc4f766-ftdp7\" (UID: \"dc68e35b-f32e-4032-a43a-78a1452fa36c\") " pod="openshift-monitoring/metrics-server-5fdfc4f766-ftdp7" Jun 03 23:29:16.061312 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.061111 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/dc68e35b-f32e-4032-a43a-78a1452fa36c-secret-metrics-server-tls\") pod \"metrics-server-5fdfc4f766-ftdp7\" (UID: \"dc68e35b-f32e-4032-a43a-78a1452fa36c\") " pod="openshift-monitoring/metrics-server-5fdfc4f766-ftdp7" Jun 03 23:29:16.061312 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.061147 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2pzm\" (UniqueName: \"kubernetes.io/projected/dc68e35b-f32e-4032-a43a-78a1452fa36c-kube-api-access-j2pzm\") pod \"metrics-server-5fdfc4f766-ftdp7\" (UID: \"dc68e35b-f32e-4032-a43a-78a1452fa36c\") " pod="openshift-monitoring/metrics-server-5fdfc4f766-ftdp7" Jun 03 23:29:16.162217 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.162179 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc68e35b-f32e-4032-a43a-78a1452fa36c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5fdfc4f766-ftdp7\" (UID: \"dc68e35b-f32e-4032-a43a-78a1452fa36c\") " pod="openshift-monitoring/metrics-server-5fdfc4f766-ftdp7" Jun 03 23:29:16.162217 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.162219 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc68e35b-f32e-4032-a43a-78a1452fa36c-client-ca-bundle\") pod \"metrics-server-5fdfc4f766-ftdp7\" (UID: \"dc68e35b-f32e-4032-a43a-78a1452fa36c\") " pod="openshift-monitoring/metrics-server-5fdfc4f766-ftdp7" Jun 03 23:29:16.162488 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.162238 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/dc68e35b-f32e-4032-a43a-78a1452fa36c-audit-log\") pod \"metrics-server-5fdfc4f766-ftdp7\" (UID: \"dc68e35b-f32e-4032-a43a-78a1452fa36c\") " pod="openshift-monitoring/metrics-server-5fdfc4f766-ftdp7" Jun 03 23:29:16.162488 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.162273 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/dc68e35b-f32e-4032-a43a-78a1452fa36c-metrics-server-audit-profiles\") pod \"metrics-server-5fdfc4f766-ftdp7\" (UID: \"dc68e35b-f32e-4032-a43a-78a1452fa36c\") " pod="openshift-monitoring/metrics-server-5fdfc4f766-ftdp7" Jun 03 23:29:16.162488 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.162328 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/dc68e35b-f32e-4032-a43a-78a1452fa36c-secret-metrics-server-client-certs\") pod \"metrics-server-5fdfc4f766-ftdp7\" (UID: \"dc68e35b-f32e-4032-a43a-78a1452fa36c\") " pod="openshift-monitoring/metrics-server-5fdfc4f766-ftdp7" Jun 03 23:29:16.162488 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.162388 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/dc68e35b-f32e-4032-a43a-78a1452fa36c-secret-metrics-server-tls\") pod \"metrics-server-5fdfc4f766-ftdp7\" (UID: \"dc68e35b-f32e-4032-a43a-78a1452fa36c\") " pod="openshift-monitoring/metrics-server-5fdfc4f766-ftdp7" Jun 03 23:29:16.162488 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.162408 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2pzm\" (UniqueName: \"kubernetes.io/projected/dc68e35b-f32e-4032-a43a-78a1452fa36c-kube-api-access-j2pzm\") pod \"metrics-server-5fdfc4f766-ftdp7\" (UID: \"dc68e35b-f32e-4032-a43a-78a1452fa36c\") " pod="openshift-monitoring/metrics-server-5fdfc4f766-ftdp7" Jun 03 23:29:16.163081 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.162724 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/dc68e35b-f32e-4032-a43a-78a1452fa36c-audit-log\") pod \"metrics-server-5fdfc4f766-ftdp7\" (UID: \"dc68e35b-f32e-4032-a43a-78a1452fa36c\") " pod="openshift-monitoring/metrics-server-5fdfc4f766-ftdp7" Jun 03 23:29:16.163081 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.163056 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc68e35b-f32e-4032-a43a-78a1452fa36c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5fdfc4f766-ftdp7\" (UID: \"dc68e35b-f32e-4032-a43a-78a1452fa36c\") " pod="openshift-monitoring/metrics-server-5fdfc4f766-ftdp7" Jun 03 23:29:16.163749 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.163726 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/dc68e35b-f32e-4032-a43a-78a1452fa36c-metrics-server-audit-profiles\") pod \"metrics-server-5fdfc4f766-ftdp7\" (UID: \"dc68e35b-f32e-4032-a43a-78a1452fa36c\") " pod="openshift-monitoring/metrics-server-5fdfc4f766-ftdp7" Jun 03 23:29:16.165253 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.165230 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/dc68e35b-f32e-4032-a43a-78a1452fa36c-secret-metrics-server-tls\") pod \"metrics-server-5fdfc4f766-ftdp7\" (UID: \"dc68e35b-f32e-4032-a43a-78a1452fa36c\") " pod="openshift-monitoring/metrics-server-5fdfc4f766-ftdp7" Jun 03 23:29:16.165514 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.165491 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/dc68e35b-f32e-4032-a43a-78a1452fa36c-secret-metrics-server-client-certs\") pod \"metrics-server-5fdfc4f766-ftdp7\" (UID: \"dc68e35b-f32e-4032-a43a-78a1452fa36c\") " pod="openshift-monitoring/metrics-server-5fdfc4f766-ftdp7" Jun 03 23:29:16.165514 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.165508 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc68e35b-f32e-4032-a43a-78a1452fa36c-client-ca-bundle\") pod \"metrics-server-5fdfc4f766-ftdp7\" (UID: \"dc68e35b-f32e-4032-a43a-78a1452fa36c\") " pod="openshift-monitoring/metrics-server-5fdfc4f766-ftdp7" Jun 03 23:29:16.171383 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.171363 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2pzm\" (UniqueName: \"kubernetes.io/projected/dc68e35b-f32e-4032-a43a-78a1452fa36c-kube-api-access-j2pzm\") pod \"metrics-server-5fdfc4f766-ftdp7\" (UID: \"dc68e35b-f32e-4032-a43a-78a1452fa36c\") " pod="openshift-monitoring/metrics-server-5fdfc4f766-ftdp7" Jun 03 23:29:16.290352 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.290247 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5fdfc4f766-ftdp7" Jun 03 23:29:16.362216 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.362174 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-9b9fc658-q9m4k"] Jun 03 23:29:16.365539 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.365515 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-9b9fc658-q9m4k" Jun 03 23:29:16.369213 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.369178 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 03 23:29:16.369213 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.369185 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-ztm2s\"" Jun 03 23:29:16.374253 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.374232 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-9b9fc658-q9m4k"] Jun 03 23:29:16.465864 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.465829 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f4038def-2ab0-4407-85a5-bb20e787479d-monitoring-plugin-cert\") pod \"monitoring-plugin-9b9fc658-q9m4k\" (UID: \"f4038def-2ab0-4407-85a5-bb20e787479d\") " pod="openshift-monitoring/monitoring-plugin-9b9fc658-q9m4k" Jun 03 23:29:16.466077 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.466012 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zrs6\" (UniqueName: \"kubernetes.io/projected/f4038def-2ab0-4407-85a5-bb20e787479d-kube-api-access-9zrs6\") pod \"monitoring-plugin-9b9fc658-q9m4k\" (UID: \"f4038def-2ab0-4407-85a5-bb20e787479d\") " pod="openshift-monitoring/monitoring-plugin-9b9fc658-q9m4k" Jun 03 23:29:16.566915 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.566815 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f4038def-2ab0-4407-85a5-bb20e787479d-monitoring-plugin-cert\") pod \"monitoring-plugin-9b9fc658-q9m4k\" (UID: \"f4038def-2ab0-4407-85a5-bb20e787479d\") " pod="openshift-monitoring/monitoring-plugin-9b9fc658-q9m4k" Jun 03 23:29:16.567080 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.566940 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zrs6\" (UniqueName: \"kubernetes.io/projected/f4038def-2ab0-4407-85a5-bb20e787479d-kube-api-access-9zrs6\") pod \"monitoring-plugin-9b9fc658-q9m4k\" (UID: \"f4038def-2ab0-4407-85a5-bb20e787479d\") " pod="openshift-monitoring/monitoring-plugin-9b9fc658-q9m4k" Jun 03 23:29:16.569825 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.569790 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f4038def-2ab0-4407-85a5-bb20e787479d-monitoring-plugin-cert\") pod \"monitoring-plugin-9b9fc658-q9m4k\" (UID: \"f4038def-2ab0-4407-85a5-bb20e787479d\") " pod="openshift-monitoring/monitoring-plugin-9b9fc658-q9m4k" Jun 03 23:29:16.576529 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.576471 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zrs6\" (UniqueName: \"kubernetes.io/projected/f4038def-2ab0-4407-85a5-bb20e787479d-kube-api-access-9zrs6\") pod \"monitoring-plugin-9b9fc658-q9m4k\" (UID: \"f4038def-2ab0-4407-85a5-bb20e787479d\") " pod="openshift-monitoring/monitoring-plugin-9b9fc658-q9m4k" Jun 03 23:29:16.676870 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.676833 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-9b9fc658-q9m4k" Jun 03 23:29:16.783863 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.783824 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-698d87b464-js7zr"] Jun 03 23:29:16.790841 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.790811 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-698d87b464-js7zr" Jun 03 23:29:16.794481 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.794398 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 03 23:29:16.794481 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.794415 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 03 23:29:16.794714 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.794516 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-8j82r\"" Jun 03 23:29:16.794714 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.794555 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 03 23:29:16.794991 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.794949 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 03 23:29:16.794991 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.794965 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 03 23:29:16.802478 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.802240 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 03 23:29:16.802478 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.802450 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-698d87b464-js7zr"] Jun 03 23:29:16.869366 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.869263 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrpk8\" (UniqueName: \"kubernetes.io/projected/274dced5-fc6e-4865-9159-63a0fd2a05fb-kube-api-access-mrpk8\") pod \"telemeter-client-698d87b464-js7zr\" (UID: \"274dced5-fc6e-4865-9159-63a0fd2a05fb\") " pod="openshift-monitoring/telemeter-client-698d87b464-js7zr" Jun 03 23:29:16.869366 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.869336 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/274dced5-fc6e-4865-9159-63a0fd2a05fb-telemeter-client-tls\") pod \"telemeter-client-698d87b464-js7zr\" (UID: \"274dced5-fc6e-4865-9159-63a0fd2a05fb\") " pod="openshift-monitoring/telemeter-client-698d87b464-js7zr" Jun 03 23:29:16.869576 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.869372 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/274dced5-fc6e-4865-9159-63a0fd2a05fb-federate-client-tls\") pod \"telemeter-client-698d87b464-js7zr\" (UID: \"274dced5-fc6e-4865-9159-63a0fd2a05fb\") " pod="openshift-monitoring/telemeter-client-698d87b464-js7zr" Jun 03 23:29:16.869576 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.869405 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/274dced5-fc6e-4865-9159-63a0fd2a05fb-secret-telemeter-client\") pod \"telemeter-client-698d87b464-js7zr\" (UID: \"274dced5-fc6e-4865-9159-63a0fd2a05fb\") " pod="openshift-monitoring/telemeter-client-698d87b464-js7zr" Jun 03 23:29:16.869576 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.869459 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/274dced5-fc6e-4865-9159-63a0fd2a05fb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-698d87b464-js7zr\" (UID: \"274dced5-fc6e-4865-9159-63a0fd2a05fb\") " pod="openshift-monitoring/telemeter-client-698d87b464-js7zr" Jun 03 23:29:16.869576 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.869555 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/274dced5-fc6e-4865-9159-63a0fd2a05fb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-698d87b464-js7zr\" (UID: \"274dced5-fc6e-4865-9159-63a0fd2a05fb\") " pod="openshift-monitoring/telemeter-client-698d87b464-js7zr" Jun 03 23:29:16.869716 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.869595 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/274dced5-fc6e-4865-9159-63a0fd2a05fb-serving-certs-ca-bundle\") pod \"telemeter-client-698d87b464-js7zr\" (UID: \"274dced5-fc6e-4865-9159-63a0fd2a05fb\") " pod="openshift-monitoring/telemeter-client-698d87b464-js7zr" Jun 03 23:29:16.869716 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.869619 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/274dced5-fc6e-4865-9159-63a0fd2a05fb-metrics-client-ca\") pod \"telemeter-client-698d87b464-js7zr\" (UID: \"274dced5-fc6e-4865-9159-63a0fd2a05fb\") " pod="openshift-monitoring/telemeter-client-698d87b464-js7zr" Jun 03 23:29:16.970875 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.970834 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/274dced5-fc6e-4865-9159-63a0fd2a05fb-serving-certs-ca-bundle\") pod \"telemeter-client-698d87b464-js7zr\" (UID: \"274dced5-fc6e-4865-9159-63a0fd2a05fb\") " pod="openshift-monitoring/telemeter-client-698d87b464-js7zr" Jun 03 23:29:16.971066 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.970881 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/274dced5-fc6e-4865-9159-63a0fd2a05fb-metrics-client-ca\") pod \"telemeter-client-698d87b464-js7zr\" (UID: \"274dced5-fc6e-4865-9159-63a0fd2a05fb\") " pod="openshift-monitoring/telemeter-client-698d87b464-js7zr" Jun 03 23:29:16.971066 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.970921 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrpk8\" (UniqueName: \"kubernetes.io/projected/274dced5-fc6e-4865-9159-63a0fd2a05fb-kube-api-access-mrpk8\") pod \"telemeter-client-698d87b464-js7zr\" (UID: \"274dced5-fc6e-4865-9159-63a0fd2a05fb\") " pod="openshift-monitoring/telemeter-client-698d87b464-js7zr" Jun 03 23:29:16.971066 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.970950 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/274dced5-fc6e-4865-9159-63a0fd2a05fb-telemeter-client-tls\") pod \"telemeter-client-698d87b464-js7zr\" (UID: \"274dced5-fc6e-4865-9159-63a0fd2a05fb\") " pod="openshift-monitoring/telemeter-client-698d87b464-js7zr" Jun 03 23:29:16.971066 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.970980 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/274dced5-fc6e-4865-9159-63a0fd2a05fb-federate-client-tls\") pod \"telemeter-client-698d87b464-js7zr\" (UID: \"274dced5-fc6e-4865-9159-63a0fd2a05fb\") " pod="openshift-monitoring/telemeter-client-698d87b464-js7zr" Jun 03 23:29:16.971066 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.971008 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/274dced5-fc6e-4865-9159-63a0fd2a05fb-secret-telemeter-client\") pod \"telemeter-client-698d87b464-js7zr\" (UID: \"274dced5-fc6e-4865-9159-63a0fd2a05fb\") " pod="openshift-monitoring/telemeter-client-698d87b464-js7zr" Jun 03 23:29:16.971066 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.971054 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/274dced5-fc6e-4865-9159-63a0fd2a05fb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-698d87b464-js7zr\" (UID: \"274dced5-fc6e-4865-9159-63a0fd2a05fb\") " pod="openshift-monitoring/telemeter-client-698d87b464-js7zr" Jun 03 23:29:16.971403 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.971095 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/274dced5-fc6e-4865-9159-63a0fd2a05fb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-698d87b464-js7zr\" (UID: \"274dced5-fc6e-4865-9159-63a0fd2a05fb\") " pod="openshift-monitoring/telemeter-client-698d87b464-js7zr" Jun 03 23:29:16.971832 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.971659 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/274dced5-fc6e-4865-9159-63a0fd2a05fb-metrics-client-ca\") pod \"telemeter-client-698d87b464-js7zr\" (UID: \"274dced5-fc6e-4865-9159-63a0fd2a05fb\") " pod="openshift-monitoring/telemeter-client-698d87b464-js7zr" Jun 03 23:29:16.971832 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.971659 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/274dced5-fc6e-4865-9159-63a0fd2a05fb-serving-certs-ca-bundle\") pod \"telemeter-client-698d87b464-js7zr\" (UID: \"274dced5-fc6e-4865-9159-63a0fd2a05fb\") " pod="openshift-monitoring/telemeter-client-698d87b464-js7zr" Jun 03 23:29:16.972323 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.972282 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/274dced5-fc6e-4865-9159-63a0fd2a05fb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-698d87b464-js7zr\" (UID: \"274dced5-fc6e-4865-9159-63a0fd2a05fb\") " pod="openshift-monitoring/telemeter-client-698d87b464-js7zr" Jun 03 23:29:16.974430 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.973926 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/274dced5-fc6e-4865-9159-63a0fd2a05fb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-698d87b464-js7zr\" (UID: \"274dced5-fc6e-4865-9159-63a0fd2a05fb\") " pod="openshift-monitoring/telemeter-client-698d87b464-js7zr" Jun 03 23:29:16.974430 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.974269 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/274dced5-fc6e-4865-9159-63a0fd2a05fb-federate-client-tls\") pod \"telemeter-client-698d87b464-js7zr\" (UID: \"274dced5-fc6e-4865-9159-63a0fd2a05fb\") " pod="openshift-monitoring/telemeter-client-698d87b464-js7zr" Jun 03 23:29:16.974430 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.974390 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/274dced5-fc6e-4865-9159-63a0fd2a05fb-telemeter-client-tls\") pod \"telemeter-client-698d87b464-js7zr\" (UID: \"274dced5-fc6e-4865-9159-63a0fd2a05fb\") " pod="openshift-monitoring/telemeter-client-698d87b464-js7zr" Jun 03 23:29:16.974644 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.974447 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/274dced5-fc6e-4865-9159-63a0fd2a05fb-secret-telemeter-client\") pod \"telemeter-client-698d87b464-js7zr\" (UID: \"274dced5-fc6e-4865-9159-63a0fd2a05fb\") " pod="openshift-monitoring/telemeter-client-698d87b464-js7zr" Jun 03 23:29:16.980593 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:16.980572 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrpk8\" (UniqueName: \"kubernetes.io/projected/274dced5-fc6e-4865-9159-63a0fd2a05fb-kube-api-access-mrpk8\") pod \"telemeter-client-698d87b464-js7zr\" (UID: \"274dced5-fc6e-4865-9159-63a0fd2a05fb\") " pod="openshift-monitoring/telemeter-client-698d87b464-js7zr" Jun 03 23:29:17.105019 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.104982 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-698d87b464-js7zr" Jun 03 23:29:17.292490 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.292441 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-698d87b464-js7zr"] Jun 03 23:29:17.298841 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:29:17.298810 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod274dced5_fc6e_4865_9159_63a0fd2a05fb.slice/crio-0ff666dd8dd64a733ba83bf57f66b45ffca047897c61341f61a5d0843b911848 WatchSource:0}: Error finding container 0ff666dd8dd64a733ba83bf57f66b45ffca047897c61341f61a5d0843b911848: Status 404 returned error can't find the container with id 0ff666dd8dd64a733ba83bf57f66b45ffca047897c61341f61a5d0843b911848 Jun 03 23:29:17.316503 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.316432 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-9b9fc658-q9m4k"] Jun 03 23:29:17.319597 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:29:17.319572 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4038def_2ab0_4407_85a5_bb20e787479d.slice/crio-932b4091d4005227b5323ac2ed7407eda21231deba930a69a4500e77c83abe6e WatchSource:0}: Error finding container 932b4091d4005227b5323ac2ed7407eda21231deba930a69a4500e77c83abe6e: Status 404 returned error can't find the container with id 932b4091d4005227b5323ac2ed7407eda21231deba930a69a4500e77c83abe6e Jun 03 23:29:17.487606 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.487566 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-698d87b464-js7zr" event={"ID":"274dced5-fc6e-4865-9159-63a0fd2a05fb","Type":"ContainerStarted","Data":"0ff666dd8dd64a733ba83bf57f66b45ffca047897c61341f61a5d0843b911848"} Jun 03 23:29:17.488801 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.488774 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-9b9fc658-q9m4k" event={"ID":"f4038def-2ab0-4407-85a5-bb20e787479d","Type":"ContainerStarted","Data":"932b4091d4005227b5323ac2ed7407eda21231deba930a69a4500e77c83abe6e"} Jun 03 23:29:17.490267 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.490244 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fbdfd477d-hxqsp" event={"ID":"739e4216-71d9-43ba-a5d1-cc4cbb3043e1","Type":"ContainerStarted","Data":"5e44bb9848247f4a0e0908967efe62bf2f1f49f622e11c0929a7e01378f935fe"} Jun 03 23:29:17.509266 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.508733 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-fbdfd477d-hxqsp" podStartSLOduration=1.698932574 podStartE2EDuration="4.508712008s" totalImagesPullingTime="2.809779434s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:29:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:29:17.508505292 +0000 UTC m=+278.315725759" watchObservedRunningTime="2026-06-03 23:29:17.508712008 +0000 UTC m=+278.315932492" Jun 03 23:29:17.522394 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.522365 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5fdfc4f766-ftdp7"] Jun 03 23:29:17.525032 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:29:17.525006 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc68e35b_f32e_4032_a43a_78a1452fa36c.slice/crio-47f14ff08d8a39f785ff40b08b1af9f7a68776ec4bf07e76534d59c1f3904909 WatchSource:0}: Error finding container 47f14ff08d8a39f785ff40b08b1af9f7a68776ec4bf07e76534d59c1f3904909: Status 404 returned error can't find the container with id 47f14ff08d8a39f785ff40b08b1af9f7a68776ec4bf07e76534d59c1f3904909 Jun 03 23:29:17.832850 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.832774 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 23:29:17.835923 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.835905 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.840867 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.840847 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 03 23:29:17.841116 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.841098 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 03 23:29:17.841252 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.841237 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 03 23:29:17.841533 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.841509 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 03 23:29:17.842123 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.842101 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 03 23:29:17.842857 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.842260 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 03 23:29:17.842857 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.842323 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 03 23:29:17.842857 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.842345 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 03 23:29:17.842857 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.842373 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 03 23:29:17.842857 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.842420 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 03 23:29:17.842857 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.842434 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hlw8c\"" Jun 03 23:29:17.842857 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.842443 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 03 23:29:17.842857 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.842489 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 03 23:29:17.842857 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.842848 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 03 23:29:17.843513 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.842961 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-dl31v292o0s0i\"" Jun 03 23:29:17.850770 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.847475 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 03 23:29:17.858818 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.858762 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 23:29:17.880492 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.880460 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c533d276-821e-4514-a1a8-9daefa23741d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.880642 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.880528 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c533d276-821e-4514-a1a8-9daefa23741d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.880642 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.880559 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c533d276-821e-4514-a1a8-9daefa23741d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.880642 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.880585 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c533d276-821e-4514-a1a8-9daefa23741d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.880642 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.880613 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fznwm\" (UniqueName: \"kubernetes.io/projected/c533d276-821e-4514-a1a8-9daefa23741d-kube-api-access-fznwm\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.880800 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.880693 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c533d276-821e-4514-a1a8-9daefa23741d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.880800 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.880732 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c533d276-821e-4514-a1a8-9daefa23741d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.880800 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.880760 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c533d276-821e-4514-a1a8-9daefa23741d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.880957 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.880817 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c533d276-821e-4514-a1a8-9daefa23741d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.880957 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.880860 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c533d276-821e-4514-a1a8-9daefa23741d-config-out\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.880957 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.880921 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c533d276-821e-4514-a1a8-9daefa23741d-config\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.880957 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.880942 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c533d276-821e-4514-a1a8-9daefa23741d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.881138 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.880963 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c533d276-821e-4514-a1a8-9daefa23741d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.881138 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.880987 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c533d276-821e-4514-a1a8-9daefa23741d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.881138 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.881014 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c533d276-821e-4514-a1a8-9daefa23741d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.881138 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.881053 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c533d276-821e-4514-a1a8-9daefa23741d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.881138 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.881108 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c533d276-821e-4514-a1a8-9daefa23741d-web-config\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.881398 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.881182 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c533d276-821e-4514-a1a8-9daefa23741d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.881398 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.881250 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c533d276-821e-4514-a1a8-9daefa23741d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.881398 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.881269 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c533d276-821e-4514-a1a8-9daefa23741d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.982753 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.982717 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c533d276-821e-4514-a1a8-9daefa23741d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.982753 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.982761 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c533d276-821e-4514-a1a8-9daefa23741d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.983166 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.982801 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c533d276-821e-4514-a1a8-9daefa23741d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.983166 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.982845 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c533d276-821e-4514-a1a8-9daefa23741d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.983166 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.982872 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c533d276-821e-4514-a1a8-9daefa23741d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.983166 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.982902 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c533d276-821e-4514-a1a8-9daefa23741d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.983166 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.982927 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fznwm\" (UniqueName: \"kubernetes.io/projected/c533d276-821e-4514-a1a8-9daefa23741d-kube-api-access-fznwm\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.983166 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.982952 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c533d276-821e-4514-a1a8-9daefa23741d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.983166 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.982977 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c533d276-821e-4514-a1a8-9daefa23741d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.983166 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.983003 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c533d276-821e-4514-a1a8-9daefa23741d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.983166 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.983036 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c533d276-821e-4514-a1a8-9daefa23741d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.983166 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.983071 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c533d276-821e-4514-a1a8-9daefa23741d-config-out\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.983166 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.983133 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c533d276-821e-4514-a1a8-9daefa23741d-config\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.983166 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.983157 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c533d276-821e-4514-a1a8-9daefa23741d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.983755 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.983180 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c533d276-821e-4514-a1a8-9daefa23741d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.983755 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.983207 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c533d276-821e-4514-a1a8-9daefa23741d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.983755 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.983231 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c533d276-821e-4514-a1a8-9daefa23741d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.983755 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.983255 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c533d276-821e-4514-a1a8-9daefa23741d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.983755 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.983282 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c533d276-821e-4514-a1a8-9daefa23741d-web-config\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.984041 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.984001 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c533d276-821e-4514-a1a8-9daefa23741d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.984109 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.983944 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c533d276-821e-4514-a1a8-9daefa23741d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.984798 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.984776 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c533d276-821e-4514-a1a8-9daefa23741d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.987008 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.983532 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c533d276-821e-4514-a1a8-9daefa23741d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.987008 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.986695 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c533d276-821e-4514-a1a8-9daefa23741d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.987708 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.987683 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c533d276-821e-4514-a1a8-9daefa23741d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.989062 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.988136 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c533d276-821e-4514-a1a8-9daefa23741d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.989062 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.988158 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c533d276-821e-4514-a1a8-9daefa23741d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.989062 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.988811 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c533d276-821e-4514-a1a8-9daefa23741d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.989062 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.989016 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c533d276-821e-4514-a1a8-9daefa23741d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.991168 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.991116 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c533d276-821e-4514-a1a8-9daefa23741d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.992145 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.991720 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c533d276-821e-4514-a1a8-9daefa23741d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.992145 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.991747 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c533d276-821e-4514-a1a8-9daefa23741d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.992145 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.991799 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c533d276-821e-4514-a1a8-9daefa23741d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.992145 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.991904 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c533d276-821e-4514-a1a8-9daefa23741d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.992145 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.991933 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c533d276-821e-4514-a1a8-9daefa23741d-config-out\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.992145 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.992108 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c533d276-821e-4514-a1a8-9daefa23741d-web-config\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.992489 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.992269 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c533d276-821e-4514-a1a8-9daefa23741d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.994108 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.994082 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c533d276-821e-4514-a1a8-9daefa23741d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.994919 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.994899 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c533d276-821e-4514-a1a8-9daefa23741d-config\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:17.999921 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:17.999898 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fznwm\" (UniqueName: \"kubernetes.io/projected/c533d276-821e-4514-a1a8-9daefa23741d-kube-api-access-fznwm\") pod \"prometheus-k8s-0\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:18.146929 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:18.146552 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:18.325395 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:18.325358 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 23:29:18.331005 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:29:18.330976 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc533d276_821e_4514_a1a8_9daefa23741d.slice/crio-44fff0396014ed67ac1406d7e4cddb5756ca399430d9671500364736b927127a WatchSource:0}: Error finding container 44fff0396014ed67ac1406d7e4cddb5756ca399430d9671500364736b927127a: Status 404 returned error can't find the container with id 44fff0396014ed67ac1406d7e4cddb5756ca399430d9671500364736b927127a Jun 03 23:29:18.496619 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:18.496519 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c533d276-821e-4514-a1a8-9daefa23741d","Type":"ContainerStarted","Data":"44fff0396014ed67ac1406d7e4cddb5756ca399430d9671500364736b927127a"} Jun 03 23:29:18.498091 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:18.498049 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5fdfc4f766-ftdp7" event={"ID":"dc68e35b-f32e-4032-a43a-78a1452fa36c","Type":"ContainerStarted","Data":"47f14ff08d8a39f785ff40b08b1af9f7a68776ec4bf07e76534d59c1f3904909"} Jun 03 23:29:20.510277 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:20.510244 2574 generic.go:356] "Generic (PLEG): container finished" podID="c533d276-821e-4514-a1a8-9daefa23741d" containerID="d853ce2db3ff7671da0f1282e47d38dd203f057b0ce5d35bdb54441d15cf8a19" exitCode=0 Jun 03 23:29:20.510737 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:20.510331 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c533d276-821e-4514-a1a8-9daefa23741d","Type":"ContainerDied","Data":"d853ce2db3ff7671da0f1282e47d38dd203f057b0ce5d35bdb54441d15cf8a19"} Jun 03 23:29:20.512455 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:20.512427 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-698d87b464-js7zr" event={"ID":"274dced5-fc6e-4865-9159-63a0fd2a05fb","Type":"ContainerStarted","Data":"e7e52e3da6315787933212d386f099a8d1a0b3dd5fe8659aabc8c75559903b45"} Jun 03 23:29:20.512655 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:20.512483 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-698d87b464-js7zr" event={"ID":"274dced5-fc6e-4865-9159-63a0fd2a05fb","Type":"ContainerStarted","Data":"0ff940ebe6456ff32fc097fdfd503142bdd74d673f0051a164904b391edbfb1f"} Jun 03 23:29:20.512655 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:20.512513 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-698d87b464-js7zr" event={"ID":"274dced5-fc6e-4865-9159-63a0fd2a05fb","Type":"ContainerStarted","Data":"3606c360ba036386922df4e72da68e36b101d806c49092e3419ef9a85a987063"} Jun 03 23:29:20.513849 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:20.513825 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-9b9fc658-q9m4k" event={"ID":"f4038def-2ab0-4407-85a5-bb20e787479d","Type":"ContainerStarted","Data":"2bb0cf8686e95ba0b84447690829657fdbb264e6ad93932786af44455ea2512c"} Jun 03 23:29:20.513942 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:20.513924 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-9b9fc658-q9m4k" Jun 03 23:29:20.515503 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:20.515479 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5fdfc4f766-ftdp7" event={"ID":"dc68e35b-f32e-4032-a43a-78a1452fa36c","Type":"ContainerStarted","Data":"87cb118ff67e2146f01aab0d2c5e707914deb8613373e626ffe7a91393c45444"} Jun 03 23:29:20.519507 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:20.519487 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-9b9fc658-q9m4k" Jun 03 23:29:20.564336 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:20.564246 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5fdfc4f766-ftdp7" podStartSLOduration=3.2368794579999998 podStartE2EDuration="5.564227498s" totalImagesPullingTime="2.32734804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:29:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:29:20.562864249 +0000 UTC m=+281.370084714" watchObservedRunningTime="2026-06-03 23:29:20.564227498 +0000 UTC m=+281.371447961" Jun 03 23:29:20.614756 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:20.614704 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-9b9fc658-q9m4k" podStartSLOduration=2.081860352 podStartE2EDuration="4.614688585s" totalImagesPullingTime="2.532828233s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:29:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:29:20.585544265 +0000 UTC m=+281.392764729" watchObservedRunningTime="2026-06-03 23:29:20.614688585 +0000 UTC m=+281.421909049" Jun 03 23:29:20.615093 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:20.615070 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-698d87b464-js7zr" podStartSLOduration=2.060861598 podStartE2EDuration="4.615064101s" totalImagesPullingTime="2.554202503s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:29:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:29:20.611787229 +0000 UTC m=+281.419007695" watchObservedRunningTime="2026-06-03 23:29:20.615064101 +0000 UTC m=+281.422284564" Jun 03 23:29:21.130965 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:29:21.130916 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-wf5jt" podUID="9ffbd581-2f34-45dd-a519-6e24200f8846" Jun 03 23:29:21.520587 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:21.520539 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wf5jt" Jun 03 23:29:23.150032 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:23.149992 2574 patch_prober.go:28] interesting pod/image-registry-7df4975dfb-6gst8 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 23:29:23.150465 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:23.150050 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7df4975dfb-6gst8" podUID="06ac1abb-a9ad-4ce2-af4a-4687869aa05d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 23:29:23.508742 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:23.508710 2574 patch_prober.go:28] interesting pod/image-registry-67f86dc978-2bf4z container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 23:29:23.508896 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:23.508762 2574 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-67f86dc978-2bf4z" podUID="78c6584c-0498-4adb-b65b-9b882781fe01" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 23:29:23.530863 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:23.530829 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c533d276-821e-4514-a1a8-9daefa23741d","Type":"ContainerStarted","Data":"13b9eaa50d93271b73de3de78fff78c93a3db89a742672c31c3303058d0ae8d5"} Jun 03 23:29:23.531002 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:23.530929 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c533d276-821e-4514-a1a8-9daefa23741d","Type":"ContainerStarted","Data":"102b75ced8aa7c3aaaeb4313561e5166eadfb60709bd0b0e9b265881676bf82a"} Jun 03 23:29:24.229097 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:24.229057 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-fbdfd477d-hxqsp" Jun 03 23:29:24.229571 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:24.229209 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-fbdfd477d-hxqsp" Jun 03 23:29:24.230957 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:24.230931 2574 patch_prober.go:28] interesting pod/console-fbdfd477d-hxqsp container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" start-of-body= Jun 03 23:29:24.231079 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:24.230980 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-fbdfd477d-hxqsp" podUID="739e4216-71d9-43ba-a5d1-cc4cbb3043e1" containerName="console" probeResult="failure" output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" Jun 03 23:29:24.453722 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:24.453668 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ffbd581-2f34-45dd-a519-6e24200f8846-metrics-tls\") pod \"dns-default-wf5jt\" (UID: \"9ffbd581-2f34-45dd-a519-6e24200f8846\") " pod="openshift-dns/dns-default-wf5jt" Jun 03 23:29:24.455850 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:24.455825 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ffbd581-2f34-45dd-a519-6e24200f8846-metrics-tls\") pod \"dns-default-wf5jt\" (UID: \"9ffbd581-2f34-45dd-a519-6e24200f8846\") " pod="openshift-dns/dns-default-wf5jt" Jun 03 23:29:24.525917 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:24.525828 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tjp8n\"" Jun 03 23:29:24.531623 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:24.531596 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wf5jt" Jun 03 23:29:25.082405 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:25.082342 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wf5jt"] Jun 03 23:29:25.090357 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:29:25.090332 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ffbd581_2f34_45dd_a519_6e24200f8846.slice/crio-4b13db59461ac04184d3c0f5f0c6c5c8d1309fc9db05d54e98007c2a5f74bb1c WatchSource:0}: Error finding container 4b13db59461ac04184d3c0f5f0c6c5c8d1309fc9db05d54e98007c2a5f74bb1c: Status 404 returned error can't find the container with id 4b13db59461ac04184d3c0f5f0c6c5c8d1309fc9db05d54e98007c2a5f74bb1c Jun 03 23:29:25.437790 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:25.437760 2574 patch_prober.go:28] interesting pod/image-registry-67f86dc978-2bf4z container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 23:29:25.438186 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:25.437808 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-67f86dc978-2bf4z" podUID="78c6584c-0498-4adb-b65b-9b882781fe01" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 23:29:25.541964 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:25.541862 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wf5jt" event={"ID":"9ffbd581-2f34-45dd-a519-6e24200f8846","Type":"ContainerStarted","Data":"4b13db59461ac04184d3c0f5f0c6c5c8d1309fc9db05d54e98007c2a5f74bb1c"} Jun 03 23:29:25.545674 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:25.545644 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c533d276-821e-4514-a1a8-9daefa23741d","Type":"ContainerStarted","Data":"8816be9e197b9260a1530372a2934e0d55be71fa03179bebac832111d6914274"} Jun 03 23:29:25.545825 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:25.545718 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c533d276-821e-4514-a1a8-9daefa23741d","Type":"ContainerStarted","Data":"4d82c98773f956fc2b894cd0ee79719b14b7f13531ae2fdd7666fea84a744f59"} Jun 03 23:29:25.545825 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:25.545750 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c533d276-821e-4514-a1a8-9daefa23741d","Type":"ContainerStarted","Data":"e116989e5c63637b4593a25dfa99a499dce12065710f5d59faf05280d2494fb5"} Jun 03 23:29:25.545825 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:25.545777 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c533d276-821e-4514-a1a8-9daefa23741d","Type":"ContainerStarted","Data":"26a5380e51eb9ccd3ee460be3165c80241880e953e04ebd5cce48c8326afa919"} Jun 03 23:29:25.582855 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:25.582799 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.625991735 podStartE2EDuration="8.582776746s" totalImagesPullingTime="5.929718788s" totalInitContainerRuntime="27.066223ms" isStatefulPod=false podCreationTimestamp="2026-06-03 23:29:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:29:25.58006303 +0000 UTC m=+286.387283499" watchObservedRunningTime="2026-06-03 23:29:25.582776746 +0000 UTC m=+286.389997213" Jun 03 23:29:27.555812 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:27.555772 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wf5jt" event={"ID":"9ffbd581-2f34-45dd-a519-6e24200f8846","Type":"ContainerStarted","Data":"9bed350bfeb5ec49e4d850a245fdc5f3b6a42afc556567302e5c94579adb0711"} Jun 03 23:29:27.556258 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:27.555853 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wf5jt" event={"ID":"9ffbd581-2f34-45dd-a519-6e24200f8846","Type":"ContainerStarted","Data":"0131d4f3e1f62aec42a1cc7f12ee833207c6d443f1a379088a1ee7ec4db019d1"} Jun 03 23:29:27.556258 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:27.555881 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wf5jt" Jun 03 23:29:27.577600 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:27.577550 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wf5jt" podStartSLOduration=252.140511947 podStartE2EDuration="4m13.577536927s" totalImagesPullingTime="1.43702498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:25:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:29:27.577215696 +0000 UTC m=+288.384436160" watchObservedRunningTime="2026-06-03 23:29:27.577536927 +0000 UTC m=+288.384757390" Jun 03 23:29:28.147570 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:28.147519 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:29:28.168067 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:28.168033 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7df4975dfb-6gst8" podUID="06ac1abb-a9ad-4ce2-af4a-4687869aa05d" containerName="registry" containerID="cri-o://21749b0ca204d22c65df2aea4b446a6322a4295a1ebc0cddd804dfbef1c3a415" gracePeriod=30 Jun 03 23:29:28.426461 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:28.426431 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7df4975dfb-6gst8" Jun 03 23:29:28.561019 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:28.560984 2574 generic.go:356] "Generic (PLEG): container finished" podID="06ac1abb-a9ad-4ce2-af4a-4687869aa05d" containerID="21749b0ca204d22c65df2aea4b446a6322a4295a1ebc0cddd804dfbef1c3a415" exitCode=0 Jun 03 23:29:28.561399 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:28.561027 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7df4975dfb-6gst8" Jun 03 23:29:28.561399 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:28.561073 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7df4975dfb-6gst8" event={"ID":"06ac1abb-a9ad-4ce2-af4a-4687869aa05d","Type":"ContainerDied","Data":"21749b0ca204d22c65df2aea4b446a6322a4295a1ebc0cddd804dfbef1c3a415"} Jun 03 23:29:28.561399 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:28.561119 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7df4975dfb-6gst8" event={"ID":"06ac1abb-a9ad-4ce2-af4a-4687869aa05d","Type":"ContainerDied","Data":"732a6e1c6701eb1d60d082d724cfc7e1f253d62f1ff9b20bdfeca5e90d0b2176"} Jun 03 23:29:28.561399 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:28.561140 2574 scope.go:117] "RemoveContainer" containerID="21749b0ca204d22c65df2aea4b446a6322a4295a1ebc0cddd804dfbef1c3a415" Jun 03 23:29:28.570787 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:28.570770 2574 scope.go:117] "RemoveContainer" containerID="21749b0ca204d22c65df2aea4b446a6322a4295a1ebc0cddd804dfbef1c3a415" Jun 03 23:29:28.571052 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:29:28.571033 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21749b0ca204d22c65df2aea4b446a6322a4295a1ebc0cddd804dfbef1c3a415\": container with ID starting with 21749b0ca204d22c65df2aea4b446a6322a4295a1ebc0cddd804dfbef1c3a415 not found: ID does not exist" containerID="21749b0ca204d22c65df2aea4b446a6322a4295a1ebc0cddd804dfbef1c3a415" Jun 03 23:29:28.571092 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:28.571063 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21749b0ca204d22c65df2aea4b446a6322a4295a1ebc0cddd804dfbef1c3a415"} err="failed to get container status \"21749b0ca204d22c65df2aea4b446a6322a4295a1ebc0cddd804dfbef1c3a415\": rpc error: code = NotFound desc = could not find container \"21749b0ca204d22c65df2aea4b446a6322a4295a1ebc0cddd804dfbef1c3a415\": container with ID starting with 21749b0ca204d22c65df2aea4b446a6322a4295a1ebc0cddd804dfbef1c3a415 not found: ID does not exist" Jun 03 23:29:28.599359 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:28.599336 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-image-registry-private-configuration\") pod \"06ac1abb-a9ad-4ce2-af4a-4687869aa05d\" (UID: \"06ac1abb-a9ad-4ce2-af4a-4687869aa05d\") " Jun 03 23:29:28.599489 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:28.599390 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvmcc\" (UniqueName: \"kubernetes.io/projected/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-kube-api-access-cvmcc\") pod \"06ac1abb-a9ad-4ce2-af4a-4687869aa05d\" (UID: \"06ac1abb-a9ad-4ce2-af4a-4687869aa05d\") " Jun 03 23:29:28.599489 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:28.599438 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-installation-pull-secrets\") pod \"06ac1abb-a9ad-4ce2-af4a-4687869aa05d\" (UID: \"06ac1abb-a9ad-4ce2-af4a-4687869aa05d\") " Jun 03 23:29:28.599489 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:28.599456 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-ca-trust-extracted\") pod \"06ac1abb-a9ad-4ce2-af4a-4687869aa05d\" (UID: \"06ac1abb-a9ad-4ce2-af4a-4687869aa05d\") " Jun 03 23:29:28.599650 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:28.599493 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-bound-sa-token\") pod \"06ac1abb-a9ad-4ce2-af4a-4687869aa05d\" (UID: \"06ac1abb-a9ad-4ce2-af4a-4687869aa05d\") " Jun 03 23:29:28.599650 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:28.599521 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-registry-certificates\") pod \"06ac1abb-a9ad-4ce2-af4a-4687869aa05d\" (UID: \"06ac1abb-a9ad-4ce2-af4a-4687869aa05d\") " Jun 03 23:29:28.599650 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:28.599537 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-registry-tls\") pod \"06ac1abb-a9ad-4ce2-af4a-4687869aa05d\" (UID: \"06ac1abb-a9ad-4ce2-af4a-4687869aa05d\") " Jun 03 23:29:28.599650 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:28.599567 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-trusted-ca\") pod \"06ac1abb-a9ad-4ce2-af4a-4687869aa05d\" (UID: \"06ac1abb-a9ad-4ce2-af4a-4687869aa05d\") " Jun 03 23:29:28.599984 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:28.599955 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "06ac1abb-a9ad-4ce2-af4a-4687869aa05d" (UID: "06ac1abb-a9ad-4ce2-af4a-4687869aa05d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 23:29:28.600121 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:28.600101 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "06ac1abb-a9ad-4ce2-af4a-4687869aa05d" (UID: "06ac1abb-a9ad-4ce2-af4a-4687869aa05d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 23:29:28.601715 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:28.601690 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "06ac1abb-a9ad-4ce2-af4a-4687869aa05d" (UID: "06ac1abb-a9ad-4ce2-af4a-4687869aa05d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 23:29:28.601859 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:28.601835 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "06ac1abb-a9ad-4ce2-af4a-4687869aa05d" (UID: "06ac1abb-a9ad-4ce2-af4a-4687869aa05d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 23:29:28.601967 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:28.601855 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-kube-api-access-cvmcc" (OuterVolumeSpecName: "kube-api-access-cvmcc") pod "06ac1abb-a9ad-4ce2-af4a-4687869aa05d" (UID: "06ac1abb-a9ad-4ce2-af4a-4687869aa05d"). InnerVolumeSpecName "kube-api-access-cvmcc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:29:28.602133 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:28.602117 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "06ac1abb-a9ad-4ce2-af4a-4687869aa05d" (UID: "06ac1abb-a9ad-4ce2-af4a-4687869aa05d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:29:28.602195 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:28.602152 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "06ac1abb-a9ad-4ce2-af4a-4687869aa05d" (UID: "06ac1abb-a9ad-4ce2-af4a-4687869aa05d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:29:28.607881 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:28.607853 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "06ac1abb-a9ad-4ce2-af4a-4687869aa05d" (UID: "06ac1abb-a9ad-4ce2-af4a-4687869aa05d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:29:28.701079 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:28.700981 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-trusted-ca\") on node \"ip-10-0-135-242.ec2.internal\" DevicePath \"\"" Jun 03 23:29:28.701079 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:28.701011 2574 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-image-registry-private-configuration\") on node \"ip-10-0-135-242.ec2.internal\" DevicePath \"\"" Jun 03 23:29:28.701079 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:28.701021 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvmcc\" (UniqueName: \"kubernetes.io/projected/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-kube-api-access-cvmcc\") on node \"ip-10-0-135-242.ec2.internal\" DevicePath \"\"" Jun 03 23:29:28.701079 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:28.701032 2574 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-installation-pull-secrets\") on node \"ip-10-0-135-242.ec2.internal\" DevicePath \"\"" Jun 03 23:29:28.701079 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:28.701041 2574 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-ca-trust-extracted\") on node \"ip-10-0-135-242.ec2.internal\" DevicePath \"\"" Jun 03 23:29:28.701079 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:28.701049 2574 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-bound-sa-token\") on node \"ip-10-0-135-242.ec2.internal\" DevicePath \"\"" Jun 03 23:29:28.701079 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:28.701057 2574 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-registry-certificates\") on node \"ip-10-0-135-242.ec2.internal\" DevicePath \"\"" Jun 03 23:29:28.701079 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:28.701064 2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06ac1abb-a9ad-4ce2-af4a-4687869aa05d-registry-tls\") on node \"ip-10-0-135-242.ec2.internal\" DevicePath \"\"" Jun 03 23:29:28.884204 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:28.884175 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7df4975dfb-6gst8"] Jun 03 23:29:28.888614 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:28.888591 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7df4975dfb-6gst8"] Jun 03 23:29:29.657389 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:29.657350 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06ac1abb-a9ad-4ce2-af4a-4687869aa05d" path="/var/lib/kubelet/pods/06ac1abb-a9ad-4ce2-af4a-4687869aa05d/volumes" Jun 03 23:29:31.681036 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:31.681000 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fbdfd477d-hxqsp"] Jun 03 23:29:33.507735 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:33.507703 2574 patch_prober.go:28] interesting pod/image-registry-67f86dc978-2bf4z container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 23:29:33.508139 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:33.507761 2574 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-67f86dc978-2bf4z" podUID="78c6584c-0498-4adb-b65b-9b882781fe01" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 23:29:35.437592 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:35.437562 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-67f86dc978-2bf4z" Jun 03 23:29:36.290977 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:36.290943 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5fdfc4f766-ftdp7" Jun 03 23:29:36.291147 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:36.291001 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5fdfc4f766-ftdp7" Jun 03 23:29:37.563460 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:37.563425 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wf5jt" Jun 03 23:29:39.629321 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:39.629279 2574 kubelet.go:1648] "Image garbage collection succeeded" Jun 03 23:29:56.296104 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:56.296078 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5fdfc4f766-ftdp7" Jun 03 23:29:56.300091 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:56.300071 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5fdfc4f766-ftdp7" Jun 03 23:29:56.679422 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:56.679394 2574 generic.go:356] "Generic (PLEG): container finished" podID="1d545fc1-b4f3-4d2c-9ed9-d04a4b3ab786" containerID="9836cbd7daad9ac21b4c79178656e6a2bd3c32e46e9e5518d68ae14791f27281" exitCode=0 Jun 03 23:29:56.679591 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:56.679467 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-69684796bc-ggcdl" event={"ID":"1d545fc1-b4f3-4d2c-9ed9-d04a4b3ab786","Type":"ContainerDied","Data":"9836cbd7daad9ac21b4c79178656e6a2bd3c32e46e9e5518d68ae14791f27281"} Jun 03 23:29:56.679930 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:56.679916 2574 scope.go:117] "RemoveContainer" containerID="9836cbd7daad9ac21b4c79178656e6a2bd3c32e46e9e5518d68ae14791f27281" Jun 03 23:29:56.700599 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:56.700572 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-fbdfd477d-hxqsp" podUID="739e4216-71d9-43ba-a5d1-cc4cbb3043e1" containerName="console" containerID="cri-o://5e44bb9848247f4a0e0908967efe62bf2f1f49f622e11c0929a7e01378f935fe" gracePeriod=15 Jun 03 23:29:56.981276 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:56.981226 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fbdfd477d-hxqsp" Jun 03 23:29:57.044372 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:57.044342 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/739e4216-71d9-43ba-a5d1-cc4cbb3043e1-service-ca\") pod \"739e4216-71d9-43ba-a5d1-cc4cbb3043e1\" (UID: \"739e4216-71d9-43ba-a5d1-cc4cbb3043e1\") " Jun 03 23:29:57.044372 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:57.044387 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cjsbb\" (UniqueName: \"kubernetes.io/projected/739e4216-71d9-43ba-a5d1-cc4cbb3043e1-kube-api-access-cjsbb\") pod \"739e4216-71d9-43ba-a5d1-cc4cbb3043e1\" (UID: \"739e4216-71d9-43ba-a5d1-cc4cbb3043e1\") " Jun 03 23:29:57.044621 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:57.044436 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/739e4216-71d9-43ba-a5d1-cc4cbb3043e1-console-oauth-config\") pod \"739e4216-71d9-43ba-a5d1-cc4cbb3043e1\" (UID: \"739e4216-71d9-43ba-a5d1-cc4cbb3043e1\") " Jun 03 23:29:57.044621 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:57.044494 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/739e4216-71d9-43ba-a5d1-cc4cbb3043e1-trusted-ca-bundle\") pod \"739e4216-71d9-43ba-a5d1-cc4cbb3043e1\" (UID: \"739e4216-71d9-43ba-a5d1-cc4cbb3043e1\") " Jun 03 23:29:57.044621 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:57.044533 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/739e4216-71d9-43ba-a5d1-cc4cbb3043e1-oauth-serving-cert\") pod \"739e4216-71d9-43ba-a5d1-cc4cbb3043e1\" (UID: \"739e4216-71d9-43ba-a5d1-cc4cbb3043e1\") " Jun 03 23:29:57.044621 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:57.044560 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/739e4216-71d9-43ba-a5d1-cc4cbb3043e1-console-config\") pod \"739e4216-71d9-43ba-a5d1-cc4cbb3043e1\" (UID: \"739e4216-71d9-43ba-a5d1-cc4cbb3043e1\") " Jun 03 23:29:57.045381 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:57.044629 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/739e4216-71d9-43ba-a5d1-cc4cbb3043e1-console-serving-cert\") pod \"739e4216-71d9-43ba-a5d1-cc4cbb3043e1\" (UID: \"739e4216-71d9-43ba-a5d1-cc4cbb3043e1\") " Jun 03 23:29:57.045381 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:57.044754 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/739e4216-71d9-43ba-a5d1-cc4cbb3043e1-service-ca" (OuterVolumeSpecName: "service-ca") pod "739e4216-71d9-43ba-a5d1-cc4cbb3043e1" (UID: "739e4216-71d9-43ba-a5d1-cc4cbb3043e1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 23:29:57.045381 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:57.044911 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/739e4216-71d9-43ba-a5d1-cc4cbb3043e1-service-ca\") on node \"ip-10-0-135-242.ec2.internal\" DevicePath \"\"" Jun 03 23:29:57.045381 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:57.045105 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/739e4216-71d9-43ba-a5d1-cc4cbb3043e1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "739e4216-71d9-43ba-a5d1-cc4cbb3043e1" (UID: "739e4216-71d9-43ba-a5d1-cc4cbb3043e1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 23:29:57.045381 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:57.045343 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/739e4216-71d9-43ba-a5d1-cc4cbb3043e1-console-config" (OuterVolumeSpecName: "console-config") pod "739e4216-71d9-43ba-a5d1-cc4cbb3043e1" (UID: "739e4216-71d9-43ba-a5d1-cc4cbb3043e1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 23:29:57.045629 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:57.045520 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/739e4216-71d9-43ba-a5d1-cc4cbb3043e1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "739e4216-71d9-43ba-a5d1-cc4cbb3043e1" (UID: "739e4216-71d9-43ba-a5d1-cc4cbb3043e1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 23:29:57.047253 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:57.047196 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/739e4216-71d9-43ba-a5d1-cc4cbb3043e1-kube-api-access-cjsbb" (OuterVolumeSpecName: "kube-api-access-cjsbb") pod "739e4216-71d9-43ba-a5d1-cc4cbb3043e1" (UID: "739e4216-71d9-43ba-a5d1-cc4cbb3043e1"). InnerVolumeSpecName "kube-api-access-cjsbb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:29:57.047253 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:57.047239 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/739e4216-71d9-43ba-a5d1-cc4cbb3043e1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "739e4216-71d9-43ba-a5d1-cc4cbb3043e1" (UID: "739e4216-71d9-43ba-a5d1-cc4cbb3043e1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 23:29:57.047440 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:57.047282 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/739e4216-71d9-43ba-a5d1-cc4cbb3043e1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "739e4216-71d9-43ba-a5d1-cc4cbb3043e1" (UID: "739e4216-71d9-43ba-a5d1-cc4cbb3043e1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 23:29:57.146224 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:57.146189 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/739e4216-71d9-43ba-a5d1-cc4cbb3043e1-console-oauth-config\") on node \"ip-10-0-135-242.ec2.internal\" DevicePath \"\"" Jun 03 23:29:57.146224 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:57.146216 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/739e4216-71d9-43ba-a5d1-cc4cbb3043e1-trusted-ca-bundle\") on node \"ip-10-0-135-242.ec2.internal\" DevicePath \"\"" Jun 03 23:29:57.146224 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:57.146225 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/739e4216-71d9-43ba-a5d1-cc4cbb3043e1-oauth-serving-cert\") on node \"ip-10-0-135-242.ec2.internal\" DevicePath \"\"" Jun 03 23:29:57.146224 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:57.146234 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/739e4216-71d9-43ba-a5d1-cc4cbb3043e1-console-config\") on node \"ip-10-0-135-242.ec2.internal\" DevicePath \"\"" Jun 03 23:29:57.146583 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:57.146241 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/739e4216-71d9-43ba-a5d1-cc4cbb3043e1-console-serving-cert\") on node \"ip-10-0-135-242.ec2.internal\" DevicePath \"\"" Jun 03 23:29:57.146583 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:57.146250 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cjsbb\" (UniqueName: \"kubernetes.io/projected/739e4216-71d9-43ba-a5d1-cc4cbb3043e1-kube-api-access-cjsbb\") on node \"ip-10-0-135-242.ec2.internal\" DevicePath \"\"" Jun 03 23:29:57.352555 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:57.352520 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7bd5df7d89-2fp8d_bfa864f5-28e9-4f1d-9515-e1ec120bdfc7/router/0.log" Jun 03 23:29:57.376533 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:57.376504 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vgpjr_ee520e2e-86a3-461f-9914-0ccf3b449d6c/serve-healthcheck-canary/0.log" Jun 03 23:29:57.684841 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:57.684807 2574 generic.go:356] "Generic (PLEG): container finished" podID="739e4216-71d9-43ba-a5d1-cc4cbb3043e1" containerID="5e44bb9848247f4a0e0908967efe62bf2f1f49f622e11c0929a7e01378f935fe" exitCode=0 Jun 03 23:29:57.684996 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:57.684855 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fbdfd477d-hxqsp" Jun 03 23:29:57.684996 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:57.684887 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fbdfd477d-hxqsp" event={"ID":"739e4216-71d9-43ba-a5d1-cc4cbb3043e1","Type":"ContainerDied","Data":"5e44bb9848247f4a0e0908967efe62bf2f1f49f622e11c0929a7e01378f935fe"} Jun 03 23:29:57.684996 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:57.684936 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fbdfd477d-hxqsp" event={"ID":"739e4216-71d9-43ba-a5d1-cc4cbb3043e1","Type":"ContainerDied","Data":"ebe7deda9e6ec99645170d39b60375d6e2866690f80a1f6a998913904db4b607"} Jun 03 23:29:57.684996 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:57.684959 2574 scope.go:117] "RemoveContainer" containerID="5e44bb9848247f4a0e0908967efe62bf2f1f49f622e11c0929a7e01378f935fe" Jun 03 23:29:57.687048 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:57.687010 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-69684796bc-ggcdl" event={"ID":"1d545fc1-b4f3-4d2c-9ed9-d04a4b3ab786","Type":"ContainerStarted","Data":"d32c4d13a2dfd663536b3c32cd0141d34256a6737c24ae3582ddbf64f424c40b"} Jun 03 23:29:57.693220 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:57.693199 2574 scope.go:117] "RemoveContainer" containerID="5e44bb9848247f4a0e0908967efe62bf2f1f49f622e11c0929a7e01378f935fe" Jun 03 23:29:57.693503 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:29:57.693483 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e44bb9848247f4a0e0908967efe62bf2f1f49f622e11c0929a7e01378f935fe\": container with ID starting with 5e44bb9848247f4a0e0908967efe62bf2f1f49f622e11c0929a7e01378f935fe not found: ID does not exist" containerID="5e44bb9848247f4a0e0908967efe62bf2f1f49f622e11c0929a7e01378f935fe" Jun 03 23:29:57.693553 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:57.693512 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e44bb9848247f4a0e0908967efe62bf2f1f49f622e11c0929a7e01378f935fe"} err="failed to get container status \"5e44bb9848247f4a0e0908967efe62bf2f1f49f622e11c0929a7e01378f935fe\": rpc error: code = NotFound desc = could not find container \"5e44bb9848247f4a0e0908967efe62bf2f1f49f622e11c0929a7e01378f935fe\": container with ID starting with 5e44bb9848247f4a0e0908967efe62bf2f1f49f622e11c0929a7e01378f935fe not found: ID does not exist" Jun 03 23:29:57.703365 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:57.703334 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fbdfd477d-hxqsp"] Jun 03 23:29:57.709210 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:57.709182 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-fbdfd477d-hxqsp"] Jun 03 23:29:59.655790 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:29:59.655758 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="739e4216-71d9-43ba-a5d1-cc4cbb3043e1" path="/var/lib/kubelet/pods/739e4216-71d9-43ba-a5d1-cc4cbb3043e1/volumes" Jun 03 23:30:01.707473 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:01.707434 2574 generic.go:356] "Generic (PLEG): container finished" podID="8e27eeb5-c500-4da6-b469-ad64b2ddcfa1" containerID="e2f75d4fd18936cf4c214aa8cc03b71f62507c7deddf1b20e716678f98144956" exitCode=0 Jun 03 23:30:01.707890 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:01.707508 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-vwhcp" event={"ID":"8e27eeb5-c500-4da6-b469-ad64b2ddcfa1","Type":"ContainerDied","Data":"e2f75d4fd18936cf4c214aa8cc03b71f62507c7deddf1b20e716678f98144956"} Jun 03 23:30:01.707890 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:01.707856 2574 scope.go:117] "RemoveContainer" containerID="e2f75d4fd18936cf4c214aa8cc03b71f62507c7deddf1b20e716678f98144956" Jun 03 23:30:02.713080 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:02.713042 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-vwhcp" event={"ID":"8e27eeb5-c500-4da6-b469-ad64b2ddcfa1","Type":"ContainerStarted","Data":"b92ec68609441fa94ad9a8e002cd63b27cc1656595cc61381b1ae92fbadd0648"} Jun 03 23:30:18.147991 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:18.147951 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:18.163415 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:18.163388 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:18.793416 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:18.793384 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:36.171988 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.171905 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 23:30:36.172546 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.172186 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c533d276-821e-4514-a1a8-9daefa23741d" containerName="prometheus" containerID="cri-o://102b75ced8aa7c3aaaeb4313561e5166eadfb60709bd0b0e9b265881676bf82a" gracePeriod=600 Jun 03 23:30:36.172546 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.172245 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c533d276-821e-4514-a1a8-9daefa23741d" containerName="kube-rbac-proxy-thanos" containerID="cri-o://8816be9e197b9260a1530372a2934e0d55be71fa03179bebac832111d6914274" gracePeriod=600 Jun 03 23:30:36.172546 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.172280 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c533d276-821e-4514-a1a8-9daefa23741d" containerName="kube-rbac-proxy-web" containerID="cri-o://e116989e5c63637b4593a25dfa99a499dce12065710f5d59faf05280d2494fb5" gracePeriod=600 Jun 03 23:30:36.172546 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.172285 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c533d276-821e-4514-a1a8-9daefa23741d" containerName="config-reloader" containerID="cri-o://13b9eaa50d93271b73de3de78fff78c93a3db89a742672c31c3303058d0ae8d5" gracePeriod=600 Jun 03 23:30:36.172546 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.172221 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c533d276-821e-4514-a1a8-9daefa23741d" containerName="kube-rbac-proxy" containerID="cri-o://4d82c98773f956fc2b894cd0ee79719b14b7f13531ae2fdd7666fea84a744f59" gracePeriod=600 Jun 03 23:30:36.172546 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.172312 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c533d276-821e-4514-a1a8-9daefa23741d" containerName="thanos-sidecar" containerID="cri-o://26a5380e51eb9ccd3ee460be3165c80241880e953e04ebd5cce48c8326afa919" gracePeriod=600 Jun 03 23:30:36.406023 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.405988 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:36.501121 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.501042 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c533d276-821e-4514-a1a8-9daefa23741d-prometheus-trusted-ca-bundle\") pod \"c533d276-821e-4514-a1a8-9daefa23741d\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " Jun 03 23:30:36.501317 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.501142 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c533d276-821e-4514-a1a8-9daefa23741d-tls-assets\") pod \"c533d276-821e-4514-a1a8-9daefa23741d\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " Jun 03 23:30:36.501317 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.501183 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fznwm\" (UniqueName: \"kubernetes.io/projected/c533d276-821e-4514-a1a8-9daefa23741d-kube-api-access-fznwm\") pod \"c533d276-821e-4514-a1a8-9daefa23741d\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " Jun 03 23:30:36.501317 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.501212 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c533d276-821e-4514-a1a8-9daefa23741d-thanos-prometheus-http-client-file\") pod \"c533d276-821e-4514-a1a8-9daefa23741d\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " Jun 03 23:30:36.501317 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.501230 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c533d276-821e-4514-a1a8-9daefa23741d-secret-prometheus-k8s-tls\") pod \"c533d276-821e-4514-a1a8-9daefa23741d\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " Jun 03 23:30:36.501317 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.501257 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c533d276-821e-4514-a1a8-9daefa23741d-configmap-kubelet-serving-ca-bundle\") pod \"c533d276-821e-4514-a1a8-9daefa23741d\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " Jun 03 23:30:36.501317 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.501281 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c533d276-821e-4514-a1a8-9daefa23741d-web-config\") pod \"c533d276-821e-4514-a1a8-9daefa23741d\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " Jun 03 23:30:36.501634 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.501405 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c533d276-821e-4514-a1a8-9daefa23741d-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "c533d276-821e-4514-a1a8-9daefa23741d" (UID: "c533d276-821e-4514-a1a8-9daefa23741d"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 23:30:36.501634 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.501419 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c533d276-821e-4514-a1a8-9daefa23741d-prometheus-k8s-rulefiles-0\") pod \"c533d276-821e-4514-a1a8-9daefa23741d\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " Jun 03 23:30:36.501634 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.501487 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c533d276-821e-4514-a1a8-9daefa23741d-configmap-metrics-client-ca\") pod \"c533d276-821e-4514-a1a8-9daefa23741d\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " Jun 03 23:30:36.501634 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.501523 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c533d276-821e-4514-a1a8-9daefa23741d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"c533d276-821e-4514-a1a8-9daefa23741d\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " Jun 03 23:30:36.501634 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.501558 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c533d276-821e-4514-a1a8-9daefa23741d-config-out\") pod \"c533d276-821e-4514-a1a8-9daefa23741d\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " Jun 03 23:30:36.501634 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.501599 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c533d276-821e-4514-a1a8-9daefa23741d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"c533d276-821e-4514-a1a8-9daefa23741d\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " Jun 03 23:30:36.501634 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.501627 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c533d276-821e-4514-a1a8-9daefa23741d-prometheus-k8s-rulefiles-1\") pod \"c533d276-821e-4514-a1a8-9daefa23741d\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " Jun 03 23:30:36.501965 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.501658 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c533d276-821e-4514-a1a8-9daefa23741d-prometheus-k8s-rulefiles-2\") pod \"c533d276-821e-4514-a1a8-9daefa23741d\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " Jun 03 23:30:36.501965 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.501700 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c533d276-821e-4514-a1a8-9daefa23741d-secret-grpc-tls\") pod \"c533d276-821e-4514-a1a8-9daefa23741d\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " Jun 03 23:30:36.501965 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.501726 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c533d276-821e-4514-a1a8-9daefa23741d-secret-metrics-client-certs\") pod \"c533d276-821e-4514-a1a8-9daefa23741d\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " Jun 03 23:30:36.501965 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.501766 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c533d276-821e-4514-a1a8-9daefa23741d-configmap-serving-certs-ca-bundle\") pod \"c533d276-821e-4514-a1a8-9daefa23741d\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " Jun 03 23:30:36.501965 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.501791 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c533d276-821e-4514-a1a8-9daefa23741d-prometheus-k8s-db\") pod \"c533d276-821e-4514-a1a8-9daefa23741d\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " Jun 03 23:30:36.501965 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.501815 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c533d276-821e-4514-a1a8-9daefa23741d-secret-kube-rbac-proxy\") pod \"c533d276-821e-4514-a1a8-9daefa23741d\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " Jun 03 23:30:36.501965 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.501846 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c533d276-821e-4514-a1a8-9daefa23741d-config\") pod \"c533d276-821e-4514-a1a8-9daefa23741d\" (UID: \"c533d276-821e-4514-a1a8-9daefa23741d\") " Jun 03 23:30:36.501965 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.501880 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c533d276-821e-4514-a1a8-9daefa23741d-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "c533d276-821e-4514-a1a8-9daefa23741d" (UID: "c533d276-821e-4514-a1a8-9daefa23741d"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 23:30:36.502368 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.502135 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c533d276-821e-4514-a1a8-9daefa23741d-prometheus-trusted-ca-bundle\") on node \"ip-10-0-135-242.ec2.internal\" DevicePath \"\"" Jun 03 23:30:36.502368 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.502154 2574 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c533d276-821e-4514-a1a8-9daefa23741d-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-135-242.ec2.internal\" DevicePath \"\"" Jun 03 23:30:36.502368 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.502218 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c533d276-821e-4514-a1a8-9daefa23741d-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "c533d276-821e-4514-a1a8-9daefa23741d" (UID: "c533d276-821e-4514-a1a8-9daefa23741d"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 23:30:36.502928 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.502571 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c533d276-821e-4514-a1a8-9daefa23741d-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "c533d276-821e-4514-a1a8-9daefa23741d" (UID: "c533d276-821e-4514-a1a8-9daefa23741d"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 23:30:36.502928 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.502875 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c533d276-821e-4514-a1a8-9daefa23741d-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "c533d276-821e-4514-a1a8-9daefa23741d" (UID: "c533d276-821e-4514-a1a8-9daefa23741d"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 23:30:36.503253 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.503222 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c533d276-821e-4514-a1a8-9daefa23741d-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "c533d276-821e-4514-a1a8-9daefa23741d" (UID: "c533d276-821e-4514-a1a8-9daefa23741d"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 23:30:36.503908 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.503751 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c533d276-821e-4514-a1a8-9daefa23741d-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "c533d276-821e-4514-a1a8-9daefa23741d" (UID: "c533d276-821e-4514-a1a8-9daefa23741d"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 23:30:36.504035 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.504005 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c533d276-821e-4514-a1a8-9daefa23741d-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "c533d276-821e-4514-a1a8-9daefa23741d" (UID: "c533d276-821e-4514-a1a8-9daefa23741d"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 23:30:36.504603 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.504577 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c533d276-821e-4514-a1a8-9daefa23741d-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "c533d276-821e-4514-a1a8-9daefa23741d" (UID: "c533d276-821e-4514-a1a8-9daefa23741d"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:30:36.504706 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.504640 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c533d276-821e-4514-a1a8-9daefa23741d-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "c533d276-821e-4514-a1a8-9daefa23741d" (UID: "c533d276-821e-4514-a1a8-9daefa23741d"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:30:36.505065 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.505033 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c533d276-821e-4514-a1a8-9daefa23741d-config" (OuterVolumeSpecName: "config") pod "c533d276-821e-4514-a1a8-9daefa23741d" (UID: "c533d276-821e-4514-a1a8-9daefa23741d"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 23:30:36.505974 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.505933 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c533d276-821e-4514-a1a8-9daefa23741d-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "c533d276-821e-4514-a1a8-9daefa23741d" (UID: "c533d276-821e-4514-a1a8-9daefa23741d"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 23:30:36.506078 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.505994 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c533d276-821e-4514-a1a8-9daefa23741d-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "c533d276-821e-4514-a1a8-9daefa23741d" (UID: "c533d276-821e-4514-a1a8-9daefa23741d"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 23:30:36.506156 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.506135 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c533d276-821e-4514-a1a8-9daefa23741d-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "c533d276-821e-4514-a1a8-9daefa23741d" (UID: "c533d276-821e-4514-a1a8-9daefa23741d"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 23:30:36.506261 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.506139 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c533d276-821e-4514-a1a8-9daefa23741d-kube-api-access-fznwm" (OuterVolumeSpecName: "kube-api-access-fznwm") pod "c533d276-821e-4514-a1a8-9daefa23741d" (UID: "c533d276-821e-4514-a1a8-9daefa23741d"). InnerVolumeSpecName "kube-api-access-fznwm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:30:36.506448 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.506402 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c533d276-821e-4514-a1a8-9daefa23741d-config-out" (OuterVolumeSpecName: "config-out") pod "c533d276-821e-4514-a1a8-9daefa23741d" (UID: "c533d276-821e-4514-a1a8-9daefa23741d"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:30:36.506510 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.506471 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c533d276-821e-4514-a1a8-9daefa23741d-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "c533d276-821e-4514-a1a8-9daefa23741d" (UID: "c533d276-821e-4514-a1a8-9daefa23741d"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 23:30:36.506769 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.506735 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c533d276-821e-4514-a1a8-9daefa23741d-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "c533d276-821e-4514-a1a8-9daefa23741d" (UID: "c533d276-821e-4514-a1a8-9daefa23741d"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 23:30:36.507648 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.507618 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c533d276-821e-4514-a1a8-9daefa23741d-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "c533d276-821e-4514-a1a8-9daefa23741d" (UID: "c533d276-821e-4514-a1a8-9daefa23741d"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 23:30:36.515405 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.515381 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c533d276-821e-4514-a1a8-9daefa23741d-web-config" (OuterVolumeSpecName: "web-config") pod "c533d276-821e-4514-a1a8-9daefa23741d" (UID: "c533d276-821e-4514-a1a8-9daefa23741d"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 23:30:36.603122 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.603085 2574 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c533d276-821e-4514-a1a8-9daefa23741d-thanos-prometheus-http-client-file\") on node \"ip-10-0-135-242.ec2.internal\" DevicePath \"\"" Jun 03 23:30:36.603122 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.603114 2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c533d276-821e-4514-a1a8-9daefa23741d-secret-prometheus-k8s-tls\") on node \"ip-10-0-135-242.ec2.internal\" DevicePath \"\"" Jun 03 23:30:36.603122 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.603127 2574 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c533d276-821e-4514-a1a8-9daefa23741d-web-config\") on node \"ip-10-0-135-242.ec2.internal\" DevicePath \"\"" Jun 03 23:30:36.603401 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.603136 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c533d276-821e-4514-a1a8-9daefa23741d-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-135-242.ec2.internal\" DevicePath \"\"" Jun 03 23:30:36.603401 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.603146 2574 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c533d276-821e-4514-a1a8-9daefa23741d-configmap-metrics-client-ca\") on node \"ip-10-0-135-242.ec2.internal\" DevicePath \"\"" Jun 03 23:30:36.603401 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.603156 2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c533d276-821e-4514-a1a8-9daefa23741d-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-135-242.ec2.internal\" DevicePath \"\"" Jun 03 23:30:36.603401 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.603164 2574 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c533d276-821e-4514-a1a8-9daefa23741d-config-out\") on node \"ip-10-0-135-242.ec2.internal\" DevicePath \"\"" Jun 03 23:30:36.603401 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.603172 2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c533d276-821e-4514-a1a8-9daefa23741d-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-135-242.ec2.internal\" DevicePath \"\"" Jun 03 23:30:36.603401 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.603180 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c533d276-821e-4514-a1a8-9daefa23741d-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-135-242.ec2.internal\" DevicePath \"\"" Jun 03 23:30:36.603401 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.603188 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c533d276-821e-4514-a1a8-9daefa23741d-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-135-242.ec2.internal\" DevicePath \"\"" Jun 03 23:30:36.603401 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.603196 2574 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c533d276-821e-4514-a1a8-9daefa23741d-secret-grpc-tls\") on node \"ip-10-0-135-242.ec2.internal\" DevicePath \"\"" Jun 03 23:30:36.603401 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.603204 2574 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c533d276-821e-4514-a1a8-9daefa23741d-secret-metrics-client-certs\") on node \"ip-10-0-135-242.ec2.internal\" DevicePath \"\"" Jun 03 23:30:36.603401 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.603213 2574 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c533d276-821e-4514-a1a8-9daefa23741d-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-135-242.ec2.internal\" DevicePath \"\"" Jun 03 23:30:36.603401 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.603220 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c533d276-821e-4514-a1a8-9daefa23741d-prometheus-k8s-db\") on node \"ip-10-0-135-242.ec2.internal\" DevicePath \"\"" Jun 03 23:30:36.603401 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.603228 2574 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c533d276-821e-4514-a1a8-9daefa23741d-secret-kube-rbac-proxy\") on node \"ip-10-0-135-242.ec2.internal\" DevicePath \"\"" Jun 03 23:30:36.603401 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.603236 2574 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/c533d276-821e-4514-a1a8-9daefa23741d-config\") on node \"ip-10-0-135-242.ec2.internal\" DevicePath \"\"" Jun 03 23:30:36.603401 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.603244 2574 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c533d276-821e-4514-a1a8-9daefa23741d-tls-assets\") on node \"ip-10-0-135-242.ec2.internal\" DevicePath \"\"" Jun 03 23:30:36.603401 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.603252 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fznwm\" (UniqueName: \"kubernetes.io/projected/c533d276-821e-4514-a1a8-9daefa23741d-kube-api-access-fznwm\") on node \"ip-10-0-135-242.ec2.internal\" DevicePath \"\"" Jun 03 23:30:36.864718 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.864619 2574 generic.go:356] "Generic (PLEG): container finished" podID="c533d276-821e-4514-a1a8-9daefa23741d" containerID="8816be9e197b9260a1530372a2934e0d55be71fa03179bebac832111d6914274" exitCode=0 Jun 03 23:30:36.864718 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.864647 2574 generic.go:356] "Generic (PLEG): container finished" podID="c533d276-821e-4514-a1a8-9daefa23741d" containerID="4d82c98773f956fc2b894cd0ee79719b14b7f13531ae2fdd7666fea84a744f59" exitCode=0 Jun 03 23:30:36.864718 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.864657 2574 generic.go:356] "Generic (PLEG): container finished" podID="c533d276-821e-4514-a1a8-9daefa23741d" containerID="e116989e5c63637b4593a25dfa99a499dce12065710f5d59faf05280d2494fb5" exitCode=0 Jun 03 23:30:36.864718 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.864663 2574 generic.go:356] "Generic (PLEG): container finished" podID="c533d276-821e-4514-a1a8-9daefa23741d" containerID="26a5380e51eb9ccd3ee460be3165c80241880e953e04ebd5cce48c8326afa919" exitCode=0 Jun 03 23:30:36.864718 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.864670 2574 generic.go:356] "Generic (PLEG): container finished" podID="c533d276-821e-4514-a1a8-9daefa23741d" containerID="13b9eaa50d93271b73de3de78fff78c93a3db89a742672c31c3303058d0ae8d5" exitCode=0 Jun 03 23:30:36.864718 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.864677 2574 generic.go:356] "Generic (PLEG): container finished" podID="c533d276-821e-4514-a1a8-9daefa23741d" containerID="102b75ced8aa7c3aaaeb4313561e5166eadfb60709bd0b0e9b265881676bf82a" exitCode=0 Jun 03 23:30:36.864718 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.864694 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:36.864718 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.864702 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c533d276-821e-4514-a1a8-9daefa23741d","Type":"ContainerDied","Data":"8816be9e197b9260a1530372a2934e0d55be71fa03179bebac832111d6914274"} Jun 03 23:30:36.865183 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.864767 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c533d276-821e-4514-a1a8-9daefa23741d","Type":"ContainerDied","Data":"4d82c98773f956fc2b894cd0ee79719b14b7f13531ae2fdd7666fea84a744f59"} Jun 03 23:30:36.865183 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.864782 2574 scope.go:117] "RemoveContainer" containerID="8816be9e197b9260a1530372a2934e0d55be71fa03179bebac832111d6914274" Jun 03 23:30:36.865183 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.864795 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c533d276-821e-4514-a1a8-9daefa23741d","Type":"ContainerDied","Data":"e116989e5c63637b4593a25dfa99a499dce12065710f5d59faf05280d2494fb5"} Jun 03 23:30:36.865183 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.864821 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c533d276-821e-4514-a1a8-9daefa23741d","Type":"ContainerDied","Data":"26a5380e51eb9ccd3ee460be3165c80241880e953e04ebd5cce48c8326afa919"} Jun 03 23:30:36.865183 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.864845 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c533d276-821e-4514-a1a8-9daefa23741d","Type":"ContainerDied","Data":"13b9eaa50d93271b73de3de78fff78c93a3db89a742672c31c3303058d0ae8d5"} Jun 03 23:30:36.865183 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.864879 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c533d276-821e-4514-a1a8-9daefa23741d","Type":"ContainerDied","Data":"102b75ced8aa7c3aaaeb4313561e5166eadfb60709bd0b0e9b265881676bf82a"} Jun 03 23:30:36.865183 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.864903 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c533d276-821e-4514-a1a8-9daefa23741d","Type":"ContainerDied","Data":"44fff0396014ed67ac1406d7e4cddb5756ca399430d9671500364736b927127a"} Jun 03 23:30:36.873233 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.873205 2574 scope.go:117] "RemoveContainer" containerID="4d82c98773f956fc2b894cd0ee79719b14b7f13531ae2fdd7666fea84a744f59" Jun 03 23:30:36.882518 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.882496 2574 scope.go:117] "RemoveContainer" containerID="e116989e5c63637b4593a25dfa99a499dce12065710f5d59faf05280d2494fb5" Jun 03 23:30:36.890256 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.890230 2574 scope.go:117] "RemoveContainer" containerID="26a5380e51eb9ccd3ee460be3165c80241880e953e04ebd5cce48c8326afa919" Jun 03 23:30:36.890697 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.890677 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 23:30:36.895131 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.895109 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 23:30:36.897707 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.897691 2574 scope.go:117] "RemoveContainer" containerID="13b9eaa50d93271b73de3de78fff78c93a3db89a742672c31c3303058d0ae8d5" Jun 03 23:30:36.904633 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.904613 2574 scope.go:117] "RemoveContainer" containerID="102b75ced8aa7c3aaaeb4313561e5166eadfb60709bd0b0e9b265881676bf82a" Jun 03 23:30:36.911948 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.911922 2574 scope.go:117] "RemoveContainer" containerID="d853ce2db3ff7671da0f1282e47d38dd203f057b0ce5d35bdb54441d15cf8a19" Jun 03 23:30:36.918808 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.918790 2574 scope.go:117] "RemoveContainer" containerID="8816be9e197b9260a1530372a2934e0d55be71fa03179bebac832111d6914274" Jun 03 23:30:36.919060 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:30:36.919042 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8816be9e197b9260a1530372a2934e0d55be71fa03179bebac832111d6914274\": container with ID starting with 8816be9e197b9260a1530372a2934e0d55be71fa03179bebac832111d6914274 not found: ID does not exist" containerID="8816be9e197b9260a1530372a2934e0d55be71fa03179bebac832111d6914274" Jun 03 23:30:36.919107 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.919068 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8816be9e197b9260a1530372a2934e0d55be71fa03179bebac832111d6914274"} err="failed to get container status \"8816be9e197b9260a1530372a2934e0d55be71fa03179bebac832111d6914274\": rpc error: code = NotFound desc = could not find container \"8816be9e197b9260a1530372a2934e0d55be71fa03179bebac832111d6914274\": container with ID starting with 8816be9e197b9260a1530372a2934e0d55be71fa03179bebac832111d6914274 not found: ID does not exist" Jun 03 23:30:36.919107 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.919088 2574 scope.go:117] "RemoveContainer" containerID="4d82c98773f956fc2b894cd0ee79719b14b7f13531ae2fdd7666fea84a744f59" Jun 03 23:30:36.919328 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:30:36.919313 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d82c98773f956fc2b894cd0ee79719b14b7f13531ae2fdd7666fea84a744f59\": container with ID starting with 4d82c98773f956fc2b894cd0ee79719b14b7f13531ae2fdd7666fea84a744f59 not found: ID does not exist" containerID="4d82c98773f956fc2b894cd0ee79719b14b7f13531ae2fdd7666fea84a744f59" Jun 03 23:30:36.919429 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.919330 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d82c98773f956fc2b894cd0ee79719b14b7f13531ae2fdd7666fea84a744f59"} err="failed to get container status \"4d82c98773f956fc2b894cd0ee79719b14b7f13531ae2fdd7666fea84a744f59\": rpc error: code = NotFound desc = could not find container \"4d82c98773f956fc2b894cd0ee79719b14b7f13531ae2fdd7666fea84a744f59\": container with ID starting with 4d82c98773f956fc2b894cd0ee79719b14b7f13531ae2fdd7666fea84a744f59 not found: ID does not exist" Jun 03 23:30:36.919429 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.919345 2574 scope.go:117] "RemoveContainer" containerID="e116989e5c63637b4593a25dfa99a499dce12065710f5d59faf05280d2494fb5" Jun 03 23:30:36.919556 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:30:36.919533 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e116989e5c63637b4593a25dfa99a499dce12065710f5d59faf05280d2494fb5\": container with ID starting with e116989e5c63637b4593a25dfa99a499dce12065710f5d59faf05280d2494fb5 not found: ID does not exist" containerID="e116989e5c63637b4593a25dfa99a499dce12065710f5d59faf05280d2494fb5" Jun 03 23:30:36.919615 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.919566 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e116989e5c63637b4593a25dfa99a499dce12065710f5d59faf05280d2494fb5"} err="failed to get container status \"e116989e5c63637b4593a25dfa99a499dce12065710f5d59faf05280d2494fb5\": rpc error: code = NotFound desc = could not find container \"e116989e5c63637b4593a25dfa99a499dce12065710f5d59faf05280d2494fb5\": container with ID starting with e116989e5c63637b4593a25dfa99a499dce12065710f5d59faf05280d2494fb5 not found: ID does not exist" Jun 03 23:30:36.919615 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.919592 2574 scope.go:117] "RemoveContainer" containerID="26a5380e51eb9ccd3ee460be3165c80241880e953e04ebd5cce48c8326afa919" Jun 03 23:30:36.919817 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:30:36.919801 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26a5380e51eb9ccd3ee460be3165c80241880e953e04ebd5cce48c8326afa919\": container with ID starting with 26a5380e51eb9ccd3ee460be3165c80241880e953e04ebd5cce48c8326afa919 not found: ID does not exist" containerID="26a5380e51eb9ccd3ee460be3165c80241880e953e04ebd5cce48c8326afa919" Jun 03 23:30:36.919864 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.919821 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26a5380e51eb9ccd3ee460be3165c80241880e953e04ebd5cce48c8326afa919"} err="failed to get container status \"26a5380e51eb9ccd3ee460be3165c80241880e953e04ebd5cce48c8326afa919\": rpc error: code = NotFound desc = could not find container \"26a5380e51eb9ccd3ee460be3165c80241880e953e04ebd5cce48c8326afa919\": container with ID starting with 26a5380e51eb9ccd3ee460be3165c80241880e953e04ebd5cce48c8326afa919 not found: ID does not exist" Jun 03 23:30:36.919864 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.919835 2574 scope.go:117] "RemoveContainer" containerID="13b9eaa50d93271b73de3de78fff78c93a3db89a742672c31c3303058d0ae8d5" Jun 03 23:30:36.920029 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:30:36.920012 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13b9eaa50d93271b73de3de78fff78c93a3db89a742672c31c3303058d0ae8d5\": container with ID starting with 13b9eaa50d93271b73de3de78fff78c93a3db89a742672c31c3303058d0ae8d5 not found: ID does not exist" containerID="13b9eaa50d93271b73de3de78fff78c93a3db89a742672c31c3303058d0ae8d5" Jun 03 23:30:36.920084 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.920036 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13b9eaa50d93271b73de3de78fff78c93a3db89a742672c31c3303058d0ae8d5"} err="failed to get container status \"13b9eaa50d93271b73de3de78fff78c93a3db89a742672c31c3303058d0ae8d5\": rpc error: code = NotFound desc = could not find container \"13b9eaa50d93271b73de3de78fff78c93a3db89a742672c31c3303058d0ae8d5\": container with ID starting with 13b9eaa50d93271b73de3de78fff78c93a3db89a742672c31c3303058d0ae8d5 not found: ID does not exist" Jun 03 23:30:36.920084 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.920056 2574 scope.go:117] "RemoveContainer" containerID="102b75ced8aa7c3aaaeb4313561e5166eadfb60709bd0b0e9b265881676bf82a" Jun 03 23:30:36.920248 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:30:36.920232 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"102b75ced8aa7c3aaaeb4313561e5166eadfb60709bd0b0e9b265881676bf82a\": container with ID starting with 102b75ced8aa7c3aaaeb4313561e5166eadfb60709bd0b0e9b265881676bf82a not found: ID does not exist" containerID="102b75ced8aa7c3aaaeb4313561e5166eadfb60709bd0b0e9b265881676bf82a" Jun 03 23:30:36.920317 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.920252 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"102b75ced8aa7c3aaaeb4313561e5166eadfb60709bd0b0e9b265881676bf82a"} err="failed to get container status \"102b75ced8aa7c3aaaeb4313561e5166eadfb60709bd0b0e9b265881676bf82a\": rpc error: code = NotFound desc = could not find container \"102b75ced8aa7c3aaaeb4313561e5166eadfb60709bd0b0e9b265881676bf82a\": container with ID starting with 102b75ced8aa7c3aaaeb4313561e5166eadfb60709bd0b0e9b265881676bf82a not found: ID does not exist" Jun 03 23:30:36.920317 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.920265 2574 scope.go:117] "RemoveContainer" containerID="d853ce2db3ff7671da0f1282e47d38dd203f057b0ce5d35bdb54441d15cf8a19" Jun 03 23:30:36.920584 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:30:36.920568 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d853ce2db3ff7671da0f1282e47d38dd203f057b0ce5d35bdb54441d15cf8a19\": container with ID starting with d853ce2db3ff7671da0f1282e47d38dd203f057b0ce5d35bdb54441d15cf8a19 not found: ID does not exist" containerID="d853ce2db3ff7671da0f1282e47d38dd203f057b0ce5d35bdb54441d15cf8a19" Jun 03 23:30:36.920628 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.920587 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d853ce2db3ff7671da0f1282e47d38dd203f057b0ce5d35bdb54441d15cf8a19"} err="failed to get container status \"d853ce2db3ff7671da0f1282e47d38dd203f057b0ce5d35bdb54441d15cf8a19\": rpc error: code = NotFound desc = could not find container \"d853ce2db3ff7671da0f1282e47d38dd203f057b0ce5d35bdb54441d15cf8a19\": container with ID starting with d853ce2db3ff7671da0f1282e47d38dd203f057b0ce5d35bdb54441d15cf8a19 not found: ID does not exist" Jun 03 23:30:36.920628 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.920599 2574 scope.go:117] "RemoveContainer" containerID="8816be9e197b9260a1530372a2934e0d55be71fa03179bebac832111d6914274" Jun 03 23:30:36.920818 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.920791 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8816be9e197b9260a1530372a2934e0d55be71fa03179bebac832111d6914274"} err="failed to get container status \"8816be9e197b9260a1530372a2934e0d55be71fa03179bebac832111d6914274\": rpc error: code = NotFound desc = could not find container \"8816be9e197b9260a1530372a2934e0d55be71fa03179bebac832111d6914274\": container with ID starting with 8816be9e197b9260a1530372a2934e0d55be71fa03179bebac832111d6914274 not found: ID does not exist" Jun 03 23:30:36.920818 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.920817 2574 scope.go:117] "RemoveContainer" containerID="4d82c98773f956fc2b894cd0ee79719b14b7f13531ae2fdd7666fea84a744f59" Jun 03 23:30:36.921094 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.921066 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d82c98773f956fc2b894cd0ee79719b14b7f13531ae2fdd7666fea84a744f59"} err="failed to get container status \"4d82c98773f956fc2b894cd0ee79719b14b7f13531ae2fdd7666fea84a744f59\": rpc error: code = NotFound desc = could not find container \"4d82c98773f956fc2b894cd0ee79719b14b7f13531ae2fdd7666fea84a744f59\": container with ID starting with 4d82c98773f956fc2b894cd0ee79719b14b7f13531ae2fdd7666fea84a744f59 not found: ID does not exist" Jun 03 23:30:36.921191 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.921096 2574 scope.go:117] "RemoveContainer" containerID="e116989e5c63637b4593a25dfa99a499dce12065710f5d59faf05280d2494fb5" Jun 03 23:30:36.921909 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.921883 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e116989e5c63637b4593a25dfa99a499dce12065710f5d59faf05280d2494fb5"} err="failed to get container status \"e116989e5c63637b4593a25dfa99a499dce12065710f5d59faf05280d2494fb5\": rpc error: code = NotFound desc = could not find container \"e116989e5c63637b4593a25dfa99a499dce12065710f5d59faf05280d2494fb5\": container with ID starting with e116989e5c63637b4593a25dfa99a499dce12065710f5d59faf05280d2494fb5 not found: ID does not exist" Jun 03 23:30:36.922031 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.921909 2574 scope.go:117] "RemoveContainer" containerID="26a5380e51eb9ccd3ee460be3165c80241880e953e04ebd5cce48c8326afa919" Jun 03 23:30:36.922225 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.922192 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26a5380e51eb9ccd3ee460be3165c80241880e953e04ebd5cce48c8326afa919"} err="failed to get container status \"26a5380e51eb9ccd3ee460be3165c80241880e953e04ebd5cce48c8326afa919\": rpc error: code = NotFound desc = could not find container \"26a5380e51eb9ccd3ee460be3165c80241880e953e04ebd5cce48c8326afa919\": container with ID starting with 26a5380e51eb9ccd3ee460be3165c80241880e953e04ebd5cce48c8326afa919 not found: ID does not exist" Jun 03 23:30:36.922225 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.922218 2574 scope.go:117] "RemoveContainer" containerID="13b9eaa50d93271b73de3de78fff78c93a3db89a742672c31c3303058d0ae8d5" Jun 03 23:30:36.922460 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.922441 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13b9eaa50d93271b73de3de78fff78c93a3db89a742672c31c3303058d0ae8d5"} err="failed to get container status \"13b9eaa50d93271b73de3de78fff78c93a3db89a742672c31c3303058d0ae8d5\": rpc error: code = NotFound desc = could not find container \"13b9eaa50d93271b73de3de78fff78c93a3db89a742672c31c3303058d0ae8d5\": container with ID starting with 13b9eaa50d93271b73de3de78fff78c93a3db89a742672c31c3303058d0ae8d5 not found: ID does not exist" Jun 03 23:30:36.922537 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.922462 2574 scope.go:117] "RemoveContainer" containerID="102b75ced8aa7c3aaaeb4313561e5166eadfb60709bd0b0e9b265881676bf82a" Jun 03 23:30:36.922705 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.922677 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"102b75ced8aa7c3aaaeb4313561e5166eadfb60709bd0b0e9b265881676bf82a"} err="failed to get container status \"102b75ced8aa7c3aaaeb4313561e5166eadfb60709bd0b0e9b265881676bf82a\": rpc error: code = NotFound desc = could not find container \"102b75ced8aa7c3aaaeb4313561e5166eadfb60709bd0b0e9b265881676bf82a\": container with ID starting with 102b75ced8aa7c3aaaeb4313561e5166eadfb60709bd0b0e9b265881676bf82a not found: ID does not exist" Jun 03 23:30:36.922705 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.922695 2574 scope.go:117] "RemoveContainer" containerID="d853ce2db3ff7671da0f1282e47d38dd203f057b0ce5d35bdb54441d15cf8a19" Jun 03 23:30:36.922968 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.922948 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d853ce2db3ff7671da0f1282e47d38dd203f057b0ce5d35bdb54441d15cf8a19"} err="failed to get container status \"d853ce2db3ff7671da0f1282e47d38dd203f057b0ce5d35bdb54441d15cf8a19\": rpc error: code = NotFound desc = could not find container \"d853ce2db3ff7671da0f1282e47d38dd203f057b0ce5d35bdb54441d15cf8a19\": container with ID starting with d853ce2db3ff7671da0f1282e47d38dd203f057b0ce5d35bdb54441d15cf8a19 not found: ID does not exist" Jun 03 23:30:36.923042 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.922970 2574 scope.go:117] "RemoveContainer" containerID="8816be9e197b9260a1530372a2934e0d55be71fa03179bebac832111d6914274" Jun 03 23:30:36.923191 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.923175 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8816be9e197b9260a1530372a2934e0d55be71fa03179bebac832111d6914274"} err="failed to get container status \"8816be9e197b9260a1530372a2934e0d55be71fa03179bebac832111d6914274\": rpc error: code = NotFound desc = could not find container \"8816be9e197b9260a1530372a2934e0d55be71fa03179bebac832111d6914274\": container with ID starting with 8816be9e197b9260a1530372a2934e0d55be71fa03179bebac832111d6914274 not found: ID does not exist" Jun 03 23:30:36.923261 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.923192 2574 scope.go:117] "RemoveContainer" containerID="4d82c98773f956fc2b894cd0ee79719b14b7f13531ae2fdd7666fea84a744f59" Jun 03 23:30:36.923417 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.923399 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 23:30:36.923488 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.923456 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d82c98773f956fc2b894cd0ee79719b14b7f13531ae2fdd7666fea84a744f59"} err="failed to get container status \"4d82c98773f956fc2b894cd0ee79719b14b7f13531ae2fdd7666fea84a744f59\": rpc error: code = NotFound desc = could not find container \"4d82c98773f956fc2b894cd0ee79719b14b7f13531ae2fdd7666fea84a744f59\": container with ID starting with 4d82c98773f956fc2b894cd0ee79719b14b7f13531ae2fdd7666fea84a744f59 not found: ID does not exist" Jun 03 23:30:36.923488 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.923477 2574 scope.go:117] "RemoveContainer" containerID="e116989e5c63637b4593a25dfa99a499dce12065710f5d59faf05280d2494fb5" Jun 03 23:30:36.923696 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.923683 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06ac1abb-a9ad-4ce2-af4a-4687869aa05d" containerName="registry" Jun 03 23:30:36.923736 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.923698 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="06ac1abb-a9ad-4ce2-af4a-4687869aa05d" containerName="registry" Jun 03 23:30:36.923736 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.923710 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c533d276-821e-4514-a1a8-9daefa23741d" containerName="config-reloader" Jun 03 23:30:36.923736 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.923717 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c533d276-821e-4514-a1a8-9daefa23741d" containerName="config-reloader" Jun 03 23:30:36.923736 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.923728 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c533d276-821e-4514-a1a8-9daefa23741d" containerName="prometheus" Jun 03 23:30:36.923736 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.923735 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c533d276-821e-4514-a1a8-9daefa23741d" containerName="prometheus" Jun 03 23:30:36.923885 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.923742 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c533d276-821e-4514-a1a8-9daefa23741d" containerName="kube-rbac-proxy" Jun 03 23:30:36.923885 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.923747 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c533d276-821e-4514-a1a8-9daefa23741d" containerName="kube-rbac-proxy" Jun 03 23:30:36.923885 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.923753 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="739e4216-71d9-43ba-a5d1-cc4cbb3043e1" containerName="console" Jun 03 23:30:36.923885 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.923758 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="739e4216-71d9-43ba-a5d1-cc4cbb3043e1" containerName="console" Jun 03 23:30:36.923885 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.923693 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e116989e5c63637b4593a25dfa99a499dce12065710f5d59faf05280d2494fb5"} err="failed to get container status \"e116989e5c63637b4593a25dfa99a499dce12065710f5d59faf05280d2494fb5\": rpc error: code = NotFound desc = could not find container \"e116989e5c63637b4593a25dfa99a499dce12065710f5d59faf05280d2494fb5\": container with ID starting with e116989e5c63637b4593a25dfa99a499dce12065710f5d59faf05280d2494fb5 not found: ID does not exist" Jun 03 23:30:36.923885 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.923776 2574 scope.go:117] "RemoveContainer" containerID="26a5380e51eb9ccd3ee460be3165c80241880e953e04ebd5cce48c8326afa919" Jun 03 23:30:36.923885 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.923765 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c533d276-821e-4514-a1a8-9daefa23741d" containerName="init-config-reloader" Jun 03 23:30:36.923885 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.923824 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c533d276-821e-4514-a1a8-9daefa23741d" containerName="init-config-reloader" Jun 03 23:30:36.923885 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.923840 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c533d276-821e-4514-a1a8-9daefa23741d" containerName="kube-rbac-proxy-web" Jun 03 23:30:36.923885 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.923849 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c533d276-821e-4514-a1a8-9daefa23741d" containerName="kube-rbac-proxy-web" Jun 03 23:30:36.923885 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.923869 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c533d276-821e-4514-a1a8-9daefa23741d" containerName="thanos-sidecar" Jun 03 23:30:36.923885 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.923877 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c533d276-821e-4514-a1a8-9daefa23741d" containerName="thanos-sidecar" Jun 03 23:30:36.923885 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.923887 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c533d276-821e-4514-a1a8-9daefa23741d" containerName="kube-rbac-proxy-thanos" Jun 03 23:30:36.923885 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.923893 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c533d276-821e-4514-a1a8-9daefa23741d" containerName="kube-rbac-proxy-thanos" Jun 03 23:30:36.924377 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.923983 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c533d276-821e-4514-a1a8-9daefa23741d" containerName="kube-rbac-proxy-thanos" Jun 03 23:30:36.924377 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.923993 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c533d276-821e-4514-a1a8-9daefa23741d" containerName="kube-rbac-proxy-web" Jun 03 23:30:36.924377 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.924000 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="06ac1abb-a9ad-4ce2-af4a-4687869aa05d" containerName="registry" Jun 03 23:30:36.924377 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.924006 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c533d276-821e-4514-a1a8-9daefa23741d" containerName="config-reloader" Jun 03 23:30:36.924377 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.924012 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c533d276-821e-4514-a1a8-9daefa23741d" containerName="kube-rbac-proxy" Jun 03 23:30:36.924377 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.924018 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="739e4216-71d9-43ba-a5d1-cc4cbb3043e1" containerName="console" Jun 03 23:30:36.924377 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.924024 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c533d276-821e-4514-a1a8-9daefa23741d" containerName="thanos-sidecar" Jun 03 23:30:36.924377 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.924030 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c533d276-821e-4514-a1a8-9daefa23741d" containerName="prometheus" Jun 03 23:30:36.924377 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.924004 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26a5380e51eb9ccd3ee460be3165c80241880e953e04ebd5cce48c8326afa919"} err="failed to get container status \"26a5380e51eb9ccd3ee460be3165c80241880e953e04ebd5cce48c8326afa919\": rpc error: code = NotFound desc = could not find container \"26a5380e51eb9ccd3ee460be3165c80241880e953e04ebd5cce48c8326afa919\": container with ID starting with 26a5380e51eb9ccd3ee460be3165c80241880e953e04ebd5cce48c8326afa919 not found: ID does not exist" Jun 03 23:30:36.924377 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.924092 2574 scope.go:117] "RemoveContainer" containerID="13b9eaa50d93271b73de3de78fff78c93a3db89a742672c31c3303058d0ae8d5" Jun 03 23:30:36.924377 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.924316 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13b9eaa50d93271b73de3de78fff78c93a3db89a742672c31c3303058d0ae8d5"} err="failed to get container status \"13b9eaa50d93271b73de3de78fff78c93a3db89a742672c31c3303058d0ae8d5\": rpc error: code = NotFound desc = could not find container \"13b9eaa50d93271b73de3de78fff78c93a3db89a742672c31c3303058d0ae8d5\": container with ID starting with 13b9eaa50d93271b73de3de78fff78c93a3db89a742672c31c3303058d0ae8d5 not found: ID does not exist" Jun 03 23:30:36.924377 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.924337 2574 scope.go:117] "RemoveContainer" containerID="102b75ced8aa7c3aaaeb4313561e5166eadfb60709bd0b0e9b265881676bf82a" Jun 03 23:30:36.924828 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.924560 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"102b75ced8aa7c3aaaeb4313561e5166eadfb60709bd0b0e9b265881676bf82a"} err="failed to get container status \"102b75ced8aa7c3aaaeb4313561e5166eadfb60709bd0b0e9b265881676bf82a\": rpc error: code = NotFound desc = could not find container \"102b75ced8aa7c3aaaeb4313561e5166eadfb60709bd0b0e9b265881676bf82a\": container with ID starting with 102b75ced8aa7c3aaaeb4313561e5166eadfb60709bd0b0e9b265881676bf82a not found: ID does not exist" Jun 03 23:30:36.924828 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.924576 2574 scope.go:117] "RemoveContainer" containerID="d853ce2db3ff7671da0f1282e47d38dd203f057b0ce5d35bdb54441d15cf8a19" Jun 03 23:30:36.924828 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.924813 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d853ce2db3ff7671da0f1282e47d38dd203f057b0ce5d35bdb54441d15cf8a19"} err="failed to get container status \"d853ce2db3ff7671da0f1282e47d38dd203f057b0ce5d35bdb54441d15cf8a19\": rpc error: code = NotFound desc = could not find container \"d853ce2db3ff7671da0f1282e47d38dd203f057b0ce5d35bdb54441d15cf8a19\": container with ID starting with d853ce2db3ff7671da0f1282e47d38dd203f057b0ce5d35bdb54441d15cf8a19 not found: ID does not exist" Jun 03 23:30:36.924933 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.924835 2574 scope.go:117] "RemoveContainer" containerID="8816be9e197b9260a1530372a2934e0d55be71fa03179bebac832111d6914274" Jun 03 23:30:36.925070 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.925049 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8816be9e197b9260a1530372a2934e0d55be71fa03179bebac832111d6914274"} err="failed to get container status \"8816be9e197b9260a1530372a2934e0d55be71fa03179bebac832111d6914274\": rpc error: code = NotFound desc = could not find container \"8816be9e197b9260a1530372a2934e0d55be71fa03179bebac832111d6914274\": container with ID starting with 8816be9e197b9260a1530372a2934e0d55be71fa03179bebac832111d6914274 not found: ID does not exist" Jun 03 23:30:36.925111 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.925070 2574 scope.go:117] "RemoveContainer" containerID="4d82c98773f956fc2b894cd0ee79719b14b7f13531ae2fdd7666fea84a744f59" Jun 03 23:30:36.925285 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.925264 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d82c98773f956fc2b894cd0ee79719b14b7f13531ae2fdd7666fea84a744f59"} err="failed to get container status \"4d82c98773f956fc2b894cd0ee79719b14b7f13531ae2fdd7666fea84a744f59\": rpc error: code = NotFound desc = could not find container \"4d82c98773f956fc2b894cd0ee79719b14b7f13531ae2fdd7666fea84a744f59\": container with ID starting with 4d82c98773f956fc2b894cd0ee79719b14b7f13531ae2fdd7666fea84a744f59 not found: ID does not exist" Jun 03 23:30:36.925380 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.925283 2574 scope.go:117] "RemoveContainer" containerID="e116989e5c63637b4593a25dfa99a499dce12065710f5d59faf05280d2494fb5" Jun 03 23:30:36.925554 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.925537 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e116989e5c63637b4593a25dfa99a499dce12065710f5d59faf05280d2494fb5"} err="failed to get container status \"e116989e5c63637b4593a25dfa99a499dce12065710f5d59faf05280d2494fb5\": rpc error: code = NotFound desc = could not find container \"e116989e5c63637b4593a25dfa99a499dce12065710f5d59faf05280d2494fb5\": container with ID starting with e116989e5c63637b4593a25dfa99a499dce12065710f5d59faf05280d2494fb5 not found: ID does not exist" Jun 03 23:30:36.925601 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.925555 2574 scope.go:117] "RemoveContainer" containerID="26a5380e51eb9ccd3ee460be3165c80241880e953e04ebd5cce48c8326afa919" Jun 03 23:30:36.925772 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.925755 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26a5380e51eb9ccd3ee460be3165c80241880e953e04ebd5cce48c8326afa919"} err="failed to get container status \"26a5380e51eb9ccd3ee460be3165c80241880e953e04ebd5cce48c8326afa919\": rpc error: code = NotFound desc = could not find container \"26a5380e51eb9ccd3ee460be3165c80241880e953e04ebd5cce48c8326afa919\": container with ID starting with 26a5380e51eb9ccd3ee460be3165c80241880e953e04ebd5cce48c8326afa919 not found: ID does not exist" Jun 03 23:30:36.925814 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.925772 2574 scope.go:117] "RemoveContainer" containerID="13b9eaa50d93271b73de3de78fff78c93a3db89a742672c31c3303058d0ae8d5" Jun 03 23:30:36.925983 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.925965 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13b9eaa50d93271b73de3de78fff78c93a3db89a742672c31c3303058d0ae8d5"} err="failed to get container status \"13b9eaa50d93271b73de3de78fff78c93a3db89a742672c31c3303058d0ae8d5\": rpc error: code = NotFound desc = could not find container \"13b9eaa50d93271b73de3de78fff78c93a3db89a742672c31c3303058d0ae8d5\": container with ID starting with 13b9eaa50d93271b73de3de78fff78c93a3db89a742672c31c3303058d0ae8d5 not found: ID does not exist" Jun 03 23:30:36.925983 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.925982 2574 scope.go:117] "RemoveContainer" containerID="102b75ced8aa7c3aaaeb4313561e5166eadfb60709bd0b0e9b265881676bf82a" Jun 03 23:30:36.926187 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.926171 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"102b75ced8aa7c3aaaeb4313561e5166eadfb60709bd0b0e9b265881676bf82a"} err="failed to get container status \"102b75ced8aa7c3aaaeb4313561e5166eadfb60709bd0b0e9b265881676bf82a\": rpc error: code = NotFound desc = could not find container \"102b75ced8aa7c3aaaeb4313561e5166eadfb60709bd0b0e9b265881676bf82a\": container with ID starting with 102b75ced8aa7c3aaaeb4313561e5166eadfb60709bd0b0e9b265881676bf82a not found: ID does not exist" Jun 03 23:30:36.926232 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.926187 2574 scope.go:117] "RemoveContainer" containerID="d853ce2db3ff7671da0f1282e47d38dd203f057b0ce5d35bdb54441d15cf8a19" Jun 03 23:30:36.926413 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.926396 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d853ce2db3ff7671da0f1282e47d38dd203f057b0ce5d35bdb54441d15cf8a19"} err="failed to get container status \"d853ce2db3ff7671da0f1282e47d38dd203f057b0ce5d35bdb54441d15cf8a19\": rpc error: code = NotFound desc = could not find container \"d853ce2db3ff7671da0f1282e47d38dd203f057b0ce5d35bdb54441d15cf8a19\": container with ID starting with d853ce2db3ff7671da0f1282e47d38dd203f057b0ce5d35bdb54441d15cf8a19 not found: ID does not exist" Jun 03 23:30:36.926413 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.926413 2574 scope.go:117] "RemoveContainer" containerID="8816be9e197b9260a1530372a2934e0d55be71fa03179bebac832111d6914274" Jun 03 23:30:36.926625 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.926600 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8816be9e197b9260a1530372a2934e0d55be71fa03179bebac832111d6914274"} err="failed to get container status \"8816be9e197b9260a1530372a2934e0d55be71fa03179bebac832111d6914274\": rpc error: code = NotFound desc = could not find container \"8816be9e197b9260a1530372a2934e0d55be71fa03179bebac832111d6914274\": container with ID starting with 8816be9e197b9260a1530372a2934e0d55be71fa03179bebac832111d6914274 not found: ID does not exist" Jun 03 23:30:36.926712 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.926626 2574 scope.go:117] "RemoveContainer" containerID="4d82c98773f956fc2b894cd0ee79719b14b7f13531ae2fdd7666fea84a744f59" Jun 03 23:30:36.926883 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.926861 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d82c98773f956fc2b894cd0ee79719b14b7f13531ae2fdd7666fea84a744f59"} err="failed to get container status \"4d82c98773f956fc2b894cd0ee79719b14b7f13531ae2fdd7666fea84a744f59\": rpc error: code = NotFound desc = could not find container \"4d82c98773f956fc2b894cd0ee79719b14b7f13531ae2fdd7666fea84a744f59\": container with ID starting with 4d82c98773f956fc2b894cd0ee79719b14b7f13531ae2fdd7666fea84a744f59 not found: ID does not exist" Jun 03 23:30:36.926959 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.926884 2574 scope.go:117] "RemoveContainer" containerID="e116989e5c63637b4593a25dfa99a499dce12065710f5d59faf05280d2494fb5" Jun 03 23:30:36.927126 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.927105 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e116989e5c63637b4593a25dfa99a499dce12065710f5d59faf05280d2494fb5"} err="failed to get container status \"e116989e5c63637b4593a25dfa99a499dce12065710f5d59faf05280d2494fb5\": rpc error: code = NotFound desc = could not find container \"e116989e5c63637b4593a25dfa99a499dce12065710f5d59faf05280d2494fb5\": container with ID starting with e116989e5c63637b4593a25dfa99a499dce12065710f5d59faf05280d2494fb5 not found: ID does not exist" Jun 03 23:30:36.927180 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.927128 2574 scope.go:117] "RemoveContainer" containerID="26a5380e51eb9ccd3ee460be3165c80241880e953e04ebd5cce48c8326afa919" Jun 03 23:30:36.927353 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.927335 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26a5380e51eb9ccd3ee460be3165c80241880e953e04ebd5cce48c8326afa919"} err="failed to get container status \"26a5380e51eb9ccd3ee460be3165c80241880e953e04ebd5cce48c8326afa919\": rpc error: code = NotFound desc = could not find container \"26a5380e51eb9ccd3ee460be3165c80241880e953e04ebd5cce48c8326afa919\": container with ID starting with 26a5380e51eb9ccd3ee460be3165c80241880e953e04ebd5cce48c8326afa919 not found: ID does not exist" Jun 03 23:30:36.927353 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.927352 2574 scope.go:117] "RemoveContainer" containerID="13b9eaa50d93271b73de3de78fff78c93a3db89a742672c31c3303058d0ae8d5" Jun 03 23:30:36.927583 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.927547 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13b9eaa50d93271b73de3de78fff78c93a3db89a742672c31c3303058d0ae8d5"} err="failed to get container status \"13b9eaa50d93271b73de3de78fff78c93a3db89a742672c31c3303058d0ae8d5\": rpc error: code = NotFound desc = could not find container \"13b9eaa50d93271b73de3de78fff78c93a3db89a742672c31c3303058d0ae8d5\": container with ID starting with 13b9eaa50d93271b73de3de78fff78c93a3db89a742672c31c3303058d0ae8d5 not found: ID does not exist" Jun 03 23:30:36.927622 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.927584 2574 scope.go:117] "RemoveContainer" containerID="102b75ced8aa7c3aaaeb4313561e5166eadfb60709bd0b0e9b265881676bf82a" Jun 03 23:30:36.927825 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.927802 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"102b75ced8aa7c3aaaeb4313561e5166eadfb60709bd0b0e9b265881676bf82a"} err="failed to get container status \"102b75ced8aa7c3aaaeb4313561e5166eadfb60709bd0b0e9b265881676bf82a\": rpc error: code = NotFound desc = could not find container \"102b75ced8aa7c3aaaeb4313561e5166eadfb60709bd0b0e9b265881676bf82a\": container with ID starting with 102b75ced8aa7c3aaaeb4313561e5166eadfb60709bd0b0e9b265881676bf82a not found: ID does not exist" Jun 03 23:30:36.927867 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.927826 2574 scope.go:117] "RemoveContainer" containerID="d853ce2db3ff7671da0f1282e47d38dd203f057b0ce5d35bdb54441d15cf8a19" Jun 03 23:30:36.928045 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.928026 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d853ce2db3ff7671da0f1282e47d38dd203f057b0ce5d35bdb54441d15cf8a19"} err="failed to get container status \"d853ce2db3ff7671da0f1282e47d38dd203f057b0ce5d35bdb54441d15cf8a19\": rpc error: code = NotFound desc = could not find container \"d853ce2db3ff7671da0f1282e47d38dd203f057b0ce5d35bdb54441d15cf8a19\": container with ID starting with d853ce2db3ff7671da0f1282e47d38dd203f057b0ce5d35bdb54441d15cf8a19 not found: ID does not exist" Jun 03 23:30:36.928097 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.928046 2574 scope.go:117] "RemoveContainer" containerID="8816be9e197b9260a1530372a2934e0d55be71fa03179bebac832111d6914274" Jun 03 23:30:36.928280 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.928261 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8816be9e197b9260a1530372a2934e0d55be71fa03179bebac832111d6914274"} err="failed to get container status \"8816be9e197b9260a1530372a2934e0d55be71fa03179bebac832111d6914274\": rpc error: code = NotFound desc = could not find container \"8816be9e197b9260a1530372a2934e0d55be71fa03179bebac832111d6914274\": container with ID starting with 8816be9e197b9260a1530372a2934e0d55be71fa03179bebac832111d6914274 not found: ID does not exist" Jun 03 23:30:36.928280 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.928279 2574 scope.go:117] "RemoveContainer" containerID="4d82c98773f956fc2b894cd0ee79719b14b7f13531ae2fdd7666fea84a744f59" Jun 03 23:30:36.928497 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.928481 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d82c98773f956fc2b894cd0ee79719b14b7f13531ae2fdd7666fea84a744f59"} err="failed to get container status \"4d82c98773f956fc2b894cd0ee79719b14b7f13531ae2fdd7666fea84a744f59\": rpc error: code = NotFound desc = could not find container \"4d82c98773f956fc2b894cd0ee79719b14b7f13531ae2fdd7666fea84a744f59\": container with ID starting with 4d82c98773f956fc2b894cd0ee79719b14b7f13531ae2fdd7666fea84a744f59 not found: ID does not exist" Jun 03 23:30:36.928553 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.928498 2574 scope.go:117] "RemoveContainer" containerID="e116989e5c63637b4593a25dfa99a499dce12065710f5d59faf05280d2494fb5" Jun 03 23:30:36.928691 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.928676 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e116989e5c63637b4593a25dfa99a499dce12065710f5d59faf05280d2494fb5"} err="failed to get container status \"e116989e5c63637b4593a25dfa99a499dce12065710f5d59faf05280d2494fb5\": rpc error: code = NotFound desc = could not find container \"e116989e5c63637b4593a25dfa99a499dce12065710f5d59faf05280d2494fb5\": container with ID starting with e116989e5c63637b4593a25dfa99a499dce12065710f5d59faf05280d2494fb5 not found: ID does not exist" Jun 03 23:30:36.928691 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.928690 2574 scope.go:117] "RemoveContainer" containerID="26a5380e51eb9ccd3ee460be3165c80241880e953e04ebd5cce48c8326afa919" Jun 03 23:30:36.928893 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.928867 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26a5380e51eb9ccd3ee460be3165c80241880e953e04ebd5cce48c8326afa919"} err="failed to get container status \"26a5380e51eb9ccd3ee460be3165c80241880e953e04ebd5cce48c8326afa919\": rpc error: code = NotFound desc = could not find container \"26a5380e51eb9ccd3ee460be3165c80241880e953e04ebd5cce48c8326afa919\": container with ID starting with 26a5380e51eb9ccd3ee460be3165c80241880e953e04ebd5cce48c8326afa919 not found: ID does not exist" Jun 03 23:30:36.928893 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.928881 2574 scope.go:117] "RemoveContainer" containerID="13b9eaa50d93271b73de3de78fff78c93a3db89a742672c31c3303058d0ae8d5" Jun 03 23:30:36.929102 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.929081 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13b9eaa50d93271b73de3de78fff78c93a3db89a742672c31c3303058d0ae8d5"} err="failed to get container status \"13b9eaa50d93271b73de3de78fff78c93a3db89a742672c31c3303058d0ae8d5\": rpc error: code = NotFound desc = could not find container \"13b9eaa50d93271b73de3de78fff78c93a3db89a742672c31c3303058d0ae8d5\": container with ID starting with 13b9eaa50d93271b73de3de78fff78c93a3db89a742672c31c3303058d0ae8d5 not found: ID does not exist" Jun 03 23:30:36.929157 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.929101 2574 scope.go:117] "RemoveContainer" containerID="102b75ced8aa7c3aaaeb4313561e5166eadfb60709bd0b0e9b265881676bf82a" Jun 03 23:30:36.929326 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.929309 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"102b75ced8aa7c3aaaeb4313561e5166eadfb60709bd0b0e9b265881676bf82a"} err="failed to get container status \"102b75ced8aa7c3aaaeb4313561e5166eadfb60709bd0b0e9b265881676bf82a\": rpc error: code = NotFound desc = could not find container \"102b75ced8aa7c3aaaeb4313561e5166eadfb60709bd0b0e9b265881676bf82a\": container with ID starting with 102b75ced8aa7c3aaaeb4313561e5166eadfb60709bd0b0e9b265881676bf82a not found: ID does not exist" Jun 03 23:30:36.929377 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.929326 2574 scope.go:117] "RemoveContainer" containerID="d853ce2db3ff7671da0f1282e47d38dd203f057b0ce5d35bdb54441d15cf8a19" Jun 03 23:30:36.929482 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.929461 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:36.929557 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.929521 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d853ce2db3ff7671da0f1282e47d38dd203f057b0ce5d35bdb54441d15cf8a19"} err="failed to get container status \"d853ce2db3ff7671da0f1282e47d38dd203f057b0ce5d35bdb54441d15cf8a19\": rpc error: code = NotFound desc = could not find container \"d853ce2db3ff7671da0f1282e47d38dd203f057b0ce5d35bdb54441d15cf8a19\": container with ID starting with d853ce2db3ff7671da0f1282e47d38dd203f057b0ce5d35bdb54441d15cf8a19 not found: ID does not exist" Jun 03 23:30:36.932445 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.932417 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 03 23:30:36.932547 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.932453 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 03 23:30:36.932547 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.932510 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 03 23:30:36.932660 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.932599 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 03 23:30:36.933246 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.932717 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hlw8c\"" Jun 03 23:30:36.933246 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.932757 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 03 23:30:36.933246 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.932769 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-dl31v292o0s0i\"" Jun 03 23:30:36.933246 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.932788 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 03 23:30:36.933246 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.933011 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 03 23:30:36.933246 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.933081 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 03 23:30:36.933246 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.933090 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 03 23:30:36.933246 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.933102 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 03 23:30:36.933246 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.933162 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 03 23:30:36.933988 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.933971 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 03 23:30:36.937206 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.937186 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 03 23:30:36.939723 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.939702 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 03 23:30:36.945952 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:36.945926 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 23:30:37.005118 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.005082 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/42093802-1cfa-4450-b765-83ef0ddf7382-config\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.005118 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.005120 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/42093802-1cfa-4450-b765-83ef0ddf7382-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.005386 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.005146 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/42093802-1cfa-4450-b765-83ef0ddf7382-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.005386 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.005194 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/42093802-1cfa-4450-b765-83ef0ddf7382-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.005386 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.005246 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/42093802-1cfa-4450-b765-83ef0ddf7382-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.005386 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.005342 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/42093802-1cfa-4450-b765-83ef0ddf7382-config-out\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.005524 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.005409 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42093802-1cfa-4450-b765-83ef0ddf7382-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.005524 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.005430 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/42093802-1cfa-4450-b765-83ef0ddf7382-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.005524 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.005459 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/42093802-1cfa-4450-b765-83ef0ddf7382-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.005524 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.005476 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/42093802-1cfa-4450-b765-83ef0ddf7382-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.005647 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.005531 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42093802-1cfa-4450-b765-83ef0ddf7382-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.005647 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.005567 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/42093802-1cfa-4450-b765-83ef0ddf7382-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.005647 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.005590 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/42093802-1cfa-4450-b765-83ef0ddf7382-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.005647 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.005607 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42093802-1cfa-4450-b765-83ef0ddf7382-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.005647 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.005625 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42093802-1cfa-4450-b765-83ef0ddf7382-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.005787 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.005642 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/42093802-1cfa-4450-b765-83ef0ddf7382-web-config\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.005787 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.005677 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn7vr\" (UniqueName: \"kubernetes.io/projected/42093802-1cfa-4450-b765-83ef0ddf7382-kube-api-access-bn7vr\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.005787 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.005695 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/42093802-1cfa-4450-b765-83ef0ddf7382-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.005787 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.005714 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/42093802-1cfa-4450-b765-83ef0ddf7382-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.005787 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.005769 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/42093802-1cfa-4450-b765-83ef0ddf7382-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.106165 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.106130 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/42093802-1cfa-4450-b765-83ef0ddf7382-config-out\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.106342 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.106177 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42093802-1cfa-4450-b765-83ef0ddf7382-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.106342 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.106199 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/42093802-1cfa-4450-b765-83ef0ddf7382-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.106342 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.106222 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/42093802-1cfa-4450-b765-83ef0ddf7382-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.106342 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.106243 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/42093802-1cfa-4450-b765-83ef0ddf7382-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.106342 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.106273 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42093802-1cfa-4450-b765-83ef0ddf7382-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.106342 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.106322 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/42093802-1cfa-4450-b765-83ef0ddf7382-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.106660 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.106348 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/42093802-1cfa-4450-b765-83ef0ddf7382-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.106660 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.106399 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42093802-1cfa-4450-b765-83ef0ddf7382-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.106660 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.106442 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42093802-1cfa-4450-b765-83ef0ddf7382-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.106660 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.106468 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/42093802-1cfa-4450-b765-83ef0ddf7382-web-config\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.106660 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.106494 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bn7vr\" (UniqueName: \"kubernetes.io/projected/42093802-1cfa-4450-b765-83ef0ddf7382-kube-api-access-bn7vr\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.106660 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.106522 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/42093802-1cfa-4450-b765-83ef0ddf7382-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.106660 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.106553 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/42093802-1cfa-4450-b765-83ef0ddf7382-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.107466 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.107435 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/42093802-1cfa-4450-b765-83ef0ddf7382-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.108445 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.107645 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42093802-1cfa-4450-b765-83ef0ddf7382-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.108445 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.107663 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42093802-1cfa-4450-b765-83ef0ddf7382-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.108445 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.107720 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/42093802-1cfa-4450-b765-83ef0ddf7382-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.108445 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.107783 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/42093802-1cfa-4450-b765-83ef0ddf7382-config\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.108445 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.107816 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/42093802-1cfa-4450-b765-83ef0ddf7382-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.108445 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.107851 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/42093802-1cfa-4450-b765-83ef0ddf7382-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.108445 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.107882 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/42093802-1cfa-4450-b765-83ef0ddf7382-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.108445 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.107912 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/42093802-1cfa-4450-b765-83ef0ddf7382-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.108968 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.108946 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/42093802-1cfa-4450-b765-83ef0ddf7382-config-out\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.109894 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.109676 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42093802-1cfa-4450-b765-83ef0ddf7382-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.109894 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.109683 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42093802-1cfa-4450-b765-83ef0ddf7382-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.109894 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.109759 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/42093802-1cfa-4450-b765-83ef0ddf7382-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.109894 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.109850 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/42093802-1cfa-4450-b765-83ef0ddf7382-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.111126 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.111098 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/42093802-1cfa-4450-b765-83ef0ddf7382-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.113137 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.112166 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/42093802-1cfa-4450-b765-83ef0ddf7382-web-config\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.113137 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.112669 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/42093802-1cfa-4450-b765-83ef0ddf7382-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.113137 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.113071 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/42093802-1cfa-4450-b765-83ef0ddf7382-config\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.113137 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.113074 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/42093802-1cfa-4450-b765-83ef0ddf7382-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.113137 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.113088 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/42093802-1cfa-4450-b765-83ef0ddf7382-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.113137 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.113083 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/42093802-1cfa-4450-b765-83ef0ddf7382-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.113598 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.113578 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/42093802-1cfa-4450-b765-83ef0ddf7382-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.113684 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.113658 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/42093802-1cfa-4450-b765-83ef0ddf7382-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.115396 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.115146 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/42093802-1cfa-4450-b765-83ef0ddf7382-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.115396 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.115271 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/42093802-1cfa-4450-b765-83ef0ddf7382-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.117581 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.117556 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bn7vr\" (UniqueName: \"kubernetes.io/projected/42093802-1cfa-4450-b765-83ef0ddf7382-kube-api-access-bn7vr\") pod \"prometheus-k8s-0\" (UID: \"42093802-1cfa-4450-b765-83ef0ddf7382\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.239197 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.239157 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:30:37.382505 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.382421 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 23:30:37.385528 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:30:37.385503 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42093802_1cfa_4450_b765_83ef0ddf7382.slice/crio-2f18422a6f7fda368eff89ba88782ca724faccb2404e1b5f8251df19abbebe56 WatchSource:0}: Error finding container 2f18422a6f7fda368eff89ba88782ca724faccb2404e1b5f8251df19abbebe56: Status 404 returned error can't find the container with id 2f18422a6f7fda368eff89ba88782ca724faccb2404e1b5f8251df19abbebe56 Jun 03 23:30:37.656254 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.656181 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c533d276-821e-4514-a1a8-9daefa23741d" path="/var/lib/kubelet/pods/c533d276-821e-4514-a1a8-9daefa23741d/volumes" Jun 03 23:30:37.870593 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.870557 2574 generic.go:356] "Generic (PLEG): container finished" podID="42093802-1cfa-4450-b765-83ef0ddf7382" containerID="7f780e456e1b46ddc37d8afc7a3e0f35c264be3eb95e9f4953220b0c0c55d199" exitCode=0 Jun 03 23:30:37.870762 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.870621 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"42093802-1cfa-4450-b765-83ef0ddf7382","Type":"ContainerDied","Data":"7f780e456e1b46ddc37d8afc7a3e0f35c264be3eb95e9f4953220b0c0c55d199"} Jun 03 23:30:37.870762 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:37.870690 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"42093802-1cfa-4450-b765-83ef0ddf7382","Type":"ContainerStarted","Data":"2f18422a6f7fda368eff89ba88782ca724faccb2404e1b5f8251df19abbebe56"} Jun 03 23:30:38.878427 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:38.878391 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"42093802-1cfa-4450-b765-83ef0ddf7382","Type":"ContainerStarted","Data":"a7c1d0d34cdbec5d6ff1fcbc65d18d1714f00dd629a57e12e1d73512616ff35a"} Jun 03 23:30:38.878823 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:38.878458 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"42093802-1cfa-4450-b765-83ef0ddf7382","Type":"ContainerStarted","Data":"e3bb7c499ae1082889da63cbcbcfb0235894c96a5dc4ad2a10fb0e1c6c323c66"} Jun 03 23:30:38.878823 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:38.878483 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"42093802-1cfa-4450-b765-83ef0ddf7382","Type":"ContainerStarted","Data":"8f5b6beebbc2fddc36269890a99ddf497ef614679bd57edf476c6f2bc75c669e"} Jun 03 23:30:38.878823 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:38.878518 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"42093802-1cfa-4450-b765-83ef0ddf7382","Type":"ContainerStarted","Data":"64a6b9aca36685c52aaee0dee68ccf2a80cb4cc1b5dd3e817a8abc11767ba9bd"} Jun 03 23:30:38.878823 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:38.878544 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"42093802-1cfa-4450-b765-83ef0ddf7382","Type":"ContainerStarted","Data":"dae4b622aa3e96f74632bcf35652d582d4c4c5776c42d232d5937670553dea1d"} Jun 03 23:30:38.878823 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:38.878566 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"42093802-1cfa-4450-b765-83ef0ddf7382","Type":"ContainerStarted","Data":"68d8df871f9ae76e4e36ecf2e761dcbc5d266dd8b57a958417dbcb1e240a9022"} Jun 03 23:30:38.912618 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:38.912565 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.895598296 podStartE2EDuration="2.912543247s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.944951ms" isStatefulPod=false podCreationTimestamp="2026-06-03 23:30:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:30:38.909754414 +0000 UTC m=+359.716974881" watchObservedRunningTime="2026-06-03 23:30:38.912543247 +0000 UTC m=+359.719763919" Jun 03 23:30:42.239491 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:30:42.239451 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:31:37.240327 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:31:37.240269 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:31:37.255746 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:31:37.255716 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:31:38.118763 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:31:38.118734 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 23:32:44.849354 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:44.849319 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-869fd7c4f4-zwksg"] Jun 03 23:32:44.852688 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:44.852667 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-869fd7c4f4-zwksg" Jun 03 23:32:44.863536 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:44.863511 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 03 23:32:44.863678 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:44.863536 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 03 23:32:44.863678 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:44.863536 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 03 23:32:44.863678 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:44.863511 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-zfszn\"" Jun 03 23:32:44.863912 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:44.863899 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 03 23:32:44.864435 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:44.864423 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 03 23:32:44.872203 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:44.872176 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-869fd7c4f4-zwksg"] Jun 03 23:32:44.894643 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:44.894607 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxcfh\" (UniqueName: \"kubernetes.io/projected/a3b2b6f3-f8f8-431b-84cc-bae8c4bce9fd-kube-api-access-jxcfh\") pod \"lws-controller-manager-869fd7c4f4-zwksg\" (UID: \"a3b2b6f3-f8f8-431b-84cc-bae8c4bce9fd\") " pod="openshift-lws-operator/lws-controller-manager-869fd7c4f4-zwksg" Jun 03 23:32:44.894828 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:44.894668 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a3b2b6f3-f8f8-431b-84cc-bae8c4bce9fd-metrics-cert\") pod \"lws-controller-manager-869fd7c4f4-zwksg\" (UID: \"a3b2b6f3-f8f8-431b-84cc-bae8c4bce9fd\") " pod="openshift-lws-operator/lws-controller-manager-869fd7c4f4-zwksg" Jun 03 23:32:44.894828 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:44.894738 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a3b2b6f3-f8f8-431b-84cc-bae8c4bce9fd-manager-config\") pod \"lws-controller-manager-869fd7c4f4-zwksg\" (UID: \"a3b2b6f3-f8f8-431b-84cc-bae8c4bce9fd\") " pod="openshift-lws-operator/lws-controller-manager-869fd7c4f4-zwksg" Jun 03 23:32:44.894828 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:44.894782 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a3b2b6f3-f8f8-431b-84cc-bae8c4bce9fd-cert\") pod \"lws-controller-manager-869fd7c4f4-zwksg\" (UID: \"a3b2b6f3-f8f8-431b-84cc-bae8c4bce9fd\") " pod="openshift-lws-operator/lws-controller-manager-869fd7c4f4-zwksg" Jun 03 23:32:44.996216 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:44.996161 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a3b2b6f3-f8f8-431b-84cc-bae8c4bce9fd-metrics-cert\") pod \"lws-controller-manager-869fd7c4f4-zwksg\" (UID: \"a3b2b6f3-f8f8-431b-84cc-bae8c4bce9fd\") " pod="openshift-lws-operator/lws-controller-manager-869fd7c4f4-zwksg" Jun 03 23:32:44.996216 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:44.996218 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a3b2b6f3-f8f8-431b-84cc-bae8c4bce9fd-manager-config\") pod \"lws-controller-manager-869fd7c4f4-zwksg\" (UID: \"a3b2b6f3-f8f8-431b-84cc-bae8c4bce9fd\") " pod="openshift-lws-operator/lws-controller-manager-869fd7c4f4-zwksg" Jun 03 23:32:44.996216 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:44.996236 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a3b2b6f3-f8f8-431b-84cc-bae8c4bce9fd-cert\") pod \"lws-controller-manager-869fd7c4f4-zwksg\" (UID: \"a3b2b6f3-f8f8-431b-84cc-bae8c4bce9fd\") " pod="openshift-lws-operator/lws-controller-manager-869fd7c4f4-zwksg" Jun 03 23:32:44.996566 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:44.996282 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxcfh\" (UniqueName: \"kubernetes.io/projected/a3b2b6f3-f8f8-431b-84cc-bae8c4bce9fd-kube-api-access-jxcfh\") pod \"lws-controller-manager-869fd7c4f4-zwksg\" (UID: \"a3b2b6f3-f8f8-431b-84cc-bae8c4bce9fd\") " pod="openshift-lws-operator/lws-controller-manager-869fd7c4f4-zwksg" Jun 03 23:32:44.996988 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:44.996961 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a3b2b6f3-f8f8-431b-84cc-bae8c4bce9fd-manager-config\") pod \"lws-controller-manager-869fd7c4f4-zwksg\" (UID: \"a3b2b6f3-f8f8-431b-84cc-bae8c4bce9fd\") " pod="openshift-lws-operator/lws-controller-manager-869fd7c4f4-zwksg" Jun 03 23:32:44.998636 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:44.998617 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a3b2b6f3-f8f8-431b-84cc-bae8c4bce9fd-cert\") pod \"lws-controller-manager-869fd7c4f4-zwksg\" (UID: \"a3b2b6f3-f8f8-431b-84cc-bae8c4bce9fd\") " pod="openshift-lws-operator/lws-controller-manager-869fd7c4f4-zwksg" Jun 03 23:32:44.998730 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:44.998668 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a3b2b6f3-f8f8-431b-84cc-bae8c4bce9fd-metrics-cert\") pod \"lws-controller-manager-869fd7c4f4-zwksg\" (UID: \"a3b2b6f3-f8f8-431b-84cc-bae8c4bce9fd\") " pod="openshift-lws-operator/lws-controller-manager-869fd7c4f4-zwksg" Jun 03 23:32:45.011343 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:45.011313 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxcfh\" (UniqueName: \"kubernetes.io/projected/a3b2b6f3-f8f8-431b-84cc-bae8c4bce9fd-kube-api-access-jxcfh\") pod \"lws-controller-manager-869fd7c4f4-zwksg\" (UID: \"a3b2b6f3-f8f8-431b-84cc-bae8c4bce9fd\") " pod="openshift-lws-operator/lws-controller-manager-869fd7c4f4-zwksg" Jun 03 23:32:45.161077 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:45.161050 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-869fd7c4f4-zwksg" Jun 03 23:32:45.308105 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:45.308071 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-684bd49f57-6s9qs"] Jun 03 23:32:45.311797 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:45.311768 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-684bd49f57-6s9qs" Jun 03 23:32:45.313360 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:45.313340 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-869fd7c4f4-zwksg"] Jun 03 23:32:45.315085 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:45.315066 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 03 23:32:45.315160 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:45.315082 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 03 23:32:45.315487 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:45.315470 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 03 23:32:45.315603 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:45.315492 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-sj8gs\"" Jun 03 23:32:45.315603 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:45.315477 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 03 23:32:45.316980 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:32:45.316952 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3b2b6f3_f8f8_431b_84cc_bae8c4bce9fd.slice/crio-7b0661a5add6a0e8b9cc74f463532b3f8e540c599dc2e732e012f01c14229e52 WatchSource:0}: Error finding container 7b0661a5add6a0e8b9cc74f463532b3f8e540c599dc2e732e012f01c14229e52: Status 404 returned error can't find the container with id 7b0661a5add6a0e8b9cc74f463532b3f8e540c599dc2e732e012f01c14229e52 Jun 03 23:32:45.318993 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:45.318974 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 23:32:45.331773 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:45.331744 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-684bd49f57-6s9qs"] Jun 03 23:32:45.353419 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:45.353337 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-869fd7c4f4-zwksg" event={"ID":"a3b2b6f3-f8f8-431b-84cc-bae8c4bce9fd","Type":"ContainerStarted","Data":"7b0661a5add6a0e8b9cc74f463532b3f8e540c599dc2e732e012f01c14229e52"} Jun 03 23:32:45.400157 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:45.400118 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3861be43-9e72-4c22-90d3-1c7ab0e6d737-apiservice-cert\") pod \"opendatahub-operator-controller-manager-684bd49f57-6s9qs\" (UID: \"3861be43-9e72-4c22-90d3-1c7ab0e6d737\") " pod="opendatahub/opendatahub-operator-controller-manager-684bd49f57-6s9qs" Jun 03 23:32:45.400386 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:45.400183 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3861be43-9e72-4c22-90d3-1c7ab0e6d737-webhook-cert\") pod \"opendatahub-operator-controller-manager-684bd49f57-6s9qs\" (UID: \"3861be43-9e72-4c22-90d3-1c7ab0e6d737\") " pod="opendatahub/opendatahub-operator-controller-manager-684bd49f57-6s9qs" Jun 03 23:32:45.400386 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:45.400235 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klpg9\" (UniqueName: \"kubernetes.io/projected/3861be43-9e72-4c22-90d3-1c7ab0e6d737-kube-api-access-klpg9\") pod \"opendatahub-operator-controller-manager-684bd49f57-6s9qs\" (UID: \"3861be43-9e72-4c22-90d3-1c7ab0e6d737\") " pod="opendatahub/opendatahub-operator-controller-manager-684bd49f57-6s9qs" Jun 03 23:32:45.400386 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:45.400317 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3861be43-9e72-4c22-90d3-1c7ab0e6d737-tmp\") pod \"opendatahub-operator-controller-manager-684bd49f57-6s9qs\" (UID: \"3861be43-9e72-4c22-90d3-1c7ab0e6d737\") " pod="opendatahub/opendatahub-operator-controller-manager-684bd49f57-6s9qs" Jun 03 23:32:45.400386 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:45.400368 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3861be43-9e72-4c22-90d3-1c7ab0e6d737-manifests\") pod \"opendatahub-operator-controller-manager-684bd49f57-6s9qs\" (UID: \"3861be43-9e72-4c22-90d3-1c7ab0e6d737\") " pod="opendatahub/opendatahub-operator-controller-manager-684bd49f57-6s9qs" Jun 03 23:32:45.500886 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:45.500807 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3861be43-9e72-4c22-90d3-1c7ab0e6d737-tmp\") pod \"opendatahub-operator-controller-manager-684bd49f57-6s9qs\" (UID: \"3861be43-9e72-4c22-90d3-1c7ab0e6d737\") " pod="opendatahub/opendatahub-operator-controller-manager-684bd49f57-6s9qs" Jun 03 23:32:45.500886 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:45.500845 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3861be43-9e72-4c22-90d3-1c7ab0e6d737-manifests\") pod \"opendatahub-operator-controller-manager-684bd49f57-6s9qs\" (UID: \"3861be43-9e72-4c22-90d3-1c7ab0e6d737\") " pod="opendatahub/opendatahub-operator-controller-manager-684bd49f57-6s9qs" Jun 03 23:32:45.501073 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:45.500972 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3861be43-9e72-4c22-90d3-1c7ab0e6d737-apiservice-cert\") pod \"opendatahub-operator-controller-manager-684bd49f57-6s9qs\" (UID: \"3861be43-9e72-4c22-90d3-1c7ab0e6d737\") " pod="opendatahub/opendatahub-operator-controller-manager-684bd49f57-6s9qs" Jun 03 23:32:45.501073 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:45.501032 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3861be43-9e72-4c22-90d3-1c7ab0e6d737-webhook-cert\") pod \"opendatahub-operator-controller-manager-684bd49f57-6s9qs\" (UID: \"3861be43-9e72-4c22-90d3-1c7ab0e6d737\") " pod="opendatahub/opendatahub-operator-controller-manager-684bd49f57-6s9qs" Jun 03 23:32:45.501151 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:45.501082 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klpg9\" (UniqueName: \"kubernetes.io/projected/3861be43-9e72-4c22-90d3-1c7ab0e6d737-kube-api-access-klpg9\") pod \"opendatahub-operator-controller-manager-684bd49f57-6s9qs\" (UID: \"3861be43-9e72-4c22-90d3-1c7ab0e6d737\") " pod="opendatahub/opendatahub-operator-controller-manager-684bd49f57-6s9qs" Jun 03 23:32:45.501216 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:45.501194 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3861be43-9e72-4c22-90d3-1c7ab0e6d737-manifests\") pod \"opendatahub-operator-controller-manager-684bd49f57-6s9qs\" (UID: \"3861be43-9e72-4c22-90d3-1c7ab0e6d737\") " pod="opendatahub/opendatahub-operator-controller-manager-684bd49f57-6s9qs" Jun 03 23:32:45.503259 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:45.503218 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3861be43-9e72-4c22-90d3-1c7ab0e6d737-tmp\") pod \"opendatahub-operator-controller-manager-684bd49f57-6s9qs\" (UID: \"3861be43-9e72-4c22-90d3-1c7ab0e6d737\") " pod="opendatahub/opendatahub-operator-controller-manager-684bd49f57-6s9qs" Jun 03 23:32:45.503403 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:45.503305 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3861be43-9e72-4c22-90d3-1c7ab0e6d737-webhook-cert\") pod \"opendatahub-operator-controller-manager-684bd49f57-6s9qs\" (UID: \"3861be43-9e72-4c22-90d3-1c7ab0e6d737\") " pod="opendatahub/opendatahub-operator-controller-manager-684bd49f57-6s9qs" Jun 03 23:32:45.503403 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:45.503371 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3861be43-9e72-4c22-90d3-1c7ab0e6d737-apiservice-cert\") pod \"opendatahub-operator-controller-manager-684bd49f57-6s9qs\" (UID: \"3861be43-9e72-4c22-90d3-1c7ab0e6d737\") " pod="opendatahub/opendatahub-operator-controller-manager-684bd49f57-6s9qs" Jun 03 23:32:45.509921 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:45.509893 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klpg9\" (UniqueName: \"kubernetes.io/projected/3861be43-9e72-4c22-90d3-1c7ab0e6d737-kube-api-access-klpg9\") pod \"opendatahub-operator-controller-manager-684bd49f57-6s9qs\" (UID: \"3861be43-9e72-4c22-90d3-1c7ab0e6d737\") " pod="opendatahub/opendatahub-operator-controller-manager-684bd49f57-6s9qs" Jun 03 23:32:45.624728 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:45.624689 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-684bd49f57-6s9qs" Jun 03 23:32:45.769705 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:45.769681 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-684bd49f57-6s9qs"] Jun 03 23:32:45.772280 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:32:45.772253 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3861be43_9e72_4c22_90d3_1c7ab0e6d737.slice/crio-7b4720461c53abc8abafa0370f97eb1ace0cf318fe4119ef687d9be0b4bd6817 WatchSource:0}: Error finding container 7b4720461c53abc8abafa0370f97eb1ace0cf318fe4119ef687d9be0b4bd6817: Status 404 returned error can't find the container with id 7b4720461c53abc8abafa0370f97eb1ace0cf318fe4119ef687d9be0b4bd6817 Jun 03 23:32:46.361474 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:46.361401 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-684bd49f57-6s9qs" event={"ID":"3861be43-9e72-4c22-90d3-1c7ab0e6d737","Type":"ContainerStarted","Data":"7b4720461c53abc8abafa0370f97eb1ace0cf318fe4119ef687d9be0b4bd6817"} Jun 03 23:32:50.388039 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:50.388002 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-869fd7c4f4-zwksg" event={"ID":"a3b2b6f3-f8f8-431b-84cc-bae8c4bce9fd","Type":"ContainerStarted","Data":"58fec2e2d48291fbe8cdb3d1aa480ded23a9f6eb0426a074b452dde052c2069d"} Jun 03 23:32:50.388620 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:50.388084 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-869fd7c4f4-zwksg" Jun 03 23:32:50.389738 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:50.389714 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-684bd49f57-6s9qs" event={"ID":"3861be43-9e72-4c22-90d3-1c7ab0e6d737","Type":"ContainerStarted","Data":"e3805d9f7f567d5769486f951a4e01a6c1755dd1c0583d6534aceeff3f23446f"} Jun 03 23:32:50.414367 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:50.414319 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-869fd7c4f4-zwksg" podStartSLOduration=2.047788009 podStartE2EDuration="6.414284521s" totalImagesPullingTime="4.366496512s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:32:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:32:50.412893412 +0000 UTC m=+491.220113878" watchObservedRunningTime="2026-06-03 23:32:50.414284521 +0000 UTC m=+491.221504985" Jun 03 23:32:51.395946 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:51.395905 2574 generic.go:356] "Generic (PLEG): container finished" podID="3861be43-9e72-4c22-90d3-1c7ab0e6d737" containerID="e3805d9f7f567d5769486f951a4e01a6c1755dd1c0583d6534aceeff3f23446f" exitCode=0 Jun 03 23:32:51.395946 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:51.395940 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-684bd49f57-6s9qs" event={"ID":"3861be43-9e72-4c22-90d3-1c7ab0e6d737","Type":"ContainerDied","Data":"e3805d9f7f567d5769486f951a4e01a6c1755dd1c0583d6534aceeff3f23446f"} Jun 03 23:32:52.402260 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:52.402214 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-684bd49f57-6s9qs" event={"ID":"3861be43-9e72-4c22-90d3-1c7ab0e6d737","Type":"ContainerStarted","Data":"53f10b4e97409fca6990cf3765fe5da36cf9ae18afe4a761f237cefc38d6bf66"} Jun 03 23:32:52.402711 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:52.402331 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-684bd49f57-6s9qs" Jun 03 23:32:52.427185 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:32:52.427126 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-684bd49f57-6s9qs" podStartSLOduration=2.118766889 podStartE2EDuration="7.427108754s" totalImagesPullingTime="4.226563897s" totalInitContainerRuntime="1.081777968s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:32:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:32:52.426341254 +0000 UTC m=+493.233561718" watchObservedRunningTime="2026-06-03 23:32:52.427108754 +0000 UTC m=+493.234329217" Jun 03 23:33:01.398072 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:01.398041 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-869fd7c4f4-zwksg" Jun 03 23:33:03.409547 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:03.409517 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-684bd49f57-6s9qs" Jun 03 23:33:21.259603 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:21.259569 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-6bf55d5568-fw7c8"] Jun 03 23:33:21.267512 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:21.267487 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6bf55d5568-fw7c8" Jun 03 23:33:21.274498 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:21.274478 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 03 23:33:21.274622 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:21.274479 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-dt9rn\"" Jun 03 23:33:21.318822 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:21.318785 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/c38f1fe3-2682-42a2-ab07-8d7e60e18d8a-redirect-config\") pod \"dashboard-redirect-6bf55d5568-fw7c8\" (UID: \"c38f1fe3-2682-42a2-ab07-8d7e60e18d8a\") " pod="opendatahub/dashboard-redirect-6bf55d5568-fw7c8" Jun 03 23:33:21.318822 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:21.318824 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsmv5\" (UniqueName: \"kubernetes.io/projected/c38f1fe3-2682-42a2-ab07-8d7e60e18d8a-kube-api-access-nsmv5\") pod \"dashboard-redirect-6bf55d5568-fw7c8\" (UID: \"c38f1fe3-2682-42a2-ab07-8d7e60e18d8a\") " pod="opendatahub/dashboard-redirect-6bf55d5568-fw7c8" Jun 03 23:33:21.350892 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:21.350860 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6bf55d5568-fw7c8"] Jun 03 23:33:21.419695 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:21.419664 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/c38f1fe3-2682-42a2-ab07-8d7e60e18d8a-redirect-config\") pod \"dashboard-redirect-6bf55d5568-fw7c8\" (UID: \"c38f1fe3-2682-42a2-ab07-8d7e60e18d8a\") " pod="opendatahub/dashboard-redirect-6bf55d5568-fw7c8" Jun 03 23:33:21.419872 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:21.419703 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsmv5\" (UniqueName: \"kubernetes.io/projected/c38f1fe3-2682-42a2-ab07-8d7e60e18d8a-kube-api-access-nsmv5\") pod \"dashboard-redirect-6bf55d5568-fw7c8\" (UID: \"c38f1fe3-2682-42a2-ab07-8d7e60e18d8a\") " pod="opendatahub/dashboard-redirect-6bf55d5568-fw7c8" Jun 03 23:33:21.420392 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:21.420371 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/c38f1fe3-2682-42a2-ab07-8d7e60e18d8a-redirect-config\") pod \"dashboard-redirect-6bf55d5568-fw7c8\" (UID: \"c38f1fe3-2682-42a2-ab07-8d7e60e18d8a\") " pod="opendatahub/dashboard-redirect-6bf55d5568-fw7c8" Jun 03 23:33:21.462890 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:21.462858 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsmv5\" (UniqueName: \"kubernetes.io/projected/c38f1fe3-2682-42a2-ab07-8d7e60e18d8a-kube-api-access-nsmv5\") pod \"dashboard-redirect-6bf55d5568-fw7c8\" (UID: \"c38f1fe3-2682-42a2-ab07-8d7e60e18d8a\") " pod="opendatahub/dashboard-redirect-6bf55d5568-fw7c8" Jun 03 23:33:21.577502 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:21.577396 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6bf55d5568-fw7c8" Jun 03 23:33:21.717151 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:21.717080 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6bf55d5568-fw7c8"] Jun 03 23:33:21.720652 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:33:21.720619 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc38f1fe3_2682_42a2_ab07_8d7e60e18d8a.slice/crio-f9dffb9e5d34d8b056fde98f5dfff5bf8d4d0926cd3e136b1c33524199b1cb2d WatchSource:0}: Error finding container f9dffb9e5d34d8b056fde98f5dfff5bf8d4d0926cd3e136b1c33524199b1cb2d: Status 404 returned error can't find the container with id f9dffb9e5d34d8b056fde98f5dfff5bf8d4d0926cd3e136b1c33524199b1cb2d Jun 03 23:33:22.528815 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:22.528783 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6bf55d5568-fw7c8" event={"ID":"c38f1fe3-2682-42a2-ab07-8d7e60e18d8a","Type":"ContainerStarted","Data":"f9dffb9e5d34d8b056fde98f5dfff5bf8d4d0926cd3e136b1c33524199b1cb2d"} Jun 03 23:33:27.555495 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:27.555457 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6bf55d5568-fw7c8" event={"ID":"c38f1fe3-2682-42a2-ab07-8d7e60e18d8a","Type":"ContainerStarted","Data":"178fece258eb8c62f91b44a4dcde855f0701c017278d5f0d4c344b73a3179fd4"} Jun 03 23:33:27.575962 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:27.575904 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-6bf55d5568-fw7c8" podStartSLOduration=1.438563835 podStartE2EDuration="6.575889313s" totalImagesPullingTime="5.137325478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:33:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:33:27.573546082 +0000 UTC m=+528.380766546" watchObservedRunningTime="2026-06-03 23:33:27.575889313 +0000 UTC m=+528.383109776" Jun 03 23:33:51.446977 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:51.446940 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bccdq2d"] Jun 03 23:33:51.468696 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:51.468664 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bccdq2d"] Jun 03 23:33:51.468871 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:51.468750 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bccdq2d" Jun 03 23:33:51.472024 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:51.472000 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 03 23:33:51.472152 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:51.472000 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-2kvqm\"" Jun 03 23:33:51.597218 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:51.597178 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13b63c7a-5e67-4ad7-87dc-7aaac3f3809c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bccdq2d\" (UID: \"13b63c7a-5e67-4ad7-87dc-7aaac3f3809c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bccdq2d" Jun 03 23:33:51.597218 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:51.597217 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxddd\" (UniqueName: \"kubernetes.io/projected/13b63c7a-5e67-4ad7-87dc-7aaac3f3809c-kube-api-access-lxddd\") pod \"data-science-gateway-data-science-gateway-class-5b556588bccdq2d\" (UID: \"13b63c7a-5e67-4ad7-87dc-7aaac3f3809c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bccdq2d" Jun 03 23:33:51.597443 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:51.597235 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13b63c7a-5e67-4ad7-87dc-7aaac3f3809c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bccdq2d\" (UID: \"13b63c7a-5e67-4ad7-87dc-7aaac3f3809c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bccdq2d" Jun 03 23:33:51.597443 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:51.597256 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13b63c7a-5e67-4ad7-87dc-7aaac3f3809c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bccdq2d\" (UID: \"13b63c7a-5e67-4ad7-87dc-7aaac3f3809c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bccdq2d" Jun 03 23:33:51.597443 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:51.597389 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13b63c7a-5e67-4ad7-87dc-7aaac3f3809c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bccdq2d\" (UID: \"13b63c7a-5e67-4ad7-87dc-7aaac3f3809c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bccdq2d" Jun 03 23:33:51.597443 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:51.597419 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13b63c7a-5e67-4ad7-87dc-7aaac3f3809c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bccdq2d\" (UID: \"13b63c7a-5e67-4ad7-87dc-7aaac3f3809c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bccdq2d" Jun 03 23:33:51.597443 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:51.597444 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13b63c7a-5e67-4ad7-87dc-7aaac3f3809c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bccdq2d\" (UID: \"13b63c7a-5e67-4ad7-87dc-7aaac3f3809c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bccdq2d" Jun 03 23:33:51.597605 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:51.597490 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13b63c7a-5e67-4ad7-87dc-7aaac3f3809c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bccdq2d\" (UID: \"13b63c7a-5e67-4ad7-87dc-7aaac3f3809c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bccdq2d" Jun 03 23:33:51.597605 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:51.597513 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13b63c7a-5e67-4ad7-87dc-7aaac3f3809c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bccdq2d\" (UID: \"13b63c7a-5e67-4ad7-87dc-7aaac3f3809c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bccdq2d" Jun 03 23:33:51.698463 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:51.698374 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13b63c7a-5e67-4ad7-87dc-7aaac3f3809c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bccdq2d\" (UID: \"13b63c7a-5e67-4ad7-87dc-7aaac3f3809c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bccdq2d" Jun 03 23:33:51.698463 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:51.698430 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13b63c7a-5e67-4ad7-87dc-7aaac3f3809c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bccdq2d\" (UID: \"13b63c7a-5e67-4ad7-87dc-7aaac3f3809c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bccdq2d" Jun 03 23:33:51.698463 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:51.698455 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxddd\" (UniqueName: \"kubernetes.io/projected/13b63c7a-5e67-4ad7-87dc-7aaac3f3809c-kube-api-access-lxddd\") pod \"data-science-gateway-data-science-gateway-class-5b556588bccdq2d\" (UID: \"13b63c7a-5e67-4ad7-87dc-7aaac3f3809c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bccdq2d" Jun 03 23:33:51.698717 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:51.698481 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13b63c7a-5e67-4ad7-87dc-7aaac3f3809c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bccdq2d\" (UID: \"13b63c7a-5e67-4ad7-87dc-7aaac3f3809c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bccdq2d" Jun 03 23:33:51.698717 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:51.698504 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13b63c7a-5e67-4ad7-87dc-7aaac3f3809c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bccdq2d\" (UID: \"13b63c7a-5e67-4ad7-87dc-7aaac3f3809c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bccdq2d" Jun 03 23:33:51.698717 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:51.698572 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13b63c7a-5e67-4ad7-87dc-7aaac3f3809c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bccdq2d\" (UID: \"13b63c7a-5e67-4ad7-87dc-7aaac3f3809c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bccdq2d" Jun 03 23:33:51.698717 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:51.698601 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13b63c7a-5e67-4ad7-87dc-7aaac3f3809c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bccdq2d\" (UID: \"13b63c7a-5e67-4ad7-87dc-7aaac3f3809c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bccdq2d" Jun 03 23:33:51.698911 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:51.698824 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13b63c7a-5e67-4ad7-87dc-7aaac3f3809c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bccdq2d\" (UID: \"13b63c7a-5e67-4ad7-87dc-7aaac3f3809c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bccdq2d" Jun 03 23:33:51.698911 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:51.698635 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13b63c7a-5e67-4ad7-87dc-7aaac3f3809c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bccdq2d\" (UID: \"13b63c7a-5e67-4ad7-87dc-7aaac3f3809c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bccdq2d" Jun 03 23:33:51.699022 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:51.698918 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13b63c7a-5e67-4ad7-87dc-7aaac3f3809c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bccdq2d\" (UID: \"13b63c7a-5e67-4ad7-87dc-7aaac3f3809c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bccdq2d" Jun 03 23:33:51.699022 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:51.698926 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13b63c7a-5e67-4ad7-87dc-7aaac3f3809c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bccdq2d\" (UID: \"13b63c7a-5e67-4ad7-87dc-7aaac3f3809c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bccdq2d" Jun 03 23:33:51.699022 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:51.698973 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13b63c7a-5e67-4ad7-87dc-7aaac3f3809c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bccdq2d\" (UID: \"13b63c7a-5e67-4ad7-87dc-7aaac3f3809c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bccdq2d" Jun 03 23:33:51.699150 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:51.699121 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13b63c7a-5e67-4ad7-87dc-7aaac3f3809c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bccdq2d\" (UID: \"13b63c7a-5e67-4ad7-87dc-7aaac3f3809c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bccdq2d" Jun 03 23:33:51.699341 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:51.699321 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13b63c7a-5e67-4ad7-87dc-7aaac3f3809c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bccdq2d\" (UID: \"13b63c7a-5e67-4ad7-87dc-7aaac3f3809c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bccdq2d" Jun 03 23:33:51.701073 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:51.701053 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13b63c7a-5e67-4ad7-87dc-7aaac3f3809c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bccdq2d\" (UID: \"13b63c7a-5e67-4ad7-87dc-7aaac3f3809c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bccdq2d" Jun 03 23:33:51.701234 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:51.701218 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13b63c7a-5e67-4ad7-87dc-7aaac3f3809c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bccdq2d\" (UID: \"13b63c7a-5e67-4ad7-87dc-7aaac3f3809c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bccdq2d" Jun 03 23:33:51.708333 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:51.708310 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13b63c7a-5e67-4ad7-87dc-7aaac3f3809c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bccdq2d\" (UID: \"13b63c7a-5e67-4ad7-87dc-7aaac3f3809c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bccdq2d" Jun 03 23:33:51.708525 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:51.708504 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxddd\" (UniqueName: \"kubernetes.io/projected/13b63c7a-5e67-4ad7-87dc-7aaac3f3809c-kube-api-access-lxddd\") pod \"data-science-gateway-data-science-gateway-class-5b556588bccdq2d\" (UID: \"13b63c7a-5e67-4ad7-87dc-7aaac3f3809c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bccdq2d" Jun 03 23:33:51.781163 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:51.781125 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bccdq2d" Jun 03 23:33:51.952675 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:51.952648 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bccdq2d"] Jun 03 23:33:51.955373 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:33:51.955339 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13b63c7a_5e67_4ad7_87dc_7aaac3f3809c.slice/crio-5402b0c7ab6e5b9490c4d9ffe274a7ad28c69913b36dd60e9a9b9ab8b5bd6ee0 WatchSource:0}: Error finding container 5402b0c7ab6e5b9490c4d9ffe274a7ad28c69913b36dd60e9a9b9ab8b5bd6ee0: Status 404 returned error can't find the container with id 5402b0c7ab6e5b9490c4d9ffe274a7ad28c69913b36dd60e9a9b9ab8b5bd6ee0 Jun 03 23:33:52.675232 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:52.675194 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bccdq2d" event={"ID":"13b63c7a-5e67-4ad7-87dc-7aaac3f3809c","Type":"ContainerStarted","Data":"5402b0c7ab6e5b9490c4d9ffe274a7ad28c69913b36dd60e9a9b9ab8b5bd6ee0"} Jun 03 23:33:55.303903 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:55.303847 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 03 23:33:55.304266 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:55.303959 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 03 23:33:55.304266 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:55.304010 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 03 23:33:55.690080 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:55.690046 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bccdq2d" event={"ID":"13b63c7a-5e67-4ad7-87dc-7aaac3f3809c","Type":"ContainerStarted","Data":"2afdd64cb620f722d14855246a13b64e3aa60903891d670e13104d47a9590c0b"} Jun 03 23:33:55.715042 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:55.714985 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bccdq2d" podStartSLOduration=1.369102753 podStartE2EDuration="4.714963383s" totalImagesPullingTime="3.34586063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:33:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:33:55.712499796 +0000 UTC m=+556.519720262" watchObservedRunningTime="2026-06-03 23:33:55.714963383 +0000 UTC m=+556.522183851" Jun 03 23:33:55.781416 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:55.781382 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bccdq2d" Jun 03 23:33:56.785953 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:56.785920 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bccdq2d" Jun 03 23:33:57.699446 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:57.699414 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bccdq2d" Jun 03 23:33:57.700331 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:33:57.700313 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bccdq2d" Jun 03 23:34:06.825303 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:06.825256 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bpfzp"] Jun 03 23:34:06.828629 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:06.828611 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bpfzp" Jun 03 23:34:06.832362 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:06.832333 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 23:34:06.832362 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:06.832354 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 23:34:06.832585 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:06.832334 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-nfkvp\"" Jun 03 23:34:06.840074 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:06.840043 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bpfzp"] Jun 03 23:34:06.935978 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:06.935942 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2w5w\" (UniqueName: \"kubernetes.io/projected/7720e99d-f07c-40c4-bdc6-bbad7ee7c963-kube-api-access-n2w5w\") pod \"kuadrant-operator-catalog-bpfzp\" (UID: \"7720e99d-f07c-40c4-bdc6-bbad7ee7c963\") " pod="kuadrant-system/kuadrant-operator-catalog-bpfzp" Jun 03 23:34:07.036748 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:07.036706 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2w5w\" (UniqueName: \"kubernetes.io/projected/7720e99d-f07c-40c4-bdc6-bbad7ee7c963-kube-api-access-n2w5w\") pod \"kuadrant-operator-catalog-bpfzp\" (UID: \"7720e99d-f07c-40c4-bdc6-bbad7ee7c963\") " pod="kuadrant-system/kuadrant-operator-catalog-bpfzp" Jun 03 23:34:07.045847 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:07.045824 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2w5w\" (UniqueName: \"kubernetes.io/projected/7720e99d-f07c-40c4-bdc6-bbad7ee7c963-kube-api-access-n2w5w\") pod \"kuadrant-operator-catalog-bpfzp\" (UID: \"7720e99d-f07c-40c4-bdc6-bbad7ee7c963\") " pod="kuadrant-system/kuadrant-operator-catalog-bpfzp" Jun 03 23:34:07.140163 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:07.140063 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bpfzp" Jun 03 23:34:07.193119 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:07.193071 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bpfzp"] Jun 03 23:34:07.274699 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:07.274673 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bpfzp"] Jun 03 23:34:07.277207 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:34:07.277184 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7720e99d_f07c_40c4_bdc6_bbad7ee7c963.slice/crio-def83ecac079da819fd5cb323aaa4435bf52d529066abfaf18e7fcec7d5e78af WatchSource:0}: Error finding container def83ecac079da819fd5cb323aaa4435bf52d529066abfaf18e7fcec7d5e78af: Status 404 returned error can't find the container with id def83ecac079da819fd5cb323aaa4435bf52d529066abfaf18e7fcec7d5e78af Jun 03 23:34:07.394909 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:07.394830 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xxgtr"] Jun 03 23:34:07.399242 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:07.399223 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xxgtr" Jun 03 23:34:07.408015 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:07.407992 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xxgtr"] Jun 03 23:34:07.541375 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:07.541336 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw9dt\" (UniqueName: \"kubernetes.io/projected/592ede2c-7c28-495f-a908-6494d1afb164-kube-api-access-rw9dt\") pod \"kuadrant-operator-catalog-xxgtr\" (UID: \"592ede2c-7c28-495f-a908-6494d1afb164\") " pod="kuadrant-system/kuadrant-operator-catalog-xxgtr" Jun 03 23:34:07.642037 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:07.641996 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rw9dt\" (UniqueName: \"kubernetes.io/projected/592ede2c-7c28-495f-a908-6494d1afb164-kube-api-access-rw9dt\") pod \"kuadrant-operator-catalog-xxgtr\" (UID: \"592ede2c-7c28-495f-a908-6494d1afb164\") " pod="kuadrant-system/kuadrant-operator-catalog-xxgtr" Jun 03 23:34:07.651873 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:07.651805 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw9dt\" (UniqueName: \"kubernetes.io/projected/592ede2c-7c28-495f-a908-6494d1afb164-kube-api-access-rw9dt\") pod \"kuadrant-operator-catalog-xxgtr\" (UID: \"592ede2c-7c28-495f-a908-6494d1afb164\") " pod="kuadrant-system/kuadrant-operator-catalog-xxgtr" Jun 03 23:34:07.709114 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:07.709082 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xxgtr" Jun 03 23:34:07.748227 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:07.748130 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bpfzp" event={"ID":"7720e99d-f07c-40c4-bdc6-bbad7ee7c963","Type":"ContainerStarted","Data":"def83ecac079da819fd5cb323aaa4435bf52d529066abfaf18e7fcec7d5e78af"} Jun 03 23:34:07.860064 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:07.860037 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xxgtr"] Jun 03 23:34:07.862547 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:34:07.862520 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod592ede2c_7c28_495f_a908_6494d1afb164.slice/crio-7c7f7efa51cd52886bdc64bd29bb862fd6010054620a3d9c8de2a93eea2a7db3 WatchSource:0}: Error finding container 7c7f7efa51cd52886bdc64bd29bb862fd6010054620a3d9c8de2a93eea2a7db3: Status 404 returned error can't find the container with id 7c7f7efa51cd52886bdc64bd29bb862fd6010054620a3d9c8de2a93eea2a7db3 Jun 03 23:34:08.754791 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:08.754751 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xxgtr" event={"ID":"592ede2c-7c28-495f-a908-6494d1afb164","Type":"ContainerStarted","Data":"7c7f7efa51cd52886bdc64bd29bb862fd6010054620a3d9c8de2a93eea2a7db3"} Jun 03 23:34:09.760888 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:09.760843 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bpfzp" event={"ID":"7720e99d-f07c-40c4-bdc6-bbad7ee7c963","Type":"ContainerStarted","Data":"00b893fe82c3673eb2bb913204a8ab5a0e6389e5a68aee51c67c225b13e4d3a8"} Jun 03 23:34:09.761389 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:09.760934 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-bpfzp" podUID="7720e99d-f07c-40c4-bdc6-bbad7ee7c963" containerName="registry-server" containerID="cri-o://00b893fe82c3673eb2bb913204a8ab5a0e6389e5a68aee51c67c225b13e4d3a8" gracePeriod=2 Jun 03 23:34:09.762415 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:09.762383 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xxgtr" event={"ID":"592ede2c-7c28-495f-a908-6494d1afb164","Type":"ContainerStarted","Data":"b38fd6f82d8034f46377b7db0a341efa25b52395a4f9e52bda60e904c1b1d4e4"} Jun 03 23:34:09.786980 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:09.786934 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-bpfzp" podStartSLOduration=1.710074348 podStartE2EDuration="3.786920603s" totalImagesPullingTime="2.076846255s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:34:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:34:09.785421313 +0000 UTC m=+570.592641776" watchObservedRunningTime="2026-06-03 23:34:09.786920603 +0000 UTC m=+570.594141067" Jun 03 23:34:09.804689 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:09.804642 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-xxgtr" podStartSLOduration=1.3096971530000001 podStartE2EDuration="2.804627328s" totalImagesPullingTime="1.494930175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:34:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:34:09.803918997 +0000 UTC m=+570.611139463" watchObservedRunningTime="2026-06-03 23:34:09.804627328 +0000 UTC m=+570.611847792" Jun 03 23:34:10.004802 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:10.004767 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bpfzp" Jun 03 23:34:10.065529 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:10.065435 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2w5w\" (UniqueName: \"kubernetes.io/projected/7720e99d-f07c-40c4-bdc6-bbad7ee7c963-kube-api-access-n2w5w\") pod \"7720e99d-f07c-40c4-bdc6-bbad7ee7c963\" (UID: \"7720e99d-f07c-40c4-bdc6-bbad7ee7c963\") " Jun 03 23:34:10.067601 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:10.067576 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7720e99d-f07c-40c4-bdc6-bbad7ee7c963-kube-api-access-n2w5w" (OuterVolumeSpecName: "kube-api-access-n2w5w") pod "7720e99d-f07c-40c4-bdc6-bbad7ee7c963" (UID: "7720e99d-f07c-40c4-bdc6-bbad7ee7c963"). InnerVolumeSpecName "kube-api-access-n2w5w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:34:10.166882 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:10.166832 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2w5w\" (UniqueName: \"kubernetes.io/projected/7720e99d-f07c-40c4-bdc6-bbad7ee7c963-kube-api-access-n2w5w\") on node \"ip-10-0-135-242.ec2.internal\" DevicePath \"\"" Jun 03 23:34:10.767525 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:10.767487 2574 generic.go:356] "Generic (PLEG): container finished" podID="7720e99d-f07c-40c4-bdc6-bbad7ee7c963" containerID="00b893fe82c3673eb2bb913204a8ab5a0e6389e5a68aee51c67c225b13e4d3a8" exitCode=0 Jun 03 23:34:10.767930 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:10.767533 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bpfzp" Jun 03 23:34:10.767930 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:10.767569 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bpfzp" event={"ID":"7720e99d-f07c-40c4-bdc6-bbad7ee7c963","Type":"ContainerDied","Data":"00b893fe82c3673eb2bb913204a8ab5a0e6389e5a68aee51c67c225b13e4d3a8"} Jun 03 23:34:10.767930 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:10.767620 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bpfzp" event={"ID":"7720e99d-f07c-40c4-bdc6-bbad7ee7c963","Type":"ContainerDied","Data":"def83ecac079da819fd5cb323aaa4435bf52d529066abfaf18e7fcec7d5e78af"} Jun 03 23:34:10.767930 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:10.767636 2574 scope.go:117] "RemoveContainer" containerID="00b893fe82c3673eb2bb913204a8ab5a0e6389e5a68aee51c67c225b13e4d3a8" Jun 03 23:34:10.776663 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:10.776645 2574 scope.go:117] "RemoveContainer" containerID="00b893fe82c3673eb2bb913204a8ab5a0e6389e5a68aee51c67c225b13e4d3a8" Jun 03 23:34:10.776911 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:34:10.776893 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00b893fe82c3673eb2bb913204a8ab5a0e6389e5a68aee51c67c225b13e4d3a8\": container with ID starting with 00b893fe82c3673eb2bb913204a8ab5a0e6389e5a68aee51c67c225b13e4d3a8 not found: ID does not exist" containerID="00b893fe82c3673eb2bb913204a8ab5a0e6389e5a68aee51c67c225b13e4d3a8" Jun 03 23:34:10.776970 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:10.776924 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00b893fe82c3673eb2bb913204a8ab5a0e6389e5a68aee51c67c225b13e4d3a8"} err="failed to get container status \"00b893fe82c3673eb2bb913204a8ab5a0e6389e5a68aee51c67c225b13e4d3a8\": rpc error: code = NotFound desc = could not find container \"00b893fe82c3673eb2bb913204a8ab5a0e6389e5a68aee51c67c225b13e4d3a8\": container with ID starting with 00b893fe82c3673eb2bb913204a8ab5a0e6389e5a68aee51c67c225b13e4d3a8 not found: ID does not exist" Jun 03 23:34:10.797128 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:10.797104 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bpfzp"] Jun 03 23:34:10.802053 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:10.802026 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bpfzp"] Jun 03 23:34:11.656457 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:11.656430 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7720e99d-f07c-40c4-bdc6-bbad7ee7c963" path="/var/lib/kubelet/pods/7720e99d-f07c-40c4-bdc6-bbad7ee7c963/volumes" Jun 03 23:34:17.709974 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:17.709940 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-xxgtr" Jun 03 23:34:17.710425 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:17.709998 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-xxgtr" Jun 03 23:34:17.733051 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:17.733020 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-xxgtr" Jun 03 23:34:17.820834 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:17.820807 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-xxgtr" Jun 03 23:34:24.236950 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:24.236915 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b45b98dc4-gzhjs"] Jun 03 23:34:24.237446 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:24.237247 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7720e99d-f07c-40c4-bdc6-bbad7ee7c963" containerName="registry-server" Jun 03 23:34:24.237446 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:24.237264 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7720e99d-f07c-40c4-bdc6-bbad7ee7c963" containerName="registry-server" Jun 03 23:34:24.237446 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:24.237354 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7720e99d-f07c-40c4-bdc6-bbad7ee7c963" containerName="registry-server" Jun 03 23:34:24.241673 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:24.241651 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b45b98dc4-gzhjs" Jun 03 23:34:24.245541 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:24.245520 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 03 23:34:24.245655 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:24.245542 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 03 23:34:24.246794 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:24.246776 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 03 23:34:24.246901 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:24.246809 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 03 23:34:24.246901 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:24.246882 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 03 23:34:24.248185 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:24.248166 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 03 23:34:24.248592 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:24.248403 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 03 23:34:24.248592 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:24.248558 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6dlps\"" Jun 03 23:34:24.251406 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:24.251387 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 03 23:34:24.260869 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:24.260846 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b45b98dc4-gzhjs"] Jun 03 23:34:24.298596 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:24.298566 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dbf591be-8fad-42e4-a6c9-f957ba15fb3f-console-serving-cert\") pod \"console-b45b98dc4-gzhjs\" (UID: \"dbf591be-8fad-42e4-a6c9-f957ba15fb3f\") " pod="openshift-console/console-b45b98dc4-gzhjs" Jun 03 23:34:24.298596 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:24.298597 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dbf591be-8fad-42e4-a6c9-f957ba15fb3f-oauth-serving-cert\") pod \"console-b45b98dc4-gzhjs\" (UID: \"dbf591be-8fad-42e4-a6c9-f957ba15fb3f\") " pod="openshift-console/console-b45b98dc4-gzhjs" Jun 03 23:34:24.298779 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:24.298622 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dbf591be-8fad-42e4-a6c9-f957ba15fb3f-console-oauth-config\") pod \"console-b45b98dc4-gzhjs\" (UID: \"dbf591be-8fad-42e4-a6c9-f957ba15fb3f\") " pod="openshift-console/console-b45b98dc4-gzhjs" Jun 03 23:34:24.298779 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:24.298728 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbf591be-8fad-42e4-a6c9-f957ba15fb3f-trusted-ca-bundle\") pod \"console-b45b98dc4-gzhjs\" (UID: \"dbf591be-8fad-42e4-a6c9-f957ba15fb3f\") " pod="openshift-console/console-b45b98dc4-gzhjs" Jun 03 23:34:24.298779 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:24.298762 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dbf591be-8fad-42e4-a6c9-f957ba15fb3f-service-ca\") pod \"console-b45b98dc4-gzhjs\" (UID: \"dbf591be-8fad-42e4-a6c9-f957ba15fb3f\") " pod="openshift-console/console-b45b98dc4-gzhjs" Jun 03 23:34:24.298898 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:24.298792 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2rhj\" (UniqueName: \"kubernetes.io/projected/dbf591be-8fad-42e4-a6c9-f957ba15fb3f-kube-api-access-d2rhj\") pod \"console-b45b98dc4-gzhjs\" (UID: \"dbf591be-8fad-42e4-a6c9-f957ba15fb3f\") " pod="openshift-console/console-b45b98dc4-gzhjs" Jun 03 23:34:24.298898 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:24.298843 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dbf591be-8fad-42e4-a6c9-f957ba15fb3f-console-config\") pod \"console-b45b98dc4-gzhjs\" (UID: \"dbf591be-8fad-42e4-a6c9-f957ba15fb3f\") " pod="openshift-console/console-b45b98dc4-gzhjs" Jun 03 23:34:24.399249 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:24.399212 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbf591be-8fad-42e4-a6c9-f957ba15fb3f-trusted-ca-bundle\") pod \"console-b45b98dc4-gzhjs\" (UID: \"dbf591be-8fad-42e4-a6c9-f957ba15fb3f\") " pod="openshift-console/console-b45b98dc4-gzhjs" Jun 03 23:34:24.399569 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:24.399269 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dbf591be-8fad-42e4-a6c9-f957ba15fb3f-service-ca\") pod \"console-b45b98dc4-gzhjs\" (UID: \"dbf591be-8fad-42e4-a6c9-f957ba15fb3f\") " pod="openshift-console/console-b45b98dc4-gzhjs" Jun 03 23:34:24.399569 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:24.399311 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2rhj\" (UniqueName: \"kubernetes.io/projected/dbf591be-8fad-42e4-a6c9-f957ba15fb3f-kube-api-access-d2rhj\") pod \"console-b45b98dc4-gzhjs\" (UID: \"dbf591be-8fad-42e4-a6c9-f957ba15fb3f\") " pod="openshift-console/console-b45b98dc4-gzhjs" Jun 03 23:34:24.399569 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:24.399353 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dbf591be-8fad-42e4-a6c9-f957ba15fb3f-console-config\") pod \"console-b45b98dc4-gzhjs\" (UID: \"dbf591be-8fad-42e4-a6c9-f957ba15fb3f\") " pod="openshift-console/console-b45b98dc4-gzhjs" Jun 03 23:34:24.399569 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:24.399417 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dbf591be-8fad-42e4-a6c9-f957ba15fb3f-console-serving-cert\") pod \"console-b45b98dc4-gzhjs\" (UID: \"dbf591be-8fad-42e4-a6c9-f957ba15fb3f\") " pod="openshift-console/console-b45b98dc4-gzhjs" Jun 03 23:34:24.399569 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:24.399439 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dbf591be-8fad-42e4-a6c9-f957ba15fb3f-oauth-serving-cert\") pod \"console-b45b98dc4-gzhjs\" (UID: \"dbf591be-8fad-42e4-a6c9-f957ba15fb3f\") " pod="openshift-console/console-b45b98dc4-gzhjs" Jun 03 23:34:24.399569 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:24.399473 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dbf591be-8fad-42e4-a6c9-f957ba15fb3f-console-oauth-config\") pod \"console-b45b98dc4-gzhjs\" (UID: \"dbf591be-8fad-42e4-a6c9-f957ba15fb3f\") " pod="openshift-console/console-b45b98dc4-gzhjs" Jun 03 23:34:24.400183 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:24.400155 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dbf591be-8fad-42e4-a6c9-f957ba15fb3f-service-ca\") pod \"console-b45b98dc4-gzhjs\" (UID: \"dbf591be-8fad-42e4-a6c9-f957ba15fb3f\") " pod="openshift-console/console-b45b98dc4-gzhjs" Jun 03 23:34:24.400272 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:24.400166 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbf591be-8fad-42e4-a6c9-f957ba15fb3f-trusted-ca-bundle\") pod \"console-b45b98dc4-gzhjs\" (UID: \"dbf591be-8fad-42e4-a6c9-f957ba15fb3f\") " pod="openshift-console/console-b45b98dc4-gzhjs" Jun 03 23:34:24.400272 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:24.400202 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dbf591be-8fad-42e4-a6c9-f957ba15fb3f-console-config\") pod \"console-b45b98dc4-gzhjs\" (UID: \"dbf591be-8fad-42e4-a6c9-f957ba15fb3f\") " pod="openshift-console/console-b45b98dc4-gzhjs" Jun 03 23:34:24.400400 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:24.400371 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dbf591be-8fad-42e4-a6c9-f957ba15fb3f-oauth-serving-cert\") pod \"console-b45b98dc4-gzhjs\" (UID: \"dbf591be-8fad-42e4-a6c9-f957ba15fb3f\") " pod="openshift-console/console-b45b98dc4-gzhjs" Jun 03 23:34:24.402077 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:24.402056 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dbf591be-8fad-42e4-a6c9-f957ba15fb3f-console-oauth-config\") pod \"console-b45b98dc4-gzhjs\" (UID: \"dbf591be-8fad-42e4-a6c9-f957ba15fb3f\") " pod="openshift-console/console-b45b98dc4-gzhjs" Jun 03 23:34:24.402172 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:24.402099 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dbf591be-8fad-42e4-a6c9-f957ba15fb3f-console-serving-cert\") pod \"console-b45b98dc4-gzhjs\" (UID: \"dbf591be-8fad-42e4-a6c9-f957ba15fb3f\") " pod="openshift-console/console-b45b98dc4-gzhjs" Jun 03 23:34:24.408603 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:24.408576 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2rhj\" (UniqueName: \"kubernetes.io/projected/dbf591be-8fad-42e4-a6c9-f957ba15fb3f-kube-api-access-d2rhj\") pod \"console-b45b98dc4-gzhjs\" (UID: \"dbf591be-8fad-42e4-a6c9-f957ba15fb3f\") " pod="openshift-console/console-b45b98dc4-gzhjs" Jun 03 23:34:24.551939 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:24.551840 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b45b98dc4-gzhjs" Jun 03 23:34:24.688477 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:24.688449 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b45b98dc4-gzhjs"] Jun 03 23:34:24.690097 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:34:24.690070 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbf591be_8fad_42e4_a6c9_f957ba15fb3f.slice/crio-cbc4947afe76ab5661062ab015c6870b67b48d238ed5bc32fc5d22929fa7b53d WatchSource:0}: Error finding container cbc4947afe76ab5661062ab015c6870b67b48d238ed5bc32fc5d22929fa7b53d: Status 404 returned error can't find the container with id cbc4947afe76ab5661062ab015c6870b67b48d238ed5bc32fc5d22929fa7b53d Jun 03 23:34:24.828854 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:24.828747 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b45b98dc4-gzhjs" event={"ID":"dbf591be-8fad-42e4-a6c9-f957ba15fb3f","Type":"ContainerStarted","Data":"a7f6e7a31bf1ae078b4d593414fc779c4f908abf52d3140c258d9ea710db3ae7"} Jun 03 23:34:24.828854 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:24.828830 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b45b98dc4-gzhjs" event={"ID":"dbf591be-8fad-42e4-a6c9-f957ba15fb3f","Type":"ContainerStarted","Data":"cbc4947afe76ab5661062ab015c6870b67b48d238ed5bc32fc5d22929fa7b53d"} Jun 03 23:34:24.856598 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:24.856549 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b45b98dc4-gzhjs" podStartSLOduration=0.856533968 podStartE2EDuration="856.533968ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:34:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:34:24.855557851 +0000 UTC m=+585.662778314" watchObservedRunningTime="2026-06-03 23:34:24.856533968 +0000 UTC m=+585.663754431" Jun 03 23:34:32.884093 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:32.884056 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mszjh"] Jun 03 23:34:32.887389 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:32.887366 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mszjh" Jun 03 23:34:32.890152 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:32.890131 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-csbw6\"" Jun 03 23:34:32.899771 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:32.899740 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mszjh"] Jun 03 23:34:32.983805 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:32.983768 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkq7w\" (UniqueName: \"kubernetes.io/projected/716e82e8-bf45-48ad-9b20-dd5b6e8c3754-kube-api-access-gkq7w\") pod \"limitador-operator-controller-manager-859d7b78bd-mszjh\" (UID: \"716e82e8-bf45-48ad-9b20-dd5b6e8c3754\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mszjh" Jun 03 23:34:33.085030 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:33.084992 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkq7w\" (UniqueName: \"kubernetes.io/projected/716e82e8-bf45-48ad-9b20-dd5b6e8c3754-kube-api-access-gkq7w\") pod \"limitador-operator-controller-manager-859d7b78bd-mszjh\" (UID: \"716e82e8-bf45-48ad-9b20-dd5b6e8c3754\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mszjh" Jun 03 23:34:33.094957 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:33.094920 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkq7w\" (UniqueName: \"kubernetes.io/projected/716e82e8-bf45-48ad-9b20-dd5b6e8c3754-kube-api-access-gkq7w\") pod \"limitador-operator-controller-manager-859d7b78bd-mszjh\" (UID: \"716e82e8-bf45-48ad-9b20-dd5b6e8c3754\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mszjh" Jun 03 23:34:33.198169 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:33.198124 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mszjh" Jun 03 23:34:33.337213 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:33.337189 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mszjh"] Jun 03 23:34:33.339339 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:34:33.339313 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod716e82e8_bf45_48ad_9b20_dd5b6e8c3754.slice/crio-2665ee5c274d5cb685cbb83d5be7802a86b2da52e69e3bd7ca3324ac465ff466 WatchSource:0}: Error finding container 2665ee5c274d5cb685cbb83d5be7802a86b2da52e69e3bd7ca3324ac465ff466: Status 404 returned error can't find the container with id 2665ee5c274d5cb685cbb83d5be7802a86b2da52e69e3bd7ca3324ac465ff466 Jun 03 23:34:33.875745 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:33.875713 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mszjh" event={"ID":"716e82e8-bf45-48ad-9b20-dd5b6e8c3754","Type":"ContainerStarted","Data":"2665ee5c274d5cb685cbb83d5be7802a86b2da52e69e3bd7ca3324ac465ff466"} Jun 03 23:34:34.552551 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:34.552513 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b45b98dc4-gzhjs" Jun 03 23:34:34.553005 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:34.552619 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b45b98dc4-gzhjs" Jun 03 23:34:34.557873 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:34.557849 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b45b98dc4-gzhjs" Jun 03 23:34:34.884841 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:34.884811 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b45b98dc4-gzhjs" Jun 03 23:34:35.887185 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:35.887153 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mszjh" event={"ID":"716e82e8-bf45-48ad-9b20-dd5b6e8c3754","Type":"ContainerStarted","Data":"8dec26e6f18db6bb4803a81ee62ae69d9805060d6064208cd6083a293275a309"} Jun 03 23:34:35.887585 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:35.887324 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mszjh" Jun 03 23:34:35.906549 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:35.906500 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mszjh" podStartSLOduration=2.367783125 podStartE2EDuration="3.906483901s" totalImagesPullingTime="1.538700776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:34:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:34:35.905495943 +0000 UTC m=+596.712716438" watchObservedRunningTime="2026-06-03 23:34:35.906483901 +0000 UTC m=+596.713704364" Jun 03 23:34:42.152034 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:42.151995 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-5fgrm"] Jun 03 23:34:42.159482 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:42.159465 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5fgrm" Jun 03 23:34:42.163128 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:42.163107 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-726cr\"" Jun 03 23:34:42.163375 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:42.163359 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 03 23:34:42.171331 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:42.171310 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-5fgrm"] Jun 03 23:34:42.271352 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:42.271317 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzqxd\" (UniqueName: \"kubernetes.io/projected/11167f28-5977-4190-8f23-e473a521eecb-kube-api-access-wzqxd\") pod \"dns-operator-controller-manager-864dd78c4c-5fgrm\" (UID: \"11167f28-5977-4190-8f23-e473a521eecb\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5fgrm" Jun 03 23:34:42.372239 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:42.372198 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzqxd\" (UniqueName: \"kubernetes.io/projected/11167f28-5977-4190-8f23-e473a521eecb-kube-api-access-wzqxd\") pod \"dns-operator-controller-manager-864dd78c4c-5fgrm\" (UID: \"11167f28-5977-4190-8f23-e473a521eecb\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5fgrm" Jun 03 23:34:42.381598 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:42.381570 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzqxd\" (UniqueName: \"kubernetes.io/projected/11167f28-5977-4190-8f23-e473a521eecb-kube-api-access-wzqxd\") pod \"dns-operator-controller-manager-864dd78c4c-5fgrm\" (UID: \"11167f28-5977-4190-8f23-e473a521eecb\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5fgrm" Jun 03 23:34:42.469083 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:42.469042 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5fgrm" Jun 03 23:34:42.608634 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:42.608611 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-5fgrm"] Jun 03 23:34:42.610601 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:34:42.610576 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11167f28_5977_4190_8f23_e473a521eecb.slice/crio-cc1e344939a3dbb5e20c81edcab27f8f1fe31780ed3c03103d33f7801a137966 WatchSource:0}: Error finding container cc1e344939a3dbb5e20c81edcab27f8f1fe31780ed3c03103d33f7801a137966: Status 404 returned error can't find the container with id cc1e344939a3dbb5e20c81edcab27f8f1fe31780ed3c03103d33f7801a137966 Jun 03 23:34:42.921486 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:42.921458 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5fgrm" event={"ID":"11167f28-5977-4190-8f23-e473a521eecb","Type":"ContainerStarted","Data":"cc1e344939a3dbb5e20c81edcab27f8f1fe31780ed3c03103d33f7801a137966"} Jun 03 23:34:45.937143 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:45.937106 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5fgrm" event={"ID":"11167f28-5977-4190-8f23-e473a521eecb","Type":"ContainerStarted","Data":"cb3889e60c739ff3641ae6cb1ac86b0d679d997695d31e6039d6b74d32174470"} Jun 03 23:34:45.937574 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:45.937241 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5fgrm" Jun 03 23:34:45.956503 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:45.956457 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5fgrm" podStartSLOduration=1.68536781 podStartE2EDuration="3.956441846s" totalImagesPullingTime="2.271074036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:34:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:34:45.955446442 +0000 UTC m=+606.762666906" watchObservedRunningTime="2026-06-03 23:34:45.956441846 +0000 UTC m=+606.763662310" Jun 03 23:34:46.799910 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:46.799879 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-gqbz4"] Jun 03 23:34:46.803389 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:46.803372 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gqbz4" Jun 03 23:34:46.806356 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:46.806337 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-cdjrh\"" Jun 03 23:34:46.811570 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:46.811547 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-gqbz4"] Jun 03 23:34:46.893506 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:46.893479 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mszjh" Jun 03 23:34:46.917120 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:46.917091 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhp87\" (UniqueName: \"kubernetes.io/projected/e65211c6-a413-4dc4-8db8-ed628a292f32-kube-api-access-qhp87\") pod \"authorino-operator-75cc8d5cb7-gqbz4\" (UID: \"e65211c6-a413-4dc4-8db8-ed628a292f32\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-gqbz4" Jun 03 23:34:47.018026 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:47.017982 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhp87\" (UniqueName: \"kubernetes.io/projected/e65211c6-a413-4dc4-8db8-ed628a292f32-kube-api-access-qhp87\") pod \"authorino-operator-75cc8d5cb7-gqbz4\" (UID: \"e65211c6-a413-4dc4-8db8-ed628a292f32\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-gqbz4" Jun 03 23:34:47.032607 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:47.032576 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhp87\" (UniqueName: \"kubernetes.io/projected/e65211c6-a413-4dc4-8db8-ed628a292f32-kube-api-access-qhp87\") pod \"authorino-operator-75cc8d5cb7-gqbz4\" (UID: \"e65211c6-a413-4dc4-8db8-ed628a292f32\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-gqbz4" Jun 03 23:34:47.113699 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:47.113606 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gqbz4" Jun 03 23:34:47.281961 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:47.281931 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-gqbz4"] Jun 03 23:34:47.290263 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:34:47.290234 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode65211c6_a413_4dc4_8db8_ed628a292f32.slice/crio-7ec79ce473afeaffdac369b5dcf6770e4f3283d55346e47cd2f1e0630d64d2e0 WatchSource:0}: Error finding container 7ec79ce473afeaffdac369b5dcf6770e4f3283d55346e47cd2f1e0630d64d2e0: Status 404 returned error can't find the container with id 7ec79ce473afeaffdac369b5dcf6770e4f3283d55346e47cd2f1e0630d64d2e0 Jun 03 23:34:47.949466 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:47.949427 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gqbz4" event={"ID":"e65211c6-a413-4dc4-8db8-ed628a292f32","Type":"ContainerStarted","Data":"7ec79ce473afeaffdac369b5dcf6770e4f3283d55346e47cd2f1e0630d64d2e0"} Jun 03 23:34:49.961254 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:49.961220 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gqbz4" event={"ID":"e65211c6-a413-4dc4-8db8-ed628a292f32","Type":"ContainerStarted","Data":"dfd53aa7bf94ac9b8e5692c2f0afa763c5a15edae62f8bfea144ebe03c653c1a"} Jun 03 23:34:49.961629 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:49.961344 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gqbz4" Jun 03 23:34:49.979425 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:49.979376 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gqbz4" podStartSLOduration=1.852201704 podStartE2EDuration="3.979361529s" totalImagesPullingTime="2.127159825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:34:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:34:49.978597338 +0000 UTC m=+610.785817811" watchObservedRunningTime="2026-06-03 23:34:49.979361529 +0000 UTC m=+610.786582054" Jun 03 23:34:56.945863 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:56.945827 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5fgrm" Jun 03 23:34:57.959683 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:57.959643 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-85z7h"] Jun 03 23:34:57.963511 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:57.963488 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-85z7h" Jun 03 23:34:57.967525 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:57.967505 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-fjmn4\"" Jun 03 23:34:57.977690 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:57.977663 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-85z7h"] Jun 03 23:34:58.010266 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:58.010233 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4r99f\" (UniqueName: \"kubernetes.io/projected/9e4cfc9e-a2e5-45b8-8a8a-fde144efd4fd-kube-api-access-4r99f\") pod \"kuadrant-operator-controller-manager-55467d9f7-85z7h\" (UID: \"9e4cfc9e-a2e5-45b8-8a8a-fde144efd4fd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-85z7h" Jun 03 23:34:58.010459 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:58.010280 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e4cfc9e-a2e5-45b8-8a8a-fde144efd4fd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-85z7h\" (UID: \"9e4cfc9e-a2e5-45b8-8a8a-fde144efd4fd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-85z7h" Jun 03 23:34:58.111118 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:58.111072 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e4cfc9e-a2e5-45b8-8a8a-fde144efd4fd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-85z7h\" (UID: \"9e4cfc9e-a2e5-45b8-8a8a-fde144efd4fd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-85z7h" Jun 03 23:34:58.111272 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:58.111209 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4r99f\" (UniqueName: \"kubernetes.io/projected/9e4cfc9e-a2e5-45b8-8a8a-fde144efd4fd-kube-api-access-4r99f\") pod \"kuadrant-operator-controller-manager-55467d9f7-85z7h\" (UID: \"9e4cfc9e-a2e5-45b8-8a8a-fde144efd4fd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-85z7h" Jun 03 23:34:58.111526 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:58.111496 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e4cfc9e-a2e5-45b8-8a8a-fde144efd4fd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-85z7h\" (UID: \"9e4cfc9e-a2e5-45b8-8a8a-fde144efd4fd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-85z7h" Jun 03 23:34:58.122693 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:58.122667 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4r99f\" (UniqueName: \"kubernetes.io/projected/9e4cfc9e-a2e5-45b8-8a8a-fde144efd4fd-kube-api-access-4r99f\") pod \"kuadrant-operator-controller-manager-55467d9f7-85z7h\" (UID: \"9e4cfc9e-a2e5-45b8-8a8a-fde144efd4fd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-85z7h" Jun 03 23:34:58.273765 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:58.273669 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-85z7h" Jun 03 23:34:58.304782 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:58.304741 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-85z7h"] Jun 03 23:34:58.311191 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:58.311156 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-85z7h"] Jun 03 23:34:58.327394 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:58.327363 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mrk8g"] Jun 03 23:34:58.331696 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:58.331678 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mrk8g" Jun 03 23:34:58.343968 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:58.343943 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mrk8g"] Jun 03 23:34:58.379601 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:58.379568 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mszjh"] Jun 03 23:34:58.379837 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:58.379809 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mszjh" podUID="716e82e8-bf45-48ad-9b20-dd5b6e8c3754" containerName="manager" containerID="cri-o://8dec26e6f18db6bb4803a81ee62ae69d9805060d6064208cd6083a293275a309" gracePeriod=2 Jun 03 23:34:58.397480 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:58.397450 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mszjh"] Jun 03 23:34:58.400957 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:34:58.400926 2574 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"716e82e8-bf45-48ad-9b20-dd5b6e8c3754\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-mszjh\": pods \"limitador-operator-controller-manager-859d7b78bd-mszjh\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mszjh" Jun 03 23:34:58.414657 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:58.414623 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3c37c2d9-c614-496d-ae39-dc20cc1005fe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-mrk8g\" (UID: \"3c37c2d9-c614-496d-ae39-dc20cc1005fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mrk8g" Jun 03 23:34:58.414883 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:58.414769 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrpf4\" (UniqueName: \"kubernetes.io/projected/3c37c2d9-c614-496d-ae39-dc20cc1005fe-kube-api-access-xrpf4\") pod \"kuadrant-operator-controller-manager-55467d9f7-mrk8g\" (UID: \"3c37c2d9-c614-496d-ae39-dc20cc1005fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mrk8g" Jun 03 23:34:58.515700 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:58.515668 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrpf4\" (UniqueName: \"kubernetes.io/projected/3c37c2d9-c614-496d-ae39-dc20cc1005fe-kube-api-access-xrpf4\") pod \"kuadrant-operator-controller-manager-55467d9f7-mrk8g\" (UID: \"3c37c2d9-c614-496d-ae39-dc20cc1005fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mrk8g" Jun 03 23:34:58.515892 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:58.515746 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3c37c2d9-c614-496d-ae39-dc20cc1005fe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-mrk8g\" (UID: \"3c37c2d9-c614-496d-ae39-dc20cc1005fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mrk8g" Jun 03 23:34:58.516064 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:58.516046 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3c37c2d9-c614-496d-ae39-dc20cc1005fe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-mrk8g\" (UID: \"3c37c2d9-c614-496d-ae39-dc20cc1005fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mrk8g" Jun 03 23:34:58.525141 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:58.525024 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrpf4\" (UniqueName: \"kubernetes.io/projected/3c37c2d9-c614-496d-ae39-dc20cc1005fe-kube-api-access-xrpf4\") pod \"kuadrant-operator-controller-manager-55467d9f7-mrk8g\" (UID: \"3c37c2d9-c614-496d-ae39-dc20cc1005fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mrk8g" Jun 03 23:34:58.611095 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:58.611071 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mszjh" Jun 03 23:34:58.613487 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:34:58.613463 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mszjh\" is forbidden: User \"system:node:ip-10-0-135-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-242.ec2.internal' and this object" podUID="716e82e8-bf45-48ad-9b20-dd5b6e8c3754" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mszjh" Jun 03 23:34:58.644823 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:58.644797 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mrk8g" Jun 03 23:34:58.717672 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:58.717646 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gkq7w\" (UniqueName: \"kubernetes.io/projected/716e82e8-bf45-48ad-9b20-dd5b6e8c3754-kube-api-access-gkq7w\") pod \"716e82e8-bf45-48ad-9b20-dd5b6e8c3754\" (UID: \"716e82e8-bf45-48ad-9b20-dd5b6e8c3754\") " Jun 03 23:34:58.719538 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:58.719511 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/716e82e8-bf45-48ad-9b20-dd5b6e8c3754-kube-api-access-gkq7w" (OuterVolumeSpecName: "kube-api-access-gkq7w") pod "716e82e8-bf45-48ad-9b20-dd5b6e8c3754" (UID: "716e82e8-bf45-48ad-9b20-dd5b6e8c3754"). InnerVolumeSpecName "kube-api-access-gkq7w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:34:58.780862 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:58.780837 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mrk8g"] Jun 03 23:34:58.782691 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:34:58.782653 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c37c2d9_c614_496d_ae39_dc20cc1005fe.slice/crio-0028e1a5c59766554a4e680df091ee8a1a407593da773234be717d775e7627ec WatchSource:0}: Error finding container 0028e1a5c59766554a4e680df091ee8a1a407593da773234be717d775e7627ec: Status 404 returned error can't find the container with id 0028e1a5c59766554a4e680df091ee8a1a407593da773234be717d775e7627ec Jun 03 23:34:58.818692 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:58.818665 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gkq7w\" (UniqueName: \"kubernetes.io/projected/716e82e8-bf45-48ad-9b20-dd5b6e8c3754-kube-api-access-gkq7w\") on node \"ip-10-0-135-242.ec2.internal\" DevicePath \"\"" Jun 03 23:34:59.009185 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:59.009105 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mrk8g" event={"ID":"3c37c2d9-c614-496d-ae39-dc20cc1005fe","Type":"ContainerStarted","Data":"0028e1a5c59766554a4e680df091ee8a1a407593da773234be717d775e7627ec"} Jun 03 23:34:59.010451 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:59.010424 2574 generic.go:356] "Generic (PLEG): container finished" podID="716e82e8-bf45-48ad-9b20-dd5b6e8c3754" containerID="8dec26e6f18db6bb4803a81ee62ae69d9805060d6064208cd6083a293275a309" exitCode=0 Jun 03 23:34:59.010607 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:59.010477 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mszjh" Jun 03 23:34:59.010607 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:59.010480 2574 scope.go:117] "RemoveContainer" containerID="8dec26e6f18db6bb4803a81ee62ae69d9805060d6064208cd6083a293275a309" Jun 03 23:34:59.013332 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:34:59.013305 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mszjh\" is forbidden: User \"system:node:ip-10-0-135-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-242.ec2.internal' and this object" podUID="716e82e8-bf45-48ad-9b20-dd5b6e8c3754" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mszjh" Jun 03 23:34:59.020108 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:59.020091 2574 scope.go:117] "RemoveContainer" containerID="8dec26e6f18db6bb4803a81ee62ae69d9805060d6064208cd6083a293275a309" Jun 03 23:34:59.020428 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:34:59.020407 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8dec26e6f18db6bb4803a81ee62ae69d9805060d6064208cd6083a293275a309\": container with ID starting with 8dec26e6f18db6bb4803a81ee62ae69d9805060d6064208cd6083a293275a309 not found: ID does not exist" containerID="8dec26e6f18db6bb4803a81ee62ae69d9805060d6064208cd6083a293275a309" Jun 03 23:34:59.020497 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:59.020435 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8dec26e6f18db6bb4803a81ee62ae69d9805060d6064208cd6083a293275a309"} err="failed to get container status \"8dec26e6f18db6bb4803a81ee62ae69d9805060d6064208cd6083a293275a309\": rpc error: code = NotFound desc = could not find container \"8dec26e6f18db6bb4803a81ee62ae69d9805060d6064208cd6083a293275a309\": container with ID starting with 8dec26e6f18db6bb4803a81ee62ae69d9805060d6064208cd6083a293275a309 not found: ID does not exist" Jun 03 23:34:59.022146 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:34:59.022121 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mszjh\" is forbidden: User \"system:node:ip-10-0-135-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-242.ec2.internal' and this object" podUID="716e82e8-bf45-48ad-9b20-dd5b6e8c3754" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mszjh" Jun 03 23:34:59.280512 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:34:59.280464 2574 log.go:32] "RunPodSandbox from runtime service failed" err=< Jun 03 23:34:59.280512 ip-10-0-135-242 kubenswrapper[2574]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-85z7h_kuadrant-system_9e4cfc9e-a2e5-45b8-8a8a-fde144efd4fd_0(17f3b0676a2427415b12006c5673f44bf07de00f65bfa0859ff480750313bfa4): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-85z7h to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"17f3b0676a2427415b12006c5673f44bf07de00f65bfa0859ff480750313bfa4" Netns:"/var/run/netns/2f85ffea-69e1-4301-b8c4-cc67f172be68" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-85z7h;K8S_POD_INFRA_CONTAINER_ID=17f3b0676a2427415b12006c5673f44bf07de00f65bfa0859ff480750313bfa4;K8S_POD_UID=9e4cfc9e-a2e5-45b8-8a8a-fde144efd4fd" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-85z7h] networking: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-85z7h/9e4cfc9e-a2e5-45b8-8a8a-fde144efd4fd:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-85z7h 17f3b0676a2427415b12006c5673f44bf07de00f65bfa0859ff480750313bfa4 network default NAD default NAD key ] [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-85z7h 17f3b0676a2427415b12006c5673f44bf07de00f65bfa0859ff480750313bfa4 network default NAD default NAD key ] failed to get pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-85z7h: timed out waiting for pod after 1s: pods "kuadrant-operator-controller-manager-55467d9f7-85z7h" not found Jun 03 23:34:59.280512 ip-10-0-135-242 kubenswrapper[2574]: ' Jun 03 23:34:59.280512 ip-10-0-135-242 kubenswrapper[2574]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Jun 03 23:34:59.280512 ip-10-0-135-242 kubenswrapper[2574]: > Jun 03 23:34:59.280738 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:34:59.280539 2574 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=< Jun 03 23:34:59.280738 ip-10-0-135-242 kubenswrapper[2574]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-85z7h_kuadrant-system_9e4cfc9e-a2e5-45b8-8a8a-fde144efd4fd_0(17f3b0676a2427415b12006c5673f44bf07de00f65bfa0859ff480750313bfa4): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-85z7h to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"17f3b0676a2427415b12006c5673f44bf07de00f65bfa0859ff480750313bfa4" Netns:"/var/run/netns/2f85ffea-69e1-4301-b8c4-cc67f172be68" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-85z7h;K8S_POD_INFRA_CONTAINER_ID=17f3b0676a2427415b12006c5673f44bf07de00f65bfa0859ff480750313bfa4;K8S_POD_UID=9e4cfc9e-a2e5-45b8-8a8a-fde144efd4fd" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-85z7h] networking: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-85z7h/9e4cfc9e-a2e5-45b8-8a8a-fde144efd4fd:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-85z7h 17f3b0676a2427415b12006c5673f44bf07de00f65bfa0859ff480750313bfa4 network default NAD default NAD key ] [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-85z7h 17f3b0676a2427415b12006c5673f44bf07de00f65bfa0859ff480750313bfa4 network default NAD default NAD key ] failed to get pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-85z7h: timed out waiting for pod after 1s: pods "kuadrant-operator-controller-manager-55467d9f7-85z7h" not found Jun 03 23:34:59.280738 ip-10-0-135-242 kubenswrapper[2574]: ' Jun 03 23:34:59.280738 ip-10-0-135-242 kubenswrapper[2574]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Jun 03 23:34:59.280738 ip-10-0-135-242 kubenswrapper[2574]: > pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-85z7h" Jun 03 23:34:59.660132 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:34:59.660078 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mszjh\" is forbidden: User \"system:node:ip-10-0-135-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-242.ec2.internal' and this object" podUID="716e82e8-bf45-48ad-9b20-dd5b6e8c3754" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mszjh" Jun 03 23:34:59.664188 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:34:59.664156 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="716e82e8-bf45-48ad-9b20-dd5b6e8c3754" path="/var/lib/kubelet/pods/716e82e8-bf45-48ad-9b20-dd5b6e8c3754/volumes" Jun 03 23:35:00.016314 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:00.016227 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-85z7h" Jun 03 23:35:00.024205 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:00.024175 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-85z7h" Jun 03 23:35:00.026586 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:35:00.026552 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-85z7h\" is forbidden: User \"system:node:ip-10-0-135-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-242.ec2.internal' and this object" podUID="9e4cfc9e-a2e5-45b8-8a8a-fde144efd4fd" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-85z7h" Jun 03 23:35:00.130512 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:00.130477 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4r99f\" (UniqueName: \"kubernetes.io/projected/9e4cfc9e-a2e5-45b8-8a8a-fde144efd4fd-kube-api-access-4r99f\") pod \"9e4cfc9e-a2e5-45b8-8a8a-fde144efd4fd\" (UID: \"9e4cfc9e-a2e5-45b8-8a8a-fde144efd4fd\") " Jun 03 23:35:00.130672 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:00.130525 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e4cfc9e-a2e5-45b8-8a8a-fde144efd4fd-extensions-socket-volume\") pod \"9e4cfc9e-a2e5-45b8-8a8a-fde144efd4fd\" (UID: \"9e4cfc9e-a2e5-45b8-8a8a-fde144efd4fd\") " Jun 03 23:35:00.130832 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:00.130811 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e4cfc9e-a2e5-45b8-8a8a-fde144efd4fd-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9e4cfc9e-a2e5-45b8-8a8a-fde144efd4fd" (UID: "9e4cfc9e-a2e5-45b8-8a8a-fde144efd4fd"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:35:00.132501 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:00.132466 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e4cfc9e-a2e5-45b8-8a8a-fde144efd4fd-kube-api-access-4r99f" (OuterVolumeSpecName: "kube-api-access-4r99f") pod "9e4cfc9e-a2e5-45b8-8a8a-fde144efd4fd" (UID: "9e4cfc9e-a2e5-45b8-8a8a-fde144efd4fd"). InnerVolumeSpecName "kube-api-access-4r99f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:35:00.232489 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:00.232448 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4r99f\" (UniqueName: \"kubernetes.io/projected/9e4cfc9e-a2e5-45b8-8a8a-fde144efd4fd-kube-api-access-4r99f\") on node \"ip-10-0-135-242.ec2.internal\" DevicePath \"\"" Jun 03 23:35:00.232489 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:00.232487 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e4cfc9e-a2e5-45b8-8a8a-fde144efd4fd-extensions-socket-volume\") on node \"ip-10-0-135-242.ec2.internal\" DevicePath \"\"" Jun 03 23:35:00.968894 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:00.968858 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gqbz4" Jun 03 23:35:00.972341 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:35:00.972308 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-85z7h\" is forbidden: User \"system:node:ip-10-0-135-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-242.ec2.internal' and this object" podUID="9e4cfc9e-a2e5-45b8-8a8a-fde144efd4fd" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-85z7h" Jun 03 23:35:01.022150 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:01.022118 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-85z7h" Jun 03 23:35:01.025618 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:35:01.025586 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-85z7h\" is forbidden: User \"system:node:ip-10-0-135-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-242.ec2.internal' and this object" podUID="9e4cfc9e-a2e5-45b8-8a8a-fde144efd4fd" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-85z7h" Jun 03 23:35:01.032271 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:35:01.032237 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-85z7h\" is forbidden: User \"system:node:ip-10-0-135-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-242.ec2.internal' and this object" podUID="9e4cfc9e-a2e5-45b8-8a8a-fde144efd4fd" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-85z7h" Jun 03 23:35:01.657793 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:01.657762 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e4cfc9e-a2e5-45b8-8a8a-fde144efd4fd" path="/var/lib/kubelet/pods/9e4cfc9e-a2e5-45b8-8a8a-fde144efd4fd/volumes" Jun 03 23:35:03.033870 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:03.033834 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mrk8g" event={"ID":"3c37c2d9-c614-496d-ae39-dc20cc1005fe","Type":"ContainerStarted","Data":"79772065b15bdc2abb183b8cb8a745d00eb18a00f251226cb617be44c2e5cf54"} Jun 03 23:35:03.034277 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:03.034095 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mrk8g" Jun 03 23:35:03.057576 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:03.057530 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mrk8g" podStartSLOduration=1.285431731 podStartE2EDuration="5.057513764s" totalImagesPullingTime="3.772082033s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:34:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:35:03.05469256 +0000 UTC m=+623.861913024" watchObservedRunningTime="2026-06-03 23:35:03.057513764 +0000 UTC m=+623.864734228" Jun 03 23:35:14.041395 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:14.041367 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mrk8g" Jun 03 23:35:14.338394 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:14.338361 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dqrbh"] Jun 03 23:35:14.338762 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:14.338748 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="716e82e8-bf45-48ad-9b20-dd5b6e8c3754" containerName="manager" Jun 03 23:35:14.338806 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:14.338766 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="716e82e8-bf45-48ad-9b20-dd5b6e8c3754" containerName="manager" Jun 03 23:35:14.338840 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:14.338819 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="716e82e8-bf45-48ad-9b20-dd5b6e8c3754" containerName="manager" Jun 03 23:35:14.343372 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:14.343351 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dqrbh" Jun 03 23:35:14.356384 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:14.356354 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dqrbh"] Jun 03 23:35:14.465098 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:14.465061 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5ppw\" (UniqueName: \"kubernetes.io/projected/d61413d9-0f33-43a5-a15f-52bfe40fc84d-kube-api-access-t5ppw\") pod \"kuadrant-operator-controller-manager-86878c769f-dqrbh\" (UID: \"d61413d9-0f33-43a5-a15f-52bfe40fc84d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dqrbh" Jun 03 23:35:14.465281 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:14.465123 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d61413d9-0f33-43a5-a15f-52bfe40fc84d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-dqrbh\" (UID: \"d61413d9-0f33-43a5-a15f-52bfe40fc84d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dqrbh" Jun 03 23:35:14.566665 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:14.566629 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5ppw\" (UniqueName: \"kubernetes.io/projected/d61413d9-0f33-43a5-a15f-52bfe40fc84d-kube-api-access-t5ppw\") pod \"kuadrant-operator-controller-manager-86878c769f-dqrbh\" (UID: \"d61413d9-0f33-43a5-a15f-52bfe40fc84d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dqrbh" Jun 03 23:35:14.566807 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:14.566690 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d61413d9-0f33-43a5-a15f-52bfe40fc84d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-dqrbh\" (UID: \"d61413d9-0f33-43a5-a15f-52bfe40fc84d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dqrbh" Jun 03 23:35:14.567088 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:14.567069 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d61413d9-0f33-43a5-a15f-52bfe40fc84d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-dqrbh\" (UID: \"d61413d9-0f33-43a5-a15f-52bfe40fc84d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dqrbh" Jun 03 23:35:14.575657 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:14.575636 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5ppw\" (UniqueName: \"kubernetes.io/projected/d61413d9-0f33-43a5-a15f-52bfe40fc84d-kube-api-access-t5ppw\") pod \"kuadrant-operator-controller-manager-86878c769f-dqrbh\" (UID: \"d61413d9-0f33-43a5-a15f-52bfe40fc84d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dqrbh" Jun 03 23:35:14.654205 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:14.654126 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dqrbh" Jun 03 23:35:14.789653 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:14.789630 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dqrbh"] Jun 03 23:35:14.791430 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:35:14.791404 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd61413d9_0f33_43a5_a15f_52bfe40fc84d.slice/crio-50f41d63cc1c17c0d25f0e5c5ecc670018aefd53864b9980c583f877fae8dad3 WatchSource:0}: Error finding container 50f41d63cc1c17c0d25f0e5c5ecc670018aefd53864b9980c583f877fae8dad3: Status 404 returned error can't find the container with id 50f41d63cc1c17c0d25f0e5c5ecc670018aefd53864b9980c583f877fae8dad3 Jun 03 23:35:15.095638 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:15.095604 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dqrbh" event={"ID":"d61413d9-0f33-43a5-a15f-52bfe40fc84d","Type":"ContainerStarted","Data":"26878d3d8ebf7350d212bf60bc6eea014e02cfee7b2e0546cbb668cc7822d0ca"} Jun 03 23:35:15.096080 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:15.095661 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dqrbh" event={"ID":"d61413d9-0f33-43a5-a15f-52bfe40fc84d","Type":"ContainerStarted","Data":"50f41d63cc1c17c0d25f0e5c5ecc670018aefd53864b9980c583f877fae8dad3"} Jun 03 23:35:15.096080 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:15.095784 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dqrbh" Jun 03 23:35:15.134134 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:15.134089 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dqrbh" podStartSLOduration=1.134074197 podStartE2EDuration="1.134074197s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:35:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:35:15.131559764 +0000 UTC m=+635.938780228" watchObservedRunningTime="2026-06-03 23:35:15.134074197 +0000 UTC m=+635.941294660" Jun 03 23:35:26.103507 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:26.103471 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dqrbh" Jun 03 23:35:26.174115 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:26.174086 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mrk8g"] Jun 03 23:35:26.174355 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:26.174333 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mrk8g" podUID="3c37c2d9-c614-496d-ae39-dc20cc1005fe" containerName="manager" containerID="cri-o://79772065b15bdc2abb183b8cb8a745d00eb18a00f251226cb617be44c2e5cf54" gracePeriod=10 Jun 03 23:35:26.423491 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:26.423463 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mrk8g" Jun 03 23:35:26.578110 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:26.578076 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3c37c2d9-c614-496d-ae39-dc20cc1005fe-extensions-socket-volume\") pod \"3c37c2d9-c614-496d-ae39-dc20cc1005fe\" (UID: \"3c37c2d9-c614-496d-ae39-dc20cc1005fe\") " Jun 03 23:35:26.578275 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:26.578170 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrpf4\" (UniqueName: \"kubernetes.io/projected/3c37c2d9-c614-496d-ae39-dc20cc1005fe-kube-api-access-xrpf4\") pod \"3c37c2d9-c614-496d-ae39-dc20cc1005fe\" (UID: \"3c37c2d9-c614-496d-ae39-dc20cc1005fe\") " Jun 03 23:35:26.578584 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:26.578557 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c37c2d9-c614-496d-ae39-dc20cc1005fe-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3c37c2d9-c614-496d-ae39-dc20cc1005fe" (UID: "3c37c2d9-c614-496d-ae39-dc20cc1005fe"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:35:26.580262 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:26.580237 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c37c2d9-c614-496d-ae39-dc20cc1005fe-kube-api-access-xrpf4" (OuterVolumeSpecName: "kube-api-access-xrpf4") pod "3c37c2d9-c614-496d-ae39-dc20cc1005fe" (UID: "3c37c2d9-c614-496d-ae39-dc20cc1005fe"). InnerVolumeSpecName "kube-api-access-xrpf4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:35:26.679887 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:26.679855 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3c37c2d9-c614-496d-ae39-dc20cc1005fe-extensions-socket-volume\") on node \"ip-10-0-135-242.ec2.internal\" DevicePath \"\"" Jun 03 23:35:26.679887 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:26.679882 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrpf4\" (UniqueName: \"kubernetes.io/projected/3c37c2d9-c614-496d-ae39-dc20cc1005fe-kube-api-access-xrpf4\") on node \"ip-10-0-135-242.ec2.internal\" DevicePath \"\"" Jun 03 23:35:27.153396 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:27.153309 2574 generic.go:356] "Generic (PLEG): container finished" podID="3c37c2d9-c614-496d-ae39-dc20cc1005fe" containerID="79772065b15bdc2abb183b8cb8a745d00eb18a00f251226cb617be44c2e5cf54" exitCode=0 Jun 03 23:35:27.153396 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:27.153355 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mrk8g" Jun 03 23:35:27.153396 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:27.153359 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mrk8g" event={"ID":"3c37c2d9-c614-496d-ae39-dc20cc1005fe","Type":"ContainerDied","Data":"79772065b15bdc2abb183b8cb8a745d00eb18a00f251226cb617be44c2e5cf54"} Jun 03 23:35:27.153870 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:27.153413 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mrk8g" event={"ID":"3c37c2d9-c614-496d-ae39-dc20cc1005fe","Type":"ContainerDied","Data":"0028e1a5c59766554a4e680df091ee8a1a407593da773234be717d775e7627ec"} Jun 03 23:35:27.153870 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:27.153443 2574 scope.go:117] "RemoveContainer" containerID="79772065b15bdc2abb183b8cb8a745d00eb18a00f251226cb617be44c2e5cf54" Jun 03 23:35:27.162036 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:27.161999 2574 scope.go:117] "RemoveContainer" containerID="79772065b15bdc2abb183b8cb8a745d00eb18a00f251226cb617be44c2e5cf54" Jun 03 23:35:27.162357 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:35:27.162277 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79772065b15bdc2abb183b8cb8a745d00eb18a00f251226cb617be44c2e5cf54\": container with ID starting with 79772065b15bdc2abb183b8cb8a745d00eb18a00f251226cb617be44c2e5cf54 not found: ID does not exist" containerID="79772065b15bdc2abb183b8cb8a745d00eb18a00f251226cb617be44c2e5cf54" Jun 03 23:35:27.162405 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:27.162374 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79772065b15bdc2abb183b8cb8a745d00eb18a00f251226cb617be44c2e5cf54"} err="failed to get container status \"79772065b15bdc2abb183b8cb8a745d00eb18a00f251226cb617be44c2e5cf54\": rpc error: code = NotFound desc = could not find container \"79772065b15bdc2abb183b8cb8a745d00eb18a00f251226cb617be44c2e5cf54\": container with ID starting with 79772065b15bdc2abb183b8cb8a745d00eb18a00f251226cb617be44c2e5cf54 not found: ID does not exist" Jun 03 23:35:27.183068 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:27.183045 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mrk8g"] Jun 03 23:35:27.190691 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:27.190667 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mrk8g"] Jun 03 23:35:27.657176 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:27.657132 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c37c2d9-c614-496d-ae39-dc20cc1005fe" path="/var/lib/kubelet/pods/3c37c2d9-c614-496d-ae39-dc20cc1005fe/volumes" Jun 03 23:35:30.488429 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:30.488400 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-f49fv"] Jun 03 23:35:30.488800 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:30.488786 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c37c2d9-c614-496d-ae39-dc20cc1005fe" containerName="manager" Jun 03 23:35:30.488843 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:30.488801 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c37c2d9-c614-496d-ae39-dc20cc1005fe" containerName="manager" Jun 03 23:35:30.488876 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:30.488860 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c37c2d9-c614-496d-ae39-dc20cc1005fe" containerName="manager" Jun 03 23:35:30.491777 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:30.491759 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-f49fv" Jun 03 23:35:30.494826 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:30.494804 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-h2xk2\"" Jun 03 23:35:30.512045 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:30.512019 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-f49fv"] Jun 03 23:35:30.617066 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:30.617018 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/255c2bdc-59bb-48e2-beaf-07567929dad2-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-f49fv\" (UID: \"255c2bdc-59bb-48e2-beaf-07567929dad2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-f49fv" Jun 03 23:35:30.617229 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:30.617112 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/255c2bdc-59bb-48e2-beaf-07567929dad2-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-f49fv\" (UID: \"255c2bdc-59bb-48e2-beaf-07567929dad2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-f49fv" Jun 03 23:35:30.617229 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:30.617142 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/255c2bdc-59bb-48e2-beaf-07567929dad2-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-f49fv\" (UID: \"255c2bdc-59bb-48e2-beaf-07567929dad2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-f49fv" Jun 03 23:35:30.617229 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:30.617193 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/255c2bdc-59bb-48e2-beaf-07567929dad2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-f49fv\" (UID: \"255c2bdc-59bb-48e2-beaf-07567929dad2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-f49fv" Jun 03 23:35:30.617354 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:30.617259 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/255c2bdc-59bb-48e2-beaf-07567929dad2-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-f49fv\" (UID: \"255c2bdc-59bb-48e2-beaf-07567929dad2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-f49fv" Jun 03 23:35:30.617354 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:30.617285 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/255c2bdc-59bb-48e2-beaf-07567929dad2-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-f49fv\" (UID: \"255c2bdc-59bb-48e2-beaf-07567929dad2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-f49fv" Jun 03 23:35:30.617354 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:30.617339 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/255c2bdc-59bb-48e2-beaf-07567929dad2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-f49fv\" (UID: \"255c2bdc-59bb-48e2-beaf-07567929dad2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-f49fv" Jun 03 23:35:30.617448 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:30.617394 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/255c2bdc-59bb-48e2-beaf-07567929dad2-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-f49fv\" (UID: \"255c2bdc-59bb-48e2-beaf-07567929dad2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-f49fv" Jun 03 23:35:30.617448 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:30.617435 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4276\" (UniqueName: \"kubernetes.io/projected/255c2bdc-59bb-48e2-beaf-07567929dad2-kube-api-access-r4276\") pod \"maas-default-gateway-openshift-default-8559cd5744-f49fv\" (UID: \"255c2bdc-59bb-48e2-beaf-07567929dad2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-f49fv" Jun 03 23:35:30.718483 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:30.718446 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/255c2bdc-59bb-48e2-beaf-07567929dad2-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-f49fv\" (UID: \"255c2bdc-59bb-48e2-beaf-07567929dad2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-f49fv" Jun 03 23:35:30.718483 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:30.718479 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/255c2bdc-59bb-48e2-beaf-07567929dad2-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-f49fv\" (UID: \"255c2bdc-59bb-48e2-beaf-07567929dad2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-f49fv" Jun 03 23:35:30.718729 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:30.718498 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/255c2bdc-59bb-48e2-beaf-07567929dad2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-f49fv\" (UID: \"255c2bdc-59bb-48e2-beaf-07567929dad2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-f49fv" Jun 03 23:35:30.718729 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:30.718547 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/255c2bdc-59bb-48e2-beaf-07567929dad2-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-f49fv\" (UID: \"255c2bdc-59bb-48e2-beaf-07567929dad2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-f49fv" Jun 03 23:35:30.718729 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:30.718565 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/255c2bdc-59bb-48e2-beaf-07567929dad2-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-f49fv\" (UID: \"255c2bdc-59bb-48e2-beaf-07567929dad2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-f49fv" Jun 03 23:35:30.718729 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:30.718592 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/255c2bdc-59bb-48e2-beaf-07567929dad2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-f49fv\" (UID: \"255c2bdc-59bb-48e2-beaf-07567929dad2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-f49fv" Jun 03 23:35:30.718931 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:30.718736 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/255c2bdc-59bb-48e2-beaf-07567929dad2-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-f49fv\" (UID: \"255c2bdc-59bb-48e2-beaf-07567929dad2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-f49fv" Jun 03 23:35:30.718931 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:30.718805 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4276\" (UniqueName: \"kubernetes.io/projected/255c2bdc-59bb-48e2-beaf-07567929dad2-kube-api-access-r4276\") pod \"maas-default-gateway-openshift-default-8559cd5744-f49fv\" (UID: \"255c2bdc-59bb-48e2-beaf-07567929dad2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-f49fv" Jun 03 23:35:30.718931 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:30.718864 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/255c2bdc-59bb-48e2-beaf-07567929dad2-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-f49fv\" (UID: \"255c2bdc-59bb-48e2-beaf-07567929dad2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-f49fv" Jun 03 23:35:30.718931 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:30.718898 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/255c2bdc-59bb-48e2-beaf-07567929dad2-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-f49fv\" (UID: \"255c2bdc-59bb-48e2-beaf-07567929dad2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-f49fv" Jun 03 23:35:30.719121 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:30.718969 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/255c2bdc-59bb-48e2-beaf-07567929dad2-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-f49fv\" (UID: \"255c2bdc-59bb-48e2-beaf-07567929dad2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-f49fv" Jun 03 23:35:30.719191 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:30.719162 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/255c2bdc-59bb-48e2-beaf-07567929dad2-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-f49fv\" (UID: \"255c2bdc-59bb-48e2-beaf-07567929dad2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-f49fv" Jun 03 23:35:30.719268 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:30.719201 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/255c2bdc-59bb-48e2-beaf-07567929dad2-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-f49fv\" (UID: \"255c2bdc-59bb-48e2-beaf-07567929dad2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-f49fv" Jun 03 23:35:30.719358 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:30.719272 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/255c2bdc-59bb-48e2-beaf-07567929dad2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-f49fv\" (UID: \"255c2bdc-59bb-48e2-beaf-07567929dad2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-f49fv" Jun 03 23:35:30.720987 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:30.720965 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/255c2bdc-59bb-48e2-beaf-07567929dad2-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-f49fv\" (UID: \"255c2bdc-59bb-48e2-beaf-07567929dad2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-f49fv" Jun 03 23:35:30.721197 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:30.721179 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/255c2bdc-59bb-48e2-beaf-07567929dad2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-f49fv\" (UID: \"255c2bdc-59bb-48e2-beaf-07567929dad2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-f49fv" Jun 03 23:35:30.730015 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:30.729971 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/255c2bdc-59bb-48e2-beaf-07567929dad2-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-f49fv\" (UID: \"255c2bdc-59bb-48e2-beaf-07567929dad2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-f49fv" Jun 03 23:35:30.730015 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:30.729993 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4276\" (UniqueName: \"kubernetes.io/projected/255c2bdc-59bb-48e2-beaf-07567929dad2-kube-api-access-r4276\") pod \"maas-default-gateway-openshift-default-8559cd5744-f49fv\" (UID: \"255c2bdc-59bb-48e2-beaf-07567929dad2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-f49fv" Jun 03 23:35:30.802013 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:30.801920 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-f49fv" Jun 03 23:35:30.948651 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:30.948626 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-f49fv"] Jun 03 23:35:30.950269 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:35:30.950240 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod255c2bdc_59bb_48e2_beaf_07567929dad2.slice/crio-ce71abc290c9cb6c06c5cedb50736b0e26e2664d41725c13aedc99cdfe6dd296 WatchSource:0}: Error finding container ce71abc290c9cb6c06c5cedb50736b0e26e2664d41725c13aedc99cdfe6dd296: Status 404 returned error can't find the container with id ce71abc290c9cb6c06c5cedb50736b0e26e2664d41725c13aedc99cdfe6dd296 Jun 03 23:35:30.952276 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:30.952243 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 03 23:35:30.952353 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:30.952336 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 03 23:35:30.952390 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:30.952365 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 03 23:35:31.175670 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:31.175631 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-f49fv" event={"ID":"255c2bdc-59bb-48e2-beaf-07567929dad2","Type":"ContainerStarted","Data":"fc3d7b4e016d969dc94651456397441c7586eba4ad7da5d4cf70b33b721ab393"} Jun 03 23:35:31.175853 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:31.175695 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-f49fv" event={"ID":"255c2bdc-59bb-48e2-beaf-07567929dad2","Type":"ContainerStarted","Data":"ce71abc290c9cb6c06c5cedb50736b0e26e2664d41725c13aedc99cdfe6dd296"} Jun 03 23:35:31.237413 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:31.237360 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-f49fv" podStartSLOduration=1.237342093 podStartE2EDuration="1.237342093s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:35:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:35:31.2359694 +0000 UTC m=+652.043189865" watchObservedRunningTime="2026-06-03 23:35:31.237342093 +0000 UTC m=+652.044562557" Jun 03 23:35:31.803066 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:31.803020 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-f49fv" Jun 03 23:35:32.806898 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:32.806870 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-f49fv" Jun 03 23:35:33.189649 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:33.189624 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-f49fv" Jun 03 23:35:33.190682 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:33.190663 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-f49fv" Jun 03 23:35:46.345807 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:46.345774 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-vkmzf"] Jun 03 23:35:46.350864 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:46.350842 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-vkmzf" Jun 03 23:35:46.353968 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:46.353941 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-8nbw9\"" Jun 03 23:35:46.355724 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:46.355672 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-vkmzf"] Jun 03 23:35:46.470650 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:46.470614 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtc96\" (UniqueName: \"kubernetes.io/projected/4a775d04-a2d6-4617-a718-d3bb75c679f2-kube-api-access-gtc96\") pod \"authorino-58cd955675-vkmzf\" (UID: \"4a775d04-a2d6-4617-a718-d3bb75c679f2\") " pod="kuadrant-system/authorino-58cd955675-vkmzf" Jun 03 23:35:46.571968 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:46.571930 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtc96\" (UniqueName: \"kubernetes.io/projected/4a775d04-a2d6-4617-a718-d3bb75c679f2-kube-api-access-gtc96\") pod \"authorino-58cd955675-vkmzf\" (UID: \"4a775d04-a2d6-4617-a718-d3bb75c679f2\") " pod="kuadrant-system/authorino-58cd955675-vkmzf" Jun 03 23:35:46.581270 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:46.581243 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtc96\" (UniqueName: \"kubernetes.io/projected/4a775d04-a2d6-4617-a718-d3bb75c679f2-kube-api-access-gtc96\") pod \"authorino-58cd955675-vkmzf\" (UID: \"4a775d04-a2d6-4617-a718-d3bb75c679f2\") " pod="kuadrant-system/authorino-58cd955675-vkmzf" Jun 03 23:35:46.670497 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:46.670453 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-vkmzf" Jun 03 23:35:46.800496 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:46.800473 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-vkmzf"] Jun 03 23:35:46.802673 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:35:46.802645 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4a775d04_a2d6_4617_a718_d3bb75c679f2.slice/crio-d02fb84c4dfe03229fc98e829b86297977acb0569dc23ee6e8a11982c3d4017e WatchSource:0}: Error finding container d02fb84c4dfe03229fc98e829b86297977acb0569dc23ee6e8a11982c3d4017e: Status 404 returned error can't find the container with id d02fb84c4dfe03229fc98e829b86297977acb0569dc23ee6e8a11982c3d4017e Jun 03 23:35:47.262210 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:47.262173 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-vkmzf" event={"ID":"4a775d04-a2d6-4617-a718-d3bb75c679f2","Type":"ContainerStarted","Data":"d02fb84c4dfe03229fc98e829b86297977acb0569dc23ee6e8a11982c3d4017e"} Jun 03 23:35:50.281001 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:50.280970 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-vkmzf" event={"ID":"4a775d04-a2d6-4617-a718-d3bb75c679f2","Type":"ContainerStarted","Data":"1a7e47efa99269fea83ec3ecd6af4c58ae29825b8f9cc98e1d442dff9d108917"} Jun 03 23:35:50.300343 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:50.300278 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-vkmzf" podStartSLOduration=1.274442094 podStartE2EDuration="4.300259897s" totalImagesPullingTime="3.025817803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:35:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:35:50.298631275 +0000 UTC m=+671.105851730" watchObservedRunningTime="2026-06-03 23:35:50.300259897 +0000 UTC m=+671.107480360" Jun 03 23:35:50.643777 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:50.643694 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-vkmzf"] Jun 03 23:35:52.293160 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:52.293117 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-vkmzf" podUID="4a775d04-a2d6-4617-a718-d3bb75c679f2" containerName="authorino" containerID="cri-o://1a7e47efa99269fea83ec3ecd6af4c58ae29825b8f9cc98e1d442dff9d108917" gracePeriod=30 Jun 03 23:35:52.547635 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:52.547559 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-vkmzf" Jun 03 23:35:52.633918 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:52.633883 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gtc96\" (UniqueName: \"kubernetes.io/projected/4a775d04-a2d6-4617-a718-d3bb75c679f2-kube-api-access-gtc96\") pod \"4a775d04-a2d6-4617-a718-d3bb75c679f2\" (UID: \"4a775d04-a2d6-4617-a718-d3bb75c679f2\") " Jun 03 23:35:52.636003 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:52.635966 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a775d04-a2d6-4617-a718-d3bb75c679f2-kube-api-access-gtc96" (OuterVolumeSpecName: "kube-api-access-gtc96") pod "4a775d04-a2d6-4617-a718-d3bb75c679f2" (UID: "4a775d04-a2d6-4617-a718-d3bb75c679f2"). InnerVolumeSpecName "kube-api-access-gtc96". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:35:52.735313 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:52.735254 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gtc96\" (UniqueName: \"kubernetes.io/projected/4a775d04-a2d6-4617-a718-d3bb75c679f2-kube-api-access-gtc96\") on node \"ip-10-0-135-242.ec2.internal\" DevicePath \"\"" Jun 03 23:35:53.299160 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:53.299128 2574 generic.go:356] "Generic (PLEG): container finished" podID="4a775d04-a2d6-4617-a718-d3bb75c679f2" containerID="1a7e47efa99269fea83ec3ecd6af4c58ae29825b8f9cc98e1d442dff9d108917" exitCode=0 Jun 03 23:35:53.299649 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:53.299168 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-vkmzf" Jun 03 23:35:53.299649 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:53.299214 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-vkmzf" event={"ID":"4a775d04-a2d6-4617-a718-d3bb75c679f2","Type":"ContainerDied","Data":"1a7e47efa99269fea83ec3ecd6af4c58ae29825b8f9cc98e1d442dff9d108917"} Jun 03 23:35:53.299649 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:53.299257 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-vkmzf" event={"ID":"4a775d04-a2d6-4617-a718-d3bb75c679f2","Type":"ContainerDied","Data":"d02fb84c4dfe03229fc98e829b86297977acb0569dc23ee6e8a11982c3d4017e"} Jun 03 23:35:53.299649 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:53.299284 2574 scope.go:117] "RemoveContainer" containerID="1a7e47efa99269fea83ec3ecd6af4c58ae29825b8f9cc98e1d442dff9d108917" Jun 03 23:35:53.308314 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:53.308275 2574 scope.go:117] "RemoveContainer" containerID="1a7e47efa99269fea83ec3ecd6af4c58ae29825b8f9cc98e1d442dff9d108917" Jun 03 23:35:53.308555 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:35:53.308535 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a7e47efa99269fea83ec3ecd6af4c58ae29825b8f9cc98e1d442dff9d108917\": container with ID starting with 1a7e47efa99269fea83ec3ecd6af4c58ae29825b8f9cc98e1d442dff9d108917 not found: ID does not exist" containerID="1a7e47efa99269fea83ec3ecd6af4c58ae29825b8f9cc98e1d442dff9d108917" Jun 03 23:35:53.308623 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:53.308567 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a7e47efa99269fea83ec3ecd6af4c58ae29825b8f9cc98e1d442dff9d108917"} err="failed to get container status \"1a7e47efa99269fea83ec3ecd6af4c58ae29825b8f9cc98e1d442dff9d108917\": rpc error: code = NotFound desc = could not find container \"1a7e47efa99269fea83ec3ecd6af4c58ae29825b8f9cc98e1d442dff9d108917\": container with ID starting with 1a7e47efa99269fea83ec3ecd6af4c58ae29825b8f9cc98e1d442dff9d108917 not found: ID does not exist" Jun 03 23:35:53.320930 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:53.320903 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-vkmzf"] Jun 03 23:35:53.324690 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:53.324669 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-vkmzf"] Jun 03 23:35:53.656556 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:35:53.656476 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a775d04-a2d6-4617-a718-d3bb75c679f2" path="/var/lib/kubelet/pods/4a775d04-a2d6-4617-a718-d3bb75c679f2/volumes" Jun 03 23:36:06.197677 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:36:06.197645 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-tjqck"] Jun 03 23:36:06.198321 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:36:06.198275 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a775d04-a2d6-4617-a718-d3bb75c679f2" containerName="authorino" Jun 03 23:36:06.198553 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:36:06.198533 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a775d04-a2d6-4617-a718-d3bb75c679f2" containerName="authorino" Jun 03 23:36:06.198708 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:36:06.198695 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a775d04-a2d6-4617-a718-d3bb75c679f2" containerName="authorino" Jun 03 23:36:06.202269 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:36:06.202248 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-tjqck" Jun 03 23:36:06.205248 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:36:06.205222 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 03 23:36:06.209166 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:36:06.209143 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-tjqck"] Jun 03 23:36:06.269905 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:36:06.269855 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d947s\" (UniqueName: \"kubernetes.io/projected/65f8a1de-358f-440e-bda5-c450f43820ff-kube-api-access-d947s\") pod \"postgres-69fb4594cf-tjqck\" (UID: \"65f8a1de-358f-440e-bda5-c450f43820ff\") " pod="opendatahub/postgres-69fb4594cf-tjqck" Jun 03 23:36:06.270109 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:36:06.269993 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/65f8a1de-358f-440e-bda5-c450f43820ff-data\") pod \"postgres-69fb4594cf-tjqck\" (UID: \"65f8a1de-358f-440e-bda5-c450f43820ff\") " pod="opendatahub/postgres-69fb4594cf-tjqck" Jun 03 23:36:06.370729 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:36:06.370690 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/65f8a1de-358f-440e-bda5-c450f43820ff-data\") pod \"postgres-69fb4594cf-tjqck\" (UID: \"65f8a1de-358f-440e-bda5-c450f43820ff\") " pod="opendatahub/postgres-69fb4594cf-tjqck" Jun 03 23:36:06.370925 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:36:06.370772 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d947s\" (UniqueName: \"kubernetes.io/projected/65f8a1de-358f-440e-bda5-c450f43820ff-kube-api-access-d947s\") pod \"postgres-69fb4594cf-tjqck\" (UID: \"65f8a1de-358f-440e-bda5-c450f43820ff\") " pod="opendatahub/postgres-69fb4594cf-tjqck" Jun 03 23:36:06.371071 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:36:06.371050 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/65f8a1de-358f-440e-bda5-c450f43820ff-data\") pod \"postgres-69fb4594cf-tjqck\" (UID: \"65f8a1de-358f-440e-bda5-c450f43820ff\") " pod="opendatahub/postgres-69fb4594cf-tjqck" Jun 03 23:36:06.382629 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:36:06.382599 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d947s\" (UniqueName: \"kubernetes.io/projected/65f8a1de-358f-440e-bda5-c450f43820ff-kube-api-access-d947s\") pod \"postgres-69fb4594cf-tjqck\" (UID: \"65f8a1de-358f-440e-bda5-c450f43820ff\") " pod="opendatahub/postgres-69fb4594cf-tjqck" Jun 03 23:36:06.516382 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:36:06.516271 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-tjqck" Jun 03 23:36:06.650755 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:36:06.650722 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-tjqck"] Jun 03 23:36:06.652851 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:36:06.652826 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65f8a1de_358f_440e_bda5_c450f43820ff.slice/crio-b801f1e7fca0bcaa417b104d6f0d3edf5af556e0e65d027611551bebdd6b23bc WatchSource:0}: Error finding container b801f1e7fca0bcaa417b104d6f0d3edf5af556e0e65d027611551bebdd6b23bc: Status 404 returned error can't find the container with id b801f1e7fca0bcaa417b104d6f0d3edf5af556e0e65d027611551bebdd6b23bc Jun 03 23:36:07.367386 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:36:07.367345 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-tjqck" event={"ID":"65f8a1de-358f-440e-bda5-c450f43820ff","Type":"ContainerStarted","Data":"b801f1e7fca0bcaa417b104d6f0d3edf5af556e0e65d027611551bebdd6b23bc"} Jun 03 23:36:09.379278 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:36:09.379245 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-tjqck" event={"ID":"65f8a1de-358f-440e-bda5-c450f43820ff","Type":"ContainerStarted","Data":"07129fe829bdabaaebfdbfd9813951591f9f84326013df479e3ef1abb47bfd27"} Jun 03 23:36:09.379692 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:36:09.379356 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-tjqck" Jun 03 23:36:09.410370 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:36:09.410260 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-tjqck" podStartSLOduration=1.431747307 podStartE2EDuration="3.410236892s" totalImagesPullingTime="1.978489585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:36:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:36:09.408696376 +0000 UTC m=+690.215916841" watchObservedRunningTime="2026-06-03 23:36:09.410236892 +0000 UTC m=+690.217457358" Jun 03 23:36:15.414461 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:36:15.414432 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-tjqck" Jun 03 23:37:09.832434 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:09.832404 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-fdb6m"] Jun 03 23:37:09.835858 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:09.835837 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-fdb6m" Jun 03 23:37:09.838714 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:09.838691 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-8nbw9\"" Jun 03 23:37:09.843630 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:09.843607 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-fdb6m"] Jun 03 23:37:09.951117 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:09.951083 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tz48\" (UniqueName: \"kubernetes.io/projected/45b57b1b-4def-4edb-ba51-a371319b9382-kube-api-access-7tz48\") pod \"authorino-5d4b67c446-fdb6m\" (UID: \"45b57b1b-4def-4edb-ba51-a371319b9382\") " pod="kuadrant-system/authorino-5d4b67c446-fdb6m" Jun 03 23:37:10.052207 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:10.052166 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tz48\" (UniqueName: \"kubernetes.io/projected/45b57b1b-4def-4edb-ba51-a371319b9382-kube-api-access-7tz48\") pod \"authorino-5d4b67c446-fdb6m\" (UID: \"45b57b1b-4def-4edb-ba51-a371319b9382\") " pod="kuadrant-system/authorino-5d4b67c446-fdb6m" Jun 03 23:37:10.064043 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:10.064017 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tz48\" (UniqueName: \"kubernetes.io/projected/45b57b1b-4def-4edb-ba51-a371319b9382-kube-api-access-7tz48\") pod \"authorino-5d4b67c446-fdb6m\" (UID: \"45b57b1b-4def-4edb-ba51-a371319b9382\") " pod="kuadrant-system/authorino-5d4b67c446-fdb6m" Jun 03 23:37:10.077103 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:10.077071 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-fdb6m"] Jun 03 23:37:10.077413 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:10.077380 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-fdb6m" Jun 03 23:37:10.102555 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:10.102528 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5bf7df756-6cfsz"] Jun 03 23:37:10.106134 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:10.106111 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bf7df756-6cfsz" Jun 03 23:37:10.112939 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:10.112913 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5bf7df756-6cfsz"] Jun 03 23:37:10.153285 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:10.153249 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7ftd\" (UniqueName: \"kubernetes.io/projected/9dc4c4a6-9013-452d-8090-67e9c4debc20-kube-api-access-h7ftd\") pod \"authorino-5bf7df756-6cfsz\" (UID: \"9dc4c4a6-9013-452d-8090-67e9c4debc20\") " pod="kuadrant-system/authorino-5bf7df756-6cfsz" Jun 03 23:37:10.216042 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:10.216017 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-fdb6m"] Jun 03 23:37:10.218417 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:37:10.218391 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod45b57b1b_4def_4edb_ba51_a371319b9382.slice/crio-03831431a2c228500eea97c90db9384ded7f92b59a87033514e0438188155a9b WatchSource:0}: Error finding container 03831431a2c228500eea97c90db9384ded7f92b59a87033514e0438188155a9b: Status 404 returned error can't find the container with id 03831431a2c228500eea97c90db9384ded7f92b59a87033514e0438188155a9b Jun 03 23:37:10.254651 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:10.254619 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7ftd\" (UniqueName: \"kubernetes.io/projected/9dc4c4a6-9013-452d-8090-67e9c4debc20-kube-api-access-h7ftd\") pod \"authorino-5bf7df756-6cfsz\" (UID: \"9dc4c4a6-9013-452d-8090-67e9c4debc20\") " pod="kuadrant-system/authorino-5bf7df756-6cfsz" Jun 03 23:37:10.265355 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:10.265332 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7ftd\" (UniqueName: \"kubernetes.io/projected/9dc4c4a6-9013-452d-8090-67e9c4debc20-kube-api-access-h7ftd\") pod \"authorino-5bf7df756-6cfsz\" (UID: \"9dc4c4a6-9013-452d-8090-67e9c4debc20\") " pod="kuadrant-system/authorino-5bf7df756-6cfsz" Jun 03 23:37:10.379726 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:10.379634 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5bf7df756-6cfsz"] Jun 03 23:37:10.379945 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:10.379929 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bf7df756-6cfsz" Jun 03 23:37:10.411835 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:10.411803 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b4468484-r78c4"] Jun 03 23:37:10.415449 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:10.415426 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b4468484-r78c4" Jun 03 23:37:10.419205 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:10.419183 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 03 23:37:10.426374 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:10.426267 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b4468484-r78c4"] Jun 03 23:37:10.456627 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:10.456596 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2gn7\" (UniqueName: \"kubernetes.io/projected/3c3c5e17-7aec-4382-8afe-8d47ec5b932f-kube-api-access-k2gn7\") pod \"authorino-b4468484-r78c4\" (UID: \"3c3c5e17-7aec-4382-8afe-8d47ec5b932f\") " pod="kuadrant-system/authorino-b4468484-r78c4" Jun 03 23:37:10.456800 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:10.456732 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3c3c5e17-7aec-4382-8afe-8d47ec5b932f-tls-cert\") pod \"authorino-b4468484-r78c4\" (UID: \"3c3c5e17-7aec-4382-8afe-8d47ec5b932f\") " pod="kuadrant-system/authorino-b4468484-r78c4" Jun 03 23:37:10.522200 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:10.522175 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5bf7df756-6cfsz"] Jun 03 23:37:10.524685 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:37:10.524650 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9dc4c4a6_9013_452d_8090_67e9c4debc20.slice/crio-6904f9e77b8575bdd7c6eadafab0d8f48a8f8974036913b10aee8a7a60416dc8 WatchSource:0}: Error finding container 6904f9e77b8575bdd7c6eadafab0d8f48a8f8974036913b10aee8a7a60416dc8: Status 404 returned error can't find the container with id 6904f9e77b8575bdd7c6eadafab0d8f48a8f8974036913b10aee8a7a60416dc8 Jun 03 23:37:10.557558 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:10.557523 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3c3c5e17-7aec-4382-8afe-8d47ec5b932f-tls-cert\") pod \"authorino-b4468484-r78c4\" (UID: \"3c3c5e17-7aec-4382-8afe-8d47ec5b932f\") " pod="kuadrant-system/authorino-b4468484-r78c4" Jun 03 23:37:10.557705 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:10.557596 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2gn7\" (UniqueName: \"kubernetes.io/projected/3c3c5e17-7aec-4382-8afe-8d47ec5b932f-kube-api-access-k2gn7\") pod \"authorino-b4468484-r78c4\" (UID: \"3c3c5e17-7aec-4382-8afe-8d47ec5b932f\") " pod="kuadrant-system/authorino-b4468484-r78c4" Jun 03 23:37:10.559922 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:10.559889 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3c3c5e17-7aec-4382-8afe-8d47ec5b932f-tls-cert\") pod \"authorino-b4468484-r78c4\" (UID: \"3c3c5e17-7aec-4382-8afe-8d47ec5b932f\") " pod="kuadrant-system/authorino-b4468484-r78c4" Jun 03 23:37:10.575634 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:10.575604 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2gn7\" (UniqueName: \"kubernetes.io/projected/3c3c5e17-7aec-4382-8afe-8d47ec5b932f-kube-api-access-k2gn7\") pod \"authorino-b4468484-r78c4\" (UID: \"3c3c5e17-7aec-4382-8afe-8d47ec5b932f\") " pod="kuadrant-system/authorino-b4468484-r78c4" Jun 03 23:37:10.666382 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:10.666331 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bf7df756-6cfsz" event={"ID":"9dc4c4a6-9013-452d-8090-67e9c4debc20","Type":"ContainerStarted","Data":"6904f9e77b8575bdd7c6eadafab0d8f48a8f8974036913b10aee8a7a60416dc8"} Jun 03 23:37:10.668052 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:10.668026 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-fdb6m" event={"ID":"45b57b1b-4def-4edb-ba51-a371319b9382","Type":"ContainerStarted","Data":"ce660ac422633fbeaf34100b66103b22ae5668c878eb2f53386864f2e0768b9a"} Jun 03 23:37:10.668187 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:10.668057 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-fdb6m" event={"ID":"45b57b1b-4def-4edb-ba51-a371319b9382","Type":"ContainerStarted","Data":"03831431a2c228500eea97c90db9384ded7f92b59a87033514e0438188155a9b"} Jun 03 23:37:10.668187 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:10.668108 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-fdb6m" podUID="45b57b1b-4def-4edb-ba51-a371319b9382" containerName="authorino" containerID="cri-o://ce660ac422633fbeaf34100b66103b22ae5668c878eb2f53386864f2e0768b9a" gracePeriod=30 Jun 03 23:37:10.705314 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:10.705246 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-fdb6m" podStartSLOduration=1.344404197 podStartE2EDuration="1.70523066s" totalImagesPullingTime="360.826463ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:37:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:37:10.704319401 +0000 UTC m=+751.511539855" watchObservedRunningTime="2026-06-03 23:37:10.70523066 +0000 UTC m=+751.512451124" Jun 03 23:37:10.727630 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:10.727597 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b4468484-r78c4" Jun 03 23:37:10.877124 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:10.876867 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b4468484-r78c4"] Jun 03 23:37:10.879553 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:37:10.879525 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3c3c5e17_7aec_4382_8afe_8d47ec5b932f.slice/crio-57adfbc09b287feedcb1f821e6135d2f87d346614b89bee5d80c7cd3a0644d11 WatchSource:0}: Error finding container 57adfbc09b287feedcb1f821e6135d2f87d346614b89bee5d80c7cd3a0644d11: Status 404 returned error can't find the container with id 57adfbc09b287feedcb1f821e6135d2f87d346614b89bee5d80c7cd3a0644d11 Jun 03 23:37:10.934098 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:10.934070 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-fdb6m" Jun 03 23:37:10.963117 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:10.963085 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7tz48\" (UniqueName: \"kubernetes.io/projected/45b57b1b-4def-4edb-ba51-a371319b9382-kube-api-access-7tz48\") pod \"45b57b1b-4def-4edb-ba51-a371319b9382\" (UID: \"45b57b1b-4def-4edb-ba51-a371319b9382\") " Jun 03 23:37:10.965226 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:10.965191 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45b57b1b-4def-4edb-ba51-a371319b9382-kube-api-access-7tz48" (OuterVolumeSpecName: "kube-api-access-7tz48") pod "45b57b1b-4def-4edb-ba51-a371319b9382" (UID: "45b57b1b-4def-4edb-ba51-a371319b9382"). InnerVolumeSpecName "kube-api-access-7tz48". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:37:11.064615 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:11.064577 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7tz48\" (UniqueName: \"kubernetes.io/projected/45b57b1b-4def-4edb-ba51-a371319b9382-kube-api-access-7tz48\") on node \"ip-10-0-135-242.ec2.internal\" DevicePath \"\"" Jun 03 23:37:11.674581 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:11.674549 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b4468484-r78c4" event={"ID":"3c3c5e17-7aec-4382-8afe-8d47ec5b932f","Type":"ContainerStarted","Data":"19000fd1c5835bdbb3a5952129aed39bb05994d22c9fe84446c26e4aadf9c7b2"} Jun 03 23:37:11.674733 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:11.674595 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b4468484-r78c4" event={"ID":"3c3c5e17-7aec-4382-8afe-8d47ec5b932f","Type":"ContainerStarted","Data":"57adfbc09b287feedcb1f821e6135d2f87d346614b89bee5d80c7cd3a0644d11"} Jun 03 23:37:11.676081 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:11.676055 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bf7df756-6cfsz" event={"ID":"9dc4c4a6-9013-452d-8090-67e9c4debc20","Type":"ContainerStarted","Data":"3cfd51f388b2cec39a42ac09a7f4d3c768e168d0f9a9a878eb12768bfe3720d4"} Jun 03 23:37:11.676191 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:11.676166 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5bf7df756-6cfsz" podUID="9dc4c4a6-9013-452d-8090-67e9c4debc20" containerName="authorino" containerID="cri-o://3cfd51f388b2cec39a42ac09a7f4d3c768e168d0f9a9a878eb12768bfe3720d4" gracePeriod=30 Jun 03 23:37:11.677311 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:11.677265 2574 generic.go:356] "Generic (PLEG): container finished" podID="45b57b1b-4def-4edb-ba51-a371319b9382" containerID="ce660ac422633fbeaf34100b66103b22ae5668c878eb2f53386864f2e0768b9a" exitCode=0 Jun 03 23:37:11.677406 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:11.677323 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-fdb6m" event={"ID":"45b57b1b-4def-4edb-ba51-a371319b9382","Type":"ContainerDied","Data":"ce660ac422633fbeaf34100b66103b22ae5668c878eb2f53386864f2e0768b9a"} Jun 03 23:37:11.677406 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:11.677356 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-fdb6m" event={"ID":"45b57b1b-4def-4edb-ba51-a371319b9382","Type":"ContainerDied","Data":"03831431a2c228500eea97c90db9384ded7f92b59a87033514e0438188155a9b"} Jun 03 23:37:11.677406 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:11.677326 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-fdb6m" Jun 03 23:37:11.677406 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:11.677372 2574 scope.go:117] "RemoveContainer" containerID="ce660ac422633fbeaf34100b66103b22ae5668c878eb2f53386864f2e0768b9a" Jun 03 23:37:11.686208 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:11.686188 2574 scope.go:117] "RemoveContainer" containerID="ce660ac422633fbeaf34100b66103b22ae5668c878eb2f53386864f2e0768b9a" Jun 03 23:37:11.686502 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:37:11.686480 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce660ac422633fbeaf34100b66103b22ae5668c878eb2f53386864f2e0768b9a\": container with ID starting with ce660ac422633fbeaf34100b66103b22ae5668c878eb2f53386864f2e0768b9a not found: ID does not exist" containerID="ce660ac422633fbeaf34100b66103b22ae5668c878eb2f53386864f2e0768b9a" Jun 03 23:37:11.686574 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:11.686515 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce660ac422633fbeaf34100b66103b22ae5668c878eb2f53386864f2e0768b9a"} err="failed to get container status \"ce660ac422633fbeaf34100b66103b22ae5668c878eb2f53386864f2e0768b9a\": rpc error: code = NotFound desc = could not find container \"ce660ac422633fbeaf34100b66103b22ae5668c878eb2f53386864f2e0768b9a\": container with ID starting with ce660ac422633fbeaf34100b66103b22ae5668c878eb2f53386864f2e0768b9a not found: ID does not exist" Jun 03 23:37:11.691828 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:11.691788 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b4468484-r78c4" podStartSLOduration=1.3826888880000001 podStartE2EDuration="1.691772346s" totalImagesPullingTime="309.083458ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:37:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:37:11.691439436 +0000 UTC m=+752.498659900" watchObservedRunningTime="2026-06-03 23:37:11.691772346 +0000 UTC m=+752.498992812" Jun 03 23:37:11.708178 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:11.708123 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5bf7df756-6cfsz" podStartSLOduration=1.414383793 podStartE2EDuration="1.708103105s" totalImagesPullingTime="293.719312ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:37:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:37:11.706924118 +0000 UTC m=+752.514144582" watchObservedRunningTime="2026-06-03 23:37:11.708103105 +0000 UTC m=+752.515323570" Jun 03 23:37:11.724895 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:11.724863 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-fdb6m"] Jun 03 23:37:11.726765 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:11.726740 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-fdb6m"] Jun 03 23:37:11.923112 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:11.923048 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bf7df756-6cfsz" Jun 03 23:37:11.972541 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:11.972508 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7ftd\" (UniqueName: \"kubernetes.io/projected/9dc4c4a6-9013-452d-8090-67e9c4debc20-kube-api-access-h7ftd\") pod \"9dc4c4a6-9013-452d-8090-67e9c4debc20\" (UID: \"9dc4c4a6-9013-452d-8090-67e9c4debc20\") " Jun 03 23:37:11.974625 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:11.974595 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9dc4c4a6-9013-452d-8090-67e9c4debc20-kube-api-access-h7ftd" (OuterVolumeSpecName: "kube-api-access-h7ftd") pod "9dc4c4a6-9013-452d-8090-67e9c4debc20" (UID: "9dc4c4a6-9013-452d-8090-67e9c4debc20"). InnerVolumeSpecName "kube-api-access-h7ftd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:37:12.073574 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:12.073547 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7ftd\" (UniqueName: \"kubernetes.io/projected/9dc4c4a6-9013-452d-8090-67e9c4debc20-kube-api-access-h7ftd\") on node \"ip-10-0-135-242.ec2.internal\" DevicePath \"\"" Jun 03 23:37:12.684234 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:12.684202 2574 generic.go:356] "Generic (PLEG): container finished" podID="9dc4c4a6-9013-452d-8090-67e9c4debc20" containerID="3cfd51f388b2cec39a42ac09a7f4d3c768e168d0f9a9a878eb12768bfe3720d4" exitCode=0 Jun 03 23:37:12.684449 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:12.684242 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bf7df756-6cfsz" Jun 03 23:37:12.684449 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:12.684276 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bf7df756-6cfsz" event={"ID":"9dc4c4a6-9013-452d-8090-67e9c4debc20","Type":"ContainerDied","Data":"3cfd51f388b2cec39a42ac09a7f4d3c768e168d0f9a9a878eb12768bfe3720d4"} Jun 03 23:37:12.684449 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:12.684331 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bf7df756-6cfsz" event={"ID":"9dc4c4a6-9013-452d-8090-67e9c4debc20","Type":"ContainerDied","Data":"6904f9e77b8575bdd7c6eadafab0d8f48a8f8974036913b10aee8a7a60416dc8"} Jun 03 23:37:12.684449 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:12.684349 2574 scope.go:117] "RemoveContainer" containerID="3cfd51f388b2cec39a42ac09a7f4d3c768e168d0f9a9a878eb12768bfe3720d4" Jun 03 23:37:12.693346 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:12.693329 2574 scope.go:117] "RemoveContainer" containerID="3cfd51f388b2cec39a42ac09a7f4d3c768e168d0f9a9a878eb12768bfe3720d4" Jun 03 23:37:12.693595 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:37:12.693572 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cfd51f388b2cec39a42ac09a7f4d3c768e168d0f9a9a878eb12768bfe3720d4\": container with ID starting with 3cfd51f388b2cec39a42ac09a7f4d3c768e168d0f9a9a878eb12768bfe3720d4 not found: ID does not exist" containerID="3cfd51f388b2cec39a42ac09a7f4d3c768e168d0f9a9a878eb12768bfe3720d4" Jun 03 23:37:12.693689 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:12.693600 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cfd51f388b2cec39a42ac09a7f4d3c768e168d0f9a9a878eb12768bfe3720d4"} err="failed to get container status \"3cfd51f388b2cec39a42ac09a7f4d3c768e168d0f9a9a878eb12768bfe3720d4\": rpc error: code = NotFound desc = could not find container \"3cfd51f388b2cec39a42ac09a7f4d3c768e168d0f9a9a878eb12768bfe3720d4\": container with ID starting with 3cfd51f388b2cec39a42ac09a7f4d3c768e168d0f9a9a878eb12768bfe3720d4 not found: ID does not exist" Jun 03 23:37:12.707394 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:12.707369 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5bf7df756-6cfsz"] Jun 03 23:37:12.711253 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:12.711232 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5bf7df756-6cfsz"] Jun 03 23:37:13.657910 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:13.657879 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45b57b1b-4def-4edb-ba51-a371319b9382" path="/var/lib/kubelet/pods/45b57b1b-4def-4edb-ba51-a371319b9382/volumes" Jun 03 23:37:13.658313 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:13.658221 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9dc4c4a6-9013-452d-8090-67e9c4debc20" path="/var/lib/kubelet/pods/9dc4c4a6-9013-452d-8090-67e9c4debc20/volumes" Jun 03 23:37:48.990060 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:48.990023 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-xg6dk"] Jun 03 23:37:48.990492 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:48.990423 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45b57b1b-4def-4edb-ba51-a371319b9382" containerName="authorino" Jun 03 23:37:48.990492 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:48.990435 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="45b57b1b-4def-4edb-ba51-a371319b9382" containerName="authorino" Jun 03 23:37:48.990492 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:48.990455 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9dc4c4a6-9013-452d-8090-67e9c4debc20" containerName="authorino" Jun 03 23:37:48.990492 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:48.990461 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dc4c4a6-9013-452d-8090-67e9c4debc20" containerName="authorino" Jun 03 23:37:48.990628 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:48.990529 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="45b57b1b-4def-4edb-ba51-a371319b9382" containerName="authorino" Jun 03 23:37:48.990628 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:48.990537 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9dc4c4a6-9013-452d-8090-67e9c4debc20" containerName="authorino" Jun 03 23:37:48.995114 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:48.995090 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-xg6dk" Jun 03 23:37:48.997837 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:48.997814 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 03 23:37:48.997993 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:48.997969 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-5kg5t\"" Jun 03 23:37:49.002551 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:49.002522 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-xg6dk"] Jun 03 23:37:49.017627 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:49.017592 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt4cm\" (UniqueName: \"kubernetes.io/projected/aa8ccb73-6b73-4dba-8b20-1e6e9638fa1c-kube-api-access-pt4cm\") pod \"payload-pre-processing-67d7689b65-xg6dk\" (UID: \"aa8ccb73-6b73-4dba-8b20-1e6e9638fa1c\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-xg6dk" Jun 03 23:37:49.119115 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:49.119081 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt4cm\" (UniqueName: \"kubernetes.io/projected/aa8ccb73-6b73-4dba-8b20-1e6e9638fa1c-kube-api-access-pt4cm\") pod \"payload-pre-processing-67d7689b65-xg6dk\" (UID: \"aa8ccb73-6b73-4dba-8b20-1e6e9638fa1c\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-xg6dk" Jun 03 23:37:49.127335 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:49.127305 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt4cm\" (UniqueName: \"kubernetes.io/projected/aa8ccb73-6b73-4dba-8b20-1e6e9638fa1c-kube-api-access-pt4cm\") pod \"payload-pre-processing-67d7689b65-xg6dk\" (UID: \"aa8ccb73-6b73-4dba-8b20-1e6e9638fa1c\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-xg6dk" Jun 03 23:37:49.307547 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:49.307461 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-xg6dk" Jun 03 23:37:49.444744 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:49.444719 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-xg6dk"] Jun 03 23:37:49.446521 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:37:49.446492 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa8ccb73_6b73_4dba_8b20_1e6e9638fa1c.slice/crio-c2a4f1447a73f9dde8148c13dcf87a84b21e18f452294d55bed824cac56a4c39 WatchSource:0}: Error finding container c2a4f1447a73f9dde8148c13dcf87a84b21e18f452294d55bed824cac56a4c39: Status 404 returned error can't find the container with id c2a4f1447a73f9dde8148c13dcf87a84b21e18f452294d55bed824cac56a4c39 Jun 03 23:37:49.448430 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:49.448414 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 23:37:49.864361 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:49.864321 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-xg6dk" event={"ID":"aa8ccb73-6b73-4dba-8b20-1e6e9638fa1c","Type":"ContainerStarted","Data":"c2a4f1447a73f9dde8148c13dcf87a84b21e18f452294d55bed824cac56a4c39"} Jun 03 23:37:52.890836 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:52.889902 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-xg6dk" event={"ID":"aa8ccb73-6b73-4dba-8b20-1e6e9638fa1c","Type":"ContainerStarted","Data":"c049deaf795a1acb0f7026a6226bf2fcf71c29c8fe8b6fc45cf9db78ae7b9654"} Jun 03 23:37:52.890836 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:52.890774 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-xg6dk" Jun 03 23:37:52.913802 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:52.913748 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-67d7689b65-xg6dk" podStartSLOduration=2.154502494 podStartE2EDuration="4.913731684s" totalImagesPullingTime="2.75922919s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:37:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:37:52.912024632 +0000 UTC m=+793.719245097" watchObservedRunningTime="2026-06-03 23:37:52.913731684 +0000 UTC m=+793.720952154" Jun 03 23:37:56.911787 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:56.911754 2574 generic.go:356] "Generic (PLEG): container finished" podID="255c2bdc-59bb-48e2-beaf-07567929dad2" containerID="fc3d7b4e016d969dc94651456397441c7586eba4ad7da5d4cf70b33b721ab393" exitCode=0 Jun 03 23:37:56.912274 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:56.911824 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-f49fv" event={"ID":"255c2bdc-59bb-48e2-beaf-07567929dad2","Type":"ContainerDied","Data":"fc3d7b4e016d969dc94651456397441c7586eba4ad7da5d4cf70b33b721ab393"} Jun 03 23:37:56.912274 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:56.912240 2574 scope.go:117] "RemoveContainer" containerID="fc3d7b4e016d969dc94651456397441c7586eba4ad7da5d4cf70b33b721ab393" Jun 03 23:37:56.913306 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:56.913265 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 03 23:37:56.913390 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:56.913372 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 03 23:37:56.913442 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:56.913425 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 03 23:37:57.918513 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:57.918479 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-f49fv" event={"ID":"255c2bdc-59bb-48e2-beaf-07567929dad2","Type":"ContainerStarted","Data":"8f9040dd6ab19574f7c995cfa656d1352ac6a7f5692f45e1d9a20edcfd0ee6ff"} Jun 03 23:37:58.802250 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:58.802203 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-f49fv" Jun 03 23:37:58.803907 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:58.803873 2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-f49fv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jun 03 23:37:58.804218 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:58.804184 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-f49fv" podUID="255c2bdc-59bb-48e2-beaf-07567929dad2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jun 03 23:37:59.802619 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:59.802584 2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-f49fv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jun 03 23:37:59.803203 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:37:59.803170 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-f49fv" podUID="255c2bdc-59bb-48e2-beaf-07567929dad2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jun 03 23:38:00.802601 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:38:00.802551 2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-f49fv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jun 03 23:38:00.802812 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:38:00.802627 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-f49fv" podUID="255c2bdc-59bb-48e2-beaf-07567929dad2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jun 03 23:38:01.802264 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:38:01.802233 2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-f49fv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jun 03 23:38:01.802457 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:38:01.802307 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-f49fv" podUID="255c2bdc-59bb-48e2-beaf-07567929dad2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jun 03 23:38:02.806951 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:38:02.806910 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-f49fv" Jun 03 23:38:02.807420 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:38:02.807199 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-f49fv" Jun 03 23:38:02.808044 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:38:02.808029 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-f49fv" Jun 03 23:38:04.903929 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:38:04.903897 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-xg6dk" Jun 03 23:38:37.610544 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:38:37.610506 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5db79cf446-4vq8c"] Jun 03 23:38:37.613103 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:38:37.613085 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5db79cf446-4vq8c" Jun 03 23:38:37.617804 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:38:37.617781 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 03 23:38:37.636382 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:38:37.636353 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5db79cf446-4vq8c"] Jun 03 23:38:37.684069 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:38:37.684029 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n24h7\" (UniqueName: \"kubernetes.io/projected/c4adeb98-1fd4-4701-bf45-8ad9c8b38bff-kube-api-access-n24h7\") pod \"authorino-5db79cf446-4vq8c\" (UID: \"c4adeb98-1fd4-4701-bf45-8ad9c8b38bff\") " pod="kuadrant-system/authorino-5db79cf446-4vq8c" Jun 03 23:38:37.684233 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:38:37.684093 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c4adeb98-1fd4-4701-bf45-8ad9c8b38bff-tls-cert\") pod \"authorino-5db79cf446-4vq8c\" (UID: \"c4adeb98-1fd4-4701-bf45-8ad9c8b38bff\") " pod="kuadrant-system/authorino-5db79cf446-4vq8c" Jun 03 23:38:37.684277 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:38:37.684232 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c4adeb98-1fd4-4701-bf45-8ad9c8b38bff-oidc-ca\") pod \"authorino-5db79cf446-4vq8c\" (UID: \"c4adeb98-1fd4-4701-bf45-8ad9c8b38bff\") " pod="kuadrant-system/authorino-5db79cf446-4vq8c" Jun 03 23:38:37.785500 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:38:37.785463 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n24h7\" (UniqueName: \"kubernetes.io/projected/c4adeb98-1fd4-4701-bf45-8ad9c8b38bff-kube-api-access-n24h7\") pod \"authorino-5db79cf446-4vq8c\" (UID: \"c4adeb98-1fd4-4701-bf45-8ad9c8b38bff\") " pod="kuadrant-system/authorino-5db79cf446-4vq8c" Jun 03 23:38:37.785699 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:38:37.785514 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c4adeb98-1fd4-4701-bf45-8ad9c8b38bff-tls-cert\") pod \"authorino-5db79cf446-4vq8c\" (UID: \"c4adeb98-1fd4-4701-bf45-8ad9c8b38bff\") " pod="kuadrant-system/authorino-5db79cf446-4vq8c" Jun 03 23:38:37.785699 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:38:37.785573 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c4adeb98-1fd4-4701-bf45-8ad9c8b38bff-oidc-ca\") pod \"authorino-5db79cf446-4vq8c\" (UID: \"c4adeb98-1fd4-4701-bf45-8ad9c8b38bff\") " pod="kuadrant-system/authorino-5db79cf446-4vq8c" Jun 03 23:38:37.786346 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:38:37.786325 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c4adeb98-1fd4-4701-bf45-8ad9c8b38bff-oidc-ca\") pod \"authorino-5db79cf446-4vq8c\" (UID: \"c4adeb98-1fd4-4701-bf45-8ad9c8b38bff\") " pod="kuadrant-system/authorino-5db79cf446-4vq8c" Jun 03 23:38:37.788091 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:38:37.788068 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c4adeb98-1fd4-4701-bf45-8ad9c8b38bff-tls-cert\") pod \"authorino-5db79cf446-4vq8c\" (UID: \"c4adeb98-1fd4-4701-bf45-8ad9c8b38bff\") " pod="kuadrant-system/authorino-5db79cf446-4vq8c" Jun 03 23:38:37.794678 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:38:37.794657 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n24h7\" (UniqueName: \"kubernetes.io/projected/c4adeb98-1fd4-4701-bf45-8ad9c8b38bff-kube-api-access-n24h7\") pod \"authorino-5db79cf446-4vq8c\" (UID: \"c4adeb98-1fd4-4701-bf45-8ad9c8b38bff\") " pod="kuadrant-system/authorino-5db79cf446-4vq8c" Jun 03 23:38:37.922798 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:38:37.922768 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5db79cf446-4vq8c" Jun 03 23:38:38.064385 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:38:38.064361 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5db79cf446-4vq8c"] Jun 03 23:38:38.066497 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:38:38.066468 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc4adeb98_1fd4_4701_bf45_8ad9c8b38bff.slice/crio-642737f532f8de86df43b63f09d1510dc954b9dac52477dcebed97467f6f5f5e WatchSource:0}: Error finding container 642737f532f8de86df43b63f09d1510dc954b9dac52477dcebed97467f6f5f5e: Status 404 returned error can't find the container with id 642737f532f8de86df43b63f09d1510dc954b9dac52477dcebed97467f6f5f5e Jun 03 23:38:38.111213 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:38:38.111184 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5db79cf446-4vq8c" event={"ID":"c4adeb98-1fd4-4701-bf45-8ad9c8b38bff","Type":"ContainerStarted","Data":"642737f532f8de86df43b63f09d1510dc954b9dac52477dcebed97467f6f5f5e"} Jun 03 23:38:39.118911 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:38:39.118872 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5db79cf446-4vq8c" event={"ID":"c4adeb98-1fd4-4701-bf45-8ad9c8b38bff","Type":"ContainerStarted","Data":"0a4e118ef5dd2f4e4337eb7d301d821d989b6a1c0253cf7974b1baaca135c89f"} Jun 03 23:38:39.138965 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:38:39.138916 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5db79cf446-4vq8c" podStartSLOduration=1.786585004 podStartE2EDuration="2.138896835s" totalImagesPullingTime="352.311831ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:38:39.136805661 +0000 UTC m=+839.944026129" watchObservedRunningTime="2026-06-03 23:38:39.138896835 +0000 UTC m=+839.946117298" Jun 03 23:38:39.166354 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:38:39.166321 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b4468484-r78c4"] Jun 03 23:38:39.166543 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:38:39.166520 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-b4468484-r78c4" podUID="3c3c5e17-7aec-4382-8afe-8d47ec5b932f" containerName="authorino" containerID="cri-o://19000fd1c5835bdbb3a5952129aed39bb05994d22c9fe84446c26e4aadf9c7b2" gracePeriod=30 Jun 03 23:38:39.435464 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:38:39.435436 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b4468484-r78c4" Jun 03 23:38:39.504357 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:38:39.504326 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k2gn7\" (UniqueName: \"kubernetes.io/projected/3c3c5e17-7aec-4382-8afe-8d47ec5b932f-kube-api-access-k2gn7\") pod \"3c3c5e17-7aec-4382-8afe-8d47ec5b932f\" (UID: \"3c3c5e17-7aec-4382-8afe-8d47ec5b932f\") " Jun 03 23:38:39.504549 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:38:39.504384 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3c3c5e17-7aec-4382-8afe-8d47ec5b932f-tls-cert\") pod \"3c3c5e17-7aec-4382-8afe-8d47ec5b932f\" (UID: \"3c3c5e17-7aec-4382-8afe-8d47ec5b932f\") " Jun 03 23:38:39.506485 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:38:39.506457 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c3c5e17-7aec-4382-8afe-8d47ec5b932f-kube-api-access-k2gn7" (OuterVolumeSpecName: "kube-api-access-k2gn7") pod "3c3c5e17-7aec-4382-8afe-8d47ec5b932f" (UID: "3c3c5e17-7aec-4382-8afe-8d47ec5b932f"). InnerVolumeSpecName "kube-api-access-k2gn7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:38:39.515043 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:38:39.515021 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c3c5e17-7aec-4382-8afe-8d47ec5b932f-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "3c3c5e17-7aec-4382-8afe-8d47ec5b932f" (UID: "3c3c5e17-7aec-4382-8afe-8d47ec5b932f"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 23:38:39.605461 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:38:39.605431 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2gn7\" (UniqueName: \"kubernetes.io/projected/3c3c5e17-7aec-4382-8afe-8d47ec5b932f-kube-api-access-k2gn7\") on node \"ip-10-0-135-242.ec2.internal\" DevicePath \"\"" Jun 03 23:38:39.605461 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:38:39.605456 2574 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3c3c5e17-7aec-4382-8afe-8d47ec5b932f-tls-cert\") on node \"ip-10-0-135-242.ec2.internal\" DevicePath \"\"" Jun 03 23:38:40.124659 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:38:40.124564 2574 generic.go:356] "Generic (PLEG): container finished" podID="3c3c5e17-7aec-4382-8afe-8d47ec5b932f" containerID="19000fd1c5835bdbb3a5952129aed39bb05994d22c9fe84446c26e4aadf9c7b2" exitCode=0 Jun 03 23:38:40.124659 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:38:40.124605 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b4468484-r78c4" Jun 03 23:38:40.124659 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:38:40.124641 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b4468484-r78c4" event={"ID":"3c3c5e17-7aec-4382-8afe-8d47ec5b932f","Type":"ContainerDied","Data":"19000fd1c5835bdbb3a5952129aed39bb05994d22c9fe84446c26e4aadf9c7b2"} Jun 03 23:38:40.125208 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:38:40.124684 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b4468484-r78c4" event={"ID":"3c3c5e17-7aec-4382-8afe-8d47ec5b932f","Type":"ContainerDied","Data":"57adfbc09b287feedcb1f821e6135d2f87d346614b89bee5d80c7cd3a0644d11"} Jun 03 23:38:40.125208 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:38:40.124706 2574 scope.go:117] "RemoveContainer" containerID="19000fd1c5835bdbb3a5952129aed39bb05994d22c9fe84446c26e4aadf9c7b2" Jun 03 23:38:40.133696 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:38:40.133673 2574 scope.go:117] "RemoveContainer" containerID="19000fd1c5835bdbb3a5952129aed39bb05994d22c9fe84446c26e4aadf9c7b2" Jun 03 23:38:40.133978 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:38:40.133958 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19000fd1c5835bdbb3a5952129aed39bb05994d22c9fe84446c26e4aadf9c7b2\": container with ID starting with 19000fd1c5835bdbb3a5952129aed39bb05994d22c9fe84446c26e4aadf9c7b2 not found: ID does not exist" containerID="19000fd1c5835bdbb3a5952129aed39bb05994d22c9fe84446c26e4aadf9c7b2" Jun 03 23:38:40.134056 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:38:40.133990 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19000fd1c5835bdbb3a5952129aed39bb05994d22c9fe84446c26e4aadf9c7b2"} err="failed to get container status \"19000fd1c5835bdbb3a5952129aed39bb05994d22c9fe84446c26e4aadf9c7b2\": rpc error: code = NotFound desc = could not find container \"19000fd1c5835bdbb3a5952129aed39bb05994d22c9fe84446c26e4aadf9c7b2\": container with ID starting with 19000fd1c5835bdbb3a5952129aed39bb05994d22c9fe84446c26e4aadf9c7b2 not found: ID does not exist" Jun 03 23:38:40.143523 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:38:40.143492 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b4468484-r78c4"] Jun 03 23:38:40.145327 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:38:40.145307 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b4468484-r78c4"] Jun 03 23:38:41.656622 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:38:41.656590 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c3c5e17-7aec-4382-8afe-8d47ec5b932f" path="/var/lib/kubelet/pods/3c3c5e17-7aec-4382-8afe-8d47ec5b932f/volumes" Jun 03 23:39:04.011284 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:04.011242 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jbpvm"] Jun 03 23:39:04.011709 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:04.011640 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c3c5e17-7aec-4382-8afe-8d47ec5b932f" containerName="authorino" Jun 03 23:39:04.011709 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:04.011652 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c3c5e17-7aec-4382-8afe-8d47ec5b932f" containerName="authorino" Jun 03 23:39:04.011797 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:04.011745 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c3c5e17-7aec-4382-8afe-8d47ec5b932f" containerName="authorino" Jun 03 23:39:04.014070 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:04.014035 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jbpvm" Jun 03 23:39:04.018216 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:04.018179 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-v9cnz\"" Jun 03 23:39:04.018216 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:04.018211 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 03 23:39:04.018418 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:04.018191 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 03 23:39:04.018418 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:04.018304 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 03 23:39:04.026425 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:04.026401 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jbpvm"] Jun 03 23:39:04.035356 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:04.035326 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2m2m\" (UniqueName: \"kubernetes.io/projected/f034ce3b-c646-465d-b905-33d61da135be-kube-api-access-t2m2m\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jbpvm\" (UID: \"f034ce3b-c646-465d-b905-33d61da135be\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jbpvm" Jun 03 23:39:04.035479 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:04.035362 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f034ce3b-c646-465d-b905-33d61da135be-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jbpvm\" (UID: \"f034ce3b-c646-465d-b905-33d61da135be\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jbpvm" Jun 03 23:39:04.035479 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:04.035465 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f034ce3b-c646-465d-b905-33d61da135be-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jbpvm\" (UID: \"f034ce3b-c646-465d-b905-33d61da135be\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jbpvm" Jun 03 23:39:04.035576 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:04.035498 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f034ce3b-c646-465d-b905-33d61da135be-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jbpvm\" (UID: \"f034ce3b-c646-465d-b905-33d61da135be\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jbpvm" Jun 03 23:39:04.035576 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:04.035523 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f034ce3b-c646-465d-b905-33d61da135be-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jbpvm\" (UID: \"f034ce3b-c646-465d-b905-33d61da135be\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jbpvm" Jun 03 23:39:04.035576 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:04.035562 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f034ce3b-c646-465d-b905-33d61da135be-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jbpvm\" (UID: \"f034ce3b-c646-465d-b905-33d61da135be\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jbpvm" Jun 03 23:39:04.136578 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:04.136541 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2m2m\" (UniqueName: \"kubernetes.io/projected/f034ce3b-c646-465d-b905-33d61da135be-kube-api-access-t2m2m\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jbpvm\" (UID: \"f034ce3b-c646-465d-b905-33d61da135be\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jbpvm" Jun 03 23:39:04.136779 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:04.136588 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f034ce3b-c646-465d-b905-33d61da135be-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jbpvm\" (UID: \"f034ce3b-c646-465d-b905-33d61da135be\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jbpvm" Jun 03 23:39:04.136779 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:04.136642 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f034ce3b-c646-465d-b905-33d61da135be-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jbpvm\" (UID: \"f034ce3b-c646-465d-b905-33d61da135be\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jbpvm" Jun 03 23:39:04.136779 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:04.136670 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f034ce3b-c646-465d-b905-33d61da135be-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jbpvm\" (UID: \"f034ce3b-c646-465d-b905-33d61da135be\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jbpvm" Jun 03 23:39:04.136779 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:04.136695 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f034ce3b-c646-465d-b905-33d61da135be-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jbpvm\" (UID: \"f034ce3b-c646-465d-b905-33d61da135be\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jbpvm" Jun 03 23:39:04.136779 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:04.136721 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f034ce3b-c646-465d-b905-33d61da135be-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jbpvm\" (UID: \"f034ce3b-c646-465d-b905-33d61da135be\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jbpvm" Jun 03 23:39:04.137135 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:04.137108 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f034ce3b-c646-465d-b905-33d61da135be-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jbpvm\" (UID: \"f034ce3b-c646-465d-b905-33d61da135be\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jbpvm" Jun 03 23:39:04.137225 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:04.137166 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f034ce3b-c646-465d-b905-33d61da135be-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jbpvm\" (UID: \"f034ce3b-c646-465d-b905-33d61da135be\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jbpvm" Jun 03 23:39:04.137280 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:04.137264 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f034ce3b-c646-465d-b905-33d61da135be-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jbpvm\" (UID: \"f034ce3b-c646-465d-b905-33d61da135be\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jbpvm" Jun 03 23:39:04.139077 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:04.139054 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f034ce3b-c646-465d-b905-33d61da135be-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jbpvm\" (UID: \"f034ce3b-c646-465d-b905-33d61da135be\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jbpvm" Jun 03 23:39:04.139361 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:04.139342 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f034ce3b-c646-465d-b905-33d61da135be-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jbpvm\" (UID: \"f034ce3b-c646-465d-b905-33d61da135be\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jbpvm" Jun 03 23:39:04.144837 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:04.144815 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2m2m\" (UniqueName: \"kubernetes.io/projected/f034ce3b-c646-465d-b905-33d61da135be-kube-api-access-t2m2m\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jbpvm\" (UID: \"f034ce3b-c646-465d-b905-33d61da135be\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jbpvm" Jun 03 23:39:04.326104 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:04.326003 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jbpvm" Jun 03 23:39:04.465358 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:04.465332 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jbpvm"] Jun 03 23:39:04.467060 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:39:04.467030 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf034ce3b_c646_465d_b905_33d61da135be.slice/crio-bbbbec84366ccd6b496f5be4b0288262d0d2f804fb5777b6dba4a384c417fc76 WatchSource:0}: Error finding container bbbbec84366ccd6b496f5be4b0288262d0d2f804fb5777b6dba4a384c417fc76: Status 404 returned error can't find the container with id bbbbec84366ccd6b496f5be4b0288262d0d2f804fb5777b6dba4a384c417fc76 Jun 03 23:39:05.251562 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:05.251482 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jbpvm" event={"ID":"f034ce3b-c646-465d-b905-33d61da135be","Type":"ContainerStarted","Data":"bbbbec84366ccd6b496f5be4b0288262d0d2f804fb5777b6dba4a384c417fc76"} Jun 03 23:39:08.273925 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:08.273891 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jbpvm" event={"ID":"f034ce3b-c646-465d-b905-33d61da135be","Type":"ContainerStarted","Data":"9ad6b2d6afde768d99f2f002a6cf50be76ae35f919f554e3e01c13f8407ab528"} Jun 03 23:39:10.285443 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:10.285407 2574 generic.go:356] "Generic (PLEG): container finished" podID="f034ce3b-c646-465d-b905-33d61da135be" containerID="9ad6b2d6afde768d99f2f002a6cf50be76ae35f919f554e3e01c13f8407ab528" exitCode=0 Jun 03 23:39:10.285952 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:10.285481 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jbpvm" event={"ID":"f034ce3b-c646-465d-b905-33d61da135be","Type":"ContainerDied","Data":"9ad6b2d6afde768d99f2f002a6cf50be76ae35f919f554e3e01c13f8407ab528"} Jun 03 23:39:12.300334 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:12.300274 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jbpvm" event={"ID":"f034ce3b-c646-465d-b905-33d61da135be","Type":"ContainerStarted","Data":"2a4f6e88e94104f8b02bcaf698312729102b467870bdf158b030b21e25fb0bd2"} Jun 03 23:39:12.321340 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:12.321256 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jbpvm" podStartSLOduration=3.353157831 podStartE2EDuration="9.321233678s" totalImagesPullingTime="4.634078674s" totalInitContainerRuntime="1.333997173s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:39:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:39:12.319863818 +0000 UTC m=+873.127084483" watchObservedRunningTime="2026-06-03 23:39:12.321233678 +0000 UTC m=+873.128454145" Jun 03 23:39:14.326730 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:14.326686 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jbpvm" Jun 03 23:39:14.327133 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:14.326756 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jbpvm" Jun 03 23:39:14.340074 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:14.340044 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jbpvm" Jun 03 23:39:15.328305 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:15.328268 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jbpvm" Jun 03 23:39:22.605913 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:22.605878 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fwscv"] Jun 03 23:39:22.609925 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:22.609907 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fwscv" Jun 03 23:39:22.612871 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:22.612844 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 03 23:39:22.622520 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:22.622489 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fwscv"] Jun 03 23:39:22.729253 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:22.729214 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e3a84e7-9ee6-4253-8143-a50796093e79-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fwscv\" (UID: \"9e3a84e7-9ee6-4253-8143-a50796093e79\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fwscv" Jun 03 23:39:22.729650 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:22.729618 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e3a84e7-9ee6-4253-8143-a50796093e79-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fwscv\" (UID: \"9e3a84e7-9ee6-4253-8143-a50796093e79\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fwscv" Jun 03 23:39:22.729830 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:22.729660 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e3a84e7-9ee6-4253-8143-a50796093e79-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fwscv\" (UID: \"9e3a84e7-9ee6-4253-8143-a50796093e79\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fwscv" Jun 03 23:39:22.729830 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:22.729802 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9e3a84e7-9ee6-4253-8143-a50796093e79-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fwscv\" (UID: \"9e3a84e7-9ee6-4253-8143-a50796093e79\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fwscv" Jun 03 23:39:22.729830 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:22.729837 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e3a84e7-9ee6-4253-8143-a50796093e79-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fwscv\" (UID: \"9e3a84e7-9ee6-4253-8143-a50796093e79\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fwscv" Jun 03 23:39:22.730211 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:22.729962 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wf4x\" (UniqueName: \"kubernetes.io/projected/9e3a84e7-9ee6-4253-8143-a50796093e79-kube-api-access-9wf4x\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fwscv\" (UID: \"9e3a84e7-9ee6-4253-8143-a50796093e79\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fwscv" Jun 03 23:39:22.830951 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:22.830912 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9e3a84e7-9ee6-4253-8143-a50796093e79-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fwscv\" (UID: \"9e3a84e7-9ee6-4253-8143-a50796093e79\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fwscv" Jun 03 23:39:22.830951 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:22.830955 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e3a84e7-9ee6-4253-8143-a50796093e79-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fwscv\" (UID: \"9e3a84e7-9ee6-4253-8143-a50796093e79\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fwscv" Jun 03 23:39:22.831165 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:22.831010 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wf4x\" (UniqueName: \"kubernetes.io/projected/9e3a84e7-9ee6-4253-8143-a50796093e79-kube-api-access-9wf4x\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fwscv\" (UID: \"9e3a84e7-9ee6-4253-8143-a50796093e79\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fwscv" Jun 03 23:39:22.831165 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:22.831077 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e3a84e7-9ee6-4253-8143-a50796093e79-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fwscv\" (UID: \"9e3a84e7-9ee6-4253-8143-a50796093e79\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fwscv" Jun 03 23:39:22.831165 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:22.831124 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e3a84e7-9ee6-4253-8143-a50796093e79-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fwscv\" (UID: \"9e3a84e7-9ee6-4253-8143-a50796093e79\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fwscv" Jun 03 23:39:22.831348 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:22.831261 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e3a84e7-9ee6-4253-8143-a50796093e79-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fwscv\" (UID: \"9e3a84e7-9ee6-4253-8143-a50796093e79\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fwscv" Jun 03 23:39:22.831511 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:22.831470 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9e3a84e7-9ee6-4253-8143-a50796093e79-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fwscv\" (UID: \"9e3a84e7-9ee6-4253-8143-a50796093e79\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fwscv" Jun 03 23:39:22.831696 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:22.831672 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e3a84e7-9ee6-4253-8143-a50796093e79-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fwscv\" (UID: \"9e3a84e7-9ee6-4253-8143-a50796093e79\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fwscv" Jun 03 23:39:22.831792 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:22.831733 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e3a84e7-9ee6-4253-8143-a50796093e79-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fwscv\" (UID: \"9e3a84e7-9ee6-4253-8143-a50796093e79\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fwscv" Jun 03 23:39:22.833375 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:22.833353 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e3a84e7-9ee6-4253-8143-a50796093e79-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fwscv\" (UID: \"9e3a84e7-9ee6-4253-8143-a50796093e79\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fwscv" Jun 03 23:39:22.833760 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:22.833742 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e3a84e7-9ee6-4253-8143-a50796093e79-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fwscv\" (UID: \"9e3a84e7-9ee6-4253-8143-a50796093e79\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fwscv" Jun 03 23:39:22.839724 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:22.839701 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wf4x\" (UniqueName: \"kubernetes.io/projected/9e3a84e7-9ee6-4253-8143-a50796093e79-kube-api-access-9wf4x\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fwscv\" (UID: \"9e3a84e7-9ee6-4253-8143-a50796093e79\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fwscv" Jun 03 23:39:22.947132 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:22.947099 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fwscv" Jun 03 23:39:23.090727 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:23.090696 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fwscv"] Jun 03 23:39:23.092793 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:39:23.092764 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e3a84e7_9ee6_4253_8143_a50796093e79.slice/crio-5bf5e5a71ae69b98ea161d73be54e32a6bd857f1e23c432d52ed93e71f7f89af WatchSource:0}: Error finding container 5bf5e5a71ae69b98ea161d73be54e32a6bd857f1e23c432d52ed93e71f7f89af: Status 404 returned error can't find the container with id 5bf5e5a71ae69b98ea161d73be54e32a6bd857f1e23c432d52ed93e71f7f89af Jun 03 23:39:23.357641 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:23.357552 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fwscv" event={"ID":"9e3a84e7-9ee6-4253-8143-a50796093e79","Type":"ContainerStarted","Data":"6ad9d0e1f4209e03204300ddeef13dce17b9fc7217d865fcd1416711525e77e9"} Jun 03 23:39:23.357641 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:23.357613 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fwscv" event={"ID":"9e3a84e7-9ee6-4253-8143-a50796093e79","Type":"ContainerStarted","Data":"5bf5e5a71ae69b98ea161d73be54e32a6bd857f1e23c432d52ed93e71f7f89af"} Jun 03 23:39:43.503374 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:43.503340 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqnhhb"] Jun 03 23:39:43.508065 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:43.508042 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqnhhb" Jun 03 23:39:43.510971 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:43.510950 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 03 23:39:43.520011 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:43.519981 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqnhhb"] Jun 03 23:39:43.538600 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:43.538569 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d8de677d-2526-4de7-bf30-4910e15ab67a-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqnhhb\" (UID: \"d8de677d-2526-4de7-bf30-4910e15ab67a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqnhhb" Jun 03 23:39:43.538760 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:43.538693 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8de677d-2526-4de7-bf30-4910e15ab67a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqnhhb\" (UID: \"d8de677d-2526-4de7-bf30-4910e15ab67a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqnhhb" Jun 03 23:39:43.538803 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:43.538763 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8de677d-2526-4de7-bf30-4910e15ab67a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqnhhb\" (UID: \"d8de677d-2526-4de7-bf30-4910e15ab67a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqnhhb" Jun 03 23:39:43.538803 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:43.538793 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8de677d-2526-4de7-bf30-4910e15ab67a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqnhhb\" (UID: \"d8de677d-2526-4de7-bf30-4910e15ab67a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqnhhb" Jun 03 23:39:43.538869 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:43.538827 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6nt8\" (UniqueName: \"kubernetes.io/projected/d8de677d-2526-4de7-bf30-4910e15ab67a-kube-api-access-k6nt8\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqnhhb\" (UID: \"d8de677d-2526-4de7-bf30-4910e15ab67a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqnhhb" Jun 03 23:39:43.538903 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:43.538867 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8de677d-2526-4de7-bf30-4910e15ab67a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqnhhb\" (UID: \"d8de677d-2526-4de7-bf30-4910e15ab67a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqnhhb" Jun 03 23:39:43.640424 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:43.640386 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8de677d-2526-4de7-bf30-4910e15ab67a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqnhhb\" (UID: \"d8de677d-2526-4de7-bf30-4910e15ab67a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqnhhb" Jun 03 23:39:43.640634 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:43.640434 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8de677d-2526-4de7-bf30-4910e15ab67a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqnhhb\" (UID: \"d8de677d-2526-4de7-bf30-4910e15ab67a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqnhhb" Jun 03 23:39:43.640634 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:43.640452 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6nt8\" (UniqueName: \"kubernetes.io/projected/d8de677d-2526-4de7-bf30-4910e15ab67a-kube-api-access-k6nt8\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqnhhb\" (UID: \"d8de677d-2526-4de7-bf30-4910e15ab67a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqnhhb" Jun 03 23:39:43.640634 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:43.640472 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8de677d-2526-4de7-bf30-4910e15ab67a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqnhhb\" (UID: \"d8de677d-2526-4de7-bf30-4910e15ab67a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqnhhb" Jun 03 23:39:43.640634 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:43.640597 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d8de677d-2526-4de7-bf30-4910e15ab67a-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqnhhb\" (UID: \"d8de677d-2526-4de7-bf30-4910e15ab67a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqnhhb" Jun 03 23:39:43.640857 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:43.640734 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8de677d-2526-4de7-bf30-4910e15ab67a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqnhhb\" (UID: \"d8de677d-2526-4de7-bf30-4910e15ab67a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqnhhb" Jun 03 23:39:43.640970 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:43.640938 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8de677d-2526-4de7-bf30-4910e15ab67a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqnhhb\" (UID: \"d8de677d-2526-4de7-bf30-4910e15ab67a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqnhhb" Jun 03 23:39:43.641080 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:43.640994 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d8de677d-2526-4de7-bf30-4910e15ab67a-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqnhhb\" (UID: \"d8de677d-2526-4de7-bf30-4910e15ab67a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqnhhb" Jun 03 23:39:43.641080 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:43.641030 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8de677d-2526-4de7-bf30-4910e15ab67a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqnhhb\" (UID: \"d8de677d-2526-4de7-bf30-4910e15ab67a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqnhhb" Jun 03 23:39:43.642903 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:43.642884 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8de677d-2526-4de7-bf30-4910e15ab67a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqnhhb\" (UID: \"d8de677d-2526-4de7-bf30-4910e15ab67a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqnhhb" Jun 03 23:39:43.643078 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:43.643062 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8de677d-2526-4de7-bf30-4910e15ab67a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqnhhb\" (UID: \"d8de677d-2526-4de7-bf30-4910e15ab67a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqnhhb" Jun 03 23:39:43.650135 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:43.650112 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6nt8\" (UniqueName: \"kubernetes.io/projected/d8de677d-2526-4de7-bf30-4910e15ab67a-kube-api-access-k6nt8\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqnhhb\" (UID: \"d8de677d-2526-4de7-bf30-4910e15ab67a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqnhhb" Jun 03 23:39:43.821341 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:43.821227 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqnhhb" Jun 03 23:39:43.963919 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:43.963890 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqnhhb"] Jun 03 23:39:43.966285 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:39:43.966243 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8de677d_2526_4de7_bf30_4910e15ab67a.slice/crio-b4fbd5176f8aeb9fab9aa0ed46d4a0721c43ac73a7113079d2c56338f3de41c9 WatchSource:0}: Error finding container b4fbd5176f8aeb9fab9aa0ed46d4a0721c43ac73a7113079d2c56338f3de41c9: Status 404 returned error can't find the container with id b4fbd5176f8aeb9fab9aa0ed46d4a0721c43ac73a7113079d2c56338f3de41c9 Jun 03 23:39:44.467730 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:44.467690 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqnhhb" event={"ID":"d8de677d-2526-4de7-bf30-4910e15ab67a","Type":"ContainerStarted","Data":"7b138d62ac7654ab5ab7c1c9ef1d17c64c080ae5d3912fb643f71ce1714079e9"} Jun 03 23:39:44.467947 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:44.467761 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqnhhb" event={"ID":"d8de677d-2526-4de7-bf30-4910e15ab67a","Type":"ContainerStarted","Data":"b4fbd5176f8aeb9fab9aa0ed46d4a0721c43ac73a7113079d2c56338f3de41c9"} Jun 03 23:39:45.474423 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:45.474390 2574 generic.go:356] "Generic (PLEG): container finished" podID="d8de677d-2526-4de7-bf30-4910e15ab67a" containerID="7b138d62ac7654ab5ab7c1c9ef1d17c64c080ae5d3912fb643f71ce1714079e9" exitCode=0 Jun 03 23:39:45.474896 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:45.474453 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqnhhb" event={"ID":"d8de677d-2526-4de7-bf30-4910e15ab67a","Type":"ContainerDied","Data":"7b138d62ac7654ab5ab7c1c9ef1d17c64c080ae5d3912fb643f71ce1714079e9"} Jun 03 23:39:46.482397 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:46.482362 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqnhhb" event={"ID":"d8de677d-2526-4de7-bf30-4910e15ab67a","Type":"ContainerStarted","Data":"6dfe0987e9ddaf3e160f4b3a5d751c3737c7207d2722da2982918470b9cdbe5f"} Jun 03 23:39:46.503073 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:46.503019 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqnhhb" podStartSLOduration=2.045501603 podStartE2EDuration="3.503003757s" totalImagesPullingTime="184.950576ms" totalInitContainerRuntime="1.272551578s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:39:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:39:46.501613076 +0000 UTC m=+907.308833553" watchObservedRunningTime="2026-06-03 23:39:46.503003757 +0000 UTC m=+907.310224221" Jun 03 23:39:53.821698 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:53.821653 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqnhhb" Jun 03 23:39:53.822130 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:53.821719 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqnhhb" Jun 03 23:39:53.834467 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:53.834438 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqnhhb" Jun 03 23:39:54.536761 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:39:54.536729 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqnhhb" Jun 03 23:40:15.635662 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:40:15.635627 2574 generic.go:356] "Generic (PLEG): container finished" podID="9e3a84e7-9ee6-4253-8143-a50796093e79" containerID="6ad9d0e1f4209e03204300ddeef13dce17b9fc7217d865fcd1416711525e77e9" exitCode=0 Jun 03 23:40:15.636083 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:40:15.635703 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fwscv" event={"ID":"9e3a84e7-9ee6-4253-8143-a50796093e79","Type":"ContainerDied","Data":"6ad9d0e1f4209e03204300ddeef13dce17b9fc7217d865fcd1416711525e77e9"} Jun 03 23:40:16.647944 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:40:16.647910 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fwscv" event={"ID":"9e3a84e7-9ee6-4253-8143-a50796093e79","Type":"ContainerStarted","Data":"152d428756443e70c62ed27a31e70703e8992e3bb3dda9a5c506b554d3cbf305"} Jun 03 23:40:16.668776 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:40:16.668723 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fwscv" podStartSLOduration=2.749834191 podStartE2EDuration="54.668709899s" totalImagesPullingTime="199.766297ms" totalInitContainerRuntime="51.719109411s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:39:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:40:16.667393597 +0000 UTC m=+937.474614062" watchObservedRunningTime="2026-06-03 23:40:16.668709899 +0000 UTC m=+937.475930363" Jun 03 23:40:22.948001 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:40:22.947970 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fwscv" Jun 03 23:40:22.948467 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:40:22.948028 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fwscv" Jun 03 23:40:22.960610 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:40:22.960586 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fwscv" Jun 03 23:40:23.699083 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:40:23.699049 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fwscv" Jun 03 23:40:56.019032 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:40:56.019000 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6b76b77c9-5pjqr"] Jun 03 23:40:56.022734 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:40:56.022713 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b76b77c9-5pjqr" Jun 03 23:40:56.028728 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:40:56.028706 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6b76b77c9-5pjqr"] Jun 03 23:40:56.069268 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:40:56.069234 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9bbj\" (UniqueName: \"kubernetes.io/projected/06750a1a-1cb4-4cd6-b2f6-11887f25e882-kube-api-access-k9bbj\") pod \"authorino-6b76b77c9-5pjqr\" (UID: \"06750a1a-1cb4-4cd6-b2f6-11887f25e882\") " pod="kuadrant-system/authorino-6b76b77c9-5pjqr" Jun 03 23:40:56.069448 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:40:56.069279 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/06750a1a-1cb4-4cd6-b2f6-11887f25e882-tls-cert\") pod \"authorino-6b76b77c9-5pjqr\" (UID: \"06750a1a-1cb4-4cd6-b2f6-11887f25e882\") " pod="kuadrant-system/authorino-6b76b77c9-5pjqr" Jun 03 23:40:56.069448 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:40:56.069321 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/06750a1a-1cb4-4cd6-b2f6-11887f25e882-oidc-ca\") pod \"authorino-6b76b77c9-5pjqr\" (UID: \"06750a1a-1cb4-4cd6-b2f6-11887f25e882\") " pod="kuadrant-system/authorino-6b76b77c9-5pjqr" Jun 03 23:40:56.170259 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:40:56.170223 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/06750a1a-1cb4-4cd6-b2f6-11887f25e882-tls-cert\") pod \"authorino-6b76b77c9-5pjqr\" (UID: \"06750a1a-1cb4-4cd6-b2f6-11887f25e882\") " pod="kuadrant-system/authorino-6b76b77c9-5pjqr" Jun 03 23:40:56.170460 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:40:56.170278 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/06750a1a-1cb4-4cd6-b2f6-11887f25e882-oidc-ca\") pod \"authorino-6b76b77c9-5pjqr\" (UID: \"06750a1a-1cb4-4cd6-b2f6-11887f25e882\") " pod="kuadrant-system/authorino-6b76b77c9-5pjqr" Jun 03 23:40:56.170460 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:40:56.170382 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9bbj\" (UniqueName: \"kubernetes.io/projected/06750a1a-1cb4-4cd6-b2f6-11887f25e882-kube-api-access-k9bbj\") pod \"authorino-6b76b77c9-5pjqr\" (UID: \"06750a1a-1cb4-4cd6-b2f6-11887f25e882\") " pod="kuadrant-system/authorino-6b76b77c9-5pjqr" Jun 03 23:40:56.171031 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:40:56.171009 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/06750a1a-1cb4-4cd6-b2f6-11887f25e882-oidc-ca\") pod \"authorino-6b76b77c9-5pjqr\" (UID: \"06750a1a-1cb4-4cd6-b2f6-11887f25e882\") " pod="kuadrant-system/authorino-6b76b77c9-5pjqr" Jun 03 23:40:56.172758 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:40:56.172741 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/06750a1a-1cb4-4cd6-b2f6-11887f25e882-tls-cert\") pod \"authorino-6b76b77c9-5pjqr\" (UID: \"06750a1a-1cb4-4cd6-b2f6-11887f25e882\") " pod="kuadrant-system/authorino-6b76b77c9-5pjqr" Jun 03 23:40:56.178570 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:40:56.178546 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9bbj\" (UniqueName: \"kubernetes.io/projected/06750a1a-1cb4-4cd6-b2f6-11887f25e882-kube-api-access-k9bbj\") pod \"authorino-6b76b77c9-5pjqr\" (UID: \"06750a1a-1cb4-4cd6-b2f6-11887f25e882\") " pod="kuadrant-system/authorino-6b76b77c9-5pjqr" Jun 03 23:40:56.333260 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:40:56.333171 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b76b77c9-5pjqr" Jun 03 23:40:56.473281 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:40:56.473255 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6b76b77c9-5pjqr"] Jun 03 23:40:56.475366 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:40:56.475336 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod06750a1a_1cb4_4cd6_b2f6_11887f25e882.slice/crio-bdaf00e8ed5f800a9f648991a3398f2717c259441d9e357f3737f254e624eff6 WatchSource:0}: Error finding container bdaf00e8ed5f800a9f648991a3398f2717c259441d9e357f3737f254e624eff6: Status 404 returned error can't find the container with id bdaf00e8ed5f800a9f648991a3398f2717c259441d9e357f3737f254e624eff6 Jun 03 23:40:56.866405 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:40:56.866369 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b76b77c9-5pjqr" event={"ID":"06750a1a-1cb4-4cd6-b2f6-11887f25e882","Type":"ContainerStarted","Data":"bdaf00e8ed5f800a9f648991a3398f2717c259441d9e357f3737f254e624eff6"} Jun 03 23:40:57.872804 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:40:57.872767 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b76b77c9-5pjqr" event={"ID":"06750a1a-1cb4-4cd6-b2f6-11887f25e882","Type":"ContainerStarted","Data":"b5acef3d1852796cc28aa8fca56f887f4f760bedf89d17ea3ae34a152b240eb2"} Jun 03 23:40:57.890545 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:40:57.890488 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6b76b77c9-5pjqr" podStartSLOduration=2.425910543 podStartE2EDuration="2.890468309s" totalImagesPullingTime="464.557766ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:40:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:40:57.890411265 +0000 UTC m=+978.697631729" watchObservedRunningTime="2026-06-03 23:40:57.890468309 +0000 UTC m=+978.697688775" Jun 03 23:40:57.920219 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:40:57.920139 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5db79cf446-4vq8c"] Jun 03 23:40:57.920430 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:40:57.920384 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5db79cf446-4vq8c" podUID="c4adeb98-1fd4-4701-bf45-8ad9c8b38bff" containerName="authorino" containerID="cri-o://0a4e118ef5dd2f4e4337eb7d301d821d989b6a1c0253cf7974b1baaca135c89f" gracePeriod=30 Jun 03 23:40:58.195664 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:40:58.195636 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5db79cf446-4vq8c" Jun 03 23:40:58.291924 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:40:58.291894 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c4adeb98-1fd4-4701-bf45-8ad9c8b38bff-tls-cert\") pod \"c4adeb98-1fd4-4701-bf45-8ad9c8b38bff\" (UID: \"c4adeb98-1fd4-4701-bf45-8ad9c8b38bff\") " Jun 03 23:40:58.292099 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:40:58.292020 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c4adeb98-1fd4-4701-bf45-8ad9c8b38bff-oidc-ca\") pod \"c4adeb98-1fd4-4701-bf45-8ad9c8b38bff\" (UID: \"c4adeb98-1fd4-4701-bf45-8ad9c8b38bff\") " Jun 03 23:40:58.292099 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:40:58.292057 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n24h7\" (UniqueName: \"kubernetes.io/projected/c4adeb98-1fd4-4701-bf45-8ad9c8b38bff-kube-api-access-n24h7\") pod \"c4adeb98-1fd4-4701-bf45-8ad9c8b38bff\" (UID: \"c4adeb98-1fd4-4701-bf45-8ad9c8b38bff\") " Jun 03 23:40:58.294219 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:40:58.294190 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4adeb98-1fd4-4701-bf45-8ad9c8b38bff-kube-api-access-n24h7" (OuterVolumeSpecName: "kube-api-access-n24h7") pod "c4adeb98-1fd4-4701-bf45-8ad9c8b38bff" (UID: "c4adeb98-1fd4-4701-bf45-8ad9c8b38bff"). InnerVolumeSpecName "kube-api-access-n24h7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:40:58.297236 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:40:58.297205 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4adeb98-1fd4-4701-bf45-8ad9c8b38bff-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "c4adeb98-1fd4-4701-bf45-8ad9c8b38bff" (UID: "c4adeb98-1fd4-4701-bf45-8ad9c8b38bff"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 23:40:58.302610 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:40:58.302588 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4adeb98-1fd4-4701-bf45-8ad9c8b38bff-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "c4adeb98-1fd4-4701-bf45-8ad9c8b38bff" (UID: "c4adeb98-1fd4-4701-bf45-8ad9c8b38bff"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 23:40:58.393355 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:40:58.393316 2574 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c4adeb98-1fd4-4701-bf45-8ad9c8b38bff-oidc-ca\") on node \"ip-10-0-135-242.ec2.internal\" DevicePath \"\"" Jun 03 23:40:58.393355 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:40:58.393351 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n24h7\" (UniqueName: \"kubernetes.io/projected/c4adeb98-1fd4-4701-bf45-8ad9c8b38bff-kube-api-access-n24h7\") on node \"ip-10-0-135-242.ec2.internal\" DevicePath \"\"" Jun 03 23:40:58.393355 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:40:58.393361 2574 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c4adeb98-1fd4-4701-bf45-8ad9c8b38bff-tls-cert\") on node \"ip-10-0-135-242.ec2.internal\" DevicePath \"\"" Jun 03 23:40:58.878848 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:40:58.878812 2574 generic.go:356] "Generic (PLEG): container finished" podID="c4adeb98-1fd4-4701-bf45-8ad9c8b38bff" containerID="0a4e118ef5dd2f4e4337eb7d301d821d989b6a1c0253cf7974b1baaca135c89f" exitCode=0 Jun 03 23:40:58.879376 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:40:58.878880 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5db79cf446-4vq8c" Jun 03 23:40:58.879376 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:40:58.878911 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5db79cf446-4vq8c" event={"ID":"c4adeb98-1fd4-4701-bf45-8ad9c8b38bff","Type":"ContainerDied","Data":"0a4e118ef5dd2f4e4337eb7d301d821d989b6a1c0253cf7974b1baaca135c89f"} Jun 03 23:40:58.879376 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:40:58.878962 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5db79cf446-4vq8c" event={"ID":"c4adeb98-1fd4-4701-bf45-8ad9c8b38bff","Type":"ContainerDied","Data":"642737f532f8de86df43b63f09d1510dc954b9dac52477dcebed97467f6f5f5e"} Jun 03 23:40:58.879376 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:40:58.878980 2574 scope.go:117] "RemoveContainer" containerID="0a4e118ef5dd2f4e4337eb7d301d821d989b6a1c0253cf7974b1baaca135c89f" Jun 03 23:40:58.888817 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:40:58.888800 2574 scope.go:117] "RemoveContainer" containerID="0a4e118ef5dd2f4e4337eb7d301d821d989b6a1c0253cf7974b1baaca135c89f" Jun 03 23:40:58.889101 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:40:58.889060 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a4e118ef5dd2f4e4337eb7d301d821d989b6a1c0253cf7974b1baaca135c89f\": container with ID starting with 0a4e118ef5dd2f4e4337eb7d301d821d989b6a1c0253cf7974b1baaca135c89f not found: ID does not exist" containerID="0a4e118ef5dd2f4e4337eb7d301d821d989b6a1c0253cf7974b1baaca135c89f" Jun 03 23:40:58.889101 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:40:58.889084 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a4e118ef5dd2f4e4337eb7d301d821d989b6a1c0253cf7974b1baaca135c89f"} err="failed to get container status \"0a4e118ef5dd2f4e4337eb7d301d821d989b6a1c0253cf7974b1baaca135c89f\": rpc error: code = NotFound desc = could not find container \"0a4e118ef5dd2f4e4337eb7d301d821d989b6a1c0253cf7974b1baaca135c89f\": container with ID starting with 0a4e118ef5dd2f4e4337eb7d301d821d989b6a1c0253cf7974b1baaca135c89f not found: ID does not exist" Jun 03 23:40:58.901620 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:40:58.901592 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5db79cf446-4vq8c"] Jun 03 23:40:58.905654 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:40:58.905632 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5db79cf446-4vq8c"] Jun 03 23:40:59.658041 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:40:59.658011 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4adeb98-1fd4-4701-bf45-8ad9c8b38bff" path="/var/lib/kubelet/pods/c4adeb98-1fd4-4701-bf45-8ad9c8b38bff/volumes" Jun 03 23:52:50.912994 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:52:50.912960 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dqrbh"] Jun 03 23:52:50.913553 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:52:50.913162 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dqrbh" podUID="d61413d9-0f33-43a5-a15f-52bfe40fc84d" containerName="manager" containerID="cri-o://26878d3d8ebf7350d212bf60bc6eea014e02cfee7b2e0546cbb668cc7822d0ca" gracePeriod=10 Jun 03 23:52:51.774018 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:52:51.773992 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dqrbh" Jun 03 23:52:51.830286 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:52:51.830257 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d61413d9-0f33-43a5-a15f-52bfe40fc84d-extensions-socket-volume\") pod \"d61413d9-0f33-43a5-a15f-52bfe40fc84d\" (UID: \"d61413d9-0f33-43a5-a15f-52bfe40fc84d\") " Jun 03 23:52:51.830468 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:52:51.830340 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t5ppw\" (UniqueName: \"kubernetes.io/projected/d61413d9-0f33-43a5-a15f-52bfe40fc84d-kube-api-access-t5ppw\") pod \"d61413d9-0f33-43a5-a15f-52bfe40fc84d\" (UID: \"d61413d9-0f33-43a5-a15f-52bfe40fc84d\") " Jun 03 23:52:51.830725 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:52:51.830694 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d61413d9-0f33-43a5-a15f-52bfe40fc84d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d61413d9-0f33-43a5-a15f-52bfe40fc84d" (UID: "d61413d9-0f33-43a5-a15f-52bfe40fc84d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:52:51.832373 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:52:51.832341 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d61413d9-0f33-43a5-a15f-52bfe40fc84d-kube-api-access-t5ppw" (OuterVolumeSpecName: "kube-api-access-t5ppw") pod "d61413d9-0f33-43a5-a15f-52bfe40fc84d" (UID: "d61413d9-0f33-43a5-a15f-52bfe40fc84d"). InnerVolumeSpecName "kube-api-access-t5ppw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:52:51.931176 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:52:51.931143 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d61413d9-0f33-43a5-a15f-52bfe40fc84d-extensions-socket-volume\") on node \"ip-10-0-135-242.ec2.internal\" DevicePath \"\"" Jun 03 23:52:51.931176 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:52:51.931171 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t5ppw\" (UniqueName: \"kubernetes.io/projected/d61413d9-0f33-43a5-a15f-52bfe40fc84d-kube-api-access-t5ppw\") on node \"ip-10-0-135-242.ec2.internal\" DevicePath \"\"" Jun 03 23:52:52.575624 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:52:52.575584 2574 generic.go:356] "Generic (PLEG): container finished" podID="d61413d9-0f33-43a5-a15f-52bfe40fc84d" containerID="26878d3d8ebf7350d212bf60bc6eea014e02cfee7b2e0546cbb668cc7822d0ca" exitCode=0 Jun 03 23:52:52.575624 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:52:52.575626 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dqrbh" Jun 03 23:52:52.575900 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:52:52.575671 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dqrbh" event={"ID":"d61413d9-0f33-43a5-a15f-52bfe40fc84d","Type":"ContainerDied","Data":"26878d3d8ebf7350d212bf60bc6eea014e02cfee7b2e0546cbb668cc7822d0ca"} Jun 03 23:52:52.575900 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:52:52.575735 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dqrbh" event={"ID":"d61413d9-0f33-43a5-a15f-52bfe40fc84d","Type":"ContainerDied","Data":"50f41d63cc1c17c0d25f0e5c5ecc670018aefd53864b9980c583f877fae8dad3"} Jun 03 23:52:52.575900 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:52:52.575764 2574 scope.go:117] "RemoveContainer" containerID="26878d3d8ebf7350d212bf60bc6eea014e02cfee7b2e0546cbb668cc7822d0ca" Jun 03 23:52:52.585937 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:52:52.585918 2574 scope.go:117] "RemoveContainer" containerID="26878d3d8ebf7350d212bf60bc6eea014e02cfee7b2e0546cbb668cc7822d0ca" Jun 03 23:52:52.586225 ip-10-0-135-242 kubenswrapper[2574]: E0603 23:52:52.586201 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26878d3d8ebf7350d212bf60bc6eea014e02cfee7b2e0546cbb668cc7822d0ca\": container with ID starting with 26878d3d8ebf7350d212bf60bc6eea014e02cfee7b2e0546cbb668cc7822d0ca not found: ID does not exist" containerID="26878d3d8ebf7350d212bf60bc6eea014e02cfee7b2e0546cbb668cc7822d0ca" Jun 03 23:52:52.586353 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:52:52.586230 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26878d3d8ebf7350d212bf60bc6eea014e02cfee7b2e0546cbb668cc7822d0ca"} err="failed to get container status \"26878d3d8ebf7350d212bf60bc6eea014e02cfee7b2e0546cbb668cc7822d0ca\": rpc error: code = NotFound desc = could not find container \"26878d3d8ebf7350d212bf60bc6eea014e02cfee7b2e0546cbb668cc7822d0ca\": container with ID starting with 26878d3d8ebf7350d212bf60bc6eea014e02cfee7b2e0546cbb668cc7822d0ca not found: ID does not exist" Jun 03 23:52:52.600790 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:52:52.600766 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dqrbh"] Jun 03 23:52:52.604044 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:52:52.604021 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dqrbh"] Jun 03 23:52:53.661783 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:52:53.661747 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d61413d9-0f33-43a5-a15f-52bfe40fc84d" path="/var/lib/kubelet/pods/d61413d9-0f33-43a5-a15f-52bfe40fc84d/volumes" Jun 03 23:53:57.034693 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:53:57.034656 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6qkjc"] Jun 03 23:53:57.035259 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:53:57.035240 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4adeb98-1fd4-4701-bf45-8ad9c8b38bff" containerName="authorino" Jun 03 23:53:57.035428 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:53:57.035262 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4adeb98-1fd4-4701-bf45-8ad9c8b38bff" containerName="authorino" Jun 03 23:53:57.035428 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:53:57.035280 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d61413d9-0f33-43a5-a15f-52bfe40fc84d" containerName="manager" Jun 03 23:53:57.035428 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:53:57.035304 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d61413d9-0f33-43a5-a15f-52bfe40fc84d" containerName="manager" Jun 03 23:53:57.035588 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:53:57.035434 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4adeb98-1fd4-4701-bf45-8ad9c8b38bff" containerName="authorino" Jun 03 23:53:57.035588 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:53:57.035449 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="d61413d9-0f33-43a5-a15f-52bfe40fc84d" containerName="manager" Jun 03 23:53:57.039798 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:53:57.039777 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6qkjc" Jun 03 23:53:57.042934 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:53:57.042914 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-fjmn4\"" Jun 03 23:53:57.051475 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:53:57.051448 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6qkjc"] Jun 03 23:53:57.075100 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:53:57.075072 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1621f0f4-bae5-4137-9dd4-292113a058aa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6qkjc\" (UID: \"1621f0f4-bae5-4137-9dd4-292113a058aa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6qkjc" Jun 03 23:53:57.075280 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:53:57.075129 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ljqv\" (UniqueName: \"kubernetes.io/projected/1621f0f4-bae5-4137-9dd4-292113a058aa-kube-api-access-4ljqv\") pod \"kuadrant-operator-controller-manager-86878c769f-6qkjc\" (UID: \"1621f0f4-bae5-4137-9dd4-292113a058aa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6qkjc" Jun 03 23:53:57.176359 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:53:57.176321 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1621f0f4-bae5-4137-9dd4-292113a058aa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6qkjc\" (UID: \"1621f0f4-bae5-4137-9dd4-292113a058aa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6qkjc" Jun 03 23:53:57.176551 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:53:57.176382 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ljqv\" (UniqueName: \"kubernetes.io/projected/1621f0f4-bae5-4137-9dd4-292113a058aa-kube-api-access-4ljqv\") pod \"kuadrant-operator-controller-manager-86878c769f-6qkjc\" (UID: \"1621f0f4-bae5-4137-9dd4-292113a058aa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6qkjc" Jun 03 23:53:57.176759 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:53:57.176735 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1621f0f4-bae5-4137-9dd4-292113a058aa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6qkjc\" (UID: \"1621f0f4-bae5-4137-9dd4-292113a058aa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6qkjc" Jun 03 23:53:57.185156 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:53:57.185127 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ljqv\" (UniqueName: \"kubernetes.io/projected/1621f0f4-bae5-4137-9dd4-292113a058aa-kube-api-access-4ljqv\") pod \"kuadrant-operator-controller-manager-86878c769f-6qkjc\" (UID: \"1621f0f4-bae5-4137-9dd4-292113a058aa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6qkjc" Jun 03 23:53:57.350503 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:53:57.350412 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6qkjc" Jun 03 23:53:57.491426 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:53:57.491397 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6qkjc"] Jun 03 23:53:57.493551 ip-10-0-135-242 kubenswrapper[2574]: W0603 23:53:57.493520 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1621f0f4_bae5_4137_9dd4_292113a058aa.slice/crio-e72960294993365fdae40d798a5deb0f2f55698faf05f8909d3f655b691c8dc8 WatchSource:0}: Error finding container e72960294993365fdae40d798a5deb0f2f55698faf05f8909d3f655b691c8dc8: Status 404 returned error can't find the container with id e72960294993365fdae40d798a5deb0f2f55698faf05f8909d3f655b691c8dc8 Jun 03 23:53:57.896370 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:53:57.896326 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6qkjc" event={"ID":"1621f0f4-bae5-4137-9dd4-292113a058aa","Type":"ContainerStarted","Data":"7fd9cf18d6585f1da7c815562de61c6b174bd370ff3f9a296fae62dfd16697e7"} Jun 03 23:53:57.896575 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:53:57.896392 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6qkjc" event={"ID":"1621f0f4-bae5-4137-9dd4-292113a058aa","Type":"ContainerStarted","Data":"e72960294993365fdae40d798a5deb0f2f55698faf05f8909d3f655b691c8dc8"} Jun 03 23:53:57.896575 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:53:57.896426 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6qkjc" Jun 03 23:53:57.917398 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:53:57.917350 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6qkjc" podStartSLOduration=0.917332948 podStartE2EDuration="917.332948ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:53:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:53:57.915178754 +0000 UTC m=+1758.722399211" watchObservedRunningTime="2026-06-03 23:53:57.917332948 +0000 UTC m=+1758.724553413" Jun 03 23:54:08.903204 ip-10-0-135-242 kubenswrapper[2574]: I0603 23:54:08.903170 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6qkjc" Jun 04 00:04:01.952993 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:01.952908 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6b76b77c9-5pjqr_06750a1a-1cb4-4cd6-b2f6-11887f25e882/authorino/0.log" Jun 04 00:04:06.523490 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:06.523462 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6bf55d5568-fw7c8_c38f1fe3-2682-42a2-ab07-8d7e60e18d8a/nginx/0.log" Jun 04 00:04:07.700524 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:07.700496 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-684bd49f57-6s9qs_3861be43-9e72-4c22-90d3-1c7ab0e6d737/copy-manifests/0.log" Jun 04 00:04:07.707241 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:07.707219 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-684bd49f57-6s9qs_3861be43-9e72-4c22-90d3-1c7ab0e6d737/manager/0.log" Jun 04 00:04:08.111914 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:08.111775 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-tjqck_65f8a1de-358f-440e-bda5-c450f43820ff/postgres/0.log" Jun 04 00:04:09.424683 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:09.424646 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6b76b77c9-5pjqr_06750a1a-1cb4-4cd6-b2f6-11887f25e882/authorino/0.log" Jun 04 00:04:09.566261 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:09.566212 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-gqbz4_e65211c6-a413-4dc4-8db8-ed628a292f32/manager/0.log" Jun 04 00:04:09.678541 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:09.678447 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-5fgrm_11167f28-5977-4190-8f23-e473a521eecb/manager/0.log" Jun 04 00:04:09.921148 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:09.921113 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-xxgtr_592ede2c-7c28-495f-a908-6494d1afb164/registry-server/0.log" Jun 04 00:04:10.048720 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:10.048634 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-6qkjc_1621f0f4-bae5-4137-9dd4-292113a058aa/manager/0.log" Jun 04 00:04:10.662330 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:10.662272 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bccdq2d_13b63c7a-5e67-4ad7-87dc-7aaac3f3809c/istio-proxy/0.log" Jun 04 00:04:11.133203 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:11.133113 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-f49fv_255c2bdc-59bb-48e2-beaf-07567929dad2/istio-proxy/1.log" Jun 04 00:04:11.250456 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:11.250427 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-xg6dk_aa8ccb73-6b73-4dba-8b20-1e6e9638fa1c/payload-pre-processing/0.log" Jun 04 00:04:11.490808 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:11.490773 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7bd5df7d89-2fp8d_bfa864f5-28e9-4f1d-9515-e1ec120bdfc7/router/0.log" Jun 04 00:04:11.834847 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:11.834746 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-jbpvm_f034ce3b-c646-465d-b905-33d61da135be/storage-initializer/0.log" Jun 04 00:04:11.843608 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:11.843582 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-jbpvm_f034ce3b-c646-465d-b905-33d61da135be/main/0.log" Jun 04 00:04:12.075495 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:12.075467 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-fwscv_9e3a84e7-9ee6-4253-8143-a50796093e79/storage-initializer/0.log" Jun 04 00:04:12.084176 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:12.084149 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-fwscv_9e3a84e7-9ee6-4253-8143-a50796093e79/main/0.log" Jun 04 00:04:12.204208 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:12.204172 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqnhhb_d8de677d-2526-4de7-bf30-4910e15ab67a/storage-initializer/0.log" Jun 04 00:04:12.212632 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:12.212604 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqnhhb_d8de677d-2526-4de7-bf30-4910e15ab67a/main/0.log" Jun 04 00:04:20.013082 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:20.013051 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4jp9j_83566a98-4a00-49eb-8108-30162d78adc8/global-pull-secret-syncer/0.log" Jun 04 00:04:20.187450 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:20.187420 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-wx4t4_9fec56be-cb0f-4e01-9e51-aa62afa1499d/konnectivity-agent/0.log" Jun 04 00:04:20.311870 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:20.311778 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-242.ec2.internal_9695b6e50d763a28dd89fc1a733fbc23/haproxy/0.log" Jun 04 00:04:25.470202 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:25.470140 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6b76b77c9-5pjqr_06750a1a-1cb4-4cd6-b2f6-11887f25e882/authorino/0.log" Jun 04 00:04:25.501022 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:25.500995 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-gqbz4_e65211c6-a413-4dc4-8db8-ed628a292f32/manager/0.log" Jun 04 00:04:25.539561 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:25.539527 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-5fgrm_11167f28-5977-4190-8f23-e473a521eecb/manager/0.log" Jun 04 00:04:25.613973 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:25.613939 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-xxgtr_592ede2c-7c28-495f-a908-6494d1afb164/registry-server/0.log" Jun 04 00:04:25.718422 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:25.718383 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-6qkjc_1621f0f4-bae5-4137-9dd4-292113a058aa/manager/0.log" Jun 04 00:04:27.590612 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:27.590581 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-57769895dd-xhccj_099633be-d81f-4570-8cfb-027c2132aa6f/cluster-monitoring-operator/0.log" Jun 04 00:04:27.622068 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:27.621984 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-79fb7d47d4-274cp_6deb7e30-1b05-48a2-921c-9aecfcc19448/kube-state-metrics/0.log" Jun 04 00:04:27.668883 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:27.668853 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-79fb7d47d4-274cp_6deb7e30-1b05-48a2-921c-9aecfcc19448/kube-rbac-proxy-main/0.log" Jun 04 00:04:27.701951 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:27.701927 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-79fb7d47d4-274cp_6deb7e30-1b05-48a2-921c-9aecfcc19448/kube-rbac-proxy-self/0.log" Jun 04 00:04:27.742614 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:27.742585 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5fdfc4f766-ftdp7_dc68e35b-f32e-4032-a43a-78a1452fa36c/metrics-server/0.log" Jun 04 00:04:27.783121 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:27.783085 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-9b9fc658-q9m4k_f4038def-2ab0-4407-85a5-bb20e787479d/monitoring-plugin/0.log" Jun 04 00:04:28.043579 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:28.043550 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ntmrl_ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9/node-exporter/0.log" Jun 04 00:04:28.068508 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:28.068482 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ntmrl_ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9/kube-rbac-proxy/0.log" Jun 04 00:04:28.089135 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:28.089105 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ntmrl_ab03e1dd-cdf3-4beb-9bec-e9aa9ddd35f9/init-textfile/0.log" Jun 04 00:04:28.204558 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:28.204477 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_42093802-1cfa-4450-b765-83ef0ddf7382/prometheus/0.log" Jun 04 00:04:28.227841 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:28.227805 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_42093802-1cfa-4450-b765-83ef0ddf7382/config-reloader/0.log" Jun 04 00:04:28.249658 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:28.249631 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_42093802-1cfa-4450-b765-83ef0ddf7382/thanos-sidecar/0.log" Jun 04 00:04:28.271342 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:28.271315 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_42093802-1cfa-4450-b765-83ef0ddf7382/kube-rbac-proxy-web/0.log" Jun 04 00:04:28.294646 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:28.294616 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_42093802-1cfa-4450-b765-83ef0ddf7382/kube-rbac-proxy/0.log" Jun 04 00:04:28.318510 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:28.318483 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_42093802-1cfa-4450-b765-83ef0ddf7382/kube-rbac-proxy-thanos/0.log" Jun 04 00:04:28.348590 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:28.348561 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_42093802-1cfa-4450-b765-83ef0ddf7382/init-config-reloader/0.log" Jun 04 00:04:28.431704 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:28.431674 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-zf5r2_257f8ce4-e88a-4899-bf56-4a52f06c5b6a/prometheus-operator-admission-webhook/0.log" Jun 04 00:04:28.477609 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:28.477504 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-698d87b464-js7zr_274dced5-fc6e-4865-9159-63a0fd2a05fb/telemeter-client/0.log" Jun 04 00:04:28.498960 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:28.498926 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-698d87b464-js7zr_274dced5-fc6e-4865-9159-63a0fd2a05fb/reload/0.log" Jun 04 00:04:28.519972 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:28.519942 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-698d87b464-js7zr_274dced5-fc6e-4865-9159-63a0fd2a05fb/kube-rbac-proxy/0.log" Jun 04 00:04:31.187021 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:31.186989 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-b45b98dc4-gzhjs_dbf591be-8fad-42e4-a6c9-f957ba15fb3f/console/0.log" Jun 04 00:04:31.640467 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:31.640374 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fc9xm/perf-node-gather-daemonset-c9zlt"] Jun 04 00:04:31.644402 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:31.644378 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fc9xm/perf-node-gather-daemonset-c9zlt" Jun 04 00:04:31.647391 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:31.647358 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fc9xm\"/\"kube-root-ca.crt\"" Jun 04 00:04:31.648610 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:31.648591 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fc9xm\"/\"openshift-service-ca.crt\"" Jun 04 00:04:31.648697 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:31.648591 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fc9xm\"/\"default-dockercfg-p65gb\"" Jun 04 00:04:31.658727 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:31.658702 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fc9xm/perf-node-gather-daemonset-c9zlt"] Jun 04 00:04:31.717375 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:31.717342 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7722dcc6-3074-4ea1-9e8f-17834c172539-sys\") pod \"perf-node-gather-daemonset-c9zlt\" (UID: \"7722dcc6-3074-4ea1-9e8f-17834c172539\") " pod="openshift-must-gather-fc9xm/perf-node-gather-daemonset-c9zlt" Jun 04 00:04:31.717375 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:31.717381 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7722dcc6-3074-4ea1-9e8f-17834c172539-podres\") pod \"perf-node-gather-daemonset-c9zlt\" (UID: \"7722dcc6-3074-4ea1-9e8f-17834c172539\") " pod="openshift-must-gather-fc9xm/perf-node-gather-daemonset-c9zlt" Jun 04 00:04:31.717599 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:31.717410 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7722dcc6-3074-4ea1-9e8f-17834c172539-lib-modules\") pod \"perf-node-gather-daemonset-c9zlt\" (UID: \"7722dcc6-3074-4ea1-9e8f-17834c172539\") " pod="openshift-must-gather-fc9xm/perf-node-gather-daemonset-c9zlt" Jun 04 00:04:31.717599 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:31.717482 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7722dcc6-3074-4ea1-9e8f-17834c172539-proc\") pod \"perf-node-gather-daemonset-c9zlt\" (UID: \"7722dcc6-3074-4ea1-9e8f-17834c172539\") " pod="openshift-must-gather-fc9xm/perf-node-gather-daemonset-c9zlt" Jun 04 00:04:31.717599 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:31.717514 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8wrf\" (UniqueName: \"kubernetes.io/projected/7722dcc6-3074-4ea1-9e8f-17834c172539-kube-api-access-r8wrf\") pod \"perf-node-gather-daemonset-c9zlt\" (UID: \"7722dcc6-3074-4ea1-9e8f-17834c172539\") " pod="openshift-must-gather-fc9xm/perf-node-gather-daemonset-c9zlt" Jun 04 00:04:31.818416 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:31.818377 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7722dcc6-3074-4ea1-9e8f-17834c172539-lib-modules\") pod \"perf-node-gather-daemonset-c9zlt\" (UID: \"7722dcc6-3074-4ea1-9e8f-17834c172539\") " pod="openshift-must-gather-fc9xm/perf-node-gather-daemonset-c9zlt" Jun 04 00:04:31.818613 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:31.818451 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7722dcc6-3074-4ea1-9e8f-17834c172539-proc\") pod \"perf-node-gather-daemonset-c9zlt\" (UID: \"7722dcc6-3074-4ea1-9e8f-17834c172539\") " pod="openshift-must-gather-fc9xm/perf-node-gather-daemonset-c9zlt" Jun 04 00:04:31.818613 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:31.818503 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8wrf\" (UniqueName: \"kubernetes.io/projected/7722dcc6-3074-4ea1-9e8f-17834c172539-kube-api-access-r8wrf\") pod \"perf-node-gather-daemonset-c9zlt\" (UID: \"7722dcc6-3074-4ea1-9e8f-17834c172539\") " pod="openshift-must-gather-fc9xm/perf-node-gather-daemonset-c9zlt" Jun 04 00:04:31.818613 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:31.818567 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7722dcc6-3074-4ea1-9e8f-17834c172539-lib-modules\") pod \"perf-node-gather-daemonset-c9zlt\" (UID: \"7722dcc6-3074-4ea1-9e8f-17834c172539\") " pod="openshift-must-gather-fc9xm/perf-node-gather-daemonset-c9zlt" Jun 04 00:04:31.818613 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:31.818567 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7722dcc6-3074-4ea1-9e8f-17834c172539-proc\") pod \"perf-node-gather-daemonset-c9zlt\" (UID: \"7722dcc6-3074-4ea1-9e8f-17834c172539\") " pod="openshift-must-gather-fc9xm/perf-node-gather-daemonset-c9zlt" Jun 04 00:04:31.818613 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:31.818579 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7722dcc6-3074-4ea1-9e8f-17834c172539-sys\") pod \"perf-node-gather-daemonset-c9zlt\" (UID: \"7722dcc6-3074-4ea1-9e8f-17834c172539\") " pod="openshift-must-gather-fc9xm/perf-node-gather-daemonset-c9zlt" Jun 04 00:04:31.818844 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:31.818629 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7722dcc6-3074-4ea1-9e8f-17834c172539-sys\") pod \"perf-node-gather-daemonset-c9zlt\" (UID: \"7722dcc6-3074-4ea1-9e8f-17834c172539\") " pod="openshift-must-gather-fc9xm/perf-node-gather-daemonset-c9zlt" Jun 04 00:04:31.818844 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:31.818631 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7722dcc6-3074-4ea1-9e8f-17834c172539-podres\") pod \"perf-node-gather-daemonset-c9zlt\" (UID: \"7722dcc6-3074-4ea1-9e8f-17834c172539\") " pod="openshift-must-gather-fc9xm/perf-node-gather-daemonset-c9zlt" Jun 04 00:04:31.818844 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:31.818733 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7722dcc6-3074-4ea1-9e8f-17834c172539-podres\") pod \"perf-node-gather-daemonset-c9zlt\" (UID: \"7722dcc6-3074-4ea1-9e8f-17834c172539\") " pod="openshift-must-gather-fc9xm/perf-node-gather-daemonset-c9zlt" Jun 04 00:04:31.826763 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:31.826734 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8wrf\" (UniqueName: \"kubernetes.io/projected/7722dcc6-3074-4ea1-9e8f-17834c172539-kube-api-access-r8wrf\") pod \"perf-node-gather-daemonset-c9zlt\" (UID: \"7722dcc6-3074-4ea1-9e8f-17834c172539\") " pod="openshift-must-gather-fc9xm/perf-node-gather-daemonset-c9zlt" Jun 04 00:04:31.956225 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:31.956183 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fc9xm/perf-node-gather-daemonset-c9zlt" Jun 04 00:04:31.965233 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:31.965207 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-48q4x_60758e35-f856-44a0-b2a1-322fe75bc431/volume-data-source-validator/0.log" Jun 04 00:04:32.095972 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:32.095948 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fc9xm/perf-node-gather-daemonset-c9zlt"] Jun 04 00:04:32.097744 ip-10-0-135-242 kubenswrapper[2574]: W0604 00:04:32.097715 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7722dcc6_3074_4ea1_9e8f_17834c172539.slice/crio-fe28df81b6140ff641786e63a7db0db5772bda2bf52d5631016c88c5f1034b3f WatchSource:0}: Error finding container fe28df81b6140ff641786e63a7db0db5772bda2bf52d5631016c88c5f1034b3f: Status 404 returned error can't find the container with id fe28df81b6140ff641786e63a7db0db5772bda2bf52d5631016c88c5f1034b3f Jun 04 00:04:32.133987 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:32.133955 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fc9xm/perf-node-gather-daemonset-c9zlt" event={"ID":"7722dcc6-3074-4ea1-9e8f-17834c172539","Type":"ContainerStarted","Data":"fe28df81b6140ff641786e63a7db0db5772bda2bf52d5631016c88c5f1034b3f"} Jun 04 00:04:33.140444 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:33.140410 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fc9xm/perf-node-gather-daemonset-c9zlt" event={"ID":"7722dcc6-3074-4ea1-9e8f-17834c172539","Type":"ContainerStarted","Data":"dbe40142b7a7e224cd849e474c8c3294525e344eb7d3356d9b31106f130270fd"} Jun 04 00:04:33.140826 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:33.140550 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-fc9xm/perf-node-gather-daemonset-c9zlt" Jun 04 00:04:33.157446 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:33.157383 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fc9xm/perf-node-gather-daemonset-c9zlt" podStartSLOduration=2.157369226 podStartE2EDuration="2.157369226s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-04 00:04:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 00:04:33.156057352 +0000 UTC m=+2393.963277817" watchObservedRunningTime="2026-06-04 00:04:33.157369226 +0000 UTC m=+2393.964589690" Jun 04 00:04:33.183927 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:33.183901 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wf5jt_9ffbd581-2f34-45dd-a519-6e24200f8846/dns/0.log" Jun 04 00:04:33.204801 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:33.204778 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wf5jt_9ffbd581-2f34-45dd-a519-6e24200f8846/kube-rbac-proxy/0.log" Jun 04 00:04:33.258408 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:33.258380 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qptg9_e8eb806c-295f-4b08-ad92-6ceef3b2a7b8/dns-node-resolver/0.log" Jun 04 00:04:33.841471 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:33.841439 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-67f86dc978-2bf4z_78c6584c-0498-4adb-b65b-9b882781fe01/registry/0.log" Jun 04 00:04:33.917137 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:33.917106 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dnwpn_35356266-b28e-48fb-b508-a661319c50b1/node-ca/0.log" Jun 04 00:04:34.956589 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:34.956556 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bccdq2d_13b63c7a-5e67-4ad7-87dc-7aaac3f3809c/istio-proxy/0.log" Jun 04 00:04:35.170396 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:35.170368 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-f49fv_255c2bdc-59bb-48e2-beaf-07567929dad2/istio-proxy/0.log" Jun 04 00:04:35.231614 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:35.231506 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-f49fv_255c2bdc-59bb-48e2-beaf-07567929dad2/istio-proxy/1.log" Jun 04 00:04:35.292956 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:35.292917 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-xg6dk_aa8ccb73-6b73-4dba-8b20-1e6e9638fa1c/payload-pre-processing/0.log" Jun 04 00:04:35.422934 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:35.422905 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7bd5df7d89-2fp8d_bfa864f5-28e9-4f1d-9515-e1ec120bdfc7/router/0.log" Jun 04 00:04:36.113308 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:36.113257 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vgpjr_ee520e2e-86a3-461f-9914-0ccf3b449d6c/serve-healthcheck-canary/0.log" Jun 04 00:04:36.654690 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:36.654661 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-69684796bc-ggcdl_1d545fc1-b4f3-4d2c-9ed9-d04a4b3ab786/insights-operator/0.log" Jun 04 00:04:36.655409 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:36.655383 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-69684796bc-ggcdl_1d545fc1-b4f3-4d2c-9ed9-d04a4b3ab786/insights-operator/1.log" Jun 04 00:04:36.677945 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:36.677922 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5226r_4fcf2743-3bbd-4e8d-915c-c04e202c6a99/kube-rbac-proxy/0.log" Jun 04 00:04:36.702417 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:36.702390 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5226r_4fcf2743-3bbd-4e8d-915c-c04e202c6a99/exporter/0.log" Jun 04 00:04:36.725364 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:36.725335 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5226r_4fcf2743-3bbd-4e8d-915c-c04e202c6a99/extractor/0.log" Jun 04 00:04:39.095254 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:39.095227 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6bf55d5568-fw7c8_c38f1fe3-2682-42a2-ab07-8d7e60e18d8a/nginx/0.log" Jun 04 00:04:39.156482 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:39.156456 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-fc9xm/perf-node-gather-daemonset-c9zlt" Jun 04 00:04:39.553120 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:39.553089 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-684bd49f57-6s9qs_3861be43-9e72-4c22-90d3-1c7ab0e6d737/manager/0.log" Jun 04 00:04:39.577026 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:39.576999 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-684bd49f57-6s9qs_3861be43-9e72-4c22-90d3-1c7ab0e6d737/copy-manifests/0.log" Jun 04 00:04:39.860005 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:39.859858 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-tjqck_65f8a1de-358f-440e-bda5-c450f43820ff/postgres/0.log" Jun 04 00:04:41.722267 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:41.722197 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-869fd7c4f4-zwksg_a3b2b6f3-f8f8-431b-84cc-bae8c4bce9fd/manager/0.log" Jun 04 00:04:44.326444 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:44.326404 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bccdq2d_13b63c7a-5e67-4ad7-87dc-7aaac3f3809c/istio-proxy/0.log" Jun 04 00:04:44.475954 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:44.475901 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-f49fv_255c2bdc-59bb-48e2-beaf-07567929dad2/istio-proxy/0.log" Jun 04 00:04:44.542963 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:44.542926 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-f49fv_255c2bdc-59bb-48e2-beaf-07567929dad2/istio-proxy/1.log" Jun 04 00:04:44.597556 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:44.597482 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-xg6dk_aa8ccb73-6b73-4dba-8b20-1e6e9638fa1c/payload-pre-processing/0.log" Jun 04 00:04:44.709154 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:44.709130 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7bd5df7d89-2fp8d_bfa864f5-28e9-4f1d-9515-e1ec120bdfc7/router/0.log" Jun 04 00:04:45.874971 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:45.874939 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bccdq2d_13b63c7a-5e67-4ad7-87dc-7aaac3f3809c/istio-proxy/0.log" Jun 04 00:04:46.021275 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:46.021235 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-f49fv_255c2bdc-59bb-48e2-beaf-07567929dad2/istio-proxy/0.log" Jun 04 00:04:46.082813 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:46.082773 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-f49fv_255c2bdc-59bb-48e2-beaf-07567929dad2/istio-proxy/1.log" Jun 04 00:04:46.136638 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:46.136558 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-xg6dk_aa8ccb73-6b73-4dba-8b20-1e6e9638fa1c/payload-pre-processing/0.log" Jun 04 00:04:46.246717 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:46.246693 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7bd5df7d89-2fp8d_bfa864f5-28e9-4f1d-9515-e1ec120bdfc7/router/0.log" Jun 04 00:04:47.580037 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:47.579997 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6dfc7c8b9f-vwhcp_8e27eeb5-c500-4da6-b469-ad64b2ddcfa1/kube-storage-version-migrator-operator/1.log" Jun 04 00:04:47.581334 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:47.581310 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6dfc7c8b9f-vwhcp_8e27eeb5-c500-4da6-b469-ad64b2ddcfa1/kube-storage-version-migrator-operator/0.log" Jun 04 00:04:48.088560 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:48.088531 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bccdq2d_13b63c7a-5e67-4ad7-87dc-7aaac3f3809c/istio-proxy/0.log" Jun 04 00:04:48.224665 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:48.224632 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-f49fv_255c2bdc-59bb-48e2-beaf-07567929dad2/istio-proxy/0.log" Jun 04 00:04:48.290249 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:48.290210 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-f49fv_255c2bdc-59bb-48e2-beaf-07567929dad2/istio-proxy/1.log" Jun 04 00:04:48.342117 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:48.342001 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-xg6dk_aa8ccb73-6b73-4dba-8b20-1e6e9638fa1c/payload-pre-processing/0.log" Jun 04 00:04:48.455640 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:48.455604 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7bd5df7d89-2fp8d_bfa864f5-28e9-4f1d-9515-e1ec120bdfc7/router/0.log" Jun 04 00:04:49.081972 ip-10-0-135-242 kubenswrapper[2574]: I0604 00:04:49.081944 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z7b5v_d5046da1-6cac-4c88-9646-5f473d81cf36/kube-multus-additional-cni-plugins/0.log"