Jun 10 11:55:28.933003 ip-10-0-139-86 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 10 11:55:28.933015 ip-10-0-139-86 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 10 11:55:28.933024 ip-10-0-139-86 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 10 11:55:28.933224 ip-10-0-139-86 systemd[1]: Failed to start Kubernetes Kubelet. Jun 10 11:55:39.060062 ip-10-0-139-86 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 10 11:55:39.060082 ip-10-0-139-86 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot a71374e716714a1298ca06ff87523776 -- Jun 10 11:58:11.679445 ip-10-0-139-86 systemd[1]: Starting Kubernetes Kubelet... Jun 10 11:58:12.091087 ip-10-0-139-86 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 11:58:12.091087 ip-10-0-139-86 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 10 11:58:12.091087 ip-10-0-139-86 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 11:58:12.091087 ip-10-0-139-86 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 10 11:58:12.091087 ip-10-0-139-86 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 11:58:12.092231 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.091155 2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 10 11:58:12.098021 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098004 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 11:58:12.098021 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098019 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 11:58:12.098098 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098023 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 11:58:12.098098 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098028 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 10 11:58:12.098098 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098032 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 11:58:12.098098 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098035 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 11:58:12.098098 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098049 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 11:58:12.098098 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098053 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 11:58:12.098098 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098056 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 11:58:12.098098 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098058 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 11:58:12.098098 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098061 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 11:58:12.098098 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098064 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 11:58:12.098098 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098068 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 11:58:12.098098 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098072 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 11:58:12.098098 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098075 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 11:58:12.098098 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098078 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 11:58:12.098098 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098081 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 11:58:12.098098 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098083 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 11:58:12.098098 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098087 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 11:58:12.098098 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098090 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 11:58:12.098098 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098092 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 11:58:12.098547 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098101 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 11:58:12.098547 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098105 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 11:58:12.098547 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098108 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 11:58:12.098547 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098111 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 11:58:12.098547 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098114 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 11:58:12.098547 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098117 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 11:58:12.098547 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098120 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 11:58:12.098547 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098122 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 11:58:12.098547 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098126 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 11:58:12.098547 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098129 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 11:58:12.098547 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098132 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 11:58:12.098547 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098134 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 11:58:12.098547 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098137 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 11:58:12.098547 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098140 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 11:58:12.098547 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098143 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 11:58:12.098547 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098145 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 11:58:12.098547 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098148 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 11:58:12.098547 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098151 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 11:58:12.098547 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098154 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 11:58:12.098999 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098157 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 11:58:12.098999 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098159 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 11:58:12.098999 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098162 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 11:58:12.098999 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098165 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 11:58:12.098999 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098167 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 11:58:12.098999 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098170 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 11:58:12.098999 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098173 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 11:58:12.098999 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098175 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 11:58:12.098999 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098178 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 11:58:12.098999 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098181 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 11:58:12.098999 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098183 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 11:58:12.098999 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098186 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 11:58:12.098999 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098188 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 11:58:12.098999 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098191 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 11:58:12.098999 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098195 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 11:58:12.098999 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098198 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 11:58:12.098999 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098200 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 11:58:12.098999 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098203 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 11:58:12.098999 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098206 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 11:58:12.098999 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098208 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 11:58:12.099490 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098211 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 11:58:12.099490 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098215 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 11:58:12.099490 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098218 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 11:58:12.099490 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098221 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 11:58:12.099490 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098224 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 11:58:12.099490 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098226 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 11:58:12.099490 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098229 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 11:58:12.099490 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098231 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 11:58:12.099490 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098234 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 11:58:12.099490 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098236 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 11:58:12.099490 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098239 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 11:58:12.099490 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098242 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 11:58:12.099490 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098244 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 11:58:12.099490 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098247 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 11:58:12.099490 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098249 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 11:58:12.099490 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098253 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 11:58:12.099490 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098256 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 11:58:12.099490 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098258 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 11:58:12.099490 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098261 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 11:58:12.099490 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098264 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 11:58:12.099966 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098266 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 11:58:12.099966 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098269 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 11:58:12.099966 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098272 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 11:58:12.099966 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098274 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 11:58:12.099966 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098277 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 11:58:12.099966 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098280 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 11:58:12.099966 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098284 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 11:58:12.099966 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098287 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 11:58:12.099966 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098290 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 11:58:12.099966 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098292 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 11:58:12.099966 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098295 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 11:58:12.099966 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098297 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 11:58:12.099966 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098300 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 11:58:12.099966 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098303 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 11:58:12.099966 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098306 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 11:58:12.099966 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098310 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 11:58:12.099966 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098313 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 11:58:12.099966 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098316 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 11:58:12.099966 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.098318 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 11:58:12.100486 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099031 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 11:58:12.100486 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099052 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 11:58:12.100486 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099056 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 11:58:12.100486 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099059 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 11:58:12.100486 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099072 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 11:58:12.100486 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099075 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 11:58:12.100486 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099078 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 11:58:12.100486 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099080 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 11:58:12.100486 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099083 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 11:58:12.100486 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099086 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 11:58:12.100486 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099089 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 11:58:12.100486 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099091 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 11:58:12.100486 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099094 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 11:58:12.100486 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099097 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 11:58:12.100486 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099099 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 11:58:12.100486 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099102 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 11:58:12.100486 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099105 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 11:58:12.100486 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099107 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 11:58:12.100486 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099112 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 11:58:12.100961 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099116 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 11:58:12.100961 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099120 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 11:58:12.100961 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099124 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 11:58:12.100961 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099127 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 11:58:12.100961 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099130 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 11:58:12.100961 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099133 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 11:58:12.100961 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099135 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 11:58:12.100961 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099138 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 11:58:12.100961 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099140 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 11:58:12.100961 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099143 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 11:58:12.100961 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099146 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 11:58:12.100961 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099149 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 11:58:12.100961 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099151 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 11:58:12.100961 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099154 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 11:58:12.100961 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099158 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 11:58:12.100961 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099161 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 11:58:12.100961 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099163 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 11:58:12.100961 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099167 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 11:58:12.100961 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099171 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 11:58:12.101443 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099175 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 11:58:12.101443 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099178 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 11:58:12.101443 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099181 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 11:58:12.101443 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099183 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 11:58:12.101443 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099186 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 11:58:12.101443 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099189 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 11:58:12.101443 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099191 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 11:58:12.101443 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099194 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 11:58:12.101443 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099198 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 11:58:12.101443 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099200 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 11:58:12.101443 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099203 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 11:58:12.101443 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099206 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 11:58:12.101443 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099208 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 11:58:12.101443 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099211 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 11:58:12.101443 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099214 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 11:58:12.101443 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099216 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 11:58:12.101443 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099219 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 11:58:12.101443 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099222 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 11:58:12.101443 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099225 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 11:58:12.101443 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099228 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 11:58:12.101992 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099230 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 11:58:12.101992 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099233 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 11:58:12.101992 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099241 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 11:58:12.101992 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099244 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 11:58:12.101992 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099246 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 11:58:12.101992 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099249 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 11:58:12.101992 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099251 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 11:58:12.101992 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099254 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 10 11:58:12.101992 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099257 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 11:58:12.101992 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099259 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 11:58:12.101992 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099262 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 11:58:12.101992 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099265 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 11:58:12.101992 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099267 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 11:58:12.101992 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099270 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 11:58:12.101992 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099272 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 11:58:12.101992 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099275 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 11:58:12.101992 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099278 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 11:58:12.101992 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099280 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 11:58:12.101992 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099283 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 11:58:12.101992 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099285 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 11:58:12.102495 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099288 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 11:58:12.102495 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099290 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 11:58:12.102495 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099293 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 11:58:12.102495 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099295 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 11:58:12.102495 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099298 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 11:58:12.102495 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099300 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 11:58:12.102495 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099303 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 11:58:12.102495 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099305 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 11:58:12.102495 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099308 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 11:58:12.102495 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099311 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 11:58:12.102495 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099314 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 11:58:12.102495 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099316 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 11:58:12.102495 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099319 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 11:58:12.102495 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099321 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 11:58:12.102495 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099323 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 11:58:12.102495 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099326 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 11:58:12.102495 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099329 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 11:58:12.102495 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099332 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 11:58:12.102495 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099335 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 11:58:12.102950 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099337 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 11:58:12.102950 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099340 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 11:58:12.102950 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099700 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 11:58:12.102950 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099705 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 11:58:12.102950 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099708 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 11:58:12.102950 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099710 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 11:58:12.102950 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099713 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 11:58:12.102950 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099716 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 11:58:12.102950 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099719 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 11:58:12.102950 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099722 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 11:58:12.102950 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099724 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 11:58:12.102950 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099727 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 11:58:12.102950 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099730 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 11:58:12.102950 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099732 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 11:58:12.102950 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099734 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 11:58:12.102950 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099737 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 11:58:12.102950 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099739 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 11:58:12.102950 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099742 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 11:58:12.102950 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099746 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 11:58:12.103414 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099749 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 11:58:12.103414 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099752 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 11:58:12.103414 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099755 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 11:58:12.103414 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099758 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 11:58:12.103414 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099760 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 11:58:12.103414 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099763 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 11:58:12.103414 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099765 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 11:58:12.103414 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099767 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 11:58:12.103414 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099770 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 11:58:12.103414 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099773 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 11:58:12.103414 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099778 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 11:58:12.103414 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099781 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 11:58:12.103414 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099783 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 11:58:12.103414 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099786 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 11:58:12.103414 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099789 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 11:58:12.103414 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099791 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 11:58:12.103414 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099794 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 11:58:12.103414 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099796 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 11:58:12.103414 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099799 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 11:58:12.103414 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099801 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 11:58:12.103890 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099803 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 11:58:12.103890 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099807 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 11:58:12.103890 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099811 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 11:58:12.103890 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099813 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 11:58:12.103890 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099816 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 11:58:12.103890 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099819 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 11:58:12.103890 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099821 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 11:58:12.103890 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099824 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 11:58:12.103890 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099827 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 11:58:12.103890 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099830 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 11:58:12.103890 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099833 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 11:58:12.103890 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099836 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 11:58:12.103890 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099838 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 11:58:12.103890 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099841 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 11:58:12.103890 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099843 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 11:58:12.103890 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099846 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 11:58:12.103890 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099849 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 11:58:12.103890 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099851 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 11:58:12.103890 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099854 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 11:58:12.103890 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099856 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 11:58:12.104407 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099859 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 11:58:12.104407 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099861 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 11:58:12.104407 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099866 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 11:58:12.104407 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099868 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 11:58:12.104407 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099871 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 11:58:12.104407 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099874 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 11:58:12.104407 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099876 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 11:58:12.104407 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099879 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 11:58:12.104407 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099881 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 11:58:12.104407 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099884 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 11:58:12.104407 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099887 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 11:58:12.104407 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099890 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 11:58:12.104407 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099892 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 11:58:12.104407 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099895 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 11:58:12.104407 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099897 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 11:58:12.104407 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099900 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 11:58:12.104407 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099902 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 11:58:12.104407 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099905 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 11:58:12.104407 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099907 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 11:58:12.104407 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099909 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 11:58:12.104880 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099912 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 11:58:12.104880 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099915 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 11:58:12.104880 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099917 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 11:58:12.104880 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099920 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 11:58:12.104880 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099922 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 11:58:12.104880 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099925 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 11:58:12.104880 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099927 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 11:58:12.104880 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099930 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 11:58:12.104880 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099933 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 11:58:12.104880 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099936 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 11:58:12.104880 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099939 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 11:58:12.104880 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099941 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 11:58:12.104880 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099943 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 11:58:12.104880 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099946 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 11:58:12.104880 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099950 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 11:58:12.104880 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099952 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 11:58:12.104880 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099955 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 11:58:12.104880 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099957 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 10 11:58:12.104880 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099960 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 11:58:12.104880 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099963 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 11:58:12.105416 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099965 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 11:58:12.105416 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.099968 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 11:58:12.105416 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100056 2562 flags.go:64] FLAG: --address="0.0.0.0" Jun 10 11:58:12.105416 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100066 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 10 11:58:12.105416 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100077 2562 flags.go:64] FLAG: --anonymous-auth="true" Jun 10 11:58:12.105416 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100084 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 10 11:58:12.105416 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100089 2562 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 10 11:58:12.105416 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100092 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 10 11:58:12.105416 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100096 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 10 11:58:12.105416 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100100 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 10 11:58:12.105416 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100103 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 10 11:58:12.105416 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100106 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 10 11:58:12.105416 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100110 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 10 11:58:12.105416 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100113 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 10 11:58:12.105416 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100116 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 10 11:58:12.105416 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100119 2562 flags.go:64] FLAG: --cgroup-root="" Jun 10 11:58:12.105416 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100122 2562 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 10 11:58:12.105416 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100125 2562 flags.go:64] FLAG: --client-ca-file="" Jun 10 11:58:12.105416 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100128 2562 flags.go:64] FLAG: --cloud-provider="external" Jun 10 11:58:12.105416 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100131 2562 flags.go:64] FLAG: --cluster-dns="[]" Jun 10 11:58:12.105416 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100134 2562 flags.go:64] FLAG: --cluster-domain="" Jun 10 11:58:12.105416 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100137 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 10 11:58:12.105416 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100141 2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 10 11:58:12.105416 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100144 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 10 11:58:12.105997 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100148 2562 flags.go:64] FLAG: --container-log-max-files="5" Jun 10 11:58:12.105997 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100151 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 10 11:58:12.105997 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100156 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 10 11:58:12.105997 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100159 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 10 11:58:12.105997 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100163 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 10 11:58:12.105997 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100165 2562 flags.go:64] FLAG: --contention-profiling="false" Jun 10 11:58:12.105997 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100169 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 10 11:58:12.105997 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100173 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 10 11:58:12.105997 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100176 2562 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 10 11:58:12.105997 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100179 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 10 11:58:12.105997 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100183 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 10 11:58:12.105997 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100186 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 10 11:58:12.105997 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100189 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 10 11:58:12.105997 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100192 2562 flags.go:64] FLAG: --enable-load-reader="false" Jun 10 11:58:12.105997 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100195 2562 flags.go:64] FLAG: --enable-server="true" Jun 10 11:58:12.105997 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100198 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 10 11:58:12.105997 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100202 2562 flags.go:64] FLAG: --event-burst="100" Jun 10 11:58:12.105997 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100206 2562 flags.go:64] FLAG: --event-qps="50" Jun 10 11:58:12.105997 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100209 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 10 11:58:12.105997 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100212 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 10 11:58:12.105997 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100214 2562 flags.go:64] FLAG: --eviction-hard="" Jun 10 11:58:12.105997 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100218 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 10 11:58:12.105997 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100221 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 10 11:58:12.105997 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100224 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 10 11:58:12.105997 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100227 2562 flags.go:64] FLAG: --eviction-soft="" Jun 10 11:58:12.106978 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100230 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 10 11:58:12.106978 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100233 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 10 11:58:12.106978 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100236 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 10 11:58:12.106978 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100239 2562 flags.go:64] FLAG: --experimental-mounter-path="" Jun 10 11:58:12.106978 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100242 2562 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 10 11:58:12.106978 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100245 2562 flags.go:64] FLAG: --fail-swap-on="true" Jun 10 11:58:12.106978 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100248 2562 flags.go:64] FLAG: --feature-gates="" Jun 10 11:58:12.106978 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100252 2562 flags.go:64] FLAG: --file-check-frequency="20s" Jun 10 11:58:12.106978 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100255 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 10 11:58:12.106978 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100262 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 10 11:58:12.106978 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100269 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 10 11:58:12.106978 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100272 2562 flags.go:64] FLAG: --healthz-port="10248" Jun 10 11:58:12.106978 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100275 2562 flags.go:64] FLAG: --help="false" Jun 10 11:58:12.106978 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100278 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-139-86.ec2.internal" Jun 10 11:58:12.106978 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100281 2562 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 10 11:58:12.106978 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100284 2562 flags.go:64] FLAG: --http-check-frequency="20s" Jun 10 11:58:12.106978 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100287 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 10 11:58:12.106978 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100290 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 10 11:58:12.106978 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100294 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 10 11:58:12.106978 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100297 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 10 11:58:12.106978 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100299 2562 flags.go:64] FLAG: --image-service-endpoint="" Jun 10 11:58:12.106978 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100302 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 10 11:58:12.106978 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100305 2562 flags.go:64] FLAG: --kube-api-burst="100" Jun 10 11:58:12.107976 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100308 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 10 11:58:12.107976 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100311 2562 flags.go:64] FLAG: --kube-api-qps="50" Jun 10 11:58:12.107976 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100314 2562 flags.go:64] FLAG: --kube-reserved="" Jun 10 11:58:12.107976 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100317 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 10 11:58:12.107976 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100320 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 10 11:58:12.107976 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100323 2562 flags.go:64] FLAG: --kubelet-cgroups="" Jun 10 11:58:12.107976 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100325 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 10 11:58:12.107976 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100328 2562 flags.go:64] FLAG: --lock-file="" Jun 10 11:58:12.107976 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100331 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 10 11:58:12.107976 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100333 2562 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 10 11:58:12.107976 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100336 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 10 11:58:12.107976 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100342 2562 flags.go:64] FLAG: --log-json-split-stream="false" Jun 10 11:58:12.107976 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100345 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 10 11:58:12.107976 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100347 2562 flags.go:64] FLAG: --log-text-split-stream="false" Jun 10 11:58:12.107976 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100350 2562 flags.go:64] FLAG: --logging-format="text" Jun 10 11:58:12.107976 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100353 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 10 11:58:12.107976 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100356 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 10 11:58:12.107976 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100359 2562 flags.go:64] FLAG: --manifest-url="" Jun 10 11:58:12.107976 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100364 2562 flags.go:64] FLAG: --manifest-url-header="" Jun 10 11:58:12.107976 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100383 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 10 11:58:12.107976 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100386 2562 flags.go:64] FLAG: --max-open-files="1000000" Jun 10 11:58:12.107976 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100390 2562 flags.go:64] FLAG: --max-pods="110" Jun 10 11:58:12.107976 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100394 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 10 11:58:12.107976 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100397 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 10 11:58:12.107976 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100400 2562 flags.go:64] FLAG: --memory-manager-policy="None" Jun 10 11:58:12.108777 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100403 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 10 11:58:12.108777 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100406 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 10 11:58:12.108777 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100408 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 10 11:58:12.108777 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100411 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 10 11:58:12.108777 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100418 2562 flags.go:64] FLAG: --node-status-max-images="50" Jun 10 11:58:12.108777 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100421 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 10 11:58:12.108777 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100424 2562 flags.go:64] FLAG: --oom-score-adj="-999" Jun 10 11:58:12.108777 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100427 2562 flags.go:64] FLAG: --pod-cidr="" Jun 10 11:58:12.108777 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100430 2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 10 11:58:12.108777 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100435 2562 flags.go:64] FLAG: --pod-manifest-path="" Jun 10 11:58:12.108777 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100438 2562 flags.go:64] FLAG: --pod-max-pids="-1" Jun 10 11:58:12.108777 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100441 2562 flags.go:64] FLAG: --pods-per-core="0" Jun 10 11:58:12.108777 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100444 2562 flags.go:64] FLAG: --port="10250" Jun 10 11:58:12.108777 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100448 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 10 11:58:12.108777 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100451 2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00f8b6b8878d97e5e" Jun 10 11:58:12.108777 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100454 2562 flags.go:64] FLAG: --qos-reserved="" Jun 10 11:58:12.108777 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100457 2562 flags.go:64] FLAG: --read-only-port="10255" Jun 10 11:58:12.108777 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100460 2562 flags.go:64] FLAG: --register-node="true" Jun 10 11:58:12.108777 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100463 2562 flags.go:64] FLAG: --register-with-taints="" Jun 10 11:58:12.108777 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100467 2562 flags.go:64] FLAG: --registry-burst="10" Jun 10 11:58:12.108777 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100470 2562 flags.go:64] FLAG: --registry-qps="5" Jun 10 11:58:12.108777 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100473 2562 flags.go:64] FLAG: --reserved-cpus="" Jun 10 11:58:12.108777 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100475 2562 flags.go:64] FLAG: --reserved-memory="" Jun 10 11:58:12.108777 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100479 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 10 11:58:12.108777 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100483 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 10 11:58:12.109411 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100488 2562 flags.go:64] FLAG: --rotate-certificates="false" Jun 10 11:58:12.109411 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100491 2562 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 10 11:58:12.109411 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100496 2562 flags.go:64] FLAG: --runonce="false" Jun 10 11:58:12.109411 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100499 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 10 11:58:12.109411 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100502 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 10 11:58:12.109411 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100506 2562 flags.go:64] FLAG: --seccomp-default="false" Jun 10 11:58:12.109411 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100509 2562 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 10 11:58:12.109411 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100512 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 10 11:58:12.109411 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100515 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 10 11:58:12.109411 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100532 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 10 11:58:12.109411 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100536 2562 flags.go:64] FLAG: --storage-driver-password="root" Jun 10 11:58:12.109411 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100540 2562 flags.go:64] FLAG: --storage-driver-secure="false" Jun 10 11:58:12.109411 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100543 2562 flags.go:64] FLAG: --storage-driver-table="stats" Jun 10 11:58:12.109411 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100546 2562 flags.go:64] FLAG: --storage-driver-user="root" Jun 10 11:58:12.109411 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100549 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 10 11:58:12.109411 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100552 2562 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 10 11:58:12.109411 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100555 2562 flags.go:64] FLAG: --system-cgroups="" Jun 10 11:58:12.109411 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100558 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 10 11:58:12.109411 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100563 2562 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 10 11:58:12.109411 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100566 2562 flags.go:64] FLAG: --tls-cert-file="" Jun 10 11:58:12.109411 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100569 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 10 11:58:12.109411 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100572 2562 flags.go:64] FLAG: --tls-min-version="" Jun 10 11:58:12.109411 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100575 2562 flags.go:64] FLAG: --tls-private-key-file="" Jun 10 11:58:12.109411 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100578 2562 flags.go:64] FLAG: --topology-manager-policy="none" Jun 10 11:58:12.109411 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100581 2562 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 10 11:58:12.110015 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100584 2562 flags.go:64] FLAG: --topology-manager-scope="container" Jun 10 11:58:12.110015 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100587 2562 flags.go:64] FLAG: --v="2" Jun 10 11:58:12.110015 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100591 2562 flags.go:64] FLAG: --version="false" Jun 10 11:58:12.110015 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100594 2562 flags.go:64] FLAG: --vmodule="" Jun 10 11:58:12.110015 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100598 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 10 11:58:12.110015 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.100602 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 10 11:58:12.110015 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100759 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 11:58:12.110015 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100777 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 11:58:12.110015 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100780 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 11:58:12.110015 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100785 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 11:58:12.110015 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100787 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 11:58:12.110015 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100790 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 11:58:12.110015 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100793 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 11:58:12.110015 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100796 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 11:58:12.110015 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100798 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 11:58:12.110015 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100801 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 11:58:12.110015 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100805 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 11:58:12.110015 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100809 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 11:58:12.110015 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100812 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 11:58:12.110015 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100814 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 11:58:12.110522 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100817 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 11:58:12.110522 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100819 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 11:58:12.110522 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100822 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 11:58:12.110522 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100824 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 11:58:12.110522 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100827 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 11:58:12.110522 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100830 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 11:58:12.110522 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100832 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 11:58:12.110522 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100835 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 11:58:12.110522 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100837 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 11:58:12.110522 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100840 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 11:58:12.110522 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100843 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 11:58:12.110522 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100846 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 11:58:12.110522 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100848 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 10 11:58:12.110522 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100851 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 11:58:12.110522 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100853 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 11:58:12.110522 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100856 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 11:58:12.110522 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100859 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 11:58:12.110522 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100861 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 11:58:12.110522 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100864 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 11:58:12.110522 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100867 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 11:58:12.111014 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100875 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 11:58:12.111014 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100879 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 11:58:12.111014 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100882 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 11:58:12.111014 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100884 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 11:58:12.111014 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100887 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 11:58:12.111014 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100889 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 11:58:12.111014 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100892 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 11:58:12.111014 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100894 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 11:58:12.111014 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100897 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 11:58:12.111014 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100899 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 11:58:12.111014 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100902 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 11:58:12.111014 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100905 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 11:58:12.111014 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100907 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 11:58:12.111014 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100910 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 11:58:12.111014 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100912 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 11:58:12.111014 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100915 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 11:58:12.111014 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100917 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 11:58:12.111014 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100920 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 11:58:12.111014 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100923 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 11:58:12.111014 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100925 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 11:58:12.111527 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100928 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 11:58:12.111527 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100930 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 11:58:12.111527 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100933 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 11:58:12.111527 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100935 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 11:58:12.111527 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100938 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 11:58:12.111527 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100941 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 11:58:12.111527 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100943 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 11:58:12.111527 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100947 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 11:58:12.111527 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100949 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 11:58:12.111527 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100952 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 11:58:12.111527 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100955 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 11:58:12.111527 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100957 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 11:58:12.111527 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100960 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 11:58:12.111527 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100971 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 11:58:12.111527 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100974 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 11:58:12.111527 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100977 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 11:58:12.111527 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100980 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 11:58:12.111527 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100982 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 11:58:12.111527 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100985 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 11:58:12.111527 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100988 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 11:58:12.112014 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100991 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 11:58:12.112014 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100994 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 11:58:12.112014 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.100998 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 11:58:12.112014 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.101001 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 11:58:12.112014 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.101004 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 11:58:12.112014 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.101007 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 11:58:12.112014 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.101010 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 11:58:12.112014 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.101012 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 11:58:12.112014 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.101015 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 11:58:12.112014 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.101017 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 11:58:12.112014 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.101020 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 11:58:12.112014 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.101023 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 11:58:12.112014 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.101025 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 11:58:12.112014 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.101028 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 11:58:12.112014 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.101030 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 11:58:12.112014 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.101033 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 11:58:12.112014 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.101036 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 11:58:12.112014 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.101050 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 11:58:12.112014 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.101053 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 11:58:12.112492 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.101056 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 11:58:12.112492 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.101058 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 11:58:12.112492 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.101061 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 11:58:12.112492 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.101063 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 11:58:12.112492 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.101066 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 11:58:12.112492 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.101070 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 11:58:12.112492 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.101077 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 11:58:12.112492 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.109187 2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 10 11:58:12.112492 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.109202 2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 10 11:58:12.112492 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.109876 2562 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 10 11:58:12.112492 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.109883 2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 10 11:58:12.112492 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.109940 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 11:58:12.112492 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.109945 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 11:58:12.112492 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.109949 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 11:58:12.112492 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.109952 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 11:58:12.112902 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.109955 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 11:58:12.112902 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.109958 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 11:58:12.112902 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.109961 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 11:58:12.112902 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.109964 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 11:58:12.112902 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.109966 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 11:58:12.112902 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.109969 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 11:58:12.112902 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.109972 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 11:58:12.112902 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.109974 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 11:58:12.112902 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.109977 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 11:58:12.112902 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.109979 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 11:58:12.112902 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.109982 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 11:58:12.112902 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.109984 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 11:58:12.112902 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.109987 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 11:58:12.112902 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.109990 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 11:58:12.112902 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.109993 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 11:58:12.112902 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.109996 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 11:58:12.112902 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.109999 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 11:58:12.112902 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110003 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 11:58:12.112902 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110006 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 11:58:12.112902 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110009 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 11:58:12.113460 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110011 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 11:58:12.113460 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110014 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 11:58:12.113460 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110016 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 11:58:12.113460 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110019 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 11:58:12.113460 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110022 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 11:58:12.113460 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110025 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 11:58:12.113460 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110028 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 11:58:12.113460 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110031 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 11:58:12.113460 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110034 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 11:58:12.113460 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110036 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 11:58:12.113460 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110054 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 11:58:12.113460 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110057 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 11:58:12.113460 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110060 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 11:58:12.113460 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110063 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 11:58:12.113460 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110066 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 11:58:12.113460 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110069 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 11:58:12.113460 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110071 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 11:58:12.113460 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110074 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 11:58:12.113460 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110077 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 11:58:12.113460 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110080 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 11:58:12.113949 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110082 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 11:58:12.113949 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110085 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 11:58:12.113949 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110088 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 11:58:12.113949 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110091 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 11:58:12.113949 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110094 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 11:58:12.113949 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110096 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 11:58:12.113949 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110099 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 11:58:12.113949 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110102 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 11:58:12.113949 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110105 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 11:58:12.113949 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110108 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 11:58:12.113949 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110111 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 11:58:12.113949 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110113 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 11:58:12.113949 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110116 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 11:58:12.113949 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110118 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 11:58:12.113949 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110121 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 11:58:12.113949 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110124 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 11:58:12.113949 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110126 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 11:58:12.113949 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110129 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 11:58:12.113949 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110132 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 11:58:12.113949 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110135 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 11:58:12.114494 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110138 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 11:58:12.114494 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110140 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 11:58:12.114494 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110143 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 11:58:12.114494 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110146 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 10 11:58:12.114494 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110148 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 11:58:12.114494 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110151 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 11:58:12.114494 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110153 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 11:58:12.114494 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110156 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 11:58:12.114494 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110159 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 11:58:12.114494 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110162 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 11:58:12.114494 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110164 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 11:58:12.114494 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110167 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 11:58:12.114494 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110169 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 11:58:12.114494 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110172 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 11:58:12.114494 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110174 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 11:58:12.114494 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110179 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 11:58:12.114494 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110184 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 11:58:12.114494 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110187 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 11:58:12.114494 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110191 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 11:58:12.114949 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110194 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 11:58:12.114949 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110197 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 11:58:12.114949 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110201 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 11:58:12.114949 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110205 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 11:58:12.114949 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110207 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 11:58:12.114949 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110210 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 11:58:12.114949 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110213 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 11:58:12.114949 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110216 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 11:58:12.114949 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110218 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 11:58:12.114949 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110221 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 11:58:12.114949 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110223 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 11:58:12.114949 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110226 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 11:58:12.114949 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110228 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 11:58:12.114949 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110231 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 11:58:12.114949 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110233 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 11:58:12.114949 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110236 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 11:58:12.115355 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.110241 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 11:58:12.115355 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110352 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 11:58:12.115355 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110357 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 11:58:12.115355 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110360 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 11:58:12.115355 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110364 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 11:58:12.115355 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110368 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 11:58:12.115355 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110372 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 11:58:12.115355 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110375 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 11:58:12.115355 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110378 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 11:58:12.115355 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110381 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 11:58:12.115355 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110384 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 11:58:12.115355 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110386 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 11:58:12.115355 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110389 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 11:58:12.115355 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110393 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 11:58:12.115355 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110396 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 11:58:12.115730 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110399 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 11:58:12.115730 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110402 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 11:58:12.115730 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110405 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 11:58:12.115730 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110409 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 11:58:12.115730 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110412 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 11:58:12.115730 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110415 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 11:58:12.115730 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110418 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 11:58:12.115730 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110420 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 11:58:12.115730 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110423 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 11:58:12.115730 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110426 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 11:58:12.115730 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110428 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 11:58:12.115730 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110431 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 11:58:12.115730 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110434 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 11:58:12.115730 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110436 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 11:58:12.115730 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110438 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 11:58:12.115730 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110441 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 11:58:12.115730 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110444 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 11:58:12.115730 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110446 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 11:58:12.115730 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110449 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 11:58:12.115730 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110452 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 11:58:12.116267 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110454 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 11:58:12.116267 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110457 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 11:58:12.116267 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110460 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 11:58:12.116267 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110463 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 11:58:12.116267 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110466 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 11:58:12.116267 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110468 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 11:58:12.116267 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110471 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 11:58:12.116267 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110474 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 11:58:12.116267 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110476 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 11:58:12.116267 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110479 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 11:58:12.116267 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110482 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 11:58:12.116267 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110485 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 11:58:12.116267 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110487 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 11:58:12.116267 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110490 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 11:58:12.116267 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110493 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 11:58:12.116267 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110495 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 11:58:12.116267 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110498 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 11:58:12.116267 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110500 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 11:58:12.116267 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110503 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 11:58:12.116771 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110506 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 11:58:12.116771 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110508 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 10 11:58:12.116771 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110511 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 11:58:12.116771 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110513 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 11:58:12.116771 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110516 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 11:58:12.116771 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110519 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 11:58:12.116771 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110521 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 11:58:12.116771 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110524 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 11:58:12.116771 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110526 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 11:58:12.116771 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110529 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 11:58:12.116771 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110532 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 11:58:12.116771 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110534 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 11:58:12.116771 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110537 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 11:58:12.116771 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110541 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 11:58:12.116771 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110544 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 11:58:12.116771 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110546 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 11:58:12.116771 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110549 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 11:58:12.116771 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110551 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 11:58:12.116771 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110554 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 11:58:12.116771 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110556 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 11:58:12.117412 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110559 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 11:58:12.117412 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110561 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 11:58:12.117412 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110564 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 11:58:12.117412 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110566 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 11:58:12.117412 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110569 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 11:58:12.117412 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110573 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 11:58:12.117412 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110575 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 11:58:12.117412 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110578 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 11:58:12.117412 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110580 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 11:58:12.117412 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110583 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 11:58:12.117412 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110585 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 11:58:12.117412 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110588 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 11:58:12.117412 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110591 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 11:58:12.117412 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110593 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 11:58:12.117412 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110596 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 11:58:12.117412 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110598 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 11:58:12.117412 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110601 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 11:58:12.117412 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110603 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 11:58:12.117412 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110606 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 11:58:12.117412 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110609 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 11:58:12.117893 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110611 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 11:58:12.117893 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110613 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 11:58:12.117893 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110616 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 11:58:12.117893 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110619 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 11:58:12.117893 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110621 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 11:58:12.117893 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:12.110624 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 11:58:12.117893 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.110629 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 11:58:12.117893 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.110738 2562 server.go:962] "Client rotation is on, will bootstrap in background" Jun 10 11:58:12.117893 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.112736 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 10 11:58:12.117893 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.114094 2562 server.go:1019] "Starting client certificate rotation" Jun 10 11:58:12.117893 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.114188 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 11:58:12.117893 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.114223 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 11:58:12.117893 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.116658 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 11:58:12.118234 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.117776 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 11:58:12.126978 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.126962 2562 log.go:25] "Validated CRI v1 runtime API" Jun 10 11:58:12.131559 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.131542 2562 log.go:25] "Validated CRI v1 image API" Jun 10 11:58:12.132404 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.132390 2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 10 11:58:12.135331 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.135305 2562 fs.go:135] Filesystem UUIDs: map[786cd473-d888-4f17-aac9-3b5e72212216:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 8bfeb283-6a69-408a-9a5c-a160351653de:/dev/nvme0n1p4] Jun 10 11:58:12.135401 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.135329 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 10 11:58:12.142125 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.141988 2562 manager.go:216] Machine: {Timestamp:2026-06-10 11:58:12.140314674 +0000 UTC m=+0.346065511 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100418 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec279fcb532639ea91be9e61c108e7cc SystemUUID:ec279fcb-5326-39ea-91be-9e61c108e7cc BootID:a71374e7-1671-4a12-98ca-06ff87523776 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:59:d7:78:47:11 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:59:d7:78:47:11 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ee:50:48:e0:45:df Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 10 11:58:12.142125 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.142114 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 10 11:58:12.142253 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.142187 2562 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 10 11:58:12.145328 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.145295 2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 10 11:58:12.145493 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.145330 2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-86.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 10 11:58:12.146670 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.146659 2562 topology_manager.go:138] "Creating topology manager with none policy" Jun 10 11:58:12.146710 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.146673 2562 container_manager_linux.go:309] "Creating device plugin manager" Jun 10 11:58:12.146710 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.146682 2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 11:58:12.147206 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.147195 2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 11:58:12.148073 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.148033 2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 10 11:58:12.151110 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.151098 2562 state_mem.go:36] "Initialized new in-memory state store" Jun 10 11:58:12.151231 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.151222 2562 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 10 11:58:12.151263 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.151252 2562 kubelet.go:486] "Attempting to sync node with API server" Jun 10 11:58:12.151263 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.151261 2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 10 11:58:12.151319 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.151279 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 10 11:58:12.151319 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.151289 2562 kubelet.go:398] "Adding apiserver pod source" Jun 10 11:58:12.151319 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.151298 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 10 11:58:12.151676 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.151657 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 11:58:12.151676 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.151676 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 11:58:12.151841 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.151699 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 11:58:12.153808 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.153784 2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 10 11:58:12.155453 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.155439 2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 10 11:58:12.155492 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.155470 2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 10 11:58:12.156550 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.156535 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 10 11:58:12.156593 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.156564 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 10 11:58:12.156593 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.156576 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 10 11:58:12.156593 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.156589 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 10 11:58:12.156674 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.156604 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 10 11:58:12.156674 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.156616 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 10 11:58:12.156674 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.156628 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 10 11:58:12.156674 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.156637 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 10 11:58:12.156674 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.156645 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 10 11:58:12.156674 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.156652 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 10 11:58:12.156674 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.156661 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 10 11:58:12.156674 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.156666 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 10 11:58:12.157430 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.157420 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 10 11:58:12.157430 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.157430 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 10 11:58:12.160364 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:12.160334 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-86.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 10 11:58:12.160464 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.160374 2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-86.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 10 11:58:12.160464 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:12.160384 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 10 11:58:12.161012 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.161001 2562 server.go:1268] "Started kubelet" Jun 10 11:58:12.161119 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.161093 2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 10 11:58:12.161175 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.161093 2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 10 11:58:12.161224 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.161172 2562 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 10 11:58:12.161816 ip-10-0-139-86 systemd[1]: Started Kubernetes Kubelet. Jun 10 11:58:12.162883 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.162809 2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 10 11:58:12.163214 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.163202 2562 server.go:310] "Adding debug handlers to kubelet server" Jun 10 11:58:12.167232 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:12.166323 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-86.ec2.internal.18b7b65dec4c918a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-86.ec2.internal,UID:ip-10-0-139-86.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-86.ec2.internal,},FirstTimestamp:2026-06-10 11:58:12.160975242 +0000 UTC m=+0.366726078,LastTimestamp:2026-06-10 11:58:12.160975242 +0000 UTC m=+0.366726078,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-86.ec2.internal,}" Jun 10 11:58:12.168427 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.168408 2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 10 11:58:12.168521 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.168428 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 10 11:58:12.168521 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:12.168464 2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 10 11:58:12.168521 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:12.168507 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-86.ec2.internal\" not found" Jun 10 11:58:12.169027 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.169009 2562 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 10 11:58:12.169129 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.169029 2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 10 11:58:12.169129 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.169030 2562 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 10 11:58:12.169233 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.169181 2562 reconstruct.go:97] "Volume reconstruction finished" Jun 10 11:58:12.169233 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.169192 2562 reconciler.go:29] "Reconciler: start to sync state" Jun 10 11:58:12.169318 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.169305 2562 factory.go:55] Registering systemd factory Jun 10 11:58:12.169364 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.169320 2562 factory.go:223] Registration of the systemd container factory successfully Jun 10 11:58:12.169552 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.169536 2562 factory.go:153] Registering CRI-O factory Jun 10 11:58:12.169629 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.169554 2562 factory.go:223] Registration of the crio container factory successfully Jun 10 11:58:12.169629 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.169620 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 10 11:58:12.169719 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.169640 2562 factory.go:103] Registering Raw factory Jun 10 11:58:12.169719 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.169652 2562 manager.go:1196] Started watching for new ooms in manager Jun 10 11:58:12.170091 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.170078 2562 manager.go:349] Starting recovery of all containers Jun 10 11:58:12.177701 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:12.177584 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 10 11:58:12.177701 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:12.177633 2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-86.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 10 11:58:12.182208 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.182189 2562 manager.go:354] Recovery completed Jun 10 11:58:12.182208 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.182199 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4jbzc" Jun 10 11:58:12.187237 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.187210 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 11:58:12.189150 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.189134 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-86.ec2.internal" event="NodeHasSufficientMemory" Jun 10 11:58:12.189234 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.189168 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-86.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 11:58:12.189234 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.189183 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-86.ec2.internal" event="NodeHasSufficientPID" Jun 10 11:58:12.189743 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.189730 2562 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 10 11:58:12.189743 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.189736 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 11:58:12.189743 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.189740 2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 10 11:58:12.189867 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.189756 2562 state_mem.go:36] "Initialized new in-memory state store" Jun 10 11:58:12.191065 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.191034 2562 policy_none.go:49] "None policy: Start" Jun 10 11:58:12.191126 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.191069 2562 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 10 11:58:12.191126 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.191083 2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 10 11:58:12.191227 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.191156 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-86.ec2.internal" event="NodeHasSufficientMemory" Jun 10 11:58:12.191227 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.191185 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-86.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 11:58:12.191227 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.191201 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-86.ec2.internal" event="NodeHasSufficientPID" Jun 10 11:58:12.191402 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:12.191330 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-86.ec2.internal.18b7b65dedfa7c0f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-86.ec2.internal,UID:ip-10-0-139-86.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-86.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-86.ec2.internal,},FirstTimestamp:2026-06-10 11:58:12.189150223 +0000 UTC m=+0.394901062,LastTimestamp:2026-06-10 11:58:12.189150223 +0000 UTC m=+0.394901062,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-86.ec2.internal,}" Jun 10 11:58:12.191727 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.191714 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4jbzc" Jun 10 11:58:12.192434 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.192421 2562 policy_none.go:47] "Start" Jun 10 11:58:12.235720 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.235578 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 10 11:58:12.238469 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.236785 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 10 11:58:12.238469 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.236824 2562 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 10 11:58:12.238469 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.236846 2562 kubelet.go:2448] "Starting kubelet main sync loop" Jun 10 11:58:12.238469 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:12.236920 2562 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Jun 10 11:58:12.238469 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.237809 2562 manager.go:337] "Starting Device Plugin manager" Jun 10 11:58:12.238469 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:12.237845 2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 10 11:58:12.238469 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.237855 2562 server.go:87] "Starting device plugin registration server" Jun 10 11:58:12.238469 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.238143 2562 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 10 11:58:12.238469 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.238157 2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 10 11:58:12.238469 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.238296 2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 10 11:58:12.238469 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.238449 2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 10 11:58:12.238469 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.238460 2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 10 11:58:12.238990 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:12.238764 2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 10 11:58:12.238990 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:12.238813 2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-86.ec2.internal\" not found" Jun 10 11:58:12.239245 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.239230 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 11:58:12.337808 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.337776 2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-86.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-86.ec2.internal"] Jun 10 11:58:12.337927 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.337871 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 11:58:12.338303 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.338290 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 11:58:12.339087 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.339069 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-86.ec2.internal" event="NodeHasSufficientMemory" Jun 10 11:58:12.339176 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.339098 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-86.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 11:58:12.339176 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.339108 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-86.ec2.internal" event="NodeHasSufficientPID" Jun 10 11:58:12.339176 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.339129 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-86.ec2.internal" Jun 10 11:58:12.339348 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.339333 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-86.ec2.internal" event="NodeHasSufficientMemory" Jun 10 11:58:12.339402 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.339355 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-86.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 11:58:12.339402 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.339364 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-86.ec2.internal" event="NodeHasSufficientPID" Jun 10 11:58:12.340664 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.340652 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 11:58:12.340770 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.340756 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-86.ec2.internal" Jun 10 11:58:12.340825 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.340799 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 11:58:12.342084 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.342028 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-86.ec2.internal" event="NodeHasSufficientMemory" Jun 10 11:58:12.342084 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.342068 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-86.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 11:58:12.342084 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.342070 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-86.ec2.internal" event="NodeHasSufficientMemory" Jun 10 11:58:12.342084 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.342084 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-86.ec2.internal" event="NodeHasSufficientPID" Jun 10 11:58:12.342306 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.342093 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-86.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 11:58:12.342306 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.342103 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-86.ec2.internal" event="NodeHasSufficientPID" Jun 10 11:58:12.343309 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.343295 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-86.ec2.internal" Jun 10 11:58:12.343379 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.343318 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 11:58:12.344194 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.344178 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-86.ec2.internal" event="NodeHasSufficientMemory" Jun 10 11:58:12.344276 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.344205 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-86.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 11:58:12.344276 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.344220 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-86.ec2.internal" event="NodeHasSufficientPID" Jun 10 11:58:12.350624 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.350610 2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-86.ec2.internal" Jun 10 11:58:12.350695 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:12.350629 2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-86.ec2.internal\": node \"ip-10-0-139-86.ec2.internal\" not found" Jun 10 11:58:12.369362 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:12.369345 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-86.ec2.internal\" not found" Jun 10 11:58:12.369681 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:12.369664 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-86.ec2.internal\" not found" node="ip-10-0-139-86.ec2.internal" Jun 10 11:58:12.370350 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.370334 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/40ca37db0a7b4f65e597e689e3ee3fae-config\") pod \"kube-apiserver-proxy-ip-10-0-139-86.ec2.internal\" (UID: \"40ca37db0a7b4f65e597e689e3ee3fae\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-86.ec2.internal" Jun 10 11:58:12.370401 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.370356 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/24f1ae120e14c1eae8cf0bab07b174a0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-86.ec2.internal\" (UID: \"24f1ae120e14c1eae8cf0bab07b174a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-86.ec2.internal" Jun 10 11:58:12.370401 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.370372 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/24f1ae120e14c1eae8cf0bab07b174a0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-86.ec2.internal\" (UID: \"24f1ae120e14c1eae8cf0bab07b174a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-86.ec2.internal" Jun 10 11:58:12.374017 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:12.374002 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-86.ec2.internal\" not found" node="ip-10-0-139-86.ec2.internal" Jun 10 11:58:12.469419 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:12.469386 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-86.ec2.internal\" not found" Jun 10 11:58:12.470487 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.470471 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/24f1ae120e14c1eae8cf0bab07b174a0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-86.ec2.internal\" (UID: \"24f1ae120e14c1eae8cf0bab07b174a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-86.ec2.internal" Jun 10 11:58:12.470549 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.470496 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/24f1ae120e14c1eae8cf0bab07b174a0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-86.ec2.internal\" (UID: \"24f1ae120e14c1eae8cf0bab07b174a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-86.ec2.internal" Jun 10 11:58:12.470549 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.470511 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/40ca37db0a7b4f65e597e689e3ee3fae-config\") pod \"kube-apiserver-proxy-ip-10-0-139-86.ec2.internal\" (UID: \"40ca37db0a7b4f65e597e689e3ee3fae\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-86.ec2.internal" Jun 10 11:58:12.470549 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.470536 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/40ca37db0a7b4f65e597e689e3ee3fae-config\") pod \"kube-apiserver-proxy-ip-10-0-139-86.ec2.internal\" (UID: \"40ca37db0a7b4f65e597e689e3ee3fae\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-86.ec2.internal" Jun 10 11:58:12.470654 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.470559 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/24f1ae120e14c1eae8cf0bab07b174a0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-86.ec2.internal\" (UID: \"24f1ae120e14c1eae8cf0bab07b174a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-86.ec2.internal" Jun 10 11:58:12.470654 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.470571 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/24f1ae120e14c1eae8cf0bab07b174a0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-86.ec2.internal\" (UID: \"24f1ae120e14c1eae8cf0bab07b174a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-86.ec2.internal" Jun 10 11:58:12.569653 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:12.569620 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-86.ec2.internal\" not found" Jun 10 11:58:12.670370 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:12.670287 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-86.ec2.internal\" not found" Jun 10 11:58:12.674527 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.674514 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-86.ec2.internal" Jun 10 11:58:12.679187 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:12.679170 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-86.ec2.internal" Jun 10 11:58:12.771147 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:12.771114 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-86.ec2.internal\" not found" Jun 10 11:58:12.871544 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:12.871517 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-86.ec2.internal\" not found" Jun 10 11:58:12.972139 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:12.972023 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-86.ec2.internal\" not found" Jun 10 11:58:13.072461 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:13.072434 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-86.ec2.internal\" not found" Jun 10 11:58:13.113690 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:13.113662 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 10 11:58:13.114359 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:13.113817 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 11:58:13.172770 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:13.172743 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-86.ec2.internal\" not found" Jun 10 11:58:13.176640 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:13.176608 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40ca37db0a7b4f65e597e689e3ee3fae.slice/crio-ed3d3f8a9fb6e53c2079634c0f5a1c35bb88fd6c499d412571057e2f7863ecb9 WatchSource:0}: Error finding container ed3d3f8a9fb6e53c2079634c0f5a1c35bb88fd6c499d412571057e2f7863ecb9: Status 404 returned error can't find the container with id ed3d3f8a9fb6e53c2079634c0f5a1c35bb88fd6c499d412571057e2f7863ecb9 Jun 10 11:58:13.178675 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:13.177387 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24f1ae120e14c1eae8cf0bab07b174a0.slice/crio-c21e1a15e24a2d7254a3114e7c637fbce6e135e35aced898374d65a2730bc768 WatchSource:0}: Error finding container c21e1a15e24a2d7254a3114e7c637fbce6e135e35aced898374d65a2730bc768: Status 404 returned error can't find the container with id c21e1a15e24a2d7254a3114e7c637fbce6e135e35aced898374d65a2730bc768 Jun 10 11:58:13.180967 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:13.180950 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 11:58:13.183427 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:13.183414 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 11:58:13.194421 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:13.194386 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-09 11:53:12 +0000 UTC" deadline="2028-03-04 20:25:20.78009202 +0000 UTC" Jun 10 11:58:13.194421 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:13.194415 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15200h27m7.585680161s" Jun 10 11:58:13.240896 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:13.240796 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-86.ec2.internal" event={"ID":"24f1ae120e14c1eae8cf0bab07b174a0","Type":"ContainerStarted","Data":"c21e1a15e24a2d7254a3114e7c637fbce6e135e35aced898374d65a2730bc768"} Jun 10 11:58:13.241878 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:13.241859 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-86.ec2.internal" event={"ID":"40ca37db0a7b4f65e597e689e3ee3fae","Type":"ContainerStarted","Data":"ed3d3f8a9fb6e53c2079634c0f5a1c35bb88fd6c499d412571057e2f7863ecb9"} Jun 10 11:58:13.269013 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:13.268978 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-86.ec2.internal" Jun 10 11:58:13.280336 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:13.280314 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 11:58:13.282083 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:13.282069 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-86.ec2.internal" Jun 10 11:58:13.291080 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:13.291064 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 11:58:13.512433 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:13.512364 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 11:58:13.656152 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:13.656119 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 11:58:14.152378 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.152336 2562 apiserver.go:52] "Watching apiserver" Jun 10 11:58:14.161259 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.161235 2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 10 11:58:14.161698 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.161671 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp55n","openshift-dns/node-resolver-dhw7b","openshift-multus/multus-additional-cni-plugins-8nk9t","openshift-multus/multus-dvvkx","kube-system/kube-apiserver-proxy-ip-10-0-139-86.ec2.internal","openshift-cluster-node-tuning-operator/tuned-28kqn","openshift-image-registry/node-ca-fnfcg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-86.ec2.internal","openshift-multus/network-metrics-daemon-ndwtw","openshift-network-diagnostics/network-check-target-lfwlq","openshift-network-operator/iptables-alerter-tnsxf","openshift-ovn-kubernetes/ovnkube-node-xgfwc","kube-system/global-pull-secret-syncer-v9bc6","kube-system/konnectivity-agent-xjx89"] Jun 10 11:58:14.163135 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.163114 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fnfcg" Jun 10 11:58:14.164308 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.164283 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tnsxf" Jun 10 11:58:14.165445 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.165423 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 10 11:58:14.165553 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.165448 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7nt8v\"" Jun 10 11:58:14.165616 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.165570 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 10 11:58:14.165687 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.165666 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 10 11:58:14.165796 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.165705 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8nk9t" Jun 10 11:58:14.166784 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.166763 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 10 11:58:14.166883 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.166820 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8lw6g\"" Jun 10 11:58:14.167108 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.167085 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dvvkx" Jun 10 11:58:14.167200 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.167092 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 10 11:58:14.167200 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.167187 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 10 11:58:14.167944 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.167925 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xjx89" Jun 10 11:58:14.168412 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.168392 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 10 11:58:14.168500 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.168484 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 10 11:58:14.168500 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.168495 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 10 11:58:14.168611 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.168595 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 10 11:58:14.168836 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.168783 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 10 11:58:14.168906 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.168876 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qzxqp\"" Jun 10 11:58:14.169397 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.169173 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-28kqn" Jun 10 11:58:14.169397 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.169266 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 10 11:58:14.169521 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.169470 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 10 11:58:14.169798 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.169691 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-f4htq\"" Jun 10 11:58:14.170238 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.170222 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dnx7v\"" Jun 10 11:58:14.170331 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.170228 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 10 11:58:14.170850 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.170829 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 10 11:58:14.172279 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.171502 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndwtw" Jun 10 11:58:14.172279 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.171601 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 10 11:58:14.172279 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:14.171602 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndwtw" podUID="b8180252-e6fc-4c10-aea5-e5577682a8cf" Jun 10 11:58:14.172279 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.172137 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 10 11:58:14.172943 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.172502 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-fkcsk\"" Jun 10 11:58:14.173581 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.173136 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v9bc6" Jun 10 11:58:14.173581 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:14.173206 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v9bc6" podUID="735eadd6-c42b-4044-95b8-cd0b4762e0eb" Jun 10 11:58:14.174573 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.174552 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dhw7b" Jun 10 11:58:14.175877 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.175851 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfwlq" Jun 10 11:58:14.175967 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:14.175925 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfwlq" podUID="3b023797-5c02-41bf-a1dd-a01e3c265b91" Jun 10 11:58:14.177019 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.176994 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 10 11:58:14.177123 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.177088 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bvxrv\"" Jun 10 11:58:14.177306 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.177286 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp55n" Jun 10 11:58:14.177802 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.177783 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 10 11:58:14.178887 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.178868 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.179360 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.179334 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0b313b3a-4549-429b-8bad-9e655da23e67-etc-sysctl-d\") pod \"tuned-28kqn\" (UID: \"0b313b3a-4549-429b-8bad-9e655da23e67\") " pod="openshift-cluster-node-tuning-operator/tuned-28kqn" Jun 10 11:58:14.179454 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.179407 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/99d59973-e3c2-41fc-9b89-66993ae20586-host-var-lib-cni-multus\") pod \"multus-dvvkx\" (UID: \"99d59973-e3c2-41fc-9b89-66993ae20586\") " pod="openshift-multus/multus-dvvkx" Jun 10 11:58:14.179454 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.179439 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b313b3a-4549-429b-8bad-9e655da23e67-etc-kubernetes\") pod \"tuned-28kqn\" (UID: \"0b313b3a-4549-429b-8bad-9e655da23e67\") " pod="openshift-cluster-node-tuning-operator/tuned-28kqn" Jun 10 11:58:14.179562 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.179466 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0b313b3a-4549-429b-8bad-9e655da23e67-etc-sysctl-conf\") pod \"tuned-28kqn\" (UID: \"0b313b3a-4549-429b-8bad-9e655da23e67\") " pod="openshift-cluster-node-tuning-operator/tuned-28kqn" Jun 10 11:58:14.179562 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.179488 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0b313b3a-4549-429b-8bad-9e655da23e67-run\") pod \"tuned-28kqn\" (UID: \"0b313b3a-4549-429b-8bad-9e655da23e67\") " pod="openshift-cluster-node-tuning-operator/tuned-28kqn" Jun 10 11:58:14.179562 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.179513 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0b313b3a-4549-429b-8bad-9e655da23e67-etc-tuned\") pod \"tuned-28kqn\" (UID: \"0b313b3a-4549-429b-8bad-9e655da23e67\") " pod="openshift-cluster-node-tuning-operator/tuned-28kqn" Jun 10 11:58:14.179562 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.179536 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bc041c77-ffb6-475e-a9cf-6697f9e4d28a-iptables-alerter-script\") pod \"iptables-alerter-tnsxf\" (UID: \"bc041c77-ffb6-475e-a9cf-6697f9e4d28a\") " pod="openshift-network-operator/iptables-alerter-tnsxf" Jun 10 11:58:14.179562 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.179560 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/99d59973-e3c2-41fc-9b89-66993ae20586-host-run-netns\") pod \"multus-dvvkx\" (UID: \"99d59973-e3c2-41fc-9b89-66993ae20586\") " pod="openshift-multus/multus-dvvkx" Jun 10 11:58:14.179792 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.179584 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/99d59973-e3c2-41fc-9b89-66993ae20586-multus-conf-dir\") pod \"multus-dvvkx\" (UID: \"99d59973-e3c2-41fc-9b89-66993ae20586\") " pod="openshift-multus/multus-dvvkx" Jun 10 11:58:14.179792 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.179619 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99d59973-e3c2-41fc-9b89-66993ae20586-etc-kubernetes\") pod \"multus-dvvkx\" (UID: \"99d59973-e3c2-41fc-9b89-66993ae20586\") " pod="openshift-multus/multus-dvvkx" Jun 10 11:58:14.179792 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.179652 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs46m\" (UniqueName: \"kubernetes.io/projected/bc041c77-ffb6-475e-a9cf-6697f9e4d28a-kube-api-access-bs46m\") pod \"iptables-alerter-tnsxf\" (UID: \"bc041c77-ffb6-475e-a9cf-6697f9e4d28a\") " pod="openshift-network-operator/iptables-alerter-tnsxf" Jun 10 11:58:14.179792 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.179679 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0b313b3a-4549-429b-8bad-9e655da23e67-etc-systemd\") pod \"tuned-28kqn\" (UID: \"0b313b3a-4549-429b-8bad-9e655da23e67\") " pod="openshift-cluster-node-tuning-operator/tuned-28kqn" Jun 10 11:58:14.179792 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.179701 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0b313b3a-4549-429b-8bad-9e655da23e67-sys\") pod \"tuned-28kqn\" (UID: \"0b313b3a-4549-429b-8bad-9e655da23e67\") " pod="openshift-cluster-node-tuning-operator/tuned-28kqn" Jun 10 11:58:14.179792 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.179725 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0b313b3a-4549-429b-8bad-9e655da23e67-lib-modules\") pod \"tuned-28kqn\" (UID: \"0b313b3a-4549-429b-8bad-9e655da23e67\") " pod="openshift-cluster-node-tuning-operator/tuned-28kqn" Jun 10 11:58:14.179792 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.179746 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b313b3a-4549-429b-8bad-9e655da23e67-var-lib-kubelet\") pod \"tuned-28kqn\" (UID: \"0b313b3a-4549-429b-8bad-9e655da23e67\") " pod="openshift-cluster-node-tuning-operator/tuned-28kqn" Jun 10 11:58:14.179792 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.179768 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/99d59973-e3c2-41fc-9b89-66993ae20586-cni-binary-copy\") pod \"multus-dvvkx\" (UID: \"99d59973-e3c2-41fc-9b89-66993ae20586\") " pod="openshift-multus/multus-dvvkx" Jun 10 11:58:14.180162 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.179804 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/99d59973-e3c2-41fc-9b89-66993ae20586-hostroot\") pod \"multus-dvvkx\" (UID: \"99d59973-e3c2-41fc-9b89-66993ae20586\") " pod="openshift-multus/multus-dvvkx" Jun 10 11:58:14.180162 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.179829 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dfwp\" (UniqueName: \"kubernetes.io/projected/0b9f91bb-de66-4959-b25d-c8c4f3f6bb79-kube-api-access-5dfwp\") pod \"node-ca-fnfcg\" (UID: \"0b9f91bb-de66-4959-b25d-c8c4f3f6bb79\") " pod="openshift-image-registry/node-ca-fnfcg" Jun 10 11:58:14.180162 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.179848 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bc041c77-ffb6-475e-a9cf-6697f9e4d28a-host-slash\") pod \"iptables-alerter-tnsxf\" (UID: \"bc041c77-ffb6-475e-a9cf-6697f9e4d28a\") " pod="openshift-network-operator/iptables-alerter-tnsxf" Jun 10 11:58:14.180162 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.179869 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/28392d5e-41b1-4885-88df-071da3138132-os-release\") pod \"multus-additional-cni-plugins-8nk9t\" (UID: \"28392d5e-41b1-4885-88df-071da3138132\") " pod="openshift-multus/multus-additional-cni-plugins-8nk9t" Jun 10 11:58:14.180162 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.179890 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0b313b3a-4549-429b-8bad-9e655da23e67-host\") pod \"tuned-28kqn\" (UID: \"0b313b3a-4549-429b-8bad-9e655da23e67\") " pod="openshift-cluster-node-tuning-operator/tuned-28kqn" Jun 10 11:58:14.180162 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.179894 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 10 11:58:14.180162 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.179905 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b313b3a-4549-429b-8bad-9e655da23e67-tmp\") pod \"tuned-28kqn\" (UID: \"0b313b3a-4549-429b-8bad-9e655da23e67\") " pod="openshift-cluster-node-tuning-operator/tuned-28kqn" Jun 10 11:58:14.180162 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.179923 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87z47\" (UniqueName: \"kubernetes.io/projected/0b313b3a-4549-429b-8bad-9e655da23e67-kube-api-access-87z47\") pod \"tuned-28kqn\" (UID: \"0b313b3a-4549-429b-8bad-9e655da23e67\") " pod="openshift-cluster-node-tuning-operator/tuned-28kqn" Jun 10 11:58:14.180162 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.179940 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f11fac11-8429-4106-8c42-06e081bc5a56-konnectivity-ca\") pod \"konnectivity-agent-xjx89\" (UID: \"f11fac11-8429-4106-8c42-06e081bc5a56\") " pod="kube-system/konnectivity-agent-xjx89" Jun 10 11:58:14.180162 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.179966 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/99d59973-e3c2-41fc-9b89-66993ae20586-host-var-lib-cni-bin\") pod \"multus-dvvkx\" (UID: \"99d59973-e3c2-41fc-9b89-66993ae20586\") " pod="openshift-multus/multus-dvvkx" Jun 10 11:58:14.180162 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.179999 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/99d59973-e3c2-41fc-9b89-66993ae20586-host-var-lib-kubelet\") pod \"multus-dvvkx\" (UID: \"99d59973-e3c2-41fc-9b89-66993ae20586\") " pod="openshift-multus/multus-dvvkx" Jun 10 11:58:14.180162 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.180020 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/99d59973-e3c2-41fc-9b89-66993ae20586-multus-daemon-config\") pod \"multus-dvvkx\" (UID: \"99d59973-e3c2-41fc-9b89-66993ae20586\") " pod="openshift-multus/multus-dvvkx" Jun 10 11:58:14.180162 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.180055 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/99d59973-e3c2-41fc-9b89-66993ae20586-host-run-multus-certs\") pod \"multus-dvvkx\" (UID: \"99d59973-e3c2-41fc-9b89-66993ae20586\") " pod="openshift-multus/multus-dvvkx" Jun 10 11:58:14.180162 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.180080 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxd87\" (UniqueName: \"kubernetes.io/projected/99d59973-e3c2-41fc-9b89-66993ae20586-kube-api-access-fxd87\") pod \"multus-dvvkx\" (UID: \"99d59973-e3c2-41fc-9b89-66993ae20586\") " pod="openshift-multus/multus-dvvkx" Jun 10 11:58:14.180162 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.180103 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f11fac11-8429-4106-8c42-06e081bc5a56-agent-certs\") pod \"konnectivity-agent-xjx89\" (UID: \"f11fac11-8429-4106-8c42-06e081bc5a56\") " pod="kube-system/konnectivity-agent-xjx89" Jun 10 11:58:14.180162 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.180143 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/99d59973-e3c2-41fc-9b89-66993ae20586-os-release\") pod \"multus-dvvkx\" (UID: \"99d59973-e3c2-41fc-9b89-66993ae20586\") " pod="openshift-multus/multus-dvvkx" Jun 10 11:58:14.180162 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.180165 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8180252-e6fc-4c10-aea5-e5577682a8cf-metrics-certs\") pod \"network-metrics-daemon-ndwtw\" (UID: \"b8180252-e6fc-4c10-aea5-e5577682a8cf\") " pod="openshift-multus/network-metrics-daemon-ndwtw" Jun 10 11:58:14.180801 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.180203 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvjht\" (UniqueName: \"kubernetes.io/projected/b8180252-e6fc-4c10-aea5-e5577682a8cf-kube-api-access-tvjht\") pod \"network-metrics-daemon-ndwtw\" (UID: \"b8180252-e6fc-4c10-aea5-e5577682a8cf\") " pod="openshift-multus/network-metrics-daemon-ndwtw" Jun 10 11:58:14.180801 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.180235 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/28392d5e-41b1-4885-88df-071da3138132-system-cni-dir\") pod \"multus-additional-cni-plugins-8nk9t\" (UID: \"28392d5e-41b1-4885-88df-071da3138132\") " pod="openshift-multus/multus-additional-cni-plugins-8nk9t" Jun 10 11:58:14.180801 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.180243 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6jc8s\"" Jun 10 11:58:14.180801 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.180264 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/28392d5e-41b1-4885-88df-071da3138132-cni-binary-copy\") pod \"multus-additional-cni-plugins-8nk9t\" (UID: \"28392d5e-41b1-4885-88df-071da3138132\") " pod="openshift-multus/multus-additional-cni-plugins-8nk9t" Jun 10 11:58:14.180801 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.180289 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/28392d5e-41b1-4885-88df-071da3138132-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8nk9t\" (UID: \"28392d5e-41b1-4885-88df-071da3138132\") " pod="openshift-multus/multus-additional-cni-plugins-8nk9t" Jun 10 11:58:14.180801 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.180314 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr5sm\" (UniqueName: \"kubernetes.io/projected/28392d5e-41b1-4885-88df-071da3138132-kube-api-access-lr5sm\") pod \"multus-additional-cni-plugins-8nk9t\" (UID: \"28392d5e-41b1-4885-88df-071da3138132\") " pod="openshift-multus/multus-additional-cni-plugins-8nk9t" Jun 10 11:58:14.180801 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.180338 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/99d59973-e3c2-41fc-9b89-66993ae20586-cnibin\") pod \"multus-dvvkx\" (UID: \"99d59973-e3c2-41fc-9b89-66993ae20586\") " pod="openshift-multus/multus-dvvkx" Jun 10 11:58:14.180801 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.180385 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/99d59973-e3c2-41fc-9b89-66993ae20586-multus-socket-dir-parent\") pod \"multus-dvvkx\" (UID: \"99d59973-e3c2-41fc-9b89-66993ae20586\") " pod="openshift-multus/multus-dvvkx" Jun 10 11:58:14.180801 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.180412 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/99d59973-e3c2-41fc-9b89-66993ae20586-host-run-k8s-cni-cncf-io\") pod \"multus-dvvkx\" (UID: \"99d59973-e3c2-41fc-9b89-66993ae20586\") " pod="openshift-multus/multus-dvvkx" Jun 10 11:58:14.180801 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.180433 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0b9f91bb-de66-4959-b25d-c8c4f3f6bb79-host\") pod \"node-ca-fnfcg\" (UID: \"0b9f91bb-de66-4959-b25d-c8c4f3f6bb79\") " pod="openshift-image-registry/node-ca-fnfcg" Jun 10 11:58:14.180801 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.180453 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0b9f91bb-de66-4959-b25d-c8c4f3f6bb79-serviceca\") pod \"node-ca-fnfcg\" (UID: \"0b9f91bb-de66-4959-b25d-c8c4f3f6bb79\") " pod="openshift-image-registry/node-ca-fnfcg" Jun 10 11:58:14.180801 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.180469 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/28392d5e-41b1-4885-88df-071da3138132-cnibin\") pod \"multus-additional-cni-plugins-8nk9t\" (UID: \"28392d5e-41b1-4885-88df-071da3138132\") " pod="openshift-multus/multus-additional-cni-plugins-8nk9t" Jun 10 11:58:14.180801 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.180508 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/99d59973-e3c2-41fc-9b89-66993ae20586-system-cni-dir\") pod \"multus-dvvkx\" (UID: \"99d59973-e3c2-41fc-9b89-66993ae20586\") " pod="openshift-multus/multus-dvvkx" Jun 10 11:58:14.180801 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.180522 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/99d59973-e3c2-41fc-9b89-66993ae20586-multus-cni-dir\") pod \"multus-dvvkx\" (UID: \"99d59973-e3c2-41fc-9b89-66993ae20586\") " pod="openshift-multus/multus-dvvkx" Jun 10 11:58:14.180801 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.180564 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/28392d5e-41b1-4885-88df-071da3138132-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8nk9t\" (UID: \"28392d5e-41b1-4885-88df-071da3138132\") " pod="openshift-multus/multus-additional-cni-plugins-8nk9t" Jun 10 11:58:14.180801 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.180605 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 10 11:58:14.180801 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.180611 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/28392d5e-41b1-4885-88df-071da3138132-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8nk9t\" (UID: \"28392d5e-41b1-4885-88df-071da3138132\") " pod="openshift-multus/multus-additional-cni-plugins-8nk9t" Jun 10 11:58:14.181539 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.180637 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0b313b3a-4549-429b-8bad-9e655da23e67-etc-modprobe-d\") pod \"tuned-28kqn\" (UID: \"0b313b3a-4549-429b-8bad-9e655da23e67\") " pod="openshift-cluster-node-tuning-operator/tuned-28kqn" Jun 10 11:58:14.181539 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.180657 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 10 11:58:14.181539 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.180659 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0b313b3a-4549-429b-8bad-9e655da23e67-etc-sysconfig\") pod \"tuned-28kqn\" (UID: \"0b313b3a-4549-429b-8bad-9e655da23e67\") " pod="openshift-cluster-node-tuning-operator/tuned-28kqn" Jun 10 11:58:14.181767 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.181698 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 10 11:58:14.181934 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.181914 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 10 11:58:14.181997 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.181976 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 10 11:58:14.182088 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.182035 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 10 11:58:14.182143 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.181920 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 10 11:58:14.182891 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.182868 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2w8rw\"" Jun 10 11:58:14.182975 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.182870 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 10 11:58:14.185872 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.185849 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 11:58:14.207582 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.207558 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ck9rb" Jun 10 11:58:14.219617 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.219598 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ck9rb" Jun 10 11:58:14.270402 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.270374 2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 10 11:58:14.277910 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.277882 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 11:58:14.281824 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.281798 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b313b3a-4549-429b-8bad-9e655da23e67-etc-kubernetes\") pod \"tuned-28kqn\" (UID: \"0b313b3a-4549-429b-8bad-9e655da23e67\") " pod="openshift-cluster-node-tuning-operator/tuned-28kqn" Jun 10 11:58:14.281824 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.281823 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0b313b3a-4549-429b-8bad-9e655da23e67-etc-sysctl-conf\") pod \"tuned-28kqn\" (UID: \"0b313b3a-4549-429b-8bad-9e655da23e67\") " pod="openshift-cluster-node-tuning-operator/tuned-28kqn" Jun 10 11:58:14.282008 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.281858 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/427ee27e-2e7e-450a-abcd-2861b93faf53-registration-dir\") pod \"aws-ebs-csi-driver-node-kp55n\" (UID: \"427ee27e-2e7e-450a-abcd-2861b93faf53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp55n" Jun 10 11:58:14.282008 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.281886 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0fd68196-fb5a-4984-9c69-36a423841431-ovnkube-config\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.282008 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.281902 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99d59973-e3c2-41fc-9b89-66993ae20586-etc-kubernetes\") pod \"multus-dvvkx\" (UID: \"99d59973-e3c2-41fc-9b89-66993ae20586\") " pod="openshift-multus/multus-dvvkx" Jun 10 11:58:14.282008 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.281916 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0b313b3a-4549-429b-8bad-9e655da23e67-sys\") pod \"tuned-28kqn\" (UID: \"0b313b3a-4549-429b-8bad-9e655da23e67\") " pod="openshift-cluster-node-tuning-operator/tuned-28kqn" Jun 10 11:58:14.282008 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.281939 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b313b3a-4549-429b-8bad-9e655da23e67-etc-kubernetes\") pod \"tuned-28kqn\" (UID: \"0b313b3a-4549-429b-8bad-9e655da23e67\") " pod="openshift-cluster-node-tuning-operator/tuned-28kqn" Jun 10 11:58:14.282008 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.281970 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99d59973-e3c2-41fc-9b89-66993ae20586-etc-kubernetes\") pod \"multus-dvvkx\" (UID: \"99d59973-e3c2-41fc-9b89-66993ae20586\") " pod="openshift-multus/multus-dvvkx" Jun 10 11:58:14.282008 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.281968 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0fd68196-fb5a-4984-9c69-36a423841431-host-slash\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.282008 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.281984 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0b313b3a-4549-429b-8bad-9e655da23e67-etc-sysctl-conf\") pod \"tuned-28kqn\" (UID: \"0b313b3a-4549-429b-8bad-9e655da23e67\") " pod="openshift-cluster-node-tuning-operator/tuned-28kqn" Jun 10 11:58:14.282494 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.282022 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0fd68196-fb5a-4984-9c69-36a423841431-etc-openvswitch\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.282494 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.282062 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0fd68196-fb5a-4984-9c69-36a423841431-log-socket\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.282494 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.282092 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0fd68196-fb5a-4984-9c69-36a423841431-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.282494 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.282012 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0b313b3a-4549-429b-8bad-9e655da23e67-sys\") pod \"tuned-28kqn\" (UID: \"0b313b3a-4549-429b-8bad-9e655da23e67\") " pod="openshift-cluster-node-tuning-operator/tuned-28kqn" Jun 10 11:58:14.282494 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.282140 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0fd68196-fb5a-4984-9c69-36a423841431-env-overrides\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.282494 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.282158 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b313b3a-4549-429b-8bad-9e655da23e67-tmp\") pod \"tuned-28kqn\" (UID: \"0b313b3a-4549-429b-8bad-9e655da23e67\") " pod="openshift-cluster-node-tuning-operator/tuned-28kqn" Jun 10 11:58:14.282494 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.282180 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87z47\" (UniqueName: \"kubernetes.io/projected/0b313b3a-4549-429b-8bad-9e655da23e67-kube-api-access-87z47\") pod \"tuned-28kqn\" (UID: \"0b313b3a-4549-429b-8bad-9e655da23e67\") " pod="openshift-cluster-node-tuning-operator/tuned-28kqn" Jun 10 11:58:14.282494 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.282202 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/427ee27e-2e7e-450a-abcd-2861b93faf53-etc-selinux\") pod \"aws-ebs-csi-driver-node-kp55n\" (UID: \"427ee27e-2e7e-450a-abcd-2861b93faf53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp55n" Jun 10 11:58:14.282494 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.282251 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0fd68196-fb5a-4984-9c69-36a423841431-systemd-units\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.282494 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.282278 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0fd68196-fb5a-4984-9c69-36a423841431-var-lib-openvswitch\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.282494 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.282394 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/28392d5e-41b1-4885-88df-071da3138132-cni-binary-copy\") pod \"multus-additional-cni-plugins-8nk9t\" (UID: \"28392d5e-41b1-4885-88df-071da3138132\") " pod="openshift-multus/multus-additional-cni-plugins-8nk9t" Jun 10 11:58:14.282494 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.282414 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0b313b3a-4549-429b-8bad-9e655da23e67-etc-sysctl-d\") pod \"tuned-28kqn\" (UID: \"0b313b3a-4549-429b-8bad-9e655da23e67\") " pod="openshift-cluster-node-tuning-operator/tuned-28kqn" Jun 10 11:58:14.282494 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.282435 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0b313b3a-4549-429b-8bad-9e655da23e67-etc-systemd\") pod \"tuned-28kqn\" (UID: \"0b313b3a-4549-429b-8bad-9e655da23e67\") " pod="openshift-cluster-node-tuning-operator/tuned-28kqn" Jun 10 11:58:14.282494 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.282454 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0b313b3a-4549-429b-8bad-9e655da23e67-lib-modules\") pod \"tuned-28kqn\" (UID: \"0b313b3a-4549-429b-8bad-9e655da23e67\") " pod="openshift-cluster-node-tuning-operator/tuned-28kqn" Jun 10 11:58:14.282494 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.282477 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/99d59973-e3c2-41fc-9b89-66993ae20586-host-run-multus-certs\") pod \"multus-dvvkx\" (UID: \"99d59973-e3c2-41fc-9b89-66993ae20586\") " pod="openshift-multus/multus-dvvkx" Jun 10 11:58:14.283274 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.282504 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/28392d5e-41b1-4885-88df-071da3138132-system-cni-dir\") pod \"multus-additional-cni-plugins-8nk9t\" (UID: \"28392d5e-41b1-4885-88df-071da3138132\") " pod="openshift-multus/multus-additional-cni-plugins-8nk9t" Jun 10 11:58:14.283274 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.282533 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0b313b3a-4549-429b-8bad-9e655da23e67-etc-systemd\") pod \"tuned-28kqn\" (UID: \"0b313b3a-4549-429b-8bad-9e655da23e67\") " pod="openshift-cluster-node-tuning-operator/tuned-28kqn" Jun 10 11:58:14.283274 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.282561 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lr5sm\" (UniqueName: \"kubernetes.io/projected/28392d5e-41b1-4885-88df-071da3138132-kube-api-access-lr5sm\") pod \"multus-additional-cni-plugins-8nk9t\" (UID: \"28392d5e-41b1-4885-88df-071da3138132\") " pod="openshift-multus/multus-additional-cni-plugins-8nk9t" Jun 10 11:58:14.283274 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.282588 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/99d59973-e3c2-41fc-9b89-66993ae20586-host-run-multus-certs\") pod \"multus-dvvkx\" (UID: \"99d59973-e3c2-41fc-9b89-66993ae20586\") " pod="openshift-multus/multus-dvvkx" Jun 10 11:58:14.283274 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.282610 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/28392d5e-41b1-4885-88df-071da3138132-system-cni-dir\") pod \"multus-additional-cni-plugins-8nk9t\" (UID: \"28392d5e-41b1-4885-88df-071da3138132\") " pod="openshift-multus/multus-additional-cni-plugins-8nk9t" Jun 10 11:58:14.283274 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.283007 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0b313b3a-4549-429b-8bad-9e655da23e67-lib-modules\") pod \"tuned-28kqn\" (UID: \"0b313b3a-4549-429b-8bad-9e655da23e67\") " pod="openshift-cluster-node-tuning-operator/tuned-28kqn" Jun 10 11:58:14.283274 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.282566 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0b313b3a-4549-429b-8bad-9e655da23e67-etc-sysctl-d\") pod \"tuned-28kqn\" (UID: \"0b313b3a-4549-429b-8bad-9e655da23e67\") " pod="openshift-cluster-node-tuning-operator/tuned-28kqn" Jun 10 11:58:14.283274 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.283217 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0fd68196-fb5a-4984-9c69-36a423841431-host-cni-netd\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.283662 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.283292 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/99d59973-e3c2-41fc-9b89-66993ae20586-cnibin\") pod \"multus-dvvkx\" (UID: \"99d59973-e3c2-41fc-9b89-66993ae20586\") " pod="openshift-multus/multus-dvvkx" Jun 10 11:58:14.283662 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.283402 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0b9f91bb-de66-4959-b25d-c8c4f3f6bb79-host\") pod \"node-ca-fnfcg\" (UID: \"0b9f91bb-de66-4959-b25d-c8c4f3f6bb79\") " pod="openshift-image-registry/node-ca-fnfcg" Jun 10 11:58:14.283662 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.283425 2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 10 11:58:14.283662 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.283467 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/99d59973-e3c2-41fc-9b89-66993ae20586-cnibin\") pod \"multus-dvvkx\" (UID: \"99d59973-e3c2-41fc-9b89-66993ae20586\") " pod="openshift-multus/multus-dvvkx" Jun 10 11:58:14.283662 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.283552 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0b9f91bb-de66-4959-b25d-c8c4f3f6bb79-host\") pod \"node-ca-fnfcg\" (UID: \"0b9f91bb-de66-4959-b25d-c8c4f3f6bb79\") " pod="openshift-image-registry/node-ca-fnfcg" Jun 10 11:58:14.283662 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.283583 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0b9f91bb-de66-4959-b25d-c8c4f3f6bb79-serviceca\") pod \"node-ca-fnfcg\" (UID: \"0b9f91bb-de66-4959-b25d-c8c4f3f6bb79\") " pod="openshift-image-registry/node-ca-fnfcg" Jun 10 11:58:14.283662 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.283607 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/28392d5e-41b1-4885-88df-071da3138132-cnibin\") pod \"multus-additional-cni-plugins-8nk9t\" (UID: \"28392d5e-41b1-4885-88df-071da3138132\") " pod="openshift-multus/multus-additional-cni-plugins-8nk9t" Jun 10 11:58:14.283662 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.283637 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0fd68196-fb5a-4984-9c69-36a423841431-host-cni-bin\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.284062 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.283704 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/28392d5e-41b1-4885-88df-071da3138132-cni-binary-copy\") pod \"multus-additional-cni-plugins-8nk9t\" (UID: \"28392d5e-41b1-4885-88df-071da3138132\") " pod="openshift-multus/multus-additional-cni-plugins-8nk9t" Jun 10 11:58:14.284062 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.283721 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/28392d5e-41b1-4885-88df-071da3138132-cnibin\") pod \"multus-additional-cni-plugins-8nk9t\" (UID: \"28392d5e-41b1-4885-88df-071da3138132\") " pod="openshift-multus/multus-additional-cni-plugins-8nk9t" Jun 10 11:58:14.284062 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.283696 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s85gw\" (UniqueName: \"kubernetes.io/projected/e73f01dd-034a-4de7-a873-15dccbae3921-kube-api-access-s85gw\") pod \"node-resolver-dhw7b\" (UID: \"e73f01dd-034a-4de7-a873-15dccbae3921\") " pod="openshift-dns/node-resolver-dhw7b" Jun 10 11:58:14.284062 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.283819 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/99d59973-e3c2-41fc-9b89-66993ae20586-multus-cni-dir\") pod \"multus-dvvkx\" (UID: \"99d59973-e3c2-41fc-9b89-66993ae20586\") " pod="openshift-multus/multus-dvvkx" Jun 10 11:58:14.284062 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.283846 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/28392d5e-41b1-4885-88df-071da3138132-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8nk9t\" (UID: \"28392d5e-41b1-4885-88df-071da3138132\") " pod="openshift-multus/multus-additional-cni-plugins-8nk9t" Jun 10 11:58:14.284062 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.283888 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0b313b3a-4549-429b-8bad-9e655da23e67-run\") pod \"tuned-28kqn\" (UID: \"0b313b3a-4549-429b-8bad-9e655da23e67\") " pod="openshift-cluster-node-tuning-operator/tuned-28kqn" Jun 10 11:58:14.284062 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.283931 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0b313b3a-4549-429b-8bad-9e655da23e67-etc-tuned\") pod \"tuned-28kqn\" (UID: \"0b313b3a-4549-429b-8bad-9e655da23e67\") " pod="openshift-cluster-node-tuning-operator/tuned-28kqn" Jun 10 11:58:14.284062 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.283953 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/99d59973-e3c2-41fc-9b89-66993ae20586-multus-cni-dir\") pod \"multus-dvvkx\" (UID: \"99d59973-e3c2-41fc-9b89-66993ae20586\") " pod="openshift-multus/multus-dvvkx" Jun 10 11:58:14.284062 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.283962 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/735eadd6-c42b-4044-95b8-cd0b4762e0eb-dbus\") pod \"global-pull-secret-syncer-v9bc6\" (UID: \"735eadd6-c42b-4044-95b8-cd0b4762e0eb\") " pod="kube-system/global-pull-secret-syncer-v9bc6" Jun 10 11:58:14.284062 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.283995 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/99d59973-e3c2-41fc-9b89-66993ae20586-host-var-lib-cni-multus\") pod \"multus-dvvkx\" (UID: \"99d59973-e3c2-41fc-9b89-66993ae20586\") " pod="openshift-multus/multus-dvvkx" Jun 10 11:58:14.284062 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.284020 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8fqz\" (UniqueName: \"kubernetes.io/projected/427ee27e-2e7e-450a-abcd-2861b93faf53-kube-api-access-m8fqz\") pod \"aws-ebs-csi-driver-node-kp55n\" (UID: \"427ee27e-2e7e-450a-abcd-2861b93faf53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp55n" Jun 10 11:58:14.284062 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.284030 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0b313b3a-4549-429b-8bad-9e655da23e67-run\") pod \"tuned-28kqn\" (UID: \"0b313b3a-4549-429b-8bad-9e655da23e67\") " pod="openshift-cluster-node-tuning-operator/tuned-28kqn" Jun 10 11:58:14.284630 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.284069 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0fd68196-fb5a-4984-9c69-36a423841431-run-openvswitch\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.284630 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.284101 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9fxb\" (UniqueName: \"kubernetes.io/projected/0fd68196-fb5a-4984-9c69-36a423841431-kube-api-access-b9fxb\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.284630 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.284133 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e73f01dd-034a-4de7-a873-15dccbae3921-hosts-file\") pod \"node-resolver-dhw7b\" (UID: \"e73f01dd-034a-4de7-a873-15dccbae3921\") " pod="openshift-dns/node-resolver-dhw7b" Jun 10 11:58:14.284630 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.284160 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bc041c77-ffb6-475e-a9cf-6697f9e4d28a-iptables-alerter-script\") pod \"iptables-alerter-tnsxf\" (UID: \"bc041c77-ffb6-475e-a9cf-6697f9e4d28a\") " pod="openshift-network-operator/iptables-alerter-tnsxf" Jun 10 11:58:14.284630 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.284186 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0b9f91bb-de66-4959-b25d-c8c4f3f6bb79-serviceca\") pod \"node-ca-fnfcg\" (UID: \"0b9f91bb-de66-4959-b25d-c8c4f3f6bb79\") " pod="openshift-image-registry/node-ca-fnfcg" Jun 10 11:58:14.284630 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.284193 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/28392d5e-41b1-4885-88df-071da3138132-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8nk9t\" (UID: \"28392d5e-41b1-4885-88df-071da3138132\") " pod="openshift-multus/multus-additional-cni-plugins-8nk9t" Jun 10 11:58:14.284630 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.284188 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0fd68196-fb5a-4984-9c69-36a423841431-ovnkube-script-lib\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.284630 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.284354 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/99d59973-e3c2-41fc-9b89-66993ae20586-host-run-netns\") pod \"multus-dvvkx\" (UID: \"99d59973-e3c2-41fc-9b89-66993ae20586\") " pod="openshift-multus/multus-dvvkx" Jun 10 11:58:14.284630 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.284401 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/99d59973-e3c2-41fc-9b89-66993ae20586-multus-conf-dir\") pod \"multus-dvvkx\" (UID: \"99d59973-e3c2-41fc-9b89-66993ae20586\") " pod="openshift-multus/multus-dvvkx" Jun 10 11:58:14.284630 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.284467 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bs46m\" (UniqueName: \"kubernetes.io/projected/bc041c77-ffb6-475e-a9cf-6697f9e4d28a-kube-api-access-bs46m\") pod \"iptables-alerter-tnsxf\" (UID: \"bc041c77-ffb6-475e-a9cf-6697f9e4d28a\") " pod="openshift-network-operator/iptables-alerter-tnsxf" Jun 10 11:58:14.284630 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.284498 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0b313b3a-4549-429b-8bad-9e655da23e67-host\") pod \"tuned-28kqn\" (UID: \"0b313b3a-4549-429b-8bad-9e655da23e67\") " pod="openshift-cluster-node-tuning-operator/tuned-28kqn" Jun 10 11:58:14.284630 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.284531 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0fd68196-fb5a-4984-9c69-36a423841431-host-kubelet\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.284630 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.284555 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0fd68196-fb5a-4984-9c69-36a423841431-node-log\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.284630 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.284584 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0fd68196-fb5a-4984-9c69-36a423841431-ovn-node-metrics-cert\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.285326 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.284649 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/99d59973-e3c2-41fc-9b89-66993ae20586-cni-binary-copy\") pod \"multus-dvvkx\" (UID: \"99d59973-e3c2-41fc-9b89-66993ae20586\") " pod="openshift-multus/multus-dvvkx" Jun 10 11:58:14.285326 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.284687 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/99d59973-e3c2-41fc-9b89-66993ae20586-hostroot\") pod \"multus-dvvkx\" (UID: \"99d59973-e3c2-41fc-9b89-66993ae20586\") " pod="openshift-multus/multus-dvvkx" Jun 10 11:58:14.285326 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.284704 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/99d59973-e3c2-41fc-9b89-66993ae20586-host-run-netns\") pod \"multus-dvvkx\" (UID: \"99d59973-e3c2-41fc-9b89-66993ae20586\") " pod="openshift-multus/multus-dvvkx" Jun 10 11:58:14.285326 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.284719 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dfwp\" (UniqueName: \"kubernetes.io/projected/0b9f91bb-de66-4959-b25d-c8c4f3f6bb79-kube-api-access-5dfwp\") pod \"node-ca-fnfcg\" (UID: \"0b9f91bb-de66-4959-b25d-c8c4f3f6bb79\") " pod="openshift-image-registry/node-ca-fnfcg" Jun 10 11:58:14.285326 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.284752 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bc041c77-ffb6-475e-a9cf-6697f9e4d28a-host-slash\") pod \"iptables-alerter-tnsxf\" (UID: \"bc041c77-ffb6-475e-a9cf-6697f9e4d28a\") " pod="openshift-network-operator/iptables-alerter-tnsxf" Jun 10 11:58:14.285326 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.284787 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/28392d5e-41b1-4885-88df-071da3138132-os-release\") pod \"multus-additional-cni-plugins-8nk9t\" (UID: \"28392d5e-41b1-4885-88df-071da3138132\") " pod="openshift-multus/multus-additional-cni-plugins-8nk9t" Jun 10 11:58:14.285326 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.284791 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bc041c77-ffb6-475e-a9cf-6697f9e4d28a-iptables-alerter-script\") pod \"iptables-alerter-tnsxf\" (UID: \"bc041c77-ffb6-475e-a9cf-6697f9e4d28a\") " pod="openshift-network-operator/iptables-alerter-tnsxf" Jun 10 11:58:14.285326 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.284760 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/99d59973-e3c2-41fc-9b89-66993ae20586-multus-conf-dir\") pod \"multus-dvvkx\" (UID: \"99d59973-e3c2-41fc-9b89-66993ae20586\") " pod="openshift-multus/multus-dvvkx" Jun 10 11:58:14.285326 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.284821 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/427ee27e-2e7e-450a-abcd-2861b93faf53-device-dir\") pod \"aws-ebs-csi-driver-node-kp55n\" (UID: \"427ee27e-2e7e-450a-abcd-2861b93faf53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp55n" Jun 10 11:58:14.285326 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.284851 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0fd68196-fb5a-4984-9c69-36a423841431-run-systemd\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.285326 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.284862 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/99d59973-e3c2-41fc-9b89-66993ae20586-host-var-lib-cni-multus\") pod \"multus-dvvkx\" (UID: \"99d59973-e3c2-41fc-9b89-66993ae20586\") " pod="openshift-multus/multus-dvvkx" Jun 10 11:58:14.285326 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.284923 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/99d59973-e3c2-41fc-9b89-66993ae20586-hostroot\") pod \"multus-dvvkx\" (UID: \"99d59973-e3c2-41fc-9b89-66993ae20586\") " pod="openshift-multus/multus-dvvkx" Jun 10 11:58:14.285326 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.284973 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bc041c77-ffb6-475e-a9cf-6697f9e4d28a-host-slash\") pod \"iptables-alerter-tnsxf\" (UID: \"bc041c77-ffb6-475e-a9cf-6697f9e4d28a\") " pod="openshift-network-operator/iptables-alerter-tnsxf" Jun 10 11:58:14.285326 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.285078 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/28392d5e-41b1-4885-88df-071da3138132-os-release\") pod \"multus-additional-cni-plugins-8nk9t\" (UID: \"28392d5e-41b1-4885-88df-071da3138132\") " pod="openshift-multus/multus-additional-cni-plugins-8nk9t" Jun 10 11:58:14.285326 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.285162 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0b313b3a-4549-429b-8bad-9e655da23e67-host\") pod \"tuned-28kqn\" (UID: \"0b313b3a-4549-429b-8bad-9e655da23e67\") " pod="openshift-cluster-node-tuning-operator/tuned-28kqn" Jun 10 11:58:14.285326 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.285328 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/99d59973-e3c2-41fc-9b89-66993ae20586-cni-binary-copy\") pod \"multus-dvvkx\" (UID: \"99d59973-e3c2-41fc-9b89-66993ae20586\") " pod="openshift-multus/multus-dvvkx" Jun 10 11:58:14.286175 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.285378 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0fd68196-fb5a-4984-9c69-36a423841431-host-run-ovn-kubernetes\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.286175 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.285412 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/28392d5e-41b1-4885-88df-071da3138132-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8nk9t\" (UID: \"28392d5e-41b1-4885-88df-071da3138132\") " pod="openshift-multus/multus-additional-cni-plugins-8nk9t" Jun 10 11:58:14.286175 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.285466 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbdk6\" (UniqueName: \"kubernetes.io/projected/3b023797-5c02-41bf-a1dd-a01e3c265b91-kube-api-access-qbdk6\") pod \"network-check-target-lfwlq\" (UID: \"3b023797-5c02-41bf-a1dd-a01e3c265b91\") " pod="openshift-network-diagnostics/network-check-target-lfwlq" Jun 10 11:58:14.286175 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.285490 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/427ee27e-2e7e-450a-abcd-2861b93faf53-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kp55n\" (UID: \"427ee27e-2e7e-450a-abcd-2861b93faf53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp55n" Jun 10 11:58:14.286175 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.285520 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0b313b3a-4549-429b-8bad-9e655da23e67-etc-sysconfig\") pod \"tuned-28kqn\" (UID: \"0b313b3a-4549-429b-8bad-9e655da23e67\") " pod="openshift-cluster-node-tuning-operator/tuned-28kqn" Jun 10 11:58:14.286175 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.285547 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b313b3a-4549-429b-8bad-9e655da23e67-var-lib-kubelet\") pod \"tuned-28kqn\" (UID: \"0b313b3a-4549-429b-8bad-9e655da23e67\") " pod="openshift-cluster-node-tuning-operator/tuned-28kqn" Jun 10 11:58:14.286175 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.285575 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f11fac11-8429-4106-8c42-06e081bc5a56-konnectivity-ca\") pod \"konnectivity-agent-xjx89\" (UID: \"f11fac11-8429-4106-8c42-06e081bc5a56\") " pod="kube-system/konnectivity-agent-xjx89" Jun 10 11:58:14.286175 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.285604 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/99d59973-e3c2-41fc-9b89-66993ae20586-host-var-lib-cni-bin\") pod \"multus-dvvkx\" (UID: \"99d59973-e3c2-41fc-9b89-66993ae20586\") " pod="openshift-multus/multus-dvvkx" Jun 10 11:58:14.286175 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.285628 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/99d59973-e3c2-41fc-9b89-66993ae20586-os-release\") pod \"multus-dvvkx\" (UID: \"99d59973-e3c2-41fc-9b89-66993ae20586\") " pod="openshift-multus/multus-dvvkx" Jun 10 11:58:14.286175 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.285654 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8180252-e6fc-4c10-aea5-e5577682a8cf-metrics-certs\") pod \"network-metrics-daemon-ndwtw\" (UID: \"b8180252-e6fc-4c10-aea5-e5577682a8cf\") " pod="openshift-multus/network-metrics-daemon-ndwtw" Jun 10 11:58:14.286175 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.285693 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvjht\" (UniqueName: \"kubernetes.io/projected/b8180252-e6fc-4c10-aea5-e5577682a8cf-kube-api-access-tvjht\") pod \"network-metrics-daemon-ndwtw\" (UID: \"b8180252-e6fc-4c10-aea5-e5577682a8cf\") " pod="openshift-multus/network-metrics-daemon-ndwtw" Jun 10 11:58:14.286175 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.285721 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/427ee27e-2e7e-450a-abcd-2861b93faf53-socket-dir\") pod \"aws-ebs-csi-driver-node-kp55n\" (UID: \"427ee27e-2e7e-450a-abcd-2861b93faf53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp55n" Jun 10 11:58:14.286175 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.285740 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b313b3a-4549-429b-8bad-9e655da23e67-var-lib-kubelet\") pod \"tuned-28kqn\" (UID: \"0b313b3a-4549-429b-8bad-9e655da23e67\") " pod="openshift-cluster-node-tuning-operator/tuned-28kqn" Jun 10 11:58:14.286175 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:14.285874 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:58:14.286175 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.285927 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0b313b3a-4549-429b-8bad-9e655da23e67-etc-sysconfig\") pod \"tuned-28kqn\" (UID: \"0b313b3a-4549-429b-8bad-9e655da23e67\") " pod="openshift-cluster-node-tuning-operator/tuned-28kqn" Jun 10 11:58:14.286175 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:14.285946 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8180252-e6fc-4c10-aea5-e5577682a8cf-metrics-certs podName:b8180252-e6fc-4c10-aea5-e5577682a8cf nodeName:}" failed. No retries permitted until 2026-06-10 11:58:14.785925613 +0000 UTC m=+2.991676449 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b8180252-e6fc-4c10-aea5-e5577682a8cf-metrics-certs") pod "network-metrics-daemon-ndwtw" (UID: "b8180252-e6fc-4c10-aea5-e5577682a8cf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:58:14.286938 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.285744 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/99d59973-e3c2-41fc-9b89-66993ae20586-host-var-lib-kubelet\") pod \"multus-dvvkx\" (UID: \"99d59973-e3c2-41fc-9b89-66993ae20586\") " pod="openshift-multus/multus-dvvkx" Jun 10 11:58:14.286938 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.286223 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/99d59973-e3c2-41fc-9b89-66993ae20586-multus-daemon-config\") pod \"multus-dvvkx\" (UID: \"99d59973-e3c2-41fc-9b89-66993ae20586\") " pod="openshift-multus/multus-dvvkx" Jun 10 11:58:14.286938 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.286242 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/28392d5e-41b1-4885-88df-071da3138132-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8nk9t\" (UID: \"28392d5e-41b1-4885-88df-071da3138132\") " pod="openshift-multus/multus-additional-cni-plugins-8nk9t" Jun 10 11:58:14.286938 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.286258 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/99d59973-e3c2-41fc-9b89-66993ae20586-host-var-lib-kubelet\") pod \"multus-dvvkx\" (UID: \"99d59973-e3c2-41fc-9b89-66993ae20586\") " pod="openshift-multus/multus-dvvkx" Jun 10 11:58:14.286938 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.286260 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxd87\" (UniqueName: \"kubernetes.io/projected/99d59973-e3c2-41fc-9b89-66993ae20586-kube-api-access-fxd87\") pod \"multus-dvvkx\" (UID: \"99d59973-e3c2-41fc-9b89-66993ae20586\") " pod="openshift-multus/multus-dvvkx" Jun 10 11:58:14.286938 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.286302 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/99d59973-e3c2-41fc-9b89-66993ae20586-multus-socket-dir-parent\") pod \"multus-dvvkx\" (UID: \"99d59973-e3c2-41fc-9b89-66993ae20586\") " pod="openshift-multus/multus-dvvkx" Jun 10 11:58:14.286938 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.286304 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/99d59973-e3c2-41fc-9b89-66993ae20586-host-var-lib-cni-bin\") pod \"multus-dvvkx\" (UID: \"99d59973-e3c2-41fc-9b89-66993ae20586\") " pod="openshift-multus/multus-dvvkx" Jun 10 11:58:14.286938 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.286330 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/99d59973-e3c2-41fc-9b89-66993ae20586-os-release\") pod \"multus-dvvkx\" (UID: \"99d59973-e3c2-41fc-9b89-66993ae20586\") " pod="openshift-multus/multus-dvvkx" Jun 10 11:58:14.286938 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.286368 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/99d59973-e3c2-41fc-9b89-66993ae20586-multus-socket-dir-parent\") pod \"multus-dvvkx\" (UID: \"99d59973-e3c2-41fc-9b89-66993ae20586\") " pod="openshift-multus/multus-dvvkx" Jun 10 11:58:14.286938 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.286392 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/99d59973-e3c2-41fc-9b89-66993ae20586-host-run-k8s-cni-cncf-io\") pod \"multus-dvvkx\" (UID: \"99d59973-e3c2-41fc-9b89-66993ae20586\") " pod="openshift-multus/multus-dvvkx" Jun 10 11:58:14.286938 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.286430 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/427ee27e-2e7e-450a-abcd-2861b93faf53-sys-fs\") pod \"aws-ebs-csi-driver-node-kp55n\" (UID: \"427ee27e-2e7e-450a-abcd-2861b93faf53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp55n" Jun 10 11:58:14.286938 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.286462 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0fd68196-fb5a-4984-9c69-36a423841431-host-run-netns\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.286938 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.286486 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0fd68196-fb5a-4984-9c69-36a423841431-run-ovn\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.286938 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.286519 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e73f01dd-034a-4de7-a873-15dccbae3921-tmp-dir\") pod \"node-resolver-dhw7b\" (UID: \"e73f01dd-034a-4de7-a873-15dccbae3921\") " pod="openshift-dns/node-resolver-dhw7b" Jun 10 11:58:14.286938 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.286554 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/99d59973-e3c2-41fc-9b89-66993ae20586-system-cni-dir\") pod \"multus-dvvkx\" (UID: \"99d59973-e3c2-41fc-9b89-66993ae20586\") " pod="openshift-multus/multus-dvvkx" Jun 10 11:58:14.286938 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.286588 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/28392d5e-41b1-4885-88df-071da3138132-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8nk9t\" (UID: \"28392d5e-41b1-4885-88df-071da3138132\") " pod="openshift-multus/multus-additional-cni-plugins-8nk9t" Jun 10 11:58:14.286938 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.286623 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0b313b3a-4549-429b-8bad-9e655da23e67-etc-modprobe-d\") pod \"tuned-28kqn\" (UID: \"0b313b3a-4549-429b-8bad-9e655da23e67\") " pod="openshift-cluster-node-tuning-operator/tuned-28kqn" Jun 10 11:58:14.288187 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.286650 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f11fac11-8429-4106-8c42-06e081bc5a56-agent-certs\") pod \"konnectivity-agent-xjx89\" (UID: \"f11fac11-8429-4106-8c42-06e081bc5a56\") " pod="kube-system/konnectivity-agent-xjx89" Jun 10 11:58:14.288187 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.286681 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/735eadd6-c42b-4044-95b8-cd0b4762e0eb-kubelet-config\") pod \"global-pull-secret-syncer-v9bc6\" (UID: \"735eadd6-c42b-4044-95b8-cd0b4762e0eb\") " pod="kube-system/global-pull-secret-syncer-v9bc6" Jun 10 11:58:14.288187 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.286711 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/735eadd6-c42b-4044-95b8-cd0b4762e0eb-original-pull-secret\") pod \"global-pull-secret-syncer-v9bc6\" (UID: \"735eadd6-c42b-4044-95b8-cd0b4762e0eb\") " pod="kube-system/global-pull-secret-syncer-v9bc6" Jun 10 11:58:14.288187 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.286832 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/99d59973-e3c2-41fc-9b89-66993ae20586-host-run-k8s-cni-cncf-io\") pod \"multus-dvvkx\" (UID: \"99d59973-e3c2-41fc-9b89-66993ae20586\") " pod="openshift-multus/multus-dvvkx" Jun 10 11:58:14.288187 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.286862 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f11fac11-8429-4106-8c42-06e081bc5a56-konnectivity-ca\") pod \"konnectivity-agent-xjx89\" (UID: \"f11fac11-8429-4106-8c42-06e081bc5a56\") " pod="kube-system/konnectivity-agent-xjx89" Jun 10 11:58:14.288187 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.286954 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/99d59973-e3c2-41fc-9b89-66993ae20586-multus-daemon-config\") pod \"multus-dvvkx\" (UID: \"99d59973-e3c2-41fc-9b89-66993ae20586\") " pod="openshift-multus/multus-dvvkx" Jun 10 11:58:14.288187 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.286987 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0b313b3a-4549-429b-8bad-9e655da23e67-etc-modprobe-d\") pod \"tuned-28kqn\" (UID: \"0b313b3a-4549-429b-8bad-9e655da23e67\") " pod="openshift-cluster-node-tuning-operator/tuned-28kqn" Jun 10 11:58:14.288187 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.287076 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/99d59973-e3c2-41fc-9b89-66993ae20586-system-cni-dir\") pod \"multus-dvvkx\" (UID: \"99d59973-e3c2-41fc-9b89-66993ae20586\") " pod="openshift-multus/multus-dvvkx" Jun 10 11:58:14.288187 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.287383 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/28392d5e-41b1-4885-88df-071da3138132-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8nk9t\" (UID: \"28392d5e-41b1-4885-88df-071da3138132\") " pod="openshift-multus/multus-additional-cni-plugins-8nk9t" Jun 10 11:58:14.290357 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.290333 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b313b3a-4549-429b-8bad-9e655da23e67-tmp\") pod \"tuned-28kqn\" (UID: \"0b313b3a-4549-429b-8bad-9e655da23e67\") " pod="openshift-cluster-node-tuning-operator/tuned-28kqn" Jun 10 11:58:14.290432 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.290364 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0b313b3a-4549-429b-8bad-9e655da23e67-etc-tuned\") pod \"tuned-28kqn\" (UID: \"0b313b3a-4549-429b-8bad-9e655da23e67\") " pod="openshift-cluster-node-tuning-operator/tuned-28kqn" Jun 10 11:58:14.290621 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.290605 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f11fac11-8429-4106-8c42-06e081bc5a56-agent-certs\") pod \"konnectivity-agent-xjx89\" (UID: \"f11fac11-8429-4106-8c42-06e081bc5a56\") " pod="kube-system/konnectivity-agent-xjx89" Jun 10 11:58:14.296354 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.296322 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr5sm\" (UniqueName: \"kubernetes.io/projected/28392d5e-41b1-4885-88df-071da3138132-kube-api-access-lr5sm\") pod \"multus-additional-cni-plugins-8nk9t\" (UID: \"28392d5e-41b1-4885-88df-071da3138132\") " pod="openshift-multus/multus-additional-cni-plugins-8nk9t" Jun 10 11:58:14.296502 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.296478 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87z47\" (UniqueName: \"kubernetes.io/projected/0b313b3a-4549-429b-8bad-9e655da23e67-kube-api-access-87z47\") pod \"tuned-28kqn\" (UID: \"0b313b3a-4549-429b-8bad-9e655da23e67\") " pod="openshift-cluster-node-tuning-operator/tuned-28kqn" Jun 10 11:58:14.297948 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.297922 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxd87\" (UniqueName: \"kubernetes.io/projected/99d59973-e3c2-41fc-9b89-66993ae20586-kube-api-access-fxd87\") pod \"multus-dvvkx\" (UID: \"99d59973-e3c2-41fc-9b89-66993ae20586\") " pod="openshift-multus/multus-dvvkx" Jun 10 11:58:14.298398 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.298374 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvjht\" (UniqueName: \"kubernetes.io/projected/b8180252-e6fc-4c10-aea5-e5577682a8cf-kube-api-access-tvjht\") pod \"network-metrics-daemon-ndwtw\" (UID: \"b8180252-e6fc-4c10-aea5-e5577682a8cf\") " pod="openshift-multus/network-metrics-daemon-ndwtw" Jun 10 11:58:14.298488 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.298421 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs46m\" (UniqueName: \"kubernetes.io/projected/bc041c77-ffb6-475e-a9cf-6697f9e4d28a-kube-api-access-bs46m\") pod \"iptables-alerter-tnsxf\" (UID: \"bc041c77-ffb6-475e-a9cf-6697f9e4d28a\") " pod="openshift-network-operator/iptables-alerter-tnsxf" Jun 10 11:58:14.298780 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.298760 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dfwp\" (UniqueName: \"kubernetes.io/projected/0b9f91bb-de66-4959-b25d-c8c4f3f6bb79-kube-api-access-5dfwp\") pod \"node-ca-fnfcg\" (UID: \"0b9f91bb-de66-4959-b25d-c8c4f3f6bb79\") " pod="openshift-image-registry/node-ca-fnfcg" Jun 10 11:58:14.387779 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.387748 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/427ee27e-2e7e-450a-abcd-2861b93faf53-registration-dir\") pod \"aws-ebs-csi-driver-node-kp55n\" (UID: \"427ee27e-2e7e-450a-abcd-2861b93faf53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp55n" Jun 10 11:58:14.387779 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.387782 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0fd68196-fb5a-4984-9c69-36a423841431-ovnkube-config\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.388010 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.387808 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0fd68196-fb5a-4984-9c69-36a423841431-host-slash\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.388010 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.387832 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0fd68196-fb5a-4984-9c69-36a423841431-etc-openvswitch\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.388010 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.387857 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0fd68196-fb5a-4984-9c69-36a423841431-log-socket\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.388010 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.387886 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0fd68196-fb5a-4984-9c69-36a423841431-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.388010 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.387896 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/427ee27e-2e7e-450a-abcd-2861b93faf53-registration-dir\") pod \"aws-ebs-csi-driver-node-kp55n\" (UID: \"427ee27e-2e7e-450a-abcd-2861b93faf53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp55n" Jun 10 11:58:14.388010 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.387910 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0fd68196-fb5a-4984-9c69-36a423841431-env-overrides\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.388010 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.387953 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0fd68196-fb5a-4984-9c69-36a423841431-etc-openvswitch\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.388010 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.387957 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0fd68196-fb5a-4984-9c69-36a423841431-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.388010 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.387998 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0fd68196-fb5a-4984-9c69-36a423841431-log-socket\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.388010 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.388006 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0fd68196-fb5a-4984-9c69-36a423841431-host-slash\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.388521 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.387976 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/427ee27e-2e7e-450a-abcd-2861b93faf53-etc-selinux\") pod \"aws-ebs-csi-driver-node-kp55n\" (UID: \"427ee27e-2e7e-450a-abcd-2861b93faf53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp55n" Jun 10 11:58:14.388521 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.388066 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0fd68196-fb5a-4984-9c69-36a423841431-systemd-units\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.388521 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.388102 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/427ee27e-2e7e-450a-abcd-2861b93faf53-etc-selinux\") pod \"aws-ebs-csi-driver-node-kp55n\" (UID: \"427ee27e-2e7e-450a-abcd-2861b93faf53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp55n" Jun 10 11:58:14.388521 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.388116 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0fd68196-fb5a-4984-9c69-36a423841431-var-lib-openvswitch\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.388521 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.388163 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0fd68196-fb5a-4984-9c69-36a423841431-systemd-units\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.388521 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.388168 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0fd68196-fb5a-4984-9c69-36a423841431-var-lib-openvswitch\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.388521 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.388182 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0fd68196-fb5a-4984-9c69-36a423841431-host-cni-netd\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.388521 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.388237 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0fd68196-fb5a-4984-9c69-36a423841431-host-cni-bin\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.388521 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.388265 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s85gw\" (UniqueName: \"kubernetes.io/projected/e73f01dd-034a-4de7-a873-15dccbae3921-kube-api-access-s85gw\") pod \"node-resolver-dhw7b\" (UID: \"e73f01dd-034a-4de7-a873-15dccbae3921\") " pod="openshift-dns/node-resolver-dhw7b" Jun 10 11:58:14.388521 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.388274 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0fd68196-fb5a-4984-9c69-36a423841431-host-cni-netd\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.388521 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.388296 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0fd68196-fb5a-4984-9c69-36a423841431-host-cni-bin\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.388521 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.388297 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/735eadd6-c42b-4044-95b8-cd0b4762e0eb-dbus\") pod \"global-pull-secret-syncer-v9bc6\" (UID: \"735eadd6-c42b-4044-95b8-cd0b4762e0eb\") " pod="kube-system/global-pull-secret-syncer-v9bc6" Jun 10 11:58:14.388521 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.388343 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8fqz\" (UniqueName: \"kubernetes.io/projected/427ee27e-2e7e-450a-abcd-2861b93faf53-kube-api-access-m8fqz\") pod \"aws-ebs-csi-driver-node-kp55n\" (UID: \"427ee27e-2e7e-450a-abcd-2861b93faf53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp55n" Jun 10 11:58:14.388521 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.388394 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0fd68196-fb5a-4984-9c69-36a423841431-run-openvswitch\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.388521 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.388427 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9fxb\" (UniqueName: \"kubernetes.io/projected/0fd68196-fb5a-4984-9c69-36a423841431-kube-api-access-b9fxb\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.388521 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.388453 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e73f01dd-034a-4de7-a873-15dccbae3921-hosts-file\") pod \"node-resolver-dhw7b\" (UID: \"e73f01dd-034a-4de7-a873-15dccbae3921\") " pod="openshift-dns/node-resolver-dhw7b" Jun 10 11:58:14.388521 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.388457 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0fd68196-fb5a-4984-9c69-36a423841431-run-openvswitch\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.389301 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.388493 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0fd68196-fb5a-4984-9c69-36a423841431-ovnkube-script-lib\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.389301 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.388507 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e73f01dd-034a-4de7-a873-15dccbae3921-hosts-file\") pod \"node-resolver-dhw7b\" (UID: \"e73f01dd-034a-4de7-a873-15dccbae3921\") " pod="openshift-dns/node-resolver-dhw7b" Jun 10 11:58:14.389301 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.388524 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0fd68196-fb5a-4984-9c69-36a423841431-host-kubelet\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.389301 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.388548 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0fd68196-fb5a-4984-9c69-36a423841431-node-log\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.389301 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.388565 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/735eadd6-c42b-4044-95b8-cd0b4762e0eb-dbus\") pod \"global-pull-secret-syncer-v9bc6\" (UID: \"735eadd6-c42b-4044-95b8-cd0b4762e0eb\") " pod="kube-system/global-pull-secret-syncer-v9bc6" Jun 10 11:58:14.389301 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.388571 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0fd68196-fb5a-4984-9c69-36a423841431-ovn-node-metrics-cert\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.389301 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.388596 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0fd68196-fb5a-4984-9c69-36a423841431-env-overrides\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.389301 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.388611 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/427ee27e-2e7e-450a-abcd-2861b93faf53-device-dir\") pod \"aws-ebs-csi-driver-node-kp55n\" (UID: \"427ee27e-2e7e-450a-abcd-2861b93faf53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp55n" Jun 10 11:58:14.389301 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.388648 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0fd68196-fb5a-4984-9c69-36a423841431-host-kubelet\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.389301 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.388664 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0fd68196-fb5a-4984-9c69-36a423841431-run-systemd\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.389301 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.388693 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0fd68196-fb5a-4984-9c69-36a423841431-node-log\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.389301 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.388706 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0fd68196-fb5a-4984-9c69-36a423841431-host-run-ovn-kubernetes\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.389301 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.388732 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbdk6\" (UniqueName: \"kubernetes.io/projected/3b023797-5c02-41bf-a1dd-a01e3c265b91-kube-api-access-qbdk6\") pod \"network-check-target-lfwlq\" (UID: \"3b023797-5c02-41bf-a1dd-a01e3c265b91\") " pod="openshift-network-diagnostics/network-check-target-lfwlq" Jun 10 11:58:14.389301 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.388740 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/427ee27e-2e7e-450a-abcd-2861b93faf53-device-dir\") pod \"aws-ebs-csi-driver-node-kp55n\" (UID: \"427ee27e-2e7e-450a-abcd-2861b93faf53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp55n" Jun 10 11:58:14.389301 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.388758 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/427ee27e-2e7e-450a-abcd-2861b93faf53-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kp55n\" (UID: \"427ee27e-2e7e-450a-abcd-2861b93faf53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp55n" Jun 10 11:58:14.389301 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.388763 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0fd68196-fb5a-4984-9c69-36a423841431-run-systemd\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.389301 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.388779 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0fd68196-fb5a-4984-9c69-36a423841431-host-run-ovn-kubernetes\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.389943 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.388823 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/427ee27e-2e7e-450a-abcd-2861b93faf53-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kp55n\" (UID: \"427ee27e-2e7e-450a-abcd-2861b93faf53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp55n" Jun 10 11:58:14.389943 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.388879 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/427ee27e-2e7e-450a-abcd-2861b93faf53-socket-dir\") pod \"aws-ebs-csi-driver-node-kp55n\" (UID: \"427ee27e-2e7e-450a-abcd-2861b93faf53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp55n" Jun 10 11:58:14.389943 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.388910 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/427ee27e-2e7e-450a-abcd-2861b93faf53-sys-fs\") pod \"aws-ebs-csi-driver-node-kp55n\" (UID: \"427ee27e-2e7e-450a-abcd-2861b93faf53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp55n" Jun 10 11:58:14.389943 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.388935 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0fd68196-fb5a-4984-9c69-36a423841431-host-run-netns\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.389943 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.388956 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0fd68196-fb5a-4984-9c69-36a423841431-run-ovn\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.389943 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.388998 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e73f01dd-034a-4de7-a873-15dccbae3921-tmp-dir\") pod \"node-resolver-dhw7b\" (UID: \"e73f01dd-034a-4de7-a873-15dccbae3921\") " pod="openshift-dns/node-resolver-dhw7b" Jun 10 11:58:14.389943 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.389008 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/427ee27e-2e7e-450a-abcd-2861b93faf53-socket-dir\") pod \"aws-ebs-csi-driver-node-kp55n\" (UID: \"427ee27e-2e7e-450a-abcd-2861b93faf53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp55n" Jun 10 11:58:14.389943 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.389005 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/427ee27e-2e7e-450a-abcd-2861b93faf53-sys-fs\") pod \"aws-ebs-csi-driver-node-kp55n\" (UID: \"427ee27e-2e7e-450a-abcd-2861b93faf53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp55n" Jun 10 11:58:14.389943 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.389028 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/735eadd6-c42b-4044-95b8-cd0b4762e0eb-kubelet-config\") pod \"global-pull-secret-syncer-v9bc6\" (UID: \"735eadd6-c42b-4044-95b8-cd0b4762e0eb\") " pod="kube-system/global-pull-secret-syncer-v9bc6" Jun 10 11:58:14.389943 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.389031 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0fd68196-fb5a-4984-9c69-36a423841431-host-run-netns\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.389943 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.389074 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0fd68196-fb5a-4984-9c69-36a423841431-run-ovn\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.389943 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.389083 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/735eadd6-c42b-4044-95b8-cd0b4762e0eb-kubelet-config\") pod \"global-pull-secret-syncer-v9bc6\" (UID: \"735eadd6-c42b-4044-95b8-cd0b4762e0eb\") " pod="kube-system/global-pull-secret-syncer-v9bc6" Jun 10 11:58:14.389943 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.389095 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/735eadd6-c42b-4044-95b8-cd0b4762e0eb-original-pull-secret\") pod \"global-pull-secret-syncer-v9bc6\" (UID: \"735eadd6-c42b-4044-95b8-cd0b4762e0eb\") " pod="kube-system/global-pull-secret-syncer-v9bc6" Jun 10 11:58:14.389943 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.389192 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0fd68196-fb5a-4984-9c69-36a423841431-ovnkube-script-lib\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.389943 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:14.389198 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 11:58:14.389943 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.389270 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0fd68196-fb5a-4984-9c69-36a423841431-ovnkube-config\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.389943 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.389319 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e73f01dd-034a-4de7-a873-15dccbae3921-tmp-dir\") pod \"node-resolver-dhw7b\" (UID: \"e73f01dd-034a-4de7-a873-15dccbae3921\") " pod="openshift-dns/node-resolver-dhw7b" Jun 10 11:58:14.390564 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:14.389373 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/735eadd6-c42b-4044-95b8-cd0b4762e0eb-original-pull-secret podName:735eadd6-c42b-4044-95b8-cd0b4762e0eb nodeName:}" failed. No retries permitted until 2026-06-10 11:58:14.889351332 +0000 UTC m=+3.095102170 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/735eadd6-c42b-4044-95b8-cd0b4762e0eb-original-pull-secret") pod "global-pull-secret-syncer-v9bc6" (UID: "735eadd6-c42b-4044-95b8-cd0b4762e0eb") : object "kube-system"/"original-pull-secret" not registered Jun 10 11:58:14.391180 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.391161 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0fd68196-fb5a-4984-9c69-36a423841431-ovn-node-metrics-cert\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.396869 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:14.396841 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 11:58:14.396869 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:14.396863 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 11:58:14.397036 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:14.396876 2562 projected.go:196] Error preparing data for projected volume kube-api-access-qbdk6 for pod openshift-network-diagnostics/network-check-target-lfwlq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:58:14.397036 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:14.396951 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b023797-5c02-41bf-a1dd-a01e3c265b91-kube-api-access-qbdk6 podName:3b023797-5c02-41bf-a1dd-a01e3c265b91 nodeName:}" failed. No retries permitted until 2026-06-10 11:58:14.896934466 +0000 UTC m=+3.102685303 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qbdk6" (UniqueName: "kubernetes.io/projected/3b023797-5c02-41bf-a1dd-a01e3c265b91-kube-api-access-qbdk6") pod "network-check-target-lfwlq" (UID: "3b023797-5c02-41bf-a1dd-a01e3c265b91") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:58:14.399206 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.399186 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s85gw\" (UniqueName: \"kubernetes.io/projected/e73f01dd-034a-4de7-a873-15dccbae3921-kube-api-access-s85gw\") pod \"node-resolver-dhw7b\" (UID: \"e73f01dd-034a-4de7-a873-15dccbae3921\") " pod="openshift-dns/node-resolver-dhw7b" Jun 10 11:58:14.399642 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.399614 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9fxb\" (UniqueName: \"kubernetes.io/projected/0fd68196-fb5a-4984-9c69-36a423841431-kube-api-access-b9fxb\") pod \"ovnkube-node-xgfwc\" (UID: \"0fd68196-fb5a-4984-9c69-36a423841431\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.400589 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.400569 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8fqz\" (UniqueName: \"kubernetes.io/projected/427ee27e-2e7e-450a-abcd-2861b93faf53-kube-api-access-m8fqz\") pod \"aws-ebs-csi-driver-node-kp55n\" (UID: \"427ee27e-2e7e-450a-abcd-2861b93faf53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp55n" Jun 10 11:58:14.477220 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.477146 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fnfcg" Jun 10 11:58:14.486141 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.486118 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tnsxf" Jun 10 11:58:14.495075 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.495055 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8nk9t" Jun 10 11:58:14.498234 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.498220 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dvvkx" Jun 10 11:58:14.504700 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.504681 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xjx89" Jun 10 11:58:14.510572 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.510555 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-28kqn" Jun 10 11:58:14.517092 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.517076 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dhw7b" Jun 10 11:58:14.524362 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.524341 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp55n" Jun 10 11:58:14.530351 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.530330 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:14.792358 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.792267 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8180252-e6fc-4c10-aea5-e5577682a8cf-metrics-certs\") pod \"network-metrics-daemon-ndwtw\" (UID: \"b8180252-e6fc-4c10-aea5-e5577682a8cf\") " pod="openshift-multus/network-metrics-daemon-ndwtw" Jun 10 11:58:14.792515 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:14.792437 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:58:14.792515 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:14.792501 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8180252-e6fc-4c10-aea5-e5577682a8cf-metrics-certs podName:b8180252-e6fc-4c10-aea5-e5577682a8cf nodeName:}" failed. No retries permitted until 2026-06-10 11:58:15.792487387 +0000 UTC m=+3.998238208 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b8180252-e6fc-4c10-aea5-e5577682a8cf-metrics-certs") pod "network-metrics-daemon-ndwtw" (UID: "b8180252-e6fc-4c10-aea5-e5577682a8cf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:58:14.893356 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.893312 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/735eadd6-c42b-4044-95b8-cd0b4762e0eb-original-pull-secret\") pod \"global-pull-secret-syncer-v9bc6\" (UID: \"735eadd6-c42b-4044-95b8-cd0b4762e0eb\") " pod="kube-system/global-pull-secret-syncer-v9bc6" Jun 10 11:58:14.893552 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:14.893485 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 11:58:14.893604 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:14.893567 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/735eadd6-c42b-4044-95b8-cd0b4762e0eb-original-pull-secret podName:735eadd6-c42b-4044-95b8-cd0b4762e0eb nodeName:}" failed. No retries permitted until 2026-06-10 11:58:15.893546721 +0000 UTC m=+4.099297563 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/735eadd6-c42b-4044-95b8-cd0b4762e0eb-original-pull-secret") pod "global-pull-secret-syncer-v9bc6" (UID: "735eadd6-c42b-4044-95b8-cd0b4762e0eb") : object "kube-system"/"original-pull-secret" not registered Jun 10 11:58:14.942573 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:14.942535 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b9f91bb_de66_4959_b25d_c8c4f3f6bb79.slice/crio-529994cdfc936f5f36f6337ec0ab5a3e4c73ce24e40922685dd808725db34f74 WatchSource:0}: Error finding container 529994cdfc936f5f36f6337ec0ab5a3e4c73ce24e40922685dd808725db34f74: Status 404 returned error can't find the container with id 529994cdfc936f5f36f6337ec0ab5a3e4c73ce24e40922685dd808725db34f74 Jun 10 11:58:14.946364 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:14.946340 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf11fac11_8429_4106_8c42_06e081bc5a56.slice/crio-8e28c73657c747391b02b11463c2edbcf731b2790d774f53aee66e8b2c5ed780 WatchSource:0}: Error finding container 8e28c73657c747391b02b11463c2edbcf731b2790d774f53aee66e8b2c5ed780: Status 404 returned error can't find the container with id 8e28c73657c747391b02b11463c2edbcf731b2790d774f53aee66e8b2c5ed780 Jun 10 11:58:14.946949 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:14.946926 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b313b3a_4549_429b_8bad_9e655da23e67.slice/crio-e77dcc683f2e547dc62b99351031444eec40e1c3087bf6c5ddf7daef73944b92 WatchSource:0}: Error finding container e77dcc683f2e547dc62b99351031444eec40e1c3087bf6c5ddf7daef73944b92: Status 404 returned error can't find the container with id e77dcc683f2e547dc62b99351031444eec40e1c3087bf6c5ddf7daef73944b92 Jun 10 11:58:14.948331 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:14.948302 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fd68196_fb5a_4984_9c69_36a423841431.slice/crio-2d03b7bbdcf5965467bfa87b512e5fc913b467cacd5760c1d9f537b5c33b665a WatchSource:0}: Error finding container 2d03b7bbdcf5965467bfa87b512e5fc913b467cacd5760c1d9f537b5c33b665a: Status 404 returned error can't find the container with id 2d03b7bbdcf5965467bfa87b512e5fc913b467cacd5760c1d9f537b5c33b665a Jun 10 11:58:14.949228 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:14.949207 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode73f01dd_034a_4de7_a873_15dccbae3921.slice/crio-6f79a43ae9ad5a2071ddab2403c9d9b164285abbe8384c788ed506accfb7be72 WatchSource:0}: Error finding container 6f79a43ae9ad5a2071ddab2403c9d9b164285abbe8384c788ed506accfb7be72: Status 404 returned error can't find the container with id 6f79a43ae9ad5a2071ddab2403c9d9b164285abbe8384c788ed506accfb7be72 Jun 10 11:58:14.951416 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:14.951385 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc041c77_ffb6_475e_a9cf_6697f9e4d28a.slice/crio-5432ae3760621fb467abbf50aabcdb0ce94867352f7d08238c419401ed86932e WatchSource:0}: Error finding container 5432ae3760621fb467abbf50aabcdb0ce94867352f7d08238c419401ed86932e: Status 404 returned error can't find the container with id 5432ae3760621fb467abbf50aabcdb0ce94867352f7d08238c419401ed86932e Jun 10 11:58:14.952443 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:14.952425 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod427ee27e_2e7e_450a_abcd_2861b93faf53.slice/crio-bd1c08ec71a925210205e0d519a684235ea9df4b02a948f077e8647095030381 WatchSource:0}: Error finding container bd1c08ec71a925210205e0d519a684235ea9df4b02a948f077e8647095030381: Status 404 returned error can't find the container with id bd1c08ec71a925210205e0d519a684235ea9df4b02a948f077e8647095030381 Jun 10 11:58:14.953461 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:14.953443 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99d59973_e3c2_41fc_9b89_66993ae20586.slice/crio-d6722496b6c23110657ca8e4a80e93e007700bd07485ce6b65058d2605a08577 WatchSource:0}: Error finding container d6722496b6c23110657ca8e4a80e93e007700bd07485ce6b65058d2605a08577: Status 404 returned error can't find the container with id d6722496b6c23110657ca8e4a80e93e007700bd07485ce6b65058d2605a08577 Jun 10 11:58:14.955156 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:14.955116 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28392d5e_41b1_4885_88df_071da3138132.slice/crio-8ff2376357424be48160898cc3c869632cc7c71f20780f51c60f4c6a62a02afb WatchSource:0}: Error finding container 8ff2376357424be48160898cc3c869632cc7c71f20780f51c60f4c6a62a02afb: Status 404 returned error can't find the container with id 8ff2376357424be48160898cc3c869632cc7c71f20780f51c60f4c6a62a02afb Jun 10 11:58:14.994540 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:14.994514 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbdk6\" (UniqueName: \"kubernetes.io/projected/3b023797-5c02-41bf-a1dd-a01e3c265b91-kube-api-access-qbdk6\") pod \"network-check-target-lfwlq\" (UID: \"3b023797-5c02-41bf-a1dd-a01e3c265b91\") " pod="openshift-network-diagnostics/network-check-target-lfwlq" Jun 10 11:58:14.994754 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:14.994729 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 11:58:14.994818 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:14.994760 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 11:58:14.994818 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:14.994775 2562 projected.go:196] Error preparing data for projected volume kube-api-access-qbdk6 for pod openshift-network-diagnostics/network-check-target-lfwlq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:58:14.994882 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:14.994843 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b023797-5c02-41bf-a1dd-a01e3c265b91-kube-api-access-qbdk6 podName:3b023797-5c02-41bf-a1dd-a01e3c265b91 nodeName:}" failed. No retries permitted until 2026-06-10 11:58:15.994826501 +0000 UTC m=+4.200577336 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qbdk6" (UniqueName: "kubernetes.io/projected/3b023797-5c02-41bf-a1dd-a01e3c265b91-kube-api-access-qbdk6") pod "network-check-target-lfwlq" (UID: "3b023797-5c02-41bf-a1dd-a01e3c265b91") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:58:15.222910 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:15.222688 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 11:53:14 +0000 UTC" deadline="2028-03-12 22:41:21.3943567 +0000 UTC" Jun 10 11:58:15.222910 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:15.222909 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15394h43m6.171452307s" Jun 10 11:58:15.248930 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:15.248897 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-86.ec2.internal" event={"ID":"40ca37db0a7b4f65e597e689e3ee3fae","Type":"ContainerStarted","Data":"dcc47c907c6eede3ddbb8cd289d8ed09a7590515adafa3b594fd74831780d78b"} Jun 10 11:58:15.252073 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:15.251601 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8nk9t" event={"ID":"28392d5e-41b1-4885-88df-071da3138132","Type":"ContainerStarted","Data":"8ff2376357424be48160898cc3c869632cc7c71f20780f51c60f4c6a62a02afb"} Jun 10 11:58:15.255688 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:15.255645 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tnsxf" event={"ID":"bc041c77-ffb6-475e-a9cf-6697f9e4d28a","Type":"ContainerStarted","Data":"5432ae3760621fb467abbf50aabcdb0ce94867352f7d08238c419401ed86932e"} Jun 10 11:58:15.257196 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:15.257169 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" event={"ID":"0fd68196-fb5a-4984-9c69-36a423841431","Type":"ContainerStarted","Data":"2d03b7bbdcf5965467bfa87b512e5fc913b467cacd5760c1d9f537b5c33b665a"} Jun 10 11:58:15.259056 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:15.259019 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xjx89" event={"ID":"f11fac11-8429-4106-8c42-06e081bc5a56","Type":"ContainerStarted","Data":"8e28c73657c747391b02b11463c2edbcf731b2790d774f53aee66e8b2c5ed780"} Jun 10 11:58:15.261502 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:15.261478 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fnfcg" event={"ID":"0b9f91bb-de66-4959-b25d-c8c4f3f6bb79","Type":"ContainerStarted","Data":"529994cdfc936f5f36f6337ec0ab5a3e4c73ce24e40922685dd808725db34f74"} Jun 10 11:58:15.264052 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:15.264013 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dvvkx" event={"ID":"99d59973-e3c2-41fc-9b89-66993ae20586","Type":"ContainerStarted","Data":"d6722496b6c23110657ca8e4a80e93e007700bd07485ce6b65058d2605a08577"} Jun 10 11:58:15.265652 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:15.265629 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp55n" event={"ID":"427ee27e-2e7e-450a-abcd-2861b93faf53","Type":"ContainerStarted","Data":"bd1c08ec71a925210205e0d519a684235ea9df4b02a948f077e8647095030381"} Jun 10 11:58:15.267524 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:15.267501 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dhw7b" event={"ID":"e73f01dd-034a-4de7-a873-15dccbae3921","Type":"ContainerStarted","Data":"6f79a43ae9ad5a2071ddab2403c9d9b164285abbe8384c788ed506accfb7be72"} Jun 10 11:58:15.270219 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:15.270195 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-28kqn" event={"ID":"0b313b3a-4549-429b-8bad-9e655da23e67","Type":"ContainerStarted","Data":"e77dcc683f2e547dc62b99351031444eec40e1c3087bf6c5ddf7daef73944b92"} Jun 10 11:58:15.274384 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:15.274360 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-86.ec2.internal" event={"ID":"24f1ae120e14c1eae8cf0bab07b174a0","Type":"ContainerStarted","Data":"8457b0e8db58d825f8674faab8b19accfee380bb09810be9230d2d18e38a64ca"} Jun 10 11:58:15.293622 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:15.293573 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-86.ec2.internal" podStartSLOduration=2.293552248 podStartE2EDuration="2.293552248s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:58:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:58:15.269558805 +0000 UTC m=+3.475309649" watchObservedRunningTime="2026-06-10 11:58:15.293552248 +0000 UTC m=+3.499303096" Jun 10 11:58:15.800811 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:15.800728 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8180252-e6fc-4c10-aea5-e5577682a8cf-metrics-certs\") pod \"network-metrics-daemon-ndwtw\" (UID: \"b8180252-e6fc-4c10-aea5-e5577682a8cf\") " pod="openshift-multus/network-metrics-daemon-ndwtw" Jun 10 11:58:15.800977 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:15.800917 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:58:15.801062 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:15.800986 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8180252-e6fc-4c10-aea5-e5577682a8cf-metrics-certs podName:b8180252-e6fc-4c10-aea5-e5577682a8cf nodeName:}" failed. No retries permitted until 2026-06-10 11:58:17.800968135 +0000 UTC m=+6.006718963 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b8180252-e6fc-4c10-aea5-e5577682a8cf-metrics-certs") pod "network-metrics-daemon-ndwtw" (UID: "b8180252-e6fc-4c10-aea5-e5577682a8cf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:58:15.901190 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:15.901152 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/735eadd6-c42b-4044-95b8-cd0b4762e0eb-original-pull-secret\") pod \"global-pull-secret-syncer-v9bc6\" (UID: \"735eadd6-c42b-4044-95b8-cd0b4762e0eb\") " pod="kube-system/global-pull-secret-syncer-v9bc6" Jun 10 11:58:15.901373 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:15.901307 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 11:58:15.901373 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:15.901369 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/735eadd6-c42b-4044-95b8-cd0b4762e0eb-original-pull-secret podName:735eadd6-c42b-4044-95b8-cd0b4762e0eb nodeName:}" failed. No retries permitted until 2026-06-10 11:58:17.901351325 +0000 UTC m=+6.107102165 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/735eadd6-c42b-4044-95b8-cd0b4762e0eb-original-pull-secret") pod "global-pull-secret-syncer-v9bc6" (UID: "735eadd6-c42b-4044-95b8-cd0b4762e0eb") : object "kube-system"/"original-pull-secret" not registered Jun 10 11:58:16.002965 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:16.002314 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbdk6\" (UniqueName: \"kubernetes.io/projected/3b023797-5c02-41bf-a1dd-a01e3c265b91-kube-api-access-qbdk6\") pod \"network-check-target-lfwlq\" (UID: \"3b023797-5c02-41bf-a1dd-a01e3c265b91\") " pod="openshift-network-diagnostics/network-check-target-lfwlq" Jun 10 11:58:16.002965 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:16.002514 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 11:58:16.002965 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:16.002536 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 11:58:16.002965 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:16.002549 2562 projected.go:196] Error preparing data for projected volume kube-api-access-qbdk6 for pod openshift-network-diagnostics/network-check-target-lfwlq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:58:16.002965 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:16.002606 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b023797-5c02-41bf-a1dd-a01e3c265b91-kube-api-access-qbdk6 podName:3b023797-5c02-41bf-a1dd-a01e3c265b91 nodeName:}" failed. No retries permitted until 2026-06-10 11:58:18.002588507 +0000 UTC m=+6.208339348 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qbdk6" (UniqueName: "kubernetes.io/projected/3b023797-5c02-41bf-a1dd-a01e3c265b91-kube-api-access-qbdk6") pod "network-check-target-lfwlq" (UID: "3b023797-5c02-41bf-a1dd-a01e3c265b91") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:58:16.223730 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:16.223636 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 11:53:14 +0000 UTC" deadline="2027-11-28 06:37:05.76742496 +0000 UTC" Jun 10 11:58:16.223730 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:16.223680 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12858h38m49.543750111s" Jun 10 11:58:16.240328 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:16.240301 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndwtw" Jun 10 11:58:16.240499 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:16.240447 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndwtw" podUID="b8180252-e6fc-4c10-aea5-e5577682a8cf" Jun 10 11:58:16.240885 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:16.240864 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfwlq" Jun 10 11:58:16.240976 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:16.240960 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfwlq" podUID="3b023797-5c02-41bf-a1dd-a01e3c265b91" Jun 10 11:58:16.241231 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:16.241165 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v9bc6" Jun 10 11:58:16.241355 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:16.241275 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v9bc6" podUID="735eadd6-c42b-4044-95b8-cd0b4762e0eb" Jun 10 11:58:16.293409 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:16.292658 2562 generic.go:356] "Generic (PLEG): container finished" podID="24f1ae120e14c1eae8cf0bab07b174a0" containerID="8457b0e8db58d825f8674faab8b19accfee380bb09810be9230d2d18e38a64ca" exitCode=0 Jun 10 11:58:16.293409 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:16.293222 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-86.ec2.internal" event={"ID":"24f1ae120e14c1eae8cf0bab07b174a0","Type":"ContainerDied","Data":"8457b0e8db58d825f8674faab8b19accfee380bb09810be9230d2d18e38a64ca"} Jun 10 11:58:16.293409 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:16.293350 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-86.ec2.internal" event={"ID":"24f1ae120e14c1eae8cf0bab07b174a0","Type":"ContainerStarted","Data":"0b8dae80e4d97a48da7a05e2062da1d0ee12bcea3fc05f4c83caef2d13d56a31"} Jun 10 11:58:16.321773 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:16.321194 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-86.ec2.internal" podStartSLOduration=3.321175061 podStartE2EDuration="3.321175061s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:58:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:58:16.321143404 +0000 UTC m=+4.526894249" watchObservedRunningTime="2026-06-10 11:58:16.321175061 +0000 UTC m=+4.526925907" Jun 10 11:58:17.816283 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:17.816245 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8180252-e6fc-4c10-aea5-e5577682a8cf-metrics-certs\") pod \"network-metrics-daemon-ndwtw\" (UID: \"b8180252-e6fc-4c10-aea5-e5577682a8cf\") " pod="openshift-multus/network-metrics-daemon-ndwtw" Jun 10 11:58:17.816763 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:17.816430 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:58:17.816763 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:17.816495 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8180252-e6fc-4c10-aea5-e5577682a8cf-metrics-certs podName:b8180252-e6fc-4c10-aea5-e5577682a8cf nodeName:}" failed. No retries permitted until 2026-06-10 11:58:21.816476895 +0000 UTC m=+10.022227734 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b8180252-e6fc-4c10-aea5-e5577682a8cf-metrics-certs") pod "network-metrics-daemon-ndwtw" (UID: "b8180252-e6fc-4c10-aea5-e5577682a8cf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:58:17.917190 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:17.917142 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/735eadd6-c42b-4044-95b8-cd0b4762e0eb-original-pull-secret\") pod \"global-pull-secret-syncer-v9bc6\" (UID: \"735eadd6-c42b-4044-95b8-cd0b4762e0eb\") " pod="kube-system/global-pull-secret-syncer-v9bc6" Jun 10 11:58:17.917374 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:17.917340 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 11:58:17.917438 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:17.917403 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/735eadd6-c42b-4044-95b8-cd0b4762e0eb-original-pull-secret podName:735eadd6-c42b-4044-95b8-cd0b4762e0eb nodeName:}" failed. No retries permitted until 2026-06-10 11:58:21.917385287 +0000 UTC m=+10.123136113 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/735eadd6-c42b-4044-95b8-cd0b4762e0eb-original-pull-secret") pod "global-pull-secret-syncer-v9bc6" (UID: "735eadd6-c42b-4044-95b8-cd0b4762e0eb") : object "kube-system"/"original-pull-secret" not registered Jun 10 11:58:18.018108 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:18.017966 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbdk6\" (UniqueName: \"kubernetes.io/projected/3b023797-5c02-41bf-a1dd-a01e3c265b91-kube-api-access-qbdk6\") pod \"network-check-target-lfwlq\" (UID: \"3b023797-5c02-41bf-a1dd-a01e3c265b91\") " pod="openshift-network-diagnostics/network-check-target-lfwlq" Jun 10 11:58:18.018283 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:18.018151 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 11:58:18.018283 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:18.018176 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 11:58:18.018283 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:18.018190 2562 projected.go:196] Error preparing data for projected volume kube-api-access-qbdk6 for pod openshift-network-diagnostics/network-check-target-lfwlq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:58:18.018283 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:18.018259 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b023797-5c02-41bf-a1dd-a01e3c265b91-kube-api-access-qbdk6 podName:3b023797-5c02-41bf-a1dd-a01e3c265b91 nodeName:}" failed. No retries permitted until 2026-06-10 11:58:22.01824087 +0000 UTC m=+10.223991698 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qbdk6" (UniqueName: "kubernetes.io/projected/3b023797-5c02-41bf-a1dd-a01e3c265b91-kube-api-access-qbdk6") pod "network-check-target-lfwlq" (UID: "3b023797-5c02-41bf-a1dd-a01e3c265b91") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:58:18.238231 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:18.238148 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v9bc6" Jun 10 11:58:18.238231 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:18.238200 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndwtw" Jun 10 11:58:18.238457 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:18.238285 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v9bc6" podUID="735eadd6-c42b-4044-95b8-cd0b4762e0eb" Jun 10 11:58:18.238457 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:18.238347 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfwlq" Jun 10 11:58:18.238457 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:18.238442 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfwlq" podUID="3b023797-5c02-41bf-a1dd-a01e3c265b91" Jun 10 11:58:18.238611 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:18.238568 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndwtw" podUID="b8180252-e6fc-4c10-aea5-e5577682a8cf" Jun 10 11:58:20.237158 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:20.237129 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndwtw" Jun 10 11:58:20.237607 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:20.237167 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfwlq" Jun 10 11:58:20.237607 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:20.237274 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndwtw" podUID="b8180252-e6fc-4c10-aea5-e5577682a8cf" Jun 10 11:58:20.237607 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:20.237285 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v9bc6" Jun 10 11:58:20.237607 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:20.237341 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfwlq" podUID="3b023797-5c02-41bf-a1dd-a01e3c265b91" Jun 10 11:58:20.237607 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:20.237434 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v9bc6" podUID="735eadd6-c42b-4044-95b8-cd0b4762e0eb" Jun 10 11:58:21.850528 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:21.850492 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8180252-e6fc-4c10-aea5-e5577682a8cf-metrics-certs\") pod \"network-metrics-daemon-ndwtw\" (UID: \"b8180252-e6fc-4c10-aea5-e5577682a8cf\") " pod="openshift-multus/network-metrics-daemon-ndwtw" Jun 10 11:58:21.850999 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:21.850698 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:58:21.850999 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:21.850777 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8180252-e6fc-4c10-aea5-e5577682a8cf-metrics-certs podName:b8180252-e6fc-4c10-aea5-e5577682a8cf nodeName:}" failed. No retries permitted until 2026-06-10 11:58:29.850755889 +0000 UTC m=+18.056506728 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b8180252-e6fc-4c10-aea5-e5577682a8cf-metrics-certs") pod "network-metrics-daemon-ndwtw" (UID: "b8180252-e6fc-4c10-aea5-e5577682a8cf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:58:21.951665 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:21.951591 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/735eadd6-c42b-4044-95b8-cd0b4762e0eb-original-pull-secret\") pod \"global-pull-secret-syncer-v9bc6\" (UID: \"735eadd6-c42b-4044-95b8-cd0b4762e0eb\") " pod="kube-system/global-pull-secret-syncer-v9bc6" Jun 10 11:58:21.951839 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:21.951772 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 11:58:21.951887 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:21.951858 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/735eadd6-c42b-4044-95b8-cd0b4762e0eb-original-pull-secret podName:735eadd6-c42b-4044-95b8-cd0b4762e0eb nodeName:}" failed. No retries permitted until 2026-06-10 11:58:29.951835626 +0000 UTC m=+18.157586469 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/735eadd6-c42b-4044-95b8-cd0b4762e0eb-original-pull-secret") pod "global-pull-secret-syncer-v9bc6" (UID: "735eadd6-c42b-4044-95b8-cd0b4762e0eb") : object "kube-system"/"original-pull-secret" not registered Jun 10 11:58:22.052135 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:22.052070 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbdk6\" (UniqueName: \"kubernetes.io/projected/3b023797-5c02-41bf-a1dd-a01e3c265b91-kube-api-access-qbdk6\") pod \"network-check-target-lfwlq\" (UID: \"3b023797-5c02-41bf-a1dd-a01e3c265b91\") " pod="openshift-network-diagnostics/network-check-target-lfwlq" Jun 10 11:58:22.052318 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:22.052240 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 11:58:22.052318 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:22.052265 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 11:58:22.052318 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:22.052278 2562 projected.go:196] Error preparing data for projected volume kube-api-access-qbdk6 for pod openshift-network-diagnostics/network-check-target-lfwlq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:58:22.052549 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:22.052347 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b023797-5c02-41bf-a1dd-a01e3c265b91-kube-api-access-qbdk6 podName:3b023797-5c02-41bf-a1dd-a01e3c265b91 nodeName:}" failed. No retries permitted until 2026-06-10 11:58:30.052327671 +0000 UTC m=+18.258078510 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qbdk6" (UniqueName: "kubernetes.io/projected/3b023797-5c02-41bf-a1dd-a01e3c265b91-kube-api-access-qbdk6") pod "network-check-target-lfwlq" (UID: "3b023797-5c02-41bf-a1dd-a01e3c265b91") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:58:22.239676 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:22.238967 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfwlq" Jun 10 11:58:22.239676 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:22.239091 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfwlq" podUID="3b023797-5c02-41bf-a1dd-a01e3c265b91" Jun 10 11:58:22.239676 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:22.239470 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndwtw" Jun 10 11:58:22.239676 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:22.239579 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndwtw" podUID="b8180252-e6fc-4c10-aea5-e5577682a8cf" Jun 10 11:58:22.239676 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:22.239646 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v9bc6" Jun 10 11:58:22.240032 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:22.239738 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v9bc6" podUID="735eadd6-c42b-4044-95b8-cd0b4762e0eb" Jun 10 11:58:24.237594 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:24.237558 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfwlq" Jun 10 11:58:24.238145 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:24.237680 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v9bc6" Jun 10 11:58:24.238145 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:24.237696 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfwlq" podUID="3b023797-5c02-41bf-a1dd-a01e3c265b91" Jun 10 11:58:24.238145 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:24.237808 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v9bc6" podUID="735eadd6-c42b-4044-95b8-cd0b4762e0eb" Jun 10 11:58:24.238145 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:24.237871 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndwtw" Jun 10 11:58:24.238145 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:24.237955 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndwtw" podUID="b8180252-e6fc-4c10-aea5-e5577682a8cf" Jun 10 11:58:26.237525 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:26.237490 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v9bc6" Jun 10 11:58:26.237968 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:26.237495 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndwtw" Jun 10 11:58:26.237968 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:26.237648 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfwlq" Jun 10 11:58:26.237968 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:26.237619 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v9bc6" podUID="735eadd6-c42b-4044-95b8-cd0b4762e0eb" Jun 10 11:58:26.237968 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:26.237756 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndwtw" podUID="b8180252-e6fc-4c10-aea5-e5577682a8cf" Jun 10 11:58:26.237968 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:26.237843 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfwlq" podUID="3b023797-5c02-41bf-a1dd-a01e3c265b91" Jun 10 11:58:28.240068 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:28.240026 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndwtw" Jun 10 11:58:28.240068 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:28.240075 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfwlq" Jun 10 11:58:28.240689 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:28.240153 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v9bc6" Jun 10 11:58:28.240689 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:28.240169 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndwtw" podUID="b8180252-e6fc-4c10-aea5-e5577682a8cf" Jun 10 11:58:28.240689 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:28.240263 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v9bc6" podUID="735eadd6-c42b-4044-95b8-cd0b4762e0eb" Jun 10 11:58:28.240689 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:28.240327 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfwlq" podUID="3b023797-5c02-41bf-a1dd-a01e3c265b91" Jun 10 11:58:29.911475 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:29.911442 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8180252-e6fc-4c10-aea5-e5577682a8cf-metrics-certs\") pod \"network-metrics-daemon-ndwtw\" (UID: \"b8180252-e6fc-4c10-aea5-e5577682a8cf\") " pod="openshift-multus/network-metrics-daemon-ndwtw" Jun 10 11:58:29.911943 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:29.911568 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:58:29.911943 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:29.911719 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8180252-e6fc-4c10-aea5-e5577682a8cf-metrics-certs podName:b8180252-e6fc-4c10-aea5-e5577682a8cf nodeName:}" failed. No retries permitted until 2026-06-10 11:58:45.911623857 +0000 UTC m=+34.117374702 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b8180252-e6fc-4c10-aea5-e5577682a8cf-metrics-certs") pod "network-metrics-daemon-ndwtw" (UID: "b8180252-e6fc-4c10-aea5-e5577682a8cf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:58:30.012108 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:30.012067 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/735eadd6-c42b-4044-95b8-cd0b4762e0eb-original-pull-secret\") pod \"global-pull-secret-syncer-v9bc6\" (UID: \"735eadd6-c42b-4044-95b8-cd0b4762e0eb\") " pod="kube-system/global-pull-secret-syncer-v9bc6" Jun 10 11:58:30.012279 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:30.012190 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 11:58:30.012279 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:30.012259 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/735eadd6-c42b-4044-95b8-cd0b4762e0eb-original-pull-secret podName:735eadd6-c42b-4044-95b8-cd0b4762e0eb nodeName:}" failed. No retries permitted until 2026-06-10 11:58:46.012241845 +0000 UTC m=+34.217992687 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/735eadd6-c42b-4044-95b8-cd0b4762e0eb-original-pull-secret") pod "global-pull-secret-syncer-v9bc6" (UID: "735eadd6-c42b-4044-95b8-cd0b4762e0eb") : object "kube-system"/"original-pull-secret" not registered Jun 10 11:58:30.113452 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:30.113413 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbdk6\" (UniqueName: \"kubernetes.io/projected/3b023797-5c02-41bf-a1dd-a01e3c265b91-kube-api-access-qbdk6\") pod \"network-check-target-lfwlq\" (UID: \"3b023797-5c02-41bf-a1dd-a01e3c265b91\") " pod="openshift-network-diagnostics/network-check-target-lfwlq" Jun 10 11:58:30.113610 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:30.113589 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 11:58:30.113675 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:30.113620 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 11:58:30.113675 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:30.113635 2562 projected.go:196] Error preparing data for projected volume kube-api-access-qbdk6 for pod openshift-network-diagnostics/network-check-target-lfwlq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:58:30.113754 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:30.113695 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b023797-5c02-41bf-a1dd-a01e3c265b91-kube-api-access-qbdk6 podName:3b023797-5c02-41bf-a1dd-a01e3c265b91 nodeName:}" failed. No retries permitted until 2026-06-10 11:58:46.113679872 +0000 UTC m=+34.319430710 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qbdk6" (UniqueName: "kubernetes.io/projected/3b023797-5c02-41bf-a1dd-a01e3c265b91-kube-api-access-qbdk6") pod "network-check-target-lfwlq" (UID: "3b023797-5c02-41bf-a1dd-a01e3c265b91") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:58:30.237681 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:30.237590 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfwlq" Jun 10 11:58:30.237834 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:30.237590 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v9bc6" Jun 10 11:58:30.237834 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:30.237720 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfwlq" podUID="3b023797-5c02-41bf-a1dd-a01e3c265b91" Jun 10 11:58:30.237834 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:30.237763 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v9bc6" podUID="735eadd6-c42b-4044-95b8-cd0b4762e0eb" Jun 10 11:58:30.237834 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:30.237595 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndwtw" Jun 10 11:58:30.238026 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:30.237918 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndwtw" podUID="b8180252-e6fc-4c10-aea5-e5577682a8cf" Jun 10 11:58:32.238205 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:32.238170 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndwtw" Jun 10 11:58:32.238641 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:32.238257 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfwlq" Jun 10 11:58:32.238641 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:32.238279 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndwtw" podUID="b8180252-e6fc-4c10-aea5-e5577682a8cf" Jun 10 11:58:32.238641 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:32.238372 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfwlq" podUID="3b023797-5c02-41bf-a1dd-a01e3c265b91" Jun 10 11:58:32.238641 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:32.238432 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v9bc6" Jun 10 11:58:32.238641 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:32.238509 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v9bc6" podUID="735eadd6-c42b-4044-95b8-cd0b4762e0eb" Jun 10 11:58:34.238255 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:34.237942 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfwlq" Jun 10 11:58:34.238788 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:34.237942 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndwtw" Jun 10 11:58:34.238788 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:34.238344 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfwlq" podUID="3b023797-5c02-41bf-a1dd-a01e3c265b91" Jun 10 11:58:34.238788 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:34.238028 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v9bc6" Jun 10 11:58:34.238788 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:34.238461 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndwtw" podUID="b8180252-e6fc-4c10-aea5-e5577682a8cf" Jun 10 11:58:34.238788 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:34.238558 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v9bc6" podUID="735eadd6-c42b-4044-95b8-cd0b4762e0eb" Jun 10 11:58:34.344502 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:34.344471 2562 generic.go:356] "Generic (PLEG): container finished" podID="28392d5e-41b1-4885-88df-071da3138132" containerID="f38ae051afa927faaf75a22b8e3e07b22e5df31ceb9652b0e74acaa6d73e0ae3" exitCode=0 Jun 10 11:58:34.344665 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:34.344557 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8nk9t" event={"ID":"28392d5e-41b1-4885-88df-071da3138132","Type":"ContainerDied","Data":"f38ae051afa927faaf75a22b8e3e07b22e5df31ceb9652b0e74acaa6d73e0ae3"} Jun 10 11:58:34.347939 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:34.347911 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" event={"ID":"0fd68196-fb5a-4984-9c69-36a423841431","Type":"ContainerStarted","Data":"c61e3b8cf6839ecc8def887e9ebd4a214045907f365cebce9434533d882a8d95"} Jun 10 11:58:34.348033 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:34.347991 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" event={"ID":"0fd68196-fb5a-4984-9c69-36a423841431","Type":"ContainerStarted","Data":"491adb911fc3f7cd23ef6288a1d308a258be9629c7c29b7ad47d9836d40aaa58"} Jun 10 11:58:34.348194 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:34.348057 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" event={"ID":"0fd68196-fb5a-4984-9c69-36a423841431","Type":"ContainerStarted","Data":"46cf69169ce3c60b6ea309a5f5450e914feba40d818a9cfc3cb6ed0bdacd7f77"} Jun 10 11:58:34.348194 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:34.348105 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" event={"ID":"0fd68196-fb5a-4984-9c69-36a423841431","Type":"ContainerStarted","Data":"17e1ee0f29f98ae0e096d676427aa8b4c28081be60dc41041ac78393693c81cd"} Jun 10 11:58:34.348194 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:34.348153 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" event={"ID":"0fd68196-fb5a-4984-9c69-36a423841431","Type":"ContainerStarted","Data":"43986d62419a24d0a0c8e7b3d9d9549cfe2632a559302ac6ec735da7f2604129"} Jun 10 11:58:34.348343 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:34.348201 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" event={"ID":"0fd68196-fb5a-4984-9c69-36a423841431","Type":"ContainerStarted","Data":"e98425625261f4434ecf1faa90134e0da39c6ae1343e2ba400a414eb68606d20"} Jun 10 11:58:34.349660 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:34.349606 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xjx89" event={"ID":"f11fac11-8429-4106-8c42-06e081bc5a56","Type":"ContainerStarted","Data":"e540a36e277b4d8ba64816582162367c08620a9a5abdf9333f07dbc03e9792ad"} Jun 10 11:58:34.351643 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:34.351622 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fnfcg" event={"ID":"0b9f91bb-de66-4959-b25d-c8c4f3f6bb79","Type":"ContainerStarted","Data":"85deaa08f09e908075fa6c6af314d82c23ed7da78680a52b100aa441037b853d"} Jun 10 11:58:34.353148 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:34.353127 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dvvkx" event={"ID":"99d59973-e3c2-41fc-9b89-66993ae20586","Type":"ContainerStarted","Data":"649c2ecdef7fd0118e0d9b8aadd5de43d3de006219e9f3a9061f6005b5f23ddd"} Jun 10 11:58:34.354434 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:34.354382 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp55n" event={"ID":"427ee27e-2e7e-450a-abcd-2861b93faf53","Type":"ContainerStarted","Data":"d7f3aa0fa9959769ca9fa72da2ef459842bfbc6cae6ae8295e4991d842e54abf"} Jun 10 11:58:34.355982 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:34.355959 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dhw7b" event={"ID":"e73f01dd-034a-4de7-a873-15dccbae3921","Type":"ContainerStarted","Data":"8f5bc9b7ad5f337204db0ea57346e40f9a04c3a838ddd74cc7cb6268098e8721"} Jun 10 11:58:34.357494 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:34.357473 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-28kqn" event={"ID":"0b313b3a-4549-429b-8bad-9e655da23e67","Type":"ContainerStarted","Data":"faa5ee028abec50dc5ecc867c12c2551472aeeb87aa3bcf72f771c42fc51d21e"} Jun 10 11:58:34.393947 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:34.393887 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-fnfcg" podStartSLOduration=3.752848354 podStartE2EDuration="22.393866125s" totalImagesPullingTime="18.641017771s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:58:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:58:34.39340226 +0000 UTC m=+22.599153104" watchObservedRunningTime="2026-06-10 11:58:34.393866125 +0000 UTC m=+22.599616971" Jun 10 11:58:34.463129 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:34.463078 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xjx89" podStartSLOduration=8.121058359 podStartE2EDuration="22.463062683s" totalImagesPullingTime="14.342004324s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:58:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:58:34.462707628 +0000 UTC m=+22.668458470" watchObservedRunningTime="2026-06-10 11:58:34.463062683 +0000 UTC m=+22.668813518" Jun 10 11:58:34.463345 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:34.463318 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-dvvkx" podStartSLOduration=3.781415902 podStartE2EDuration="22.46331221s" totalImagesPullingTime="18.681896308s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:58:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:58:34.42793089 +0000 UTC m=+22.633681734" watchObservedRunningTime="2026-06-10 11:58:34.46331221 +0000 UTC m=+22.669063054" Jun 10 11:58:34.525702 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:34.525648 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dhw7b" podStartSLOduration=3.890736274 podStartE2EDuration="22.525631389s" totalImagesPullingTime="18.634895115s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:58:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:58:34.525441089 +0000 UTC m=+22.731191932" watchObservedRunningTime="2026-06-10 11:58:34.525631389 +0000 UTC m=+22.731382232" Jun 10 11:58:34.525875 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:34.525857 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-28kqn" podStartSLOduration=3.888302952 podStartE2EDuration="22.525851828s" totalImagesPullingTime="18.637548876s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:58:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:58:34.502345315 +0000 UTC m=+22.708096180" watchObservedRunningTime="2026-06-10 11:58:34.525851828 +0000 UTC m=+22.731602671" Jun 10 11:58:35.361601 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:35.361568 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tnsxf" event={"ID":"bc041c77-ffb6-475e-a9cf-6697f9e4d28a","Type":"ContainerStarted","Data":"4669c502457960e4abb2628eb73defe93842613595bcb0dc71bfd59f339d7fd6"} Jun 10 11:58:35.402932 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:35.402877 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-tnsxf" podStartSLOduration=4.770543055 podStartE2EDuration="23.402856021s" totalImagesPullingTime="18.632312966s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:58:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:58:35.402026323 +0000 UTC m=+23.607777169" watchObservedRunningTime="2026-06-10 11:58:35.402856021 +0000 UTC m=+23.608606866" Jun 10 11:58:35.533687 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:35.533659 2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 10 11:58:36.237677 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:36.237434 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v9bc6" Jun 10 11:58:36.237878 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:36.237784 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndwtw" Jun 10 11:58:36.237878 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:36.237785 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v9bc6" podUID="735eadd6-c42b-4044-95b8-cd0b4762e0eb" Jun 10 11:58:36.237878 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:36.237875 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfwlq" Jun 10 11:58:36.238068 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:36.237965 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfwlq" podUID="3b023797-5c02-41bf-a1dd-a01e3c265b91" Jun 10 11:58:36.238135 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:36.238082 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndwtw" podUID="b8180252-e6fc-4c10-aea5-e5577682a8cf" Jun 10 11:58:36.250279 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:36.250177 2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-10T11:58:35.533681253Z","UUID":"d3e56196-41a3-4efb-829d-1fedbddec68d","Handler":null,"Name":"","Endpoint":""} Jun 10 11:58:36.251968 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:36.251944 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 10 11:58:36.252126 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:36.251990 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 10 11:58:36.368086 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:36.368030 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp55n" event={"ID":"427ee27e-2e7e-450a-abcd-2861b93faf53","Type":"ContainerStarted","Data":"e0f3598dc744e298a63d7c365a2e4c7e2f54a71413aaadb4aeb87c72988f06da"} Jun 10 11:58:37.373866 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:37.373827 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" event={"ID":"0fd68196-fb5a-4984-9c69-36a423841431","Type":"ContainerStarted","Data":"0a40f8c5dd1ebde9de33ae6443a83dc9689998e90adab4b49e08ccaffce994ea"} Jun 10 11:58:37.376178 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:37.376147 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp55n" event={"ID":"427ee27e-2e7e-450a-abcd-2861b93faf53","Type":"ContainerStarted","Data":"9251d6299564d3cb4c9d4ea51792f33838e28d11402c1432d33971d9696bf9d5"} Jun 10 11:58:37.396806 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:37.396749 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp55n" podStartSLOduration=4.143083648 podStartE2EDuration="25.396732189s" totalImagesPullingTime="21.253648541s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:58:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:58:37.396209616 +0000 UTC m=+25.601960460" watchObservedRunningTime="2026-06-10 11:58:37.396732189 +0000 UTC m=+25.602483034" Jun 10 11:58:38.237877 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:38.237796 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfwlq" Jun 10 11:58:38.238034 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:38.237811 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v9bc6" Jun 10 11:58:38.238034 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:38.237919 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfwlq" podUID="3b023797-5c02-41bf-a1dd-a01e3c265b91" Jun 10 11:58:38.238167 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:38.238034 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v9bc6" podUID="735eadd6-c42b-4044-95b8-cd0b4762e0eb" Jun 10 11:58:38.238167 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:38.238141 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndwtw" Jun 10 11:58:38.238294 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:38.238270 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndwtw" podUID="b8180252-e6fc-4c10-aea5-e5577682a8cf" Jun 10 11:58:39.215152 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:39.214957 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xjx89" Jun 10 11:58:39.215604 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:39.215530 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xjx89" Jun 10 11:58:39.383403 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:39.383369 2562 generic.go:356] "Generic (PLEG): container finished" podID="28392d5e-41b1-4885-88df-071da3138132" containerID="c5e7f166f3f75fcf7187e46ebfafe1f659a8463e58adf3e76eabc1b675334531" exitCode=0 Jun 10 11:58:39.383604 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:39.383423 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8nk9t" event={"ID":"28392d5e-41b1-4885-88df-071da3138132","Type":"ContainerDied","Data":"c5e7f166f3f75fcf7187e46ebfafe1f659a8463e58adf3e76eabc1b675334531"} Jun 10 11:58:39.387064 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:39.387026 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" event={"ID":"0fd68196-fb5a-4984-9c69-36a423841431","Type":"ContainerStarted","Data":"74fbbb15d51f32956d16c35ce864cc4da9c898bc28ef62823b0a731329f90395"} Jun 10 11:58:39.387344 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:39.387324 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xjx89" Jun 10 11:58:39.387454 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:39.387396 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:39.387454 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:39.387446 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:39.387695 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:39.387678 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xjx89" Jun 10 11:58:39.403520 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:39.403501 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:39.403621 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:39.403588 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:39.453493 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:39.453442 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" podStartSLOduration=8.740704487 podStartE2EDuration="27.453427176s" totalImagesPullingTime="18.712722689s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:58:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:58:39.453104345 +0000 UTC m=+27.658855188" watchObservedRunningTime="2026-06-10 11:58:39.453427176 +0000 UTC m=+27.659178019" Jun 10 11:58:40.237566 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:40.237538 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v9bc6" Jun 10 11:58:40.238091 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:40.237575 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfwlq" Jun 10 11:58:40.238091 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:40.237538 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndwtw" Jun 10 11:58:40.238091 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:40.237643 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v9bc6" podUID="735eadd6-c42b-4044-95b8-cd0b4762e0eb" Jun 10 11:58:40.238091 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:40.237724 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndwtw" podUID="b8180252-e6fc-4c10-aea5-e5577682a8cf" Jun 10 11:58:40.238091 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:40.237797 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfwlq" podUID="3b023797-5c02-41bf-a1dd-a01e3c265b91" Jun 10 11:58:40.388943 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:40.388912 2562 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 10 11:58:40.531260 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:40.531224 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:58:40.715892 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:40.715863 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lfwlq"] Jun 10 11:58:40.716075 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:40.715957 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfwlq" Jun 10 11:58:40.716075 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:40.716036 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfwlq" podUID="3b023797-5c02-41bf-a1dd-a01e3c265b91" Jun 10 11:58:40.729579 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:40.729550 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ndwtw"] Jun 10 11:58:40.729686 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:40.729661 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndwtw" Jun 10 11:58:40.729773 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:40.729750 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndwtw" podUID="b8180252-e6fc-4c10-aea5-e5577682a8cf" Jun 10 11:58:40.744794 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:40.744765 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-v9bc6"] Jun 10 11:58:40.744886 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:40.744839 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v9bc6" Jun 10 11:58:40.744923 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:40.744905 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v9bc6" podUID="735eadd6-c42b-4044-95b8-cd0b4762e0eb" Jun 10 11:58:41.393028 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:41.392989 2562 generic.go:356] "Generic (PLEG): container finished" podID="28392d5e-41b1-4885-88df-071da3138132" containerID="04cd21518aa600d57aba78fe41a087b769b836a0936edf4819928ff41719d666" exitCode=0 Jun 10 11:58:41.393768 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:41.393070 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8nk9t" event={"ID":"28392d5e-41b1-4885-88df-071da3138132","Type":"ContainerDied","Data":"04cd21518aa600d57aba78fe41a087b769b836a0936edf4819928ff41719d666"} Jun 10 11:58:42.238266 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:42.238096 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v9bc6" Jun 10 11:58:42.238435 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:42.238325 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v9bc6" podUID="735eadd6-c42b-4044-95b8-cd0b4762e0eb" Jun 10 11:58:42.238435 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:42.238192 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfwlq" Jun 10 11:58:42.238435 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:42.238393 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfwlq" podUID="3b023797-5c02-41bf-a1dd-a01e3c265b91" Jun 10 11:58:42.238435 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:42.238166 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndwtw" Jun 10 11:58:42.238579 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:42.238470 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndwtw" podUID="b8180252-e6fc-4c10-aea5-e5577682a8cf" Jun 10 11:58:43.399122 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:43.399084 2562 generic.go:356] "Generic (PLEG): container finished" podID="28392d5e-41b1-4885-88df-071da3138132" containerID="a40b06d455b745174d23bec9eeaa096f44defe07efb5dee507650db54ca20044" exitCode=0 Jun 10 11:58:43.399518 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:43.399135 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8nk9t" event={"ID":"28392d5e-41b1-4885-88df-071da3138132","Type":"ContainerDied","Data":"a40b06d455b745174d23bec9eeaa096f44defe07efb5dee507650db54ca20044"} Jun 10 11:58:44.238148 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:44.238117 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfwlq" Jun 10 11:58:44.238320 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:44.238117 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndwtw" Jun 10 11:58:44.238320 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:44.238227 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfwlq" podUID="3b023797-5c02-41bf-a1dd-a01e3c265b91" Jun 10 11:58:44.238320 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:44.238259 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v9bc6" Jun 10 11:58:44.238461 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:44.238341 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndwtw" podUID="b8180252-e6fc-4c10-aea5-e5577682a8cf" Jun 10 11:58:44.238461 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:44.238440 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v9bc6" podUID="735eadd6-c42b-4044-95b8-cd0b4762e0eb" Jun 10 11:58:45.929623 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:45.929580 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8180252-e6fc-4c10-aea5-e5577682a8cf-metrics-certs\") pod \"network-metrics-daemon-ndwtw\" (UID: \"b8180252-e6fc-4c10-aea5-e5577682a8cf\") " pod="openshift-multus/network-metrics-daemon-ndwtw" Jun 10 11:58:45.930152 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:45.929737 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:58:45.930152 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:45.929815 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8180252-e6fc-4c10-aea5-e5577682a8cf-metrics-certs podName:b8180252-e6fc-4c10-aea5-e5577682a8cf nodeName:}" failed. No retries permitted until 2026-06-10 11:59:17.929795367 +0000 UTC m=+66.135546215 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b8180252-e6fc-4c10-aea5-e5577682a8cf-metrics-certs") pod "network-metrics-daemon-ndwtw" (UID: "b8180252-e6fc-4c10-aea5-e5577682a8cf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:58:46.030581 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.030541 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/735eadd6-c42b-4044-95b8-cd0b4762e0eb-original-pull-secret\") pod \"global-pull-secret-syncer-v9bc6\" (UID: \"735eadd6-c42b-4044-95b8-cd0b4762e0eb\") " pod="kube-system/global-pull-secret-syncer-v9bc6" Jun 10 11:58:46.030746 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:46.030698 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 11:58:46.030801 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:46.030768 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/735eadd6-c42b-4044-95b8-cd0b4762e0eb-original-pull-secret podName:735eadd6-c42b-4044-95b8-cd0b4762e0eb nodeName:}" failed. No retries permitted until 2026-06-10 11:59:18.030749839 +0000 UTC m=+66.236500676 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/735eadd6-c42b-4044-95b8-cd0b4762e0eb-original-pull-secret") pod "global-pull-secret-syncer-v9bc6" (UID: "735eadd6-c42b-4044-95b8-cd0b4762e0eb") : object "kube-system"/"original-pull-secret" not registered Jun 10 11:58:46.131192 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.131145 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbdk6\" (UniqueName: \"kubernetes.io/projected/3b023797-5c02-41bf-a1dd-a01e3c265b91-kube-api-access-qbdk6\") pod \"network-check-target-lfwlq\" (UID: \"3b023797-5c02-41bf-a1dd-a01e3c265b91\") " pod="openshift-network-diagnostics/network-check-target-lfwlq" Jun 10 11:58:46.131378 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:46.131330 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 11:58:46.131378 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:46.131353 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 11:58:46.131378 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:46.131377 2562 projected.go:196] Error preparing data for projected volume kube-api-access-qbdk6 for pod openshift-network-diagnostics/network-check-target-lfwlq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:58:46.131529 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:46.131446 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b023797-5c02-41bf-a1dd-a01e3c265b91-kube-api-access-qbdk6 podName:3b023797-5c02-41bf-a1dd-a01e3c265b91 nodeName:}" failed. No retries permitted until 2026-06-10 11:59:18.131422517 +0000 UTC m=+66.337173359 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qbdk6" (UniqueName: "kubernetes.io/projected/3b023797-5c02-41bf-a1dd-a01e3c265b91-kube-api-access-qbdk6") pod "network-check-target-lfwlq" (UID: "3b023797-5c02-41bf-a1dd-a01e3c265b91") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:58:46.241355 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.241329 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndwtw" Jun 10 11:58:46.241355 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.241345 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v9bc6" Jun 10 11:58:46.241567 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:46.241452 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndwtw" podUID="b8180252-e6fc-4c10-aea5-e5577682a8cf" Jun 10 11:58:46.241567 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:46.241508 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v9bc6" podUID="735eadd6-c42b-4044-95b8-cd0b4762e0eb" Jun 10 11:58:46.241567 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.241545 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfwlq" Jun 10 11:58:46.241708 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:46.241611 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfwlq" podUID="3b023797-5c02-41bf-a1dd-a01e3c265b91" Jun 10 11:58:46.660088 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.660056 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-86.ec2.internal" event="NodeReady" Jun 10 11:58:46.660280 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.660211 2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 10 11:58:46.737284 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.737253 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5b76d48b49-6dtdw"] Jun 10 11:58:46.739820 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.739791 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b76d48b49-6dtdw" Jun 10 11:58:46.744399 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.744376 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 10 11:58:46.744727 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.744699 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 10 11:58:46.744831 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.744785 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gpn9z\"" Jun 10 11:58:46.745145 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.745113 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 10 11:58:46.752735 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.752711 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 10 11:58:46.770680 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.770648 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b76d48b49-6dtdw"] Jun 10 11:58:46.784499 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.784472 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4jjmm"] Jun 10 11:58:46.786399 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.786381 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jlk9m"] Jun 10 11:58:46.786522 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.786511 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4jjmm" Jun 10 11:58:46.788224 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.788206 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jlk9m" Jun 10 11:58:46.790018 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.789998 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 10 11:58:46.790166 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.790149 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 10 11:58:46.790341 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.790321 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d6l2n\"" Jun 10 11:58:46.791464 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.791437 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 10 11:58:46.791630 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.791608 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-w7drr\"" Jun 10 11:58:46.794594 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.791849 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 10 11:58:46.794594 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.792369 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 10 11:58:46.801276 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.801222 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4jjmm"] Jun 10 11:58:46.803592 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.803567 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jlk9m"] Jun 10 11:58:46.835952 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.835921 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a914f89a-e48e-44d6-8655-b019b5ab1f47-registry-tls\") pod \"image-registry-5b76d48b49-6dtdw\" (UID: \"a914f89a-e48e-44d6-8655-b019b5ab1f47\") " pod="openshift-image-registry/image-registry-5b76d48b49-6dtdw" Jun 10 11:58:46.836140 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.835978 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a914f89a-e48e-44d6-8655-b019b5ab1f47-trusted-ca\") pod \"image-registry-5b76d48b49-6dtdw\" (UID: \"a914f89a-e48e-44d6-8655-b019b5ab1f47\") " pod="openshift-image-registry/image-registry-5b76d48b49-6dtdw" Jun 10 11:58:46.836140 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.836014 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a914f89a-e48e-44d6-8655-b019b5ab1f47-installation-pull-secrets\") pod \"image-registry-5b76d48b49-6dtdw\" (UID: \"a914f89a-e48e-44d6-8655-b019b5ab1f47\") " pod="openshift-image-registry/image-registry-5b76d48b49-6dtdw" Jun 10 11:58:46.836140 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.836063 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a914f89a-e48e-44d6-8655-b019b5ab1f47-registry-certificates\") pod \"image-registry-5b76d48b49-6dtdw\" (UID: \"a914f89a-e48e-44d6-8655-b019b5ab1f47\") " pod="openshift-image-registry/image-registry-5b76d48b49-6dtdw" Jun 10 11:58:46.836140 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.836090 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a914f89a-e48e-44d6-8655-b019b5ab1f47-ca-trust-extracted\") pod \"image-registry-5b76d48b49-6dtdw\" (UID: \"a914f89a-e48e-44d6-8655-b019b5ab1f47\") " pod="openshift-image-registry/image-registry-5b76d48b49-6dtdw" Jun 10 11:58:46.836140 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.836117 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a914f89a-e48e-44d6-8655-b019b5ab1f47-image-registry-private-configuration\") pod \"image-registry-5b76d48b49-6dtdw\" (UID: \"a914f89a-e48e-44d6-8655-b019b5ab1f47\") " pod="openshift-image-registry/image-registry-5b76d48b49-6dtdw" Jun 10 11:58:46.836140 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.836139 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a914f89a-e48e-44d6-8655-b019b5ab1f47-bound-sa-token\") pod \"image-registry-5b76d48b49-6dtdw\" (UID: \"a914f89a-e48e-44d6-8655-b019b5ab1f47\") " pod="openshift-image-registry/image-registry-5b76d48b49-6dtdw" Jun 10 11:58:46.836372 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.836162 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwdxv\" (UniqueName: \"kubernetes.io/projected/a914f89a-e48e-44d6-8655-b019b5ab1f47-kube-api-access-hwdxv\") pod \"image-registry-5b76d48b49-6dtdw\" (UID: \"a914f89a-e48e-44d6-8655-b019b5ab1f47\") " pod="openshift-image-registry/image-registry-5b76d48b49-6dtdw" Jun 10 11:58:46.937299 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.937216 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a914f89a-e48e-44d6-8655-b019b5ab1f47-registry-tls\") pod \"image-registry-5b76d48b49-6dtdw\" (UID: \"a914f89a-e48e-44d6-8655-b019b5ab1f47\") " pod="openshift-image-registry/image-registry-5b76d48b49-6dtdw" Jun 10 11:58:46.937735 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.937337 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/80531a6e-51be-47ad-ac4a-e7f636b8e77b-config-volume\") pod \"dns-default-4jjmm\" (UID: \"80531a6e-51be-47ad-ac4a-e7f636b8e77b\") " pod="openshift-dns/dns-default-4jjmm" Jun 10 11:58:46.937735 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:46.937357 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 11:58:46.937735 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:46.937379 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b76d48b49-6dtdw: secret "image-registry-tls" not found Jun 10 11:58:46.937735 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.937380 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/80531a6e-51be-47ad-ac4a-e7f636b8e77b-metrics-tls\") pod \"dns-default-4jjmm\" (UID: \"80531a6e-51be-47ad-ac4a-e7f636b8e77b\") " pod="openshift-dns/dns-default-4jjmm" Jun 10 11:58:46.937735 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.937406 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80531a6e-51be-47ad-ac4a-e7f636b8e77b-tmp-dir\") pod \"dns-default-4jjmm\" (UID: \"80531a6e-51be-47ad-ac4a-e7f636b8e77b\") " pod="openshift-dns/dns-default-4jjmm" Jun 10 11:58:46.937735 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.937429 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bab0f8f5-7a24-4e8e-a4fe-a1eb8faed110-cert\") pod \"ingress-canary-jlk9m\" (UID: \"bab0f8f5-7a24-4e8e-a4fe-a1eb8faed110\") " pod="openshift-ingress-canary/ingress-canary-jlk9m" Jun 10 11:58:46.937735 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:46.937450 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a914f89a-e48e-44d6-8655-b019b5ab1f47-registry-tls podName:a914f89a-e48e-44d6-8655-b019b5ab1f47 nodeName:}" failed. No retries permitted until 2026-06-10 11:58:47.437425429 +0000 UTC m=+35.643176265 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a914f89a-e48e-44d6-8655-b019b5ab1f47-registry-tls") pod "image-registry-5b76d48b49-6dtdw" (UID: "a914f89a-e48e-44d6-8655-b019b5ab1f47") : secret "image-registry-tls" not found Jun 10 11:58:46.937735 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.937529 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a914f89a-e48e-44d6-8655-b019b5ab1f47-trusted-ca\") pod \"image-registry-5b76d48b49-6dtdw\" (UID: \"a914f89a-e48e-44d6-8655-b019b5ab1f47\") " pod="openshift-image-registry/image-registry-5b76d48b49-6dtdw" Jun 10 11:58:46.937735 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.937564 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a914f89a-e48e-44d6-8655-b019b5ab1f47-installation-pull-secrets\") pod \"image-registry-5b76d48b49-6dtdw\" (UID: \"a914f89a-e48e-44d6-8655-b019b5ab1f47\") " pod="openshift-image-registry/image-registry-5b76d48b49-6dtdw" Jun 10 11:58:46.937735 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.937587 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a914f89a-e48e-44d6-8655-b019b5ab1f47-registry-certificates\") pod \"image-registry-5b76d48b49-6dtdw\" (UID: \"a914f89a-e48e-44d6-8655-b019b5ab1f47\") " pod="openshift-image-registry/image-registry-5b76d48b49-6dtdw" Jun 10 11:58:46.937735 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.937606 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skwvx\" (UniqueName: \"kubernetes.io/projected/80531a6e-51be-47ad-ac4a-e7f636b8e77b-kube-api-access-skwvx\") pod \"dns-default-4jjmm\" (UID: \"80531a6e-51be-47ad-ac4a-e7f636b8e77b\") " pod="openshift-dns/dns-default-4jjmm" Jun 10 11:58:46.937735 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.937624 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a914f89a-e48e-44d6-8655-b019b5ab1f47-ca-trust-extracted\") pod \"image-registry-5b76d48b49-6dtdw\" (UID: \"a914f89a-e48e-44d6-8655-b019b5ab1f47\") " pod="openshift-image-registry/image-registry-5b76d48b49-6dtdw" Jun 10 11:58:46.937735 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.937646 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8vz5\" (UniqueName: \"kubernetes.io/projected/bab0f8f5-7a24-4e8e-a4fe-a1eb8faed110-kube-api-access-t8vz5\") pod \"ingress-canary-jlk9m\" (UID: \"bab0f8f5-7a24-4e8e-a4fe-a1eb8faed110\") " pod="openshift-ingress-canary/ingress-canary-jlk9m" Jun 10 11:58:46.937735 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.937672 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a914f89a-e48e-44d6-8655-b019b5ab1f47-image-registry-private-configuration\") pod \"image-registry-5b76d48b49-6dtdw\" (UID: \"a914f89a-e48e-44d6-8655-b019b5ab1f47\") " pod="openshift-image-registry/image-registry-5b76d48b49-6dtdw" Jun 10 11:58:46.937735 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.937697 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a914f89a-e48e-44d6-8655-b019b5ab1f47-bound-sa-token\") pod \"image-registry-5b76d48b49-6dtdw\" (UID: \"a914f89a-e48e-44d6-8655-b019b5ab1f47\") " pod="openshift-image-registry/image-registry-5b76d48b49-6dtdw" Jun 10 11:58:46.937735 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.937719 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwdxv\" (UniqueName: \"kubernetes.io/projected/a914f89a-e48e-44d6-8655-b019b5ab1f47-kube-api-access-hwdxv\") pod \"image-registry-5b76d48b49-6dtdw\" (UID: \"a914f89a-e48e-44d6-8655-b019b5ab1f47\") " pod="openshift-image-registry/image-registry-5b76d48b49-6dtdw" Jun 10 11:58:46.938586 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.938331 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a914f89a-e48e-44d6-8655-b019b5ab1f47-registry-certificates\") pod \"image-registry-5b76d48b49-6dtdw\" (UID: \"a914f89a-e48e-44d6-8655-b019b5ab1f47\") " pod="openshift-image-registry/image-registry-5b76d48b49-6dtdw" Jun 10 11:58:46.938586 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.938397 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a914f89a-e48e-44d6-8655-b019b5ab1f47-ca-trust-extracted\") pod \"image-registry-5b76d48b49-6dtdw\" (UID: \"a914f89a-e48e-44d6-8655-b019b5ab1f47\") " pod="openshift-image-registry/image-registry-5b76d48b49-6dtdw" Jun 10 11:58:46.938586 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.938504 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a914f89a-e48e-44d6-8655-b019b5ab1f47-trusted-ca\") pod \"image-registry-5b76d48b49-6dtdw\" (UID: \"a914f89a-e48e-44d6-8655-b019b5ab1f47\") " pod="openshift-image-registry/image-registry-5b76d48b49-6dtdw" Jun 10 11:58:46.942870 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.942845 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a914f89a-e48e-44d6-8655-b019b5ab1f47-installation-pull-secrets\") pod \"image-registry-5b76d48b49-6dtdw\" (UID: \"a914f89a-e48e-44d6-8655-b019b5ab1f47\") " pod="openshift-image-registry/image-registry-5b76d48b49-6dtdw" Jun 10 11:58:46.943001 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.942868 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a914f89a-e48e-44d6-8655-b019b5ab1f47-image-registry-private-configuration\") pod \"image-registry-5b76d48b49-6dtdw\" (UID: \"a914f89a-e48e-44d6-8655-b019b5ab1f47\") " pod="openshift-image-registry/image-registry-5b76d48b49-6dtdw" Jun 10 11:58:46.950093 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.950068 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a914f89a-e48e-44d6-8655-b019b5ab1f47-bound-sa-token\") pod \"image-registry-5b76d48b49-6dtdw\" (UID: \"a914f89a-e48e-44d6-8655-b019b5ab1f47\") " pod="openshift-image-registry/image-registry-5b76d48b49-6dtdw" Jun 10 11:58:46.950426 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:46.950378 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwdxv\" (UniqueName: \"kubernetes.io/projected/a914f89a-e48e-44d6-8655-b019b5ab1f47-kube-api-access-hwdxv\") pod \"image-registry-5b76d48b49-6dtdw\" (UID: \"a914f89a-e48e-44d6-8655-b019b5ab1f47\") " pod="openshift-image-registry/image-registry-5b76d48b49-6dtdw" Jun 10 11:58:47.038422 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:47.038379 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8vz5\" (UniqueName: \"kubernetes.io/projected/bab0f8f5-7a24-4e8e-a4fe-a1eb8faed110-kube-api-access-t8vz5\") pod \"ingress-canary-jlk9m\" (UID: \"bab0f8f5-7a24-4e8e-a4fe-a1eb8faed110\") " pod="openshift-ingress-canary/ingress-canary-jlk9m" Jun 10 11:58:47.038591 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:47.038490 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/80531a6e-51be-47ad-ac4a-e7f636b8e77b-config-volume\") pod \"dns-default-4jjmm\" (UID: \"80531a6e-51be-47ad-ac4a-e7f636b8e77b\") " pod="openshift-dns/dns-default-4jjmm" Jun 10 11:58:47.038591 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:47.038527 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/80531a6e-51be-47ad-ac4a-e7f636b8e77b-metrics-tls\") pod \"dns-default-4jjmm\" (UID: \"80531a6e-51be-47ad-ac4a-e7f636b8e77b\") " pod="openshift-dns/dns-default-4jjmm" Jun 10 11:58:47.038591 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:47.038549 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80531a6e-51be-47ad-ac4a-e7f636b8e77b-tmp-dir\") pod \"dns-default-4jjmm\" (UID: \"80531a6e-51be-47ad-ac4a-e7f636b8e77b\") " pod="openshift-dns/dns-default-4jjmm" Jun 10 11:58:47.038591 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:47.038568 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bab0f8f5-7a24-4e8e-a4fe-a1eb8faed110-cert\") pod \"ingress-canary-jlk9m\" (UID: \"bab0f8f5-7a24-4e8e-a4fe-a1eb8faed110\") " pod="openshift-ingress-canary/ingress-canary-jlk9m" Jun 10 11:58:47.038765 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:47.038611 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skwvx\" (UniqueName: \"kubernetes.io/projected/80531a6e-51be-47ad-ac4a-e7f636b8e77b-kube-api-access-skwvx\") pod \"dns-default-4jjmm\" (UID: \"80531a6e-51be-47ad-ac4a-e7f636b8e77b\") " pod="openshift-dns/dns-default-4jjmm" Jun 10 11:58:47.038799 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:47.038788 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 11:58:47.038863 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:47.038849 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80531a6e-51be-47ad-ac4a-e7f636b8e77b-metrics-tls podName:80531a6e-51be-47ad-ac4a-e7f636b8e77b nodeName:}" failed. No retries permitted until 2026-06-10 11:58:47.538829209 +0000 UTC m=+35.744580037 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/80531a6e-51be-47ad-ac4a-e7f636b8e77b-metrics-tls") pod "dns-default-4jjmm" (UID: "80531a6e-51be-47ad-ac4a-e7f636b8e77b") : secret "dns-default-metrics-tls" not found Jun 10 11:58:47.039147 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:47.039125 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80531a6e-51be-47ad-ac4a-e7f636b8e77b-tmp-dir\") pod \"dns-default-4jjmm\" (UID: \"80531a6e-51be-47ad-ac4a-e7f636b8e77b\") " pod="openshift-dns/dns-default-4jjmm" Jun 10 11:58:47.039447 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:47.039422 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/80531a6e-51be-47ad-ac4a-e7f636b8e77b-config-volume\") pod \"dns-default-4jjmm\" (UID: \"80531a6e-51be-47ad-ac4a-e7f636b8e77b\") " pod="openshift-dns/dns-default-4jjmm" Jun 10 11:58:47.041658 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:47.041631 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bab0f8f5-7a24-4e8e-a4fe-a1eb8faed110-cert\") pod \"ingress-canary-jlk9m\" (UID: \"bab0f8f5-7a24-4e8e-a4fe-a1eb8faed110\") " pod="openshift-ingress-canary/ingress-canary-jlk9m" Jun 10 11:58:47.048568 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:47.048544 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skwvx\" (UniqueName: \"kubernetes.io/projected/80531a6e-51be-47ad-ac4a-e7f636b8e77b-kube-api-access-skwvx\") pod \"dns-default-4jjmm\" (UID: \"80531a6e-51be-47ad-ac4a-e7f636b8e77b\") " pod="openshift-dns/dns-default-4jjmm" Jun 10 11:58:47.048839 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:47.048819 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8vz5\" (UniqueName: \"kubernetes.io/projected/bab0f8f5-7a24-4e8e-a4fe-a1eb8faed110-kube-api-access-t8vz5\") pod \"ingress-canary-jlk9m\" (UID: \"bab0f8f5-7a24-4e8e-a4fe-a1eb8faed110\") " pod="openshift-ingress-canary/ingress-canary-jlk9m" Jun 10 11:58:47.107153 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:47.107112 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jlk9m" Jun 10 11:58:47.426570 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:47.426545 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jlk9m"] Jun 10 11:58:47.432249 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:47.432210 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbab0f8f5_7a24_4e8e_a4fe_a1eb8faed110.slice/crio-5b40c2b3e8bdafc0540e5601773598f508888dda03abb6b189fb1e828dcf42e0 WatchSource:0}: Error finding container 5b40c2b3e8bdafc0540e5601773598f508888dda03abb6b189fb1e828dcf42e0: Status 404 returned error can't find the container with id 5b40c2b3e8bdafc0540e5601773598f508888dda03abb6b189fb1e828dcf42e0 Jun 10 11:58:47.441806 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:47.441785 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a914f89a-e48e-44d6-8655-b019b5ab1f47-registry-tls\") pod \"image-registry-5b76d48b49-6dtdw\" (UID: \"a914f89a-e48e-44d6-8655-b019b5ab1f47\") " pod="openshift-image-registry/image-registry-5b76d48b49-6dtdw" Jun 10 11:58:47.441912 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:47.441899 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 11:58:47.441955 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:47.441914 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b76d48b49-6dtdw: secret "image-registry-tls" not found Jun 10 11:58:47.441989 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:47.441958 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a914f89a-e48e-44d6-8655-b019b5ab1f47-registry-tls podName:a914f89a-e48e-44d6-8655-b019b5ab1f47 nodeName:}" failed. No retries permitted until 2026-06-10 11:58:48.441944119 +0000 UTC m=+36.647694953 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a914f89a-e48e-44d6-8655-b019b5ab1f47-registry-tls") pod "image-registry-5b76d48b49-6dtdw" (UID: "a914f89a-e48e-44d6-8655-b019b5ab1f47") : secret "image-registry-tls" not found Jun 10 11:58:47.542285 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:47.542221 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/80531a6e-51be-47ad-ac4a-e7f636b8e77b-metrics-tls\") pod \"dns-default-4jjmm\" (UID: \"80531a6e-51be-47ad-ac4a-e7f636b8e77b\") " pod="openshift-dns/dns-default-4jjmm" Jun 10 11:58:47.542408 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:47.542391 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 11:58:47.542482 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:47.542472 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80531a6e-51be-47ad-ac4a-e7f636b8e77b-metrics-tls podName:80531a6e-51be-47ad-ac4a-e7f636b8e77b nodeName:}" failed. No retries permitted until 2026-06-10 11:58:48.542446949 +0000 UTC m=+36.748197790 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/80531a6e-51be-47ad-ac4a-e7f636b8e77b-metrics-tls") pod "dns-default-4jjmm" (UID: "80531a6e-51be-47ad-ac4a-e7f636b8e77b") : secret "dns-default-metrics-tls" not found Jun 10 11:58:48.241498 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:48.241472 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndwtw" Jun 10 11:58:48.242278 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:48.241682 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v9bc6" Jun 10 11:58:48.242278 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:48.241696 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfwlq" Jun 10 11:58:48.244793 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:48.244771 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 11:58:48.245604 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:48.245584 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 11:58:48.245707 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:48.245600 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j6n9s\"" Jun 10 11:58:48.245707 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:48.245695 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 11:58:48.245836 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:48.245724 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zk9qr\"" Jun 10 11:58:48.245836 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:48.245776 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 11:58:48.414323 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:48.414287 2562 generic.go:356] "Generic (PLEG): container finished" podID="28392d5e-41b1-4885-88df-071da3138132" containerID="bc8ad6aa328dd691e92b4d42386c6d28e0ed0fb83359d2e62f40e7be0832f6b0" exitCode=0 Jun 10 11:58:48.414501 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:48.414382 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8nk9t" event={"ID":"28392d5e-41b1-4885-88df-071da3138132","Type":"ContainerDied","Data":"bc8ad6aa328dd691e92b4d42386c6d28e0ed0fb83359d2e62f40e7be0832f6b0"} Jun 10 11:58:48.416170 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:48.416146 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jlk9m" event={"ID":"bab0f8f5-7a24-4e8e-a4fe-a1eb8faed110","Type":"ContainerStarted","Data":"5b40c2b3e8bdafc0540e5601773598f508888dda03abb6b189fb1e828dcf42e0"} Jun 10 11:58:48.450279 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:48.450246 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a914f89a-e48e-44d6-8655-b019b5ab1f47-registry-tls\") pod \"image-registry-5b76d48b49-6dtdw\" (UID: \"a914f89a-e48e-44d6-8655-b019b5ab1f47\") " pod="openshift-image-registry/image-registry-5b76d48b49-6dtdw" Jun 10 11:58:48.450435 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:48.450400 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 11:58:48.450435 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:48.450421 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b76d48b49-6dtdw: secret "image-registry-tls" not found Jun 10 11:58:48.450551 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:48.450487 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a914f89a-e48e-44d6-8655-b019b5ab1f47-registry-tls podName:a914f89a-e48e-44d6-8655-b019b5ab1f47 nodeName:}" failed. No retries permitted until 2026-06-10 11:58:50.450466542 +0000 UTC m=+38.656217370 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a914f89a-e48e-44d6-8655-b019b5ab1f47-registry-tls") pod "image-registry-5b76d48b49-6dtdw" (UID: "a914f89a-e48e-44d6-8655-b019b5ab1f47") : secret "image-registry-tls" not found Jun 10 11:58:48.550709 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:48.550682 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/80531a6e-51be-47ad-ac4a-e7f636b8e77b-metrics-tls\") pod \"dns-default-4jjmm\" (UID: \"80531a6e-51be-47ad-ac4a-e7f636b8e77b\") " pod="openshift-dns/dns-default-4jjmm" Jun 10 11:58:48.550862 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:48.550841 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 11:58:48.550930 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:48.550917 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80531a6e-51be-47ad-ac4a-e7f636b8e77b-metrics-tls podName:80531a6e-51be-47ad-ac4a-e7f636b8e77b nodeName:}" failed. No retries permitted until 2026-06-10 11:58:50.550898115 +0000 UTC m=+38.756648952 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/80531a6e-51be-47ad-ac4a-e7f636b8e77b-metrics-tls") pod "dns-default-4jjmm" (UID: "80531a6e-51be-47ad-ac4a-e7f636b8e77b") : secret "dns-default-metrics-tls" not found Jun 10 11:58:49.219724 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:49.219647 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-465ht"] Jun 10 11:58:49.223302 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:49.223285 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-465ht" Jun 10 11:58:49.226025 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:49.226000 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 10 11:58:49.226193 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:49.226123 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-cz8lq\"" Jun 10 11:58:49.226262 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:49.226241 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 10 11:58:49.234193 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:49.234164 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-465ht"] Jun 10 11:58:49.356459 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:49.356421 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/54ab14ef-0e83-468a-8795-3aa3df8bd004-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-465ht\" (UID: \"54ab14ef-0e83-468a-8795-3aa3df8bd004\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-465ht" Jun 10 11:58:49.356459 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:49.356459 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/54ab14ef-0e83-468a-8795-3aa3df8bd004-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-465ht\" (UID: \"54ab14ef-0e83-468a-8795-3aa3df8bd004\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-465ht" Jun 10 11:58:49.419395 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:49.419363 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jlk9m" event={"ID":"bab0f8f5-7a24-4e8e-a4fe-a1eb8faed110","Type":"ContainerStarted","Data":"cfb1b6401cec6baf16bec9dfb35f1ff6f0020d9f3480639719684a8163fe668c"} Jun 10 11:58:49.422294 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:49.422266 2562 generic.go:356] "Generic (PLEG): container finished" podID="28392d5e-41b1-4885-88df-071da3138132" containerID="f58612d3f8194aa28c067630a1d623578fd0f8bc427d4685b755f8ed9a301910" exitCode=0 Jun 10 11:58:49.422400 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:49.422322 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8nk9t" event={"ID":"28392d5e-41b1-4885-88df-071da3138132","Type":"ContainerDied","Data":"f58612d3f8194aa28c067630a1d623578fd0f8bc427d4685b755f8ed9a301910"} Jun 10 11:58:49.440743 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:49.440701 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jlk9m" podStartSLOduration=1.847782691 podStartE2EDuration="3.44068756s" totalImagesPullingTime="1.592904869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:58:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:58:49.440345739 +0000 UTC m=+37.646096584" watchObservedRunningTime="2026-06-10 11:58:49.44068756 +0000 UTC m=+37.646438403" Jun 10 11:58:49.457304 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:49.457090 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/54ab14ef-0e83-468a-8795-3aa3df8bd004-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-465ht\" (UID: \"54ab14ef-0e83-468a-8795-3aa3df8bd004\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-465ht" Jun 10 11:58:49.457419 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:49.457324 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/54ab14ef-0e83-468a-8795-3aa3df8bd004-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-465ht\" (UID: \"54ab14ef-0e83-468a-8795-3aa3df8bd004\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-465ht" Jun 10 11:58:49.457483 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:49.457450 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 11:58:49.457586 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:49.457513 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54ab14ef-0e83-468a-8795-3aa3df8bd004-networking-console-plugin-cert podName:54ab14ef-0e83-468a-8795-3aa3df8bd004 nodeName:}" failed. No retries permitted until 2026-06-10 11:58:49.957494728 +0000 UTC m=+38.163245556 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/54ab14ef-0e83-468a-8795-3aa3df8bd004-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-465ht" (UID: "54ab14ef-0e83-468a-8795-3aa3df8bd004") : secret "networking-console-plugin-cert" not found Jun 10 11:58:49.464561 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:49.464529 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/54ab14ef-0e83-468a-8795-3aa3df8bd004-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-465ht\" (UID: \"54ab14ef-0e83-468a-8795-3aa3df8bd004\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-465ht" Jun 10 11:58:49.960792 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:49.960760 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/54ab14ef-0e83-468a-8795-3aa3df8bd004-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-465ht\" (UID: \"54ab14ef-0e83-468a-8795-3aa3df8bd004\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-465ht" Jun 10 11:58:49.960954 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:49.960873 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 11:58:49.960954 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:49.960926 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54ab14ef-0e83-468a-8795-3aa3df8bd004-networking-console-plugin-cert podName:54ab14ef-0e83-468a-8795-3aa3df8bd004 nodeName:}" failed. No retries permitted until 2026-06-10 11:58:50.960912445 +0000 UTC m=+39.166663268 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/54ab14ef-0e83-468a-8795-3aa3df8bd004-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-465ht" (UID: "54ab14ef-0e83-468a-8795-3aa3df8bd004") : secret "networking-console-plugin-cert" not found Jun 10 11:58:50.428149 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:50.428114 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8nk9t" event={"ID":"28392d5e-41b1-4885-88df-071da3138132","Type":"ContainerStarted","Data":"d5a3dc7fb9f89b7188cc497199e8db121c97711c522e1c0b48ae4c099d6d974a"} Jun 10 11:58:50.455427 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:50.455378 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8nk9t" podStartSLOduration=9.741414012 podStartE2EDuration="38.455363007s" totalImagesPullingTime="28.713948995s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:58:12 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:58:50.454441477 +0000 UTC m=+38.660192321" watchObservedRunningTime="2026-06-10 11:58:50.455363007 +0000 UTC m=+38.661113851" Jun 10 11:58:50.464160 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:50.464125 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a914f89a-e48e-44d6-8655-b019b5ab1f47-registry-tls\") pod \"image-registry-5b76d48b49-6dtdw\" (UID: \"a914f89a-e48e-44d6-8655-b019b5ab1f47\") " pod="openshift-image-registry/image-registry-5b76d48b49-6dtdw" Jun 10 11:58:50.464285 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:50.464241 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 11:58:50.464285 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:50.464253 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b76d48b49-6dtdw: secret "image-registry-tls" not found Jun 10 11:58:50.464384 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:50.464296 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a914f89a-e48e-44d6-8655-b019b5ab1f47-registry-tls podName:a914f89a-e48e-44d6-8655-b019b5ab1f47 nodeName:}" failed. No retries permitted until 2026-06-10 11:58:54.464285008 +0000 UTC m=+42.670035830 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a914f89a-e48e-44d6-8655-b019b5ab1f47-registry-tls") pod "image-registry-5b76d48b49-6dtdw" (UID: "a914f89a-e48e-44d6-8655-b019b5ab1f47") : secret "image-registry-tls" not found Jun 10 11:58:50.564627 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:50.564531 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/80531a6e-51be-47ad-ac4a-e7f636b8e77b-metrics-tls\") pod \"dns-default-4jjmm\" (UID: \"80531a6e-51be-47ad-ac4a-e7f636b8e77b\") " pod="openshift-dns/dns-default-4jjmm" Jun 10 11:58:50.564916 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:50.564893 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 11:58:50.564994 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:50.564954 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80531a6e-51be-47ad-ac4a-e7f636b8e77b-metrics-tls podName:80531a6e-51be-47ad-ac4a-e7f636b8e77b nodeName:}" failed. No retries permitted until 2026-06-10 11:58:54.564939768 +0000 UTC m=+42.770690590 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/80531a6e-51be-47ad-ac4a-e7f636b8e77b-metrics-tls") pod "dns-default-4jjmm" (UID: "80531a6e-51be-47ad-ac4a-e7f636b8e77b") : secret "dns-default-metrics-tls" not found Jun 10 11:58:50.967527 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:50.967501 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/54ab14ef-0e83-468a-8795-3aa3df8bd004-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-465ht\" (UID: \"54ab14ef-0e83-468a-8795-3aa3df8bd004\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-465ht" Jun 10 11:58:50.967687 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:50.967605 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 11:58:50.967687 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:50.967662 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54ab14ef-0e83-468a-8795-3aa3df8bd004-networking-console-plugin-cert podName:54ab14ef-0e83-468a-8795-3aa3df8bd004 nodeName:}" failed. No retries permitted until 2026-06-10 11:58:52.967648224 +0000 UTC m=+41.173399047 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/54ab14ef-0e83-468a-8795-3aa3df8bd004-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-465ht" (UID: "54ab14ef-0e83-468a-8795-3aa3df8bd004") : secret "networking-console-plugin-cert" not found Jun 10 11:58:52.985316 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:52.985281 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/54ab14ef-0e83-468a-8795-3aa3df8bd004-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-465ht\" (UID: \"54ab14ef-0e83-468a-8795-3aa3df8bd004\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-465ht" Jun 10 11:58:52.985761 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:52.985469 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 11:58:52.985761 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:52.985555 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54ab14ef-0e83-468a-8795-3aa3df8bd004-networking-console-plugin-cert podName:54ab14ef-0e83-468a-8795-3aa3df8bd004 nodeName:}" failed. No retries permitted until 2026-06-10 11:58:56.985533587 +0000 UTC m=+45.191284413 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/54ab14ef-0e83-468a-8795-3aa3df8bd004-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-465ht" (UID: "54ab14ef-0e83-468a-8795-3aa3df8bd004") : secret "networking-console-plugin-cert" not found Jun 10 11:58:54.498426 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:54.498387 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a914f89a-e48e-44d6-8655-b019b5ab1f47-registry-tls\") pod \"image-registry-5b76d48b49-6dtdw\" (UID: \"a914f89a-e48e-44d6-8655-b019b5ab1f47\") " pod="openshift-image-registry/image-registry-5b76d48b49-6dtdw" Jun 10 11:58:54.498884 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:54.498568 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 11:58:54.498884 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:54.498591 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b76d48b49-6dtdw: secret "image-registry-tls" not found Jun 10 11:58:54.498884 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:54.498664 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a914f89a-e48e-44d6-8655-b019b5ab1f47-registry-tls podName:a914f89a-e48e-44d6-8655-b019b5ab1f47 nodeName:}" failed. No retries permitted until 2026-06-10 11:59:02.498642296 +0000 UTC m=+50.704393137 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a914f89a-e48e-44d6-8655-b019b5ab1f47-registry-tls") pod "image-registry-5b76d48b49-6dtdw" (UID: "a914f89a-e48e-44d6-8655-b019b5ab1f47") : secret "image-registry-tls" not found Jun 10 11:58:54.599139 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:54.599107 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/80531a6e-51be-47ad-ac4a-e7f636b8e77b-metrics-tls\") pod \"dns-default-4jjmm\" (UID: \"80531a6e-51be-47ad-ac4a-e7f636b8e77b\") " pod="openshift-dns/dns-default-4jjmm" Jun 10 11:58:54.599297 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:54.599274 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 11:58:54.599381 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:54.599356 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80531a6e-51be-47ad-ac4a-e7f636b8e77b-metrics-tls podName:80531a6e-51be-47ad-ac4a-e7f636b8e77b nodeName:}" failed. No retries permitted until 2026-06-10 11:59:02.599334808 +0000 UTC m=+50.805085630 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/80531a6e-51be-47ad-ac4a-e7f636b8e77b-metrics-tls") pod "dns-default-4jjmm" (UID: "80531a6e-51be-47ad-ac4a-e7f636b8e77b") : secret "dns-default-metrics-tls" not found Jun 10 11:58:55.542478 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:55.542442 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-q5mnd"] Jun 10 11:58:55.569209 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:55.569181 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-q5mnd"] Jun 10 11:58:55.569352 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:55.569276 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-q5mnd" Jun 10 11:58:55.571996 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:55.571973 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 10 11:58:55.572096 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:55.571973 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 10 11:58:55.573101 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:55.573083 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-tdj6h\"" Jun 10 11:58:55.708371 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:55.708333 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrvzx\" (UniqueName: \"kubernetes.io/projected/55db9178-02ce-4f84-a852-e83d475bc16c-kube-api-access-vrvzx\") pod \"migrator-955ffdf5f-q5mnd\" (UID: \"55db9178-02ce-4f84-a852-e83d475bc16c\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-q5mnd" Jun 10 11:58:55.809277 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:55.809203 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrvzx\" (UniqueName: \"kubernetes.io/projected/55db9178-02ce-4f84-a852-e83d475bc16c-kube-api-access-vrvzx\") pod \"migrator-955ffdf5f-q5mnd\" (UID: \"55db9178-02ce-4f84-a852-e83d475bc16c\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-q5mnd" Jun 10 11:58:55.821099 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:55.821068 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrvzx\" (UniqueName: \"kubernetes.io/projected/55db9178-02ce-4f84-a852-e83d475bc16c-kube-api-access-vrvzx\") pod \"migrator-955ffdf5f-q5mnd\" (UID: \"55db9178-02ce-4f84-a852-e83d475bc16c\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-q5mnd" Jun 10 11:58:55.878057 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:55.878015 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-q5mnd" Jun 10 11:58:56.037015 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:56.036986 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-q5mnd"] Jun 10 11:58:56.040283 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:56.040243 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55db9178_02ce_4f84_a852_e83d475bc16c.slice/crio-95b2af5957f1d611bc235ab1de145532dfbf42225a81efd2a8ba869275963d2a WatchSource:0}: Error finding container 95b2af5957f1d611bc235ab1de145532dfbf42225a81efd2a8ba869275963d2a: Status 404 returned error can't find the container with id 95b2af5957f1d611bc235ab1de145532dfbf42225a81efd2a8ba869275963d2a Jun 10 11:58:56.441618 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:56.441584 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-q5mnd" event={"ID":"55db9178-02ce-4f84-a852-e83d475bc16c","Type":"ContainerStarted","Data":"95b2af5957f1d611bc235ab1de145532dfbf42225a81efd2a8ba869275963d2a"} Jun 10 11:58:57.020789 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:57.020749 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/54ab14ef-0e83-468a-8795-3aa3df8bd004-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-465ht\" (UID: \"54ab14ef-0e83-468a-8795-3aa3df8bd004\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-465ht" Jun 10 11:58:57.021189 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:57.020865 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 11:58:57.021189 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:58:57.020918 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54ab14ef-0e83-468a-8795-3aa3df8bd004-networking-console-plugin-cert podName:54ab14ef-0e83-468a-8795-3aa3df8bd004 nodeName:}" failed. No retries permitted until 2026-06-10 11:59:05.020903785 +0000 UTC m=+53.226654608 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/54ab14ef-0e83-468a-8795-3aa3df8bd004-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-465ht" (UID: "54ab14ef-0e83-468a-8795-3aa3df8bd004") : secret "networking-console-plugin-cert" not found Jun 10 11:58:57.818772 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:57.818750 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-fmsz6"] Jun 10 11:58:57.822180 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:57.822158 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-fmsz6" Jun 10 11:58:57.824984 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:57.824957 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 10 11:58:57.825927 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:57.825910 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 10 11:58:57.826011 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:57.825958 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-mc7n8\"" Jun 10 11:58:57.826232 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:57.826214 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 10 11:58:57.826232 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:57.826224 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 10 11:58:57.830650 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:57.830505 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-fmsz6"] Jun 10 11:58:57.929354 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:57.929282 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ac1a9b47-226e-49f4-a9df-ea1052eda6b1-signing-key\") pod \"service-ca-7d74d578b8-fmsz6\" (UID: \"ac1a9b47-226e-49f4-a9df-ea1052eda6b1\") " pod="openshift-service-ca/service-ca-7d74d578b8-fmsz6" Jun 10 11:58:57.929486 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:57.929397 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ac1a9b47-226e-49f4-a9df-ea1052eda6b1-signing-cabundle\") pod \"service-ca-7d74d578b8-fmsz6\" (UID: \"ac1a9b47-226e-49f4-a9df-ea1052eda6b1\") " pod="openshift-service-ca/service-ca-7d74d578b8-fmsz6" Jun 10 11:58:57.929486 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:57.929423 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgshf\" (UniqueName: \"kubernetes.io/projected/ac1a9b47-226e-49f4-a9df-ea1052eda6b1-kube-api-access-qgshf\") pod \"service-ca-7d74d578b8-fmsz6\" (UID: \"ac1a9b47-226e-49f4-a9df-ea1052eda6b1\") " pod="openshift-service-ca/service-ca-7d74d578b8-fmsz6" Jun 10 11:58:58.030785 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:58.030742 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ac1a9b47-226e-49f4-a9df-ea1052eda6b1-signing-key\") pod \"service-ca-7d74d578b8-fmsz6\" (UID: \"ac1a9b47-226e-49f4-a9df-ea1052eda6b1\") " pod="openshift-service-ca/service-ca-7d74d578b8-fmsz6" Jun 10 11:58:58.031157 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:58.030868 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ac1a9b47-226e-49f4-a9df-ea1052eda6b1-signing-cabundle\") pod \"service-ca-7d74d578b8-fmsz6\" (UID: \"ac1a9b47-226e-49f4-a9df-ea1052eda6b1\") " pod="openshift-service-ca/service-ca-7d74d578b8-fmsz6" Jun 10 11:58:58.031157 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:58.030895 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgshf\" (UniqueName: \"kubernetes.io/projected/ac1a9b47-226e-49f4-a9df-ea1052eda6b1-kube-api-access-qgshf\") pod \"service-ca-7d74d578b8-fmsz6\" (UID: \"ac1a9b47-226e-49f4-a9df-ea1052eda6b1\") " pod="openshift-service-ca/service-ca-7d74d578b8-fmsz6" Jun 10 11:58:58.042843 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:58.042816 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ac1a9b47-226e-49f4-a9df-ea1052eda6b1-signing-key\") pod \"service-ca-7d74d578b8-fmsz6\" (UID: \"ac1a9b47-226e-49f4-a9df-ea1052eda6b1\") " pod="openshift-service-ca/service-ca-7d74d578b8-fmsz6" Jun 10 11:58:58.042967 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:58.042854 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgshf\" (UniqueName: \"kubernetes.io/projected/ac1a9b47-226e-49f4-a9df-ea1052eda6b1-kube-api-access-qgshf\") pod \"service-ca-7d74d578b8-fmsz6\" (UID: \"ac1a9b47-226e-49f4-a9df-ea1052eda6b1\") " pod="openshift-service-ca/service-ca-7d74d578b8-fmsz6" Jun 10 11:58:58.042967 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:58.042918 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ac1a9b47-226e-49f4-a9df-ea1052eda6b1-signing-cabundle\") pod \"service-ca-7d74d578b8-fmsz6\" (UID: \"ac1a9b47-226e-49f4-a9df-ea1052eda6b1\") " pod="openshift-service-ca/service-ca-7d74d578b8-fmsz6" Jun 10 11:58:58.132706 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:58.132679 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-fmsz6" Jun 10 11:58:58.278534 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:58.278504 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-fmsz6"] Jun 10 11:58:58.281416 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:58:58.281388 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac1a9b47_226e_49f4_a9df_ea1052eda6b1.slice/crio-1d6c0dcc59017caad0e13ce3c1ab22323920abe483babe5a027576910ee8bcd2 WatchSource:0}: Error finding container 1d6c0dcc59017caad0e13ce3c1ab22323920abe483babe5a027576910ee8bcd2: Status 404 returned error can't find the container with id 1d6c0dcc59017caad0e13ce3c1ab22323920abe483babe5a027576910ee8bcd2 Jun 10 11:58:58.448239 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:58.448150 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-q5mnd" event={"ID":"55db9178-02ce-4f84-a852-e83d475bc16c","Type":"ContainerStarted","Data":"c76dd283230873ec91a5c8977141b4f63854622f2d196780eafcf9ce5d4467f5"} Jun 10 11:58:58.448239 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:58.448216 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-q5mnd" event={"ID":"55db9178-02ce-4f84-a852-e83d475bc16c","Type":"ContainerStarted","Data":"5efd0bb2f2da3893bcb907f290d09a048103e01cb3c32b8936585682822982b9"} Jun 10 11:58:58.449181 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:58.449161 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-fmsz6" event={"ID":"ac1a9b47-226e-49f4-a9df-ea1052eda6b1","Type":"ContainerStarted","Data":"1d6c0dcc59017caad0e13ce3c1ab22323920abe483babe5a027576910ee8bcd2"} Jun 10 11:58:58.725447 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:58.725377 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dhw7b_e73f01dd-034a-4de7-a873-15dccbae3921/dns-node-resolver/0.log" Jun 10 11:58:59.925474 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:58:59.925445 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fnfcg_0b9f91bb-de66-4959-b25d-c8c4f3f6bb79/node-ca/0.log" Jun 10 11:59:00.525940 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:00.525909 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jlk9m_bab0f8f5-7a24-4e8e-a4fe-a1eb8faed110/serve-healthcheck-canary/0.log" Jun 10 11:59:00.725598 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:00.725518 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-q5mnd_55db9178-02ce-4f84-a852-e83d475bc16c/migrator/0.log" Jun 10 11:59:00.927130 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:00.927102 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-q5mnd_55db9178-02ce-4f84-a852-e83d475bc16c/graceful-termination/0.log" Jun 10 11:59:01.456960 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:01.456922 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-fmsz6" event={"ID":"ac1a9b47-226e-49f4-a9df-ea1052eda6b1","Type":"ContainerStarted","Data":"f0975ca2abf8bfa94ae8e0ce722e671045b928bf4ea403d07b6cad39cd3ed53e"} Jun 10 11:59:01.475571 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:01.475526 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-q5mnd" podStartSLOduration=4.862407732 podStartE2EDuration="6.475511897s" totalImagesPullingTime="1.613104165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:58:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:58:58.497201896 +0000 UTC m=+46.702952739" watchObservedRunningTime="2026-06-10 11:59:01.475511897 +0000 UTC m=+49.681262764" Jun 10 11:59:01.475755 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:01.475731 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-fmsz6" podStartSLOduration=2.346360685 podStartE2EDuration="4.475724294s" totalImagesPullingTime="2.129363609s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:58:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:59:01.475064472 +0000 UTC m=+49.680815316" watchObservedRunningTime="2026-06-10 11:59:01.475724294 +0000 UTC m=+49.681475138" Jun 10 11:59:02.568569 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:02.568530 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a914f89a-e48e-44d6-8655-b019b5ab1f47-registry-tls\") pod \"image-registry-5b76d48b49-6dtdw\" (UID: \"a914f89a-e48e-44d6-8655-b019b5ab1f47\") " pod="openshift-image-registry/image-registry-5b76d48b49-6dtdw" Jun 10 11:59:02.569058 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:59:02.568800 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 11:59:02.569058 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:59:02.568819 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b76d48b49-6dtdw: secret "image-registry-tls" not found Jun 10 11:59:02.569058 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:59:02.568882 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a914f89a-e48e-44d6-8655-b019b5ab1f47-registry-tls podName:a914f89a-e48e-44d6-8655-b019b5ab1f47 nodeName:}" failed. No retries permitted until 2026-06-10 11:59:18.568861174 +0000 UTC m=+66.774612019 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a914f89a-e48e-44d6-8655-b019b5ab1f47-registry-tls") pod "image-registry-5b76d48b49-6dtdw" (UID: "a914f89a-e48e-44d6-8655-b019b5ab1f47") : secret "image-registry-tls" not found Jun 10 11:59:02.669343 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:02.669310 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/80531a6e-51be-47ad-ac4a-e7f636b8e77b-metrics-tls\") pod \"dns-default-4jjmm\" (UID: \"80531a6e-51be-47ad-ac4a-e7f636b8e77b\") " pod="openshift-dns/dns-default-4jjmm" Jun 10 11:59:02.669495 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:59:02.669466 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 11:59:02.669537 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:59:02.669531 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80531a6e-51be-47ad-ac4a-e7f636b8e77b-metrics-tls podName:80531a6e-51be-47ad-ac4a-e7f636b8e77b nodeName:}" failed. No retries permitted until 2026-06-10 11:59:18.669516856 +0000 UTC m=+66.875267696 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/80531a6e-51be-47ad-ac4a-e7f636b8e77b-metrics-tls") pod "dns-default-4jjmm" (UID: "80531a6e-51be-47ad-ac4a-e7f636b8e77b") : secret "dns-default-metrics-tls" not found Jun 10 11:59:05.087765 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:59:05.087732 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 11:59:05.088162 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:59:05.087808 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54ab14ef-0e83-468a-8795-3aa3df8bd004-networking-console-plugin-cert podName:54ab14ef-0e83-468a-8795-3aa3df8bd004 nodeName:}" failed. No retries permitted until 2026-06-10 11:59:21.0877946 +0000 UTC m=+69.293545435 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/54ab14ef-0e83-468a-8795-3aa3df8bd004-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-465ht" (UID: "54ab14ef-0e83-468a-8795-3aa3df8bd004") : secret "networking-console-plugin-cert" not found Jun 10 11:59:05.088162 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:05.087722 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/54ab14ef-0e83-468a-8795-3aa3df8bd004-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-465ht\" (UID: \"54ab14ef-0e83-468a-8795-3aa3df8bd004\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-465ht" Jun 10 11:59:12.405240 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:12.405213 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xgfwc" Jun 10 11:59:17.982152 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:17.982109 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8180252-e6fc-4c10-aea5-e5577682a8cf-metrics-certs\") pod \"network-metrics-daemon-ndwtw\" (UID: \"b8180252-e6fc-4c10-aea5-e5577682a8cf\") " pod="openshift-multus/network-metrics-daemon-ndwtw" Jun 10 11:59:17.984935 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:17.984910 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 11:59:17.995357 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:17.995333 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8180252-e6fc-4c10-aea5-e5577682a8cf-metrics-certs\") pod \"network-metrics-daemon-ndwtw\" (UID: \"b8180252-e6fc-4c10-aea5-e5577682a8cf\") " pod="openshift-multus/network-metrics-daemon-ndwtw" Jun 10 11:59:18.082992 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:18.082949 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/735eadd6-c42b-4044-95b8-cd0b4762e0eb-original-pull-secret\") pod \"global-pull-secret-syncer-v9bc6\" (UID: \"735eadd6-c42b-4044-95b8-cd0b4762e0eb\") " pod="kube-system/global-pull-secret-syncer-v9bc6" Jun 10 11:59:18.085657 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:18.085637 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 11:59:18.096230 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:18.096204 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/735eadd6-c42b-4044-95b8-cd0b4762e0eb-original-pull-secret\") pod \"global-pull-secret-syncer-v9bc6\" (UID: \"735eadd6-c42b-4044-95b8-cd0b4762e0eb\") " pod="kube-system/global-pull-secret-syncer-v9bc6" Jun 10 11:59:18.183507 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:18.183466 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbdk6\" (UniqueName: \"kubernetes.io/projected/3b023797-5c02-41bf-a1dd-a01e3c265b91-kube-api-access-qbdk6\") pod \"network-check-target-lfwlq\" (UID: \"3b023797-5c02-41bf-a1dd-a01e3c265b91\") " pod="openshift-network-diagnostics/network-check-target-lfwlq" Jun 10 11:59:18.186489 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:18.186468 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 11:59:18.196522 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:18.196500 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 11:59:18.206976 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:18.206948 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbdk6\" (UniqueName: \"kubernetes.io/projected/3b023797-5c02-41bf-a1dd-a01e3c265b91-kube-api-access-qbdk6\") pod \"network-check-target-lfwlq\" (UID: \"3b023797-5c02-41bf-a1dd-a01e3c265b91\") " pod="openshift-network-diagnostics/network-check-target-lfwlq" Jun 10 11:59:18.255867 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:18.255790 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j6n9s\"" Jun 10 11:59:18.263314 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:18.263294 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndwtw" Jun 10 11:59:18.263442 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:18.263371 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zk9qr\"" Jun 10 11:59:18.267812 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:18.267795 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v9bc6" Jun 10 11:59:18.271996 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:18.271983 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfwlq" Jun 10 11:59:18.441353 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:18.441325 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ndwtw"] Jun 10 11:59:18.451543 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:59:18.451512 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8180252_e6fc_4c10_aea5_e5577682a8cf.slice/crio-ee9adc5dd539d4ae86540b12b74fe8931cdbdadaba20bf99650259446700aba5 WatchSource:0}: Error finding container ee9adc5dd539d4ae86540b12b74fe8931cdbdadaba20bf99650259446700aba5: Status 404 returned error can't find the container with id ee9adc5dd539d4ae86540b12b74fe8931cdbdadaba20bf99650259446700aba5 Jun 10 11:59:18.461397 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:18.461373 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-v9bc6"] Jun 10 11:59:18.463962 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:59:18.463928 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod735eadd6_c42b_4044_95b8_cd0b4762e0eb.slice/crio-68f5dd51125c26ad67010d25cb4dd871595b6e12ae56b8e995e4cbd3afd98739 WatchSource:0}: Error finding container 68f5dd51125c26ad67010d25cb4dd871595b6e12ae56b8e995e4cbd3afd98739: Status 404 returned error can't find the container with id 68f5dd51125c26ad67010d25cb4dd871595b6e12ae56b8e995e4cbd3afd98739 Jun 10 11:59:18.475773 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:18.475714 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lfwlq"] Jun 10 11:59:18.477856 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:59:18.477833 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b023797_5c02_41bf_a1dd_a01e3c265b91.slice/crio-0e53f2e5ab583bb1dbb0fc681ea50e616e736bc2e7b4d4451db8b306123d5b04 WatchSource:0}: Error finding container 0e53f2e5ab583bb1dbb0fc681ea50e616e736bc2e7b4d4451db8b306123d5b04: Status 404 returned error can't find the container with id 0e53f2e5ab583bb1dbb0fc681ea50e616e736bc2e7b4d4451db8b306123d5b04 Jun 10 11:59:18.501333 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:18.501307 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-v9bc6" event={"ID":"735eadd6-c42b-4044-95b8-cd0b4762e0eb","Type":"ContainerStarted","Data":"68f5dd51125c26ad67010d25cb4dd871595b6e12ae56b8e995e4cbd3afd98739"} Jun 10 11:59:18.502363 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:18.502344 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ndwtw" event={"ID":"b8180252-e6fc-4c10-aea5-e5577682a8cf","Type":"ContainerStarted","Data":"ee9adc5dd539d4ae86540b12b74fe8931cdbdadaba20bf99650259446700aba5"} Jun 10 11:59:18.503336 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:18.503316 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lfwlq" event={"ID":"3b023797-5c02-41bf-a1dd-a01e3c265b91","Type":"ContainerStarted","Data":"0e53f2e5ab583bb1dbb0fc681ea50e616e736bc2e7b4d4451db8b306123d5b04"} Jun 10 11:59:18.587967 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:18.587944 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a914f89a-e48e-44d6-8655-b019b5ab1f47-registry-tls\") pod \"image-registry-5b76d48b49-6dtdw\" (UID: \"a914f89a-e48e-44d6-8655-b019b5ab1f47\") " pod="openshift-image-registry/image-registry-5b76d48b49-6dtdw" Jun 10 11:59:18.590198 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:18.590180 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a914f89a-e48e-44d6-8655-b019b5ab1f47-registry-tls\") pod \"image-registry-5b76d48b49-6dtdw\" (UID: \"a914f89a-e48e-44d6-8655-b019b5ab1f47\") " pod="openshift-image-registry/image-registry-5b76d48b49-6dtdw" Jun 10 11:59:18.688633 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:18.688599 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/80531a6e-51be-47ad-ac4a-e7f636b8e77b-metrics-tls\") pod \"dns-default-4jjmm\" (UID: \"80531a6e-51be-47ad-ac4a-e7f636b8e77b\") " pod="openshift-dns/dns-default-4jjmm" Jun 10 11:59:18.690868 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:18.690843 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/80531a6e-51be-47ad-ac4a-e7f636b8e77b-metrics-tls\") pod \"dns-default-4jjmm\" (UID: \"80531a6e-51be-47ad-ac4a-e7f636b8e77b\") " pod="openshift-dns/dns-default-4jjmm" Jun 10 11:59:18.853767 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:18.853699 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gpn9z\"" Jun 10 11:59:18.861942 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:18.861927 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b76d48b49-6dtdw" Jun 10 11:59:18.902015 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:18.901987 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d6l2n\"" Jun 10 11:59:18.910380 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:18.910342 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4jjmm" Jun 10 11:59:19.051421 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:19.051345 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b76d48b49-6dtdw"] Jun 10 11:59:19.066126 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:59:19.062325 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda914f89a_e48e_44d6_8655_b019b5ab1f47.slice/crio-7bbeed86626a26d39d517e1a44835ce32054da3d19162210fc94b25b36ed1fe1 WatchSource:0}: Error finding container 7bbeed86626a26d39d517e1a44835ce32054da3d19162210fc94b25b36ed1fe1: Status 404 returned error can't find the container with id 7bbeed86626a26d39d517e1a44835ce32054da3d19162210fc94b25b36ed1fe1 Jun 10 11:59:19.094179 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:19.094101 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4jjmm"] Jun 10 11:59:19.509811 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:19.509296 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b76d48b49-6dtdw" event={"ID":"a914f89a-e48e-44d6-8655-b019b5ab1f47","Type":"ContainerStarted","Data":"e85faf11167ba4571d6965a67908eb50655f9d919e28458fcd88dc985dfa3a42"} Jun 10 11:59:19.509811 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:19.509357 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b76d48b49-6dtdw" event={"ID":"a914f89a-e48e-44d6-8655-b019b5ab1f47","Type":"ContainerStarted","Data":"7bbeed86626a26d39d517e1a44835ce32054da3d19162210fc94b25b36ed1fe1"} Jun 10 11:59:19.509811 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:19.509576 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5b76d48b49-6dtdw" Jun 10 11:59:19.511852 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:19.511793 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4jjmm" event={"ID":"80531a6e-51be-47ad-ac4a-e7f636b8e77b","Type":"ContainerStarted","Data":"b96c87764aff083023f4a1c381a3bc7aac562847c955d44722e4cdedf095c163"} Jun 10 11:59:19.553170 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:19.550594 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5b76d48b49-6dtdw" podStartSLOduration=57.550563523 podStartE2EDuration="57.550563523s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:58:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:59:19.54686377 +0000 UTC m=+67.752614616" watchObservedRunningTime="2026-06-10 11:59:19.550563523 +0000 UTC m=+67.756314376" Jun 10 11:59:20.521218 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:20.521129 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ndwtw" event={"ID":"b8180252-e6fc-4c10-aea5-e5577682a8cf","Type":"ContainerStarted","Data":"35377bced101c758bb7104463d0dc955a9362b4e094a9ee6e18523705eaf372d"} Jun 10 11:59:20.521218 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:20.521187 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ndwtw" event={"ID":"b8180252-e6fc-4c10-aea5-e5577682a8cf","Type":"ContainerStarted","Data":"59b6e14fd3b63f31e34dac401232f9dec326afb392527ee59e986e7b87dfdfc1"} Jun 10 11:59:21.036950 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:21.036166 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ndwtw" podStartSLOduration=67.498495985 podStartE2EDuration="1m9.036142483s" totalImagesPullingTime="1.537646498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:58:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:59:20.545353769 +0000 UTC m=+68.751104617" watchObservedRunningTime="2026-06-10 11:59:21.036142483 +0000 UTC m=+69.241893328" Jun 10 11:59:21.038963 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:21.038523 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-llx7r"] Jun 10 11:59:21.041136 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:21.041113 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-llx7r" Jun 10 11:59:21.041712 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:21.041687 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5b76d48b49-6dtdw"] Jun 10 11:59:21.045060 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:21.045015 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 10 11:59:21.045796 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:21.045525 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 10 11:59:21.045796 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:21.045585 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 10 11:59:21.045796 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:21.045601 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 10 11:59:21.046210 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:21.046187 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6mdsn\"" Jun 10 11:59:21.056710 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:21.056642 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-llx7r"] Jun 10 11:59:21.109313 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:21.109249 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/54ab14ef-0e83-468a-8795-3aa3df8bd004-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-465ht\" (UID: \"54ab14ef-0e83-468a-8795-3aa3df8bd004\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-465ht" Jun 10 11:59:21.109313 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:21.109297 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4cee9ada-9799-42b4-a209-3b55df25b91f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-llx7r\" (UID: \"4cee9ada-9799-42b4-a209-3b55df25b91f\") " pod="openshift-insights/insights-runtime-extractor-llx7r" Jun 10 11:59:21.109565 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:21.109360 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4cee9ada-9799-42b4-a209-3b55df25b91f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-llx7r\" (UID: \"4cee9ada-9799-42b4-a209-3b55df25b91f\") " pod="openshift-insights/insights-runtime-extractor-llx7r" Jun 10 11:59:21.109565 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:21.109384 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4cee9ada-9799-42b4-a209-3b55df25b91f-crio-socket\") pod \"insights-runtime-extractor-llx7r\" (UID: \"4cee9ada-9799-42b4-a209-3b55df25b91f\") " pod="openshift-insights/insights-runtime-extractor-llx7r" Jun 10 11:59:21.109565 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:21.109409 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnxcx\" (UniqueName: \"kubernetes.io/projected/4cee9ada-9799-42b4-a209-3b55df25b91f-kube-api-access-hnxcx\") pod \"insights-runtime-extractor-llx7r\" (UID: \"4cee9ada-9799-42b4-a209-3b55df25b91f\") " pod="openshift-insights/insights-runtime-extractor-llx7r" Jun 10 11:59:21.109565 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:21.109483 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4cee9ada-9799-42b4-a209-3b55df25b91f-data-volume\") pod \"insights-runtime-extractor-llx7r\" (UID: \"4cee9ada-9799-42b4-a209-3b55df25b91f\") " pod="openshift-insights/insights-runtime-extractor-llx7r" Jun 10 11:59:21.112554 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:21.112507 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/54ab14ef-0e83-468a-8795-3aa3df8bd004-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-465ht\" (UID: \"54ab14ef-0e83-468a-8795-3aa3df8bd004\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-465ht" Jun 10 11:59:21.145414 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:21.145351 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbfb5f555-8sjdq"] Jun 10 11:59:21.147910 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:21.147847 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbfb5f555-8sjdq" Jun 10 11:59:21.151494 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:21.151411 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 10 11:59:21.151494 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:21.151435 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 10 11:59:21.152389 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:21.152362 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 10 11:59:21.152500 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:21.152394 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 10 11:59:21.167240 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:21.167214 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbfb5f555-8sjdq"] Jun 10 11:59:21.210574 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:21.210542 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4cee9ada-9799-42b4-a209-3b55df25b91f-data-volume\") pod \"insights-runtime-extractor-llx7r\" (UID: \"4cee9ada-9799-42b4-a209-3b55df25b91f\") " pod="openshift-insights/insights-runtime-extractor-llx7r" Jun 10 11:59:21.210749 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:21.210593 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/adbe9fe7-26d7-45dd-8a18-4ff2b1644f1f-tmp\") pod \"klusterlet-addon-workmgr-5cbfb5f555-8sjdq\" (UID: \"adbe9fe7-26d7-45dd-8a18-4ff2b1644f1f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbfb5f555-8sjdq" Jun 10 11:59:21.210749 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:21.210642 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4cee9ada-9799-42b4-a209-3b55df25b91f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-llx7r\" (UID: \"4cee9ada-9799-42b4-a209-3b55df25b91f\") " pod="openshift-insights/insights-runtime-extractor-llx7r" Jun 10 11:59:21.210749 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:21.210682 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4cee9ada-9799-42b4-a209-3b55df25b91f-crio-socket\") pod \"insights-runtime-extractor-llx7r\" (UID: \"4cee9ada-9799-42b4-a209-3b55df25b91f\") " pod="openshift-insights/insights-runtime-extractor-llx7r" Jun 10 11:59:21.210749 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:21.210707 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/adbe9fe7-26d7-45dd-8a18-4ff2b1644f1f-klusterlet-config\") pod \"klusterlet-addon-workmgr-5cbfb5f555-8sjdq\" (UID: \"adbe9fe7-26d7-45dd-8a18-4ff2b1644f1f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbfb5f555-8sjdq" Jun 10 11:59:21.210961 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:21.210754 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkh2z\" (UniqueName: \"kubernetes.io/projected/adbe9fe7-26d7-45dd-8a18-4ff2b1644f1f-kube-api-access-nkh2z\") pod \"klusterlet-addon-workmgr-5cbfb5f555-8sjdq\" (UID: \"adbe9fe7-26d7-45dd-8a18-4ff2b1644f1f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbfb5f555-8sjdq" Jun 10 11:59:21.210961 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:21.210793 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4cee9ada-9799-42b4-a209-3b55df25b91f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-llx7r\" (UID: \"4cee9ada-9799-42b4-a209-3b55df25b91f\") " pod="openshift-insights/insights-runtime-extractor-llx7r" Jun 10 11:59:21.210961 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:21.210823 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnxcx\" (UniqueName: \"kubernetes.io/projected/4cee9ada-9799-42b4-a209-3b55df25b91f-kube-api-access-hnxcx\") pod \"insights-runtime-extractor-llx7r\" (UID: \"4cee9ada-9799-42b4-a209-3b55df25b91f\") " pod="openshift-insights/insights-runtime-extractor-llx7r" Jun 10 11:59:21.211147 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:21.210957 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4cee9ada-9799-42b4-a209-3b55df25b91f-data-volume\") pod \"insights-runtime-extractor-llx7r\" (UID: \"4cee9ada-9799-42b4-a209-3b55df25b91f\") " pod="openshift-insights/insights-runtime-extractor-llx7r" Jun 10 11:59:21.211147 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:21.211095 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4cee9ada-9799-42b4-a209-3b55df25b91f-crio-socket\") pod \"insights-runtime-extractor-llx7r\" (UID: \"4cee9ada-9799-42b4-a209-3b55df25b91f\") " pod="openshift-insights/insights-runtime-extractor-llx7r" Jun 10 11:59:21.211286 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:21.211252 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4cee9ada-9799-42b4-a209-3b55df25b91f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-llx7r\" (UID: \"4cee9ada-9799-42b4-a209-3b55df25b91f\") " pod="openshift-insights/insights-runtime-extractor-llx7r" Jun 10 11:59:21.213778 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:21.213745 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4cee9ada-9799-42b4-a209-3b55df25b91f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-llx7r\" (UID: \"4cee9ada-9799-42b4-a209-3b55df25b91f\") " pod="openshift-insights/insights-runtime-extractor-llx7r" Jun 10 11:59:21.231384 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:21.231349 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnxcx\" (UniqueName: \"kubernetes.io/projected/4cee9ada-9799-42b4-a209-3b55df25b91f-kube-api-access-hnxcx\") pod \"insights-runtime-extractor-llx7r\" (UID: \"4cee9ada-9799-42b4-a209-3b55df25b91f\") " pod="openshift-insights/insights-runtime-extractor-llx7r" Jun 10 11:59:21.311655 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:21.311550 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkh2z\" (UniqueName: \"kubernetes.io/projected/adbe9fe7-26d7-45dd-8a18-4ff2b1644f1f-kube-api-access-nkh2z\") pod \"klusterlet-addon-workmgr-5cbfb5f555-8sjdq\" (UID: \"adbe9fe7-26d7-45dd-8a18-4ff2b1644f1f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbfb5f555-8sjdq" Jun 10 11:59:21.311655 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:21.311625 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/adbe9fe7-26d7-45dd-8a18-4ff2b1644f1f-tmp\") pod \"klusterlet-addon-workmgr-5cbfb5f555-8sjdq\" (UID: \"adbe9fe7-26d7-45dd-8a18-4ff2b1644f1f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbfb5f555-8sjdq" Jun 10 11:59:21.311906 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:21.311672 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/adbe9fe7-26d7-45dd-8a18-4ff2b1644f1f-klusterlet-config\") pod \"klusterlet-addon-workmgr-5cbfb5f555-8sjdq\" (UID: \"adbe9fe7-26d7-45dd-8a18-4ff2b1644f1f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbfb5f555-8sjdq" Jun 10 11:59:21.312250 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:21.312217 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/adbe9fe7-26d7-45dd-8a18-4ff2b1644f1f-tmp\") pod \"klusterlet-addon-workmgr-5cbfb5f555-8sjdq\" (UID: \"adbe9fe7-26d7-45dd-8a18-4ff2b1644f1f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbfb5f555-8sjdq" Jun 10 11:59:21.314897 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:21.314848 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/adbe9fe7-26d7-45dd-8a18-4ff2b1644f1f-klusterlet-config\") pod \"klusterlet-addon-workmgr-5cbfb5f555-8sjdq\" (UID: \"adbe9fe7-26d7-45dd-8a18-4ff2b1644f1f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbfb5f555-8sjdq" Jun 10 11:59:21.325647 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:21.325616 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkh2z\" (UniqueName: \"kubernetes.io/projected/adbe9fe7-26d7-45dd-8a18-4ff2b1644f1f-kube-api-access-nkh2z\") pod \"klusterlet-addon-workmgr-5cbfb5f555-8sjdq\" (UID: \"adbe9fe7-26d7-45dd-8a18-4ff2b1644f1f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbfb5f555-8sjdq" Jun 10 11:59:21.337776 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:21.337723 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-cz8lq\"" Jun 10 11:59:21.345862 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:21.345837 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-465ht" Jun 10 11:59:21.352661 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:21.352638 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-llx7r" Jun 10 11:59:21.460878 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:21.460841 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbfb5f555-8sjdq" Jun 10 11:59:21.775732 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:21.775697 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-pn9pz"] Jun 10 11:59:21.778131 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:21.778106 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-pn9pz" Jun 10 11:59:21.780779 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:21.780742 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 10 11:59:21.781112 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:21.781094 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-5ckr9\"" Jun 10 11:59:21.790727 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:21.790699 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-pn9pz"] Jun 10 11:59:21.814907 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:21.814866 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/cfe9684c-b09b-4df2-82f5-83e568a8e7af-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-pn9pz\" (UID: \"cfe9684c-b09b-4df2-82f5-83e568a8e7af\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-pn9pz" Jun 10 11:59:21.916018 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:21.915976 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/cfe9684c-b09b-4df2-82f5-83e568a8e7af-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-pn9pz\" (UID: \"cfe9684c-b09b-4df2-82f5-83e568a8e7af\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-pn9pz" Jun 10 11:59:21.916204 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:59:21.916168 2562 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 10 11:59:21.916271 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:59:21.916258 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfe9684c-b09b-4df2-82f5-83e568a8e7af-tls-certificates podName:cfe9684c-b09b-4df2-82f5-83e568a8e7af nodeName:}" failed. No retries permitted until 2026-06-10 11:59:22.416236152 +0000 UTC m=+70.621986978 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/cfe9684c-b09b-4df2-82f5-83e568a8e7af-tls-certificates") pod "prometheus-operator-admission-webhook-5b6b8f594-pn9pz" (UID: "cfe9684c-b09b-4df2-82f5-83e568a8e7af") : secret "prometheus-operator-admission-webhook-tls" not found Jun 10 11:59:22.419673 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:22.419632 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/cfe9684c-b09b-4df2-82f5-83e568a8e7af-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-pn9pz\" (UID: \"cfe9684c-b09b-4df2-82f5-83e568a8e7af\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-pn9pz" Jun 10 11:59:22.422413 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:22.422390 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/cfe9684c-b09b-4df2-82f5-83e568a8e7af-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-pn9pz\" (UID: \"cfe9684c-b09b-4df2-82f5-83e568a8e7af\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-pn9pz" Jun 10 11:59:22.690374 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:22.690278 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-pn9pz" Jun 10 11:59:23.943150 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:23.943109 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-465ht"] Jun 10 11:59:23.950644 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:59:23.950603 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54ab14ef_0e83_468a_8795_3aa3df8bd004.slice/crio-83495112c39ba0f9d7a8be069703756bd1218747e4a513ef032d684735fad74f WatchSource:0}: Error finding container 83495112c39ba0f9d7a8be069703756bd1218747e4a513ef032d684735fad74f: Status 404 returned error can't find the container with id 83495112c39ba0f9d7a8be069703756bd1218747e4a513ef032d684735fad74f Jun 10 11:59:24.191212 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:24.191181 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-llx7r"] Jun 10 11:59:24.194300 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:59:24.194262 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cee9ada_9799_42b4_a209_3b55df25b91f.slice/crio-2e3c31a038e146d8c335c48dab3a138eb829689769e20935de0df0a113d25418 WatchSource:0}: Error finding container 2e3c31a038e146d8c335c48dab3a138eb829689769e20935de0df0a113d25418: Status 404 returned error can't find the container with id 2e3c31a038e146d8c335c48dab3a138eb829689769e20935de0df0a113d25418 Jun 10 11:59:24.200083 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:24.200053 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-pn9pz"] Jun 10 11:59:24.205366 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:59:24.205331 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfe9684c_b09b_4df2_82f5_83e568a8e7af.slice/crio-15ec6f707d2470d328ae63f894c773473ddaf69765ec42c30cb3abe4d698eae6 WatchSource:0}: Error finding container 15ec6f707d2470d328ae63f894c773473ddaf69765ec42c30cb3abe4d698eae6: Status 404 returned error can't find the container with id 15ec6f707d2470d328ae63f894c773473ddaf69765ec42c30cb3abe4d698eae6 Jun 10 11:59:24.210454 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:24.210431 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbfb5f555-8sjdq"] Jun 10 11:59:24.213383 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:59:24.213360 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadbe9fe7_26d7_45dd_8a18_4ff2b1644f1f.slice/crio-81d467c303a76f0006d5446826219d8a554a438fec2ff9e150b27de869fe1eaf WatchSource:0}: Error finding container 81d467c303a76f0006d5446826219d8a554a438fec2ff9e150b27de869fe1eaf: Status 404 returned error can't find the container with id 81d467c303a76f0006d5446826219d8a554a438fec2ff9e150b27de869fe1eaf Jun 10 11:59:24.539769 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:24.539727 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-v9bc6" event={"ID":"735eadd6-c42b-4044-95b8-cd0b4762e0eb","Type":"ContainerStarted","Data":"3ba21ef3180ce4e81c39b7462bbaee27fbc77c58132e5f4459b99b9ae78f5b13"} Jun 10 11:59:24.541103 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:24.541076 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-465ht" event={"ID":"54ab14ef-0e83-468a-8795-3aa3df8bd004","Type":"ContainerStarted","Data":"83495112c39ba0f9d7a8be069703756bd1218747e4a513ef032d684735fad74f"} Jun 10 11:59:24.542619 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:24.542587 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lfwlq" event={"ID":"3b023797-5c02-41bf-a1dd-a01e3c265b91","Type":"ContainerStarted","Data":"52d515785bc9c64b1d23859f7904aa3a08571aa2f01065c77203b0d69ddaa6a5"} Jun 10 11:59:24.542789 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:24.542642 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lfwlq" Jun 10 11:59:24.544672 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:24.544648 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-llx7r" event={"ID":"4cee9ada-9799-42b4-a209-3b55df25b91f","Type":"ContainerStarted","Data":"e3ca8926b18729df1ad8732ad7b88e609a758d4cb8c47338b01dc0e6dd318101"} Jun 10 11:59:24.544773 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:24.544700 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-llx7r" event={"ID":"4cee9ada-9799-42b4-a209-3b55df25b91f","Type":"ContainerStarted","Data":"2e3c31a038e146d8c335c48dab3a138eb829689769e20935de0df0a113d25418"} Jun 10 11:59:24.545916 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:24.545892 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-pn9pz" event={"ID":"cfe9684c-b09b-4df2-82f5-83e568a8e7af","Type":"ContainerStarted","Data":"15ec6f707d2470d328ae63f894c773473ddaf69765ec42c30cb3abe4d698eae6"} Jun 10 11:59:24.547749 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:24.547726 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4jjmm" event={"ID":"80531a6e-51be-47ad-ac4a-e7f636b8e77b","Type":"ContainerStarted","Data":"b79a4a51cde63a6378cb398ff96283612b3a038426f1fdf2e0ec3605c0254490"} Jun 10 11:59:24.547843 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:24.547770 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4jjmm" event={"ID":"80531a6e-51be-47ad-ac4a-e7f636b8e77b","Type":"ContainerStarted","Data":"02afcc9af21804bba5de4f4869709f9d22c3910a994ad64b98f413d593b593eb"} Jun 10 11:59:24.547843 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:24.547804 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4jjmm" Jun 10 11:59:24.548979 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:24.548959 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbfb5f555-8sjdq" event={"ID":"adbe9fe7-26d7-45dd-8a18-4ff2b1644f1f","Type":"ContainerStarted","Data":"81d467c303a76f0006d5446826219d8a554a438fec2ff9e150b27de869fe1eaf"} Jun 10 11:59:24.558691 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:24.558643 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-v9bc6" podStartSLOduration=67.258360012 podStartE2EDuration="1m12.558630401s" totalImagesPullingTime="5.300270389s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:58:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:59:24.557459715 +0000 UTC m=+72.763210560" watchObservedRunningTime="2026-06-10 11:59:24.558630401 +0000 UTC m=+72.764381246" Jun 10 11:59:24.574183 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:24.574137 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lfwlq" podStartSLOduration=67.298967369 podStartE2EDuration="1m12.574119939s" totalImagesPullingTime="5.27515257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:58:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:59:24.573294794 +0000 UTC m=+72.779045639" watchObservedRunningTime="2026-06-10 11:59:24.574119939 +0000 UTC m=+72.779870786" Jun 10 11:59:24.591141 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:24.591003 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4jjmm" podStartSLOduration=33.944887967 podStartE2EDuration="38.590957383s" totalImagesPullingTime="4.646069416s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:58:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:59:24.590490167 +0000 UTC m=+72.796241029" watchObservedRunningTime="2026-06-10 11:59:24.590957383 +0000 UTC m=+72.796708230" Jun 10 11:59:25.555071 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:25.555019 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-465ht" event={"ID":"54ab14ef-0e83-468a-8795-3aa3df8bd004","Type":"ContainerStarted","Data":"7af67eea7b3880242fd12323aad0023e356fca36e0d7be821a0f633a38558c7a"} Jun 10 11:59:25.557710 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:25.557664 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-llx7r" event={"ID":"4cee9ada-9799-42b4-a209-3b55df25b91f","Type":"ContainerStarted","Data":"dac01a854e04ed3bae4e187d4ef963f77ec49196925c2db4d09fce2f8051a332"} Jun 10 11:59:25.559742 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:25.559661 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-pn9pz" event={"ID":"cfe9684c-b09b-4df2-82f5-83e568a8e7af","Type":"ContainerStarted","Data":"f01f718a430d39f66bb4f6461c6e47d3237daeed5150eb35a40731b54a3fac4c"} Jun 10 11:59:25.560003 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:25.559978 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-pn9pz" Jun 10 11:59:25.566144 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:25.566108 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-pn9pz" Jun 10 11:59:25.573848 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:25.573799 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-465ht" podStartSLOduration=35.161133308 podStartE2EDuration="36.573781242s" totalImagesPullingTime="1.412647934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:58:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:59:25.572862488 +0000 UTC m=+73.778613333" watchObservedRunningTime="2026-06-10 11:59:25.573781242 +0000 UTC m=+73.779532089" Jun 10 11:59:25.590253 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:25.590205 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-pn9pz" podStartSLOduration=3.429653652 podStartE2EDuration="4.590187054s" totalImagesPullingTime="1.160533402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:59:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:59:25.5891318 +0000 UTC m=+73.794882645" watchObservedRunningTime="2026-06-10 11:59:25.590187054 +0000 UTC m=+73.795937899" Jun 10 11:59:29.295167 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:29.295087 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-wzc9g"] Jun 10 11:59:29.298189 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:29.298174 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-wzc9g" Jun 10 11:59:29.300627 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:29.300597 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-q9znj\"" Jun 10 11:59:29.300748 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:29.300704 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 10 11:59:29.301137 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:29.301120 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 10 11:59:29.308743 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:29.308720 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-wzc9g"] Jun 10 11:59:29.380914 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:29.380884 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dsw6\" (UniqueName: \"kubernetes.io/projected/05d0c844-384f-4af1-92c1-27b075cb581c-kube-api-access-9dsw6\") pod \"downloads-6657875f97-wzc9g\" (UID: \"05d0c844-384f-4af1-92c1-27b075cb581c\") " pod="openshift-console/downloads-6657875f97-wzc9g" Jun 10 11:59:29.481452 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:29.481400 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dsw6\" (UniqueName: \"kubernetes.io/projected/05d0c844-384f-4af1-92c1-27b075cb581c-kube-api-access-9dsw6\") pod \"downloads-6657875f97-wzc9g\" (UID: \"05d0c844-384f-4af1-92c1-27b075cb581c\") " pod="openshift-console/downloads-6657875f97-wzc9g" Jun 10 11:59:29.491257 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:29.491232 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dsw6\" (UniqueName: \"kubernetes.io/projected/05d0c844-384f-4af1-92c1-27b075cb581c-kube-api-access-9dsw6\") pod \"downloads-6657875f97-wzc9g\" (UID: \"05d0c844-384f-4af1-92c1-27b075cb581c\") " pod="openshift-console/downloads-6657875f97-wzc9g" Jun 10 11:59:29.575778 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:29.575690 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-llx7r" event={"ID":"4cee9ada-9799-42b4-a209-3b55df25b91f","Type":"ContainerStarted","Data":"5943101a2a9c85ae3665e57e6fbb777780dab08ada6db677c6c3bb331148728f"} Jun 10 11:59:29.577186 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:29.577152 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbfb5f555-8sjdq" event={"ID":"adbe9fe7-26d7-45dd-8a18-4ff2b1644f1f","Type":"ContainerStarted","Data":"7ef54628df8fce5de3cc4702787ed136ea4a15d8127cd87f59a918c11614c51b"} Jun 10 11:59:29.577359 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:29.577344 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbfb5f555-8sjdq" Jun 10 11:59:29.579096 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:29.579068 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbfb5f555-8sjdq" Jun 10 11:59:29.597636 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:29.597594 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-llx7r" podStartSLOduration=4.089998397 podStartE2EDuration="8.597581964s" totalImagesPullingTime="4.507583567s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:59:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:59:29.596767108 +0000 UTC m=+77.802517953" watchObservedRunningTime="2026-06-10 11:59:29.597581964 +0000 UTC m=+77.803332807" Jun 10 11:59:29.606528 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:29.606509 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-wzc9g" Jun 10 11:59:29.614188 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:29.614139 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbfb5f555-8sjdq" podStartSLOduration=3.967361381 podStartE2EDuration="8.614122837s" totalImagesPullingTime="4.646761456s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:59:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:59:29.613885472 +0000 UTC m=+77.819636317" watchObservedRunningTime="2026-06-10 11:59:29.614122837 +0000 UTC m=+77.819873682" Jun 10 11:59:29.747004 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:29.746968 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-wzc9g"] Jun 10 11:59:29.749591 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:59:29.749553 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05d0c844_384f_4af1_92c1_27b075cb581c.slice/crio-ce1751036eae47064179892a076c5c76716b9ef8de167d5c61640e6a80e0eaab WatchSource:0}: Error finding container ce1751036eae47064179892a076c5c76716b9ef8de167d5c61640e6a80e0eaab: Status 404 returned error can't find the container with id ce1751036eae47064179892a076c5c76716b9ef8de167d5c61640e6a80e0eaab Jun 10 11:59:30.581053 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:30.581001 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-wzc9g" event={"ID":"05d0c844-384f-4af1-92c1-27b075cb581c","Type":"ContainerStarted","Data":"ce1751036eae47064179892a076c5c76716b9ef8de167d5c61640e6a80e0eaab"} Jun 10 11:59:31.219232 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.219196 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-hdvmm"] Jun 10 11:59:31.232725 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.232695 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-vb5gh"] Jun 10 11:59:31.232877 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.232801 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hdvmm" Jun 10 11:59:31.237671 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.237598 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-vb5gh" Jun 10 11:59:31.243551 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.241205 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-j9vdm\"" Jun 10 11:59:31.243551 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.241322 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 10 11:59:31.243551 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.241467 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 10 11:59:31.243551 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.241490 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 10 11:59:31.243551 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.241563 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 10 11:59:31.243551 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.241767 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 10 11:59:31.243551 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.242102 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 10 11:59:31.243551 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.242123 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 10 11:59:31.243551 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.242415 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-zt7nl\"" Jun 10 11:59:31.243551 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.243228 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 10 11:59:31.247010 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.246883 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-hdvmm"] Jun 10 11:59:31.248341 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.248271 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-vb5gh"] Jun 10 11:59:31.263630 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.263556 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-nprtc"] Jun 10 11:59:31.267201 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.267181 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nprtc" Jun 10 11:59:31.269920 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.269894 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 10 11:59:31.270068 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.270030 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 10 11:59:31.270808 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.270631 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 10 11:59:31.271367 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.271194 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2877w\"" Jun 10 11:59:31.299552 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.299524 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b9a76923-27f8-4af2-9f09-8c0a69b8691d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-hdvmm\" (UID: \"b9a76923-27f8-4af2-9f09-8c0a69b8691d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hdvmm" Jun 10 11:59:31.299672 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.299572 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2p6q\" (UniqueName: \"kubernetes.io/projected/b9a76923-27f8-4af2-9f09-8c0a69b8691d-kube-api-access-j2p6q\") pod \"openshift-state-metrics-65f78d5c66-hdvmm\" (UID: \"b9a76923-27f8-4af2-9f09-8c0a69b8691d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hdvmm" Jun 10 11:59:31.299672 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.299618 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2353eea-0296-4a7d-8277-1b6943dc0e34-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-vb5gh\" (UID: \"d2353eea-0296-4a7d-8277-1b6943dc0e34\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-vb5gh" Jun 10 11:59:31.299672 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.299644 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2353eea-0296-4a7d-8277-1b6943dc0e34-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-vb5gh\" (UID: \"d2353eea-0296-4a7d-8277-1b6943dc0e34\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-vb5gh" Jun 10 11:59:31.299824 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.299670 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d2353eea-0296-4a7d-8277-1b6943dc0e34-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-vb5gh\" (UID: \"d2353eea-0296-4a7d-8277-1b6943dc0e34\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-vb5gh" Jun 10 11:59:31.299824 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.299706 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69wfh\" (UniqueName: \"kubernetes.io/projected/d2353eea-0296-4a7d-8277-1b6943dc0e34-kube-api-access-69wfh\") pod \"kube-state-metrics-57bbf8bfb5-vb5gh\" (UID: \"d2353eea-0296-4a7d-8277-1b6943dc0e34\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-vb5gh" Jun 10 11:59:31.299824 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.299741 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9a76923-27f8-4af2-9f09-8c0a69b8691d-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-hdvmm\" (UID: \"b9a76923-27f8-4af2-9f09-8c0a69b8691d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hdvmm" Jun 10 11:59:31.299824 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.299767 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9a76923-27f8-4af2-9f09-8c0a69b8691d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-hdvmm\" (UID: \"b9a76923-27f8-4af2-9f09-8c0a69b8691d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hdvmm" Jun 10 11:59:31.299824 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.299802 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d2353eea-0296-4a7d-8277-1b6943dc0e34-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-vb5gh\" (UID: \"d2353eea-0296-4a7d-8277-1b6943dc0e34\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-vb5gh" Jun 10 11:59:31.300068 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.299877 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d2353eea-0296-4a7d-8277-1b6943dc0e34-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-vb5gh\" (UID: \"d2353eea-0296-4a7d-8277-1b6943dc0e34\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-vb5gh" Jun 10 11:59:31.401253 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.401211 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5929bf2e-5692-45c9-8561-9e479937f7db-sys\") pod \"node-exporter-nprtc\" (UID: \"5929bf2e-5692-45c9-8561-9e479937f7db\") " pod="openshift-monitoring/node-exporter-nprtc" Jun 10 11:59:31.401417 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.401264 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69wfh\" (UniqueName: \"kubernetes.io/projected/d2353eea-0296-4a7d-8277-1b6943dc0e34-kube-api-access-69wfh\") pod \"kube-state-metrics-57bbf8bfb5-vb5gh\" (UID: \"d2353eea-0296-4a7d-8277-1b6943dc0e34\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-vb5gh" Jun 10 11:59:31.401417 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.401289 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5929bf2e-5692-45c9-8561-9e479937f7db-root\") pod \"node-exporter-nprtc\" (UID: \"5929bf2e-5692-45c9-8561-9e479937f7db\") " pod="openshift-monitoring/node-exporter-nprtc" Jun 10 11:59:31.401417 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.401319 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5929bf2e-5692-45c9-8561-9e479937f7db-node-exporter-wtmp\") pod \"node-exporter-nprtc\" (UID: \"5929bf2e-5692-45c9-8561-9e479937f7db\") " pod="openshift-monitoring/node-exporter-nprtc" Jun 10 11:59:31.401417 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.401345 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9a76923-27f8-4af2-9f09-8c0a69b8691d-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-hdvmm\" (UID: \"b9a76923-27f8-4af2-9f09-8c0a69b8691d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hdvmm" Jun 10 11:59:31.401417 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.401369 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9a76923-27f8-4af2-9f09-8c0a69b8691d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-hdvmm\" (UID: \"b9a76923-27f8-4af2-9f09-8c0a69b8691d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hdvmm" Jun 10 11:59:31.401417 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.401392 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5929bf2e-5692-45c9-8561-9e479937f7db-node-exporter-textfile\") pod \"node-exporter-nprtc\" (UID: \"5929bf2e-5692-45c9-8561-9e479937f7db\") " pod="openshift-monitoring/node-exporter-nprtc" Jun 10 11:59:31.401710 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.401420 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5929bf2e-5692-45c9-8561-9e479937f7db-node-exporter-tls\") pod \"node-exporter-nprtc\" (UID: \"5929bf2e-5692-45c9-8561-9e479937f7db\") " pod="openshift-monitoring/node-exporter-nprtc" Jun 10 11:59:31.401710 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.401453 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5929bf2e-5692-45c9-8561-9e479937f7db-node-exporter-accelerators-collector-config\") pod \"node-exporter-nprtc\" (UID: \"5929bf2e-5692-45c9-8561-9e479937f7db\") " pod="openshift-monitoring/node-exporter-nprtc" Jun 10 11:59:31.401710 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.401481 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d2353eea-0296-4a7d-8277-1b6943dc0e34-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-vb5gh\" (UID: \"d2353eea-0296-4a7d-8277-1b6943dc0e34\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-vb5gh" Jun 10 11:59:31.401710 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.401512 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d2353eea-0296-4a7d-8277-1b6943dc0e34-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-vb5gh\" (UID: \"d2353eea-0296-4a7d-8277-1b6943dc0e34\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-vb5gh" Jun 10 11:59:31.401710 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.401543 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b9a76923-27f8-4af2-9f09-8c0a69b8691d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-hdvmm\" (UID: \"b9a76923-27f8-4af2-9f09-8c0a69b8691d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hdvmm" Jun 10 11:59:31.401710 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.401591 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2p6q\" (UniqueName: \"kubernetes.io/projected/b9a76923-27f8-4af2-9f09-8c0a69b8691d-kube-api-access-j2p6q\") pod \"openshift-state-metrics-65f78d5c66-hdvmm\" (UID: \"b9a76923-27f8-4af2-9f09-8c0a69b8691d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hdvmm" Jun 10 11:59:31.401710 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.401619 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5929bf2e-5692-45c9-8561-9e479937f7db-metrics-client-ca\") pod \"node-exporter-nprtc\" (UID: \"5929bf2e-5692-45c9-8561-9e479937f7db\") " pod="openshift-monitoring/node-exporter-nprtc" Jun 10 11:59:31.401710 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.401661 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5929bf2e-5692-45c9-8561-9e479937f7db-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nprtc\" (UID: \"5929bf2e-5692-45c9-8561-9e479937f7db\") " pod="openshift-monitoring/node-exporter-nprtc" Jun 10 11:59:31.401710 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.401703 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2353eea-0296-4a7d-8277-1b6943dc0e34-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-vb5gh\" (UID: \"d2353eea-0296-4a7d-8277-1b6943dc0e34\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-vb5gh" Jun 10 11:59:31.402240 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.401734 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2353eea-0296-4a7d-8277-1b6943dc0e34-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-vb5gh\" (UID: \"d2353eea-0296-4a7d-8277-1b6943dc0e34\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-vb5gh" Jun 10 11:59:31.402240 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.401760 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d2353eea-0296-4a7d-8277-1b6943dc0e34-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-vb5gh\" (UID: \"d2353eea-0296-4a7d-8277-1b6943dc0e34\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-vb5gh" Jun 10 11:59:31.402240 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.401789 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsdq2\" (UniqueName: \"kubernetes.io/projected/5929bf2e-5692-45c9-8561-9e479937f7db-kube-api-access-dsdq2\") pod \"node-exporter-nprtc\" (UID: \"5929bf2e-5692-45c9-8561-9e479937f7db\") " pod="openshift-monitoring/node-exporter-nprtc" Jun 10 11:59:31.402240 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:59:31.401921 2562 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 10 11:59:31.402240 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:59:31.401985 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2353eea-0296-4a7d-8277-1b6943dc0e34-kube-state-metrics-tls podName:d2353eea-0296-4a7d-8277-1b6943dc0e34 nodeName:}" failed. No retries permitted until 2026-06-10 11:59:31.901964779 +0000 UTC m=+80.107715620 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/d2353eea-0296-4a7d-8277-1b6943dc0e34-kube-state-metrics-tls") pod "kube-state-metrics-57bbf8bfb5-vb5gh" (UID: "d2353eea-0296-4a7d-8277-1b6943dc0e34") : secret "kube-state-metrics-tls" not found Jun 10 11:59:31.402644 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.402618 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9a76923-27f8-4af2-9f09-8c0a69b8691d-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-hdvmm\" (UID: \"b9a76923-27f8-4af2-9f09-8c0a69b8691d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hdvmm" Jun 10 11:59:31.403607 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.402919 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2353eea-0296-4a7d-8277-1b6943dc0e34-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-vb5gh\" (UID: \"d2353eea-0296-4a7d-8277-1b6943dc0e34\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-vb5gh" Jun 10 11:59:31.403607 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.403064 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d2353eea-0296-4a7d-8277-1b6943dc0e34-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-vb5gh\" (UID: \"d2353eea-0296-4a7d-8277-1b6943dc0e34\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-vb5gh" Jun 10 11:59:31.403607 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.403565 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d2353eea-0296-4a7d-8277-1b6943dc0e34-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-vb5gh\" (UID: \"d2353eea-0296-4a7d-8277-1b6943dc0e34\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-vb5gh" Jun 10 11:59:31.406099 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.406073 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b9a76923-27f8-4af2-9f09-8c0a69b8691d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-hdvmm\" (UID: \"b9a76923-27f8-4af2-9f09-8c0a69b8691d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hdvmm" Jun 10 11:59:31.406315 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.406294 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d2353eea-0296-4a7d-8277-1b6943dc0e34-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-vb5gh\" (UID: \"d2353eea-0296-4a7d-8277-1b6943dc0e34\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-vb5gh" Jun 10 11:59:31.406480 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.406455 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9a76923-27f8-4af2-9f09-8c0a69b8691d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-hdvmm\" (UID: \"b9a76923-27f8-4af2-9f09-8c0a69b8691d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hdvmm" Jun 10 11:59:31.415470 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.415427 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2p6q\" (UniqueName: \"kubernetes.io/projected/b9a76923-27f8-4af2-9f09-8c0a69b8691d-kube-api-access-j2p6q\") pod \"openshift-state-metrics-65f78d5c66-hdvmm\" (UID: \"b9a76923-27f8-4af2-9f09-8c0a69b8691d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hdvmm" Jun 10 11:59:31.416206 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.416185 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69wfh\" (UniqueName: \"kubernetes.io/projected/d2353eea-0296-4a7d-8277-1b6943dc0e34-kube-api-access-69wfh\") pod \"kube-state-metrics-57bbf8bfb5-vb5gh\" (UID: \"d2353eea-0296-4a7d-8277-1b6943dc0e34\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-vb5gh" Jun 10 11:59:31.502975 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.502889 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsdq2\" (UniqueName: \"kubernetes.io/projected/5929bf2e-5692-45c9-8561-9e479937f7db-kube-api-access-dsdq2\") pod \"node-exporter-nprtc\" (UID: \"5929bf2e-5692-45c9-8561-9e479937f7db\") " pod="openshift-monitoring/node-exporter-nprtc" Jun 10 11:59:31.502975 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.502932 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5929bf2e-5692-45c9-8561-9e479937f7db-sys\") pod \"node-exporter-nprtc\" (UID: \"5929bf2e-5692-45c9-8561-9e479937f7db\") " pod="openshift-monitoring/node-exporter-nprtc" Jun 10 11:59:31.503197 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.502984 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5929bf2e-5692-45c9-8561-9e479937f7db-sys\") pod \"node-exporter-nprtc\" (UID: \"5929bf2e-5692-45c9-8561-9e479937f7db\") " pod="openshift-monitoring/node-exporter-nprtc" Jun 10 11:59:31.503197 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.503032 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5929bf2e-5692-45c9-8561-9e479937f7db-root\") pod \"node-exporter-nprtc\" (UID: \"5929bf2e-5692-45c9-8561-9e479937f7db\") " pod="openshift-monitoring/node-exporter-nprtc" Jun 10 11:59:31.503197 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.503088 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5929bf2e-5692-45c9-8561-9e479937f7db-node-exporter-wtmp\") pod \"node-exporter-nprtc\" (UID: \"5929bf2e-5692-45c9-8561-9e479937f7db\") " pod="openshift-monitoring/node-exporter-nprtc" Jun 10 11:59:31.503197 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.503109 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5929bf2e-5692-45c9-8561-9e479937f7db-node-exporter-textfile\") pod \"node-exporter-nprtc\" (UID: \"5929bf2e-5692-45c9-8561-9e479937f7db\") " pod="openshift-monitoring/node-exporter-nprtc" Jun 10 11:59:31.503197 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.503134 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5929bf2e-5692-45c9-8561-9e479937f7db-node-exporter-tls\") pod \"node-exporter-nprtc\" (UID: \"5929bf2e-5692-45c9-8561-9e479937f7db\") " pod="openshift-monitoring/node-exporter-nprtc" Jun 10 11:59:31.503197 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.503161 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5929bf2e-5692-45c9-8561-9e479937f7db-node-exporter-accelerators-collector-config\") pod \"node-exporter-nprtc\" (UID: \"5929bf2e-5692-45c9-8561-9e479937f7db\") " pod="openshift-monitoring/node-exporter-nprtc" Jun 10 11:59:31.503486 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.503208 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5929bf2e-5692-45c9-8561-9e479937f7db-metrics-client-ca\") pod \"node-exporter-nprtc\" (UID: \"5929bf2e-5692-45c9-8561-9e479937f7db\") " pod="openshift-monitoring/node-exporter-nprtc" Jun 10 11:59:31.503486 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.503245 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5929bf2e-5692-45c9-8561-9e479937f7db-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nprtc\" (UID: \"5929bf2e-5692-45c9-8561-9e479937f7db\") " pod="openshift-monitoring/node-exporter-nprtc" Jun 10 11:59:31.503486 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.503278 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5929bf2e-5692-45c9-8561-9e479937f7db-root\") pod \"node-exporter-nprtc\" (UID: \"5929bf2e-5692-45c9-8561-9e479937f7db\") " pod="openshift-monitoring/node-exporter-nprtc" Jun 10 11:59:31.503486 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:59:31.503364 2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 10 11:59:31.503486 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:59:31.503413 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5929bf2e-5692-45c9-8561-9e479937f7db-node-exporter-tls podName:5929bf2e-5692-45c9-8561-9e479937f7db nodeName:}" failed. No retries permitted until 2026-06-10 11:59:32.00339556 +0000 UTC m=+80.209146384 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/5929bf2e-5692-45c9-8561-9e479937f7db-node-exporter-tls") pod "node-exporter-nprtc" (UID: "5929bf2e-5692-45c9-8561-9e479937f7db") : secret "node-exporter-tls" not found Jun 10 11:59:31.503741 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.503245 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5929bf2e-5692-45c9-8561-9e479937f7db-node-exporter-wtmp\") pod \"node-exporter-nprtc\" (UID: \"5929bf2e-5692-45c9-8561-9e479937f7db\") " pod="openshift-monitoring/node-exporter-nprtc" Jun 10 11:59:31.503741 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.503583 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5929bf2e-5692-45c9-8561-9e479937f7db-node-exporter-textfile\") pod \"node-exporter-nprtc\" (UID: \"5929bf2e-5692-45c9-8561-9e479937f7db\") " pod="openshift-monitoring/node-exporter-nprtc" Jun 10 11:59:31.504272 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.504223 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5929bf2e-5692-45c9-8561-9e479937f7db-metrics-client-ca\") pod \"node-exporter-nprtc\" (UID: \"5929bf2e-5692-45c9-8561-9e479937f7db\") " pod="openshift-monitoring/node-exporter-nprtc" Jun 10 11:59:31.504384 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.504326 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5929bf2e-5692-45c9-8561-9e479937f7db-node-exporter-accelerators-collector-config\") pod \"node-exporter-nprtc\" (UID: \"5929bf2e-5692-45c9-8561-9e479937f7db\") " pod="openshift-monitoring/node-exporter-nprtc" Jun 10 11:59:31.506170 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.506126 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5929bf2e-5692-45c9-8561-9e479937f7db-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nprtc\" (UID: \"5929bf2e-5692-45c9-8561-9e479937f7db\") " pod="openshift-monitoring/node-exporter-nprtc" Jun 10 11:59:31.516188 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.516163 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsdq2\" (UniqueName: \"kubernetes.io/projected/5929bf2e-5692-45c9-8561-9e479937f7db-kube-api-access-dsdq2\") pod \"node-exporter-nprtc\" (UID: \"5929bf2e-5692-45c9-8561-9e479937f7db\") " pod="openshift-monitoring/node-exporter-nprtc" Jun 10 11:59:31.557686 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.557656 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hdvmm" Jun 10 11:59:31.736830 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.736800 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-hdvmm"] Jun 10 11:59:31.739855 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:59:31.739812 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9a76923_27f8_4af2_9f09_8c0a69b8691d.slice/crio-f9e8f89445578cc86ead0bb38bf75a013e8fede71cb6940fa8abacc28b8c8b38 WatchSource:0}: Error finding container f9e8f89445578cc86ead0bb38bf75a013e8fede71cb6940fa8abacc28b8c8b38: Status 404 returned error can't find the container with id f9e8f89445578cc86ead0bb38bf75a013e8fede71cb6940fa8abacc28b8c8b38 Jun 10 11:59:31.908196 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.907813 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2353eea-0296-4a7d-8277-1b6943dc0e34-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-vb5gh\" (UID: \"d2353eea-0296-4a7d-8277-1b6943dc0e34\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-vb5gh" Jun 10 11:59:31.910450 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:31.910423 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2353eea-0296-4a7d-8277-1b6943dc0e34-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-vb5gh\" (UID: \"d2353eea-0296-4a7d-8277-1b6943dc0e34\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-vb5gh" Jun 10 11:59:32.008747 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:32.008660 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5929bf2e-5692-45c9-8561-9e479937f7db-node-exporter-tls\") pod \"node-exporter-nprtc\" (UID: \"5929bf2e-5692-45c9-8561-9e479937f7db\") " pod="openshift-monitoring/node-exporter-nprtc" Jun 10 11:59:32.011152 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:32.011129 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5929bf2e-5692-45c9-8561-9e479937f7db-node-exporter-tls\") pod \"node-exporter-nprtc\" (UID: \"5929bf2e-5692-45c9-8561-9e479937f7db\") " pod="openshift-monitoring/node-exporter-nprtc" Jun 10 11:59:32.166742 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:32.166708 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-vb5gh" Jun 10 11:59:32.178185 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:32.177972 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nprtc" Jun 10 11:59:32.191952 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:59:32.191922 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5929bf2e_5692_45c9_8561_9e479937f7db.slice/crio-16259a68778aec5b75fca6e85ecd9c28b355cb22d595cf67d5d5165e20bf35bb WatchSource:0}: Error finding container 16259a68778aec5b75fca6e85ecd9c28b355cb22d595cf67d5d5165e20bf35bb: Status 404 returned error can't find the container with id 16259a68778aec5b75fca6e85ecd9c28b355cb22d595cf67d5d5165e20bf35bb Jun 10 11:59:32.324848 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:32.324815 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-vb5gh"] Jun 10 11:59:32.328761 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:59:32.328734 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2353eea_0296_4a7d_8277_1b6943dc0e34.slice/crio-10c011964cd147c863d0baa65074c1cb8c1634bdc4bd0baa91bc54aee57161be WatchSource:0}: Error finding container 10c011964cd147c863d0baa65074c1cb8c1634bdc4bd0baa91bc54aee57161be: Status 404 returned error can't find the container with id 10c011964cd147c863d0baa65074c1cb8c1634bdc4bd0baa91bc54aee57161be Jun 10 11:59:32.592298 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:32.592262 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nprtc" event={"ID":"5929bf2e-5692-45c9-8561-9e479937f7db","Type":"ContainerStarted","Data":"16259a68778aec5b75fca6e85ecd9c28b355cb22d595cf67d5d5165e20bf35bb"} Jun 10 11:59:32.593717 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:32.593689 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-vb5gh" event={"ID":"d2353eea-0296-4a7d-8277-1b6943dc0e34","Type":"ContainerStarted","Data":"10c011964cd147c863d0baa65074c1cb8c1634bdc4bd0baa91bc54aee57161be"} Jun 10 11:59:32.596119 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:32.596026 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hdvmm" event={"ID":"b9a76923-27f8-4af2-9f09-8c0a69b8691d","Type":"ContainerStarted","Data":"6520cdab4123b07a2baed4fb7ab3a8c178488f36c56d1ab442a256ef2b718b4a"} Jun 10 11:59:32.596119 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:32.596089 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hdvmm" event={"ID":"b9a76923-27f8-4af2-9f09-8c0a69b8691d","Type":"ContainerStarted","Data":"623694bb47c8ac5aae013b0583f572da657f896a65c988f3b8b535af3aa413eb"} Jun 10 11:59:32.596119 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:32.596118 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hdvmm" event={"ID":"b9a76923-27f8-4af2-9f09-8c0a69b8691d","Type":"ContainerStarted","Data":"f9e8f89445578cc86ead0bb38bf75a013e8fede71cb6940fa8abacc28b8c8b38"} Jun 10 11:59:33.603577 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:33.603531 2562 generic.go:356] "Generic (PLEG): container finished" podID="5929bf2e-5692-45c9-8561-9e479937f7db" containerID="0e868f0d132bcf775337ab23585f60d91d98a8ed81e29dd0039481d86577f15a" exitCode=0 Jun 10 11:59:33.604081 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:33.603628 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nprtc" event={"ID":"5929bf2e-5692-45c9-8561-9e479937f7db","Type":"ContainerDied","Data":"0e868f0d132bcf775337ab23585f60d91d98a8ed81e29dd0039481d86577f15a"} Jun 10 11:59:34.328587 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:34.328546 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-b84f8f49b-h7fxl"] Jun 10 11:59:34.332807 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:34.332785 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-b84f8f49b-h7fxl" Jun 10 11:59:34.336241 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:34.335716 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 10 11:59:34.336241 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:34.336008 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 10 11:59:34.336241 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:34.336026 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 10 11:59:34.336241 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:34.336123 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 10 11:59:34.336521 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:34.336368 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-9g8zq\"" Jun 10 11:59:34.337304 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:34.336860 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-etn3gs9ur0329\"" Jun 10 11:59:34.337304 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:34.337106 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 10 11:59:34.346220 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:34.346198 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-b84f8f49b-h7fxl"] Jun 10 11:59:34.431284 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:34.431248 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/29fd0022-4d61-450f-9074-1d9fa3b9c7be-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-b84f8f49b-h7fxl\" (UID: \"29fd0022-4d61-450f-9074-1d9fa3b9c7be\") " pod="openshift-monitoring/thanos-querier-b84f8f49b-h7fxl" Jun 10 11:59:34.431284 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:34.431296 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/29fd0022-4d61-450f-9074-1d9fa3b9c7be-secret-thanos-querier-tls\") pod \"thanos-querier-b84f8f49b-h7fxl\" (UID: \"29fd0022-4d61-450f-9074-1d9fa3b9c7be\") " pod="openshift-monitoring/thanos-querier-b84f8f49b-h7fxl" Jun 10 11:59:34.431534 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:34.431343 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/29fd0022-4d61-450f-9074-1d9fa3b9c7be-metrics-client-ca\") pod \"thanos-querier-b84f8f49b-h7fxl\" (UID: \"29fd0022-4d61-450f-9074-1d9fa3b9c7be\") " pod="openshift-monitoring/thanos-querier-b84f8f49b-h7fxl" Jun 10 11:59:34.431534 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:34.431364 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/29fd0022-4d61-450f-9074-1d9fa3b9c7be-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-b84f8f49b-h7fxl\" (UID: \"29fd0022-4d61-450f-9074-1d9fa3b9c7be\") " pod="openshift-monitoring/thanos-querier-b84f8f49b-h7fxl" Jun 10 11:59:34.431534 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:34.431386 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hcls\" (UniqueName: \"kubernetes.io/projected/29fd0022-4d61-450f-9074-1d9fa3b9c7be-kube-api-access-2hcls\") pod \"thanos-querier-b84f8f49b-h7fxl\" (UID: \"29fd0022-4d61-450f-9074-1d9fa3b9c7be\") " pod="openshift-monitoring/thanos-querier-b84f8f49b-h7fxl" Jun 10 11:59:34.431534 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:34.431444 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/29fd0022-4d61-450f-9074-1d9fa3b9c7be-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-b84f8f49b-h7fxl\" (UID: \"29fd0022-4d61-450f-9074-1d9fa3b9c7be\") " pod="openshift-monitoring/thanos-querier-b84f8f49b-h7fxl" Jun 10 11:59:34.431534 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:34.431496 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/29fd0022-4d61-450f-9074-1d9fa3b9c7be-secret-grpc-tls\") pod \"thanos-querier-b84f8f49b-h7fxl\" (UID: \"29fd0022-4d61-450f-9074-1d9fa3b9c7be\") " pod="openshift-monitoring/thanos-querier-b84f8f49b-h7fxl" Jun 10 11:59:34.431767 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:34.431548 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/29fd0022-4d61-450f-9074-1d9fa3b9c7be-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-b84f8f49b-h7fxl\" (UID: \"29fd0022-4d61-450f-9074-1d9fa3b9c7be\") " pod="openshift-monitoring/thanos-querier-b84f8f49b-h7fxl" Jun 10 11:59:34.533281 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:34.532667 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hcls\" (UniqueName: \"kubernetes.io/projected/29fd0022-4d61-450f-9074-1d9fa3b9c7be-kube-api-access-2hcls\") pod \"thanos-querier-b84f8f49b-h7fxl\" (UID: \"29fd0022-4d61-450f-9074-1d9fa3b9c7be\") " pod="openshift-monitoring/thanos-querier-b84f8f49b-h7fxl" Jun 10 11:59:34.533281 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:34.532732 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/29fd0022-4d61-450f-9074-1d9fa3b9c7be-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-b84f8f49b-h7fxl\" (UID: \"29fd0022-4d61-450f-9074-1d9fa3b9c7be\") " pod="openshift-monitoring/thanos-querier-b84f8f49b-h7fxl" Jun 10 11:59:34.533281 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:34.532784 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/29fd0022-4d61-450f-9074-1d9fa3b9c7be-secret-grpc-tls\") pod \"thanos-querier-b84f8f49b-h7fxl\" (UID: \"29fd0022-4d61-450f-9074-1d9fa3b9c7be\") " pod="openshift-monitoring/thanos-querier-b84f8f49b-h7fxl" Jun 10 11:59:34.533281 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:34.532908 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/29fd0022-4d61-450f-9074-1d9fa3b9c7be-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-b84f8f49b-h7fxl\" (UID: \"29fd0022-4d61-450f-9074-1d9fa3b9c7be\") " pod="openshift-monitoring/thanos-querier-b84f8f49b-h7fxl" Jun 10 11:59:34.533281 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:34.532980 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/29fd0022-4d61-450f-9074-1d9fa3b9c7be-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-b84f8f49b-h7fxl\" (UID: \"29fd0022-4d61-450f-9074-1d9fa3b9c7be\") " pod="openshift-monitoring/thanos-querier-b84f8f49b-h7fxl" Jun 10 11:59:34.533281 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:34.533008 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/29fd0022-4d61-450f-9074-1d9fa3b9c7be-secret-thanos-querier-tls\") pod \"thanos-querier-b84f8f49b-h7fxl\" (UID: \"29fd0022-4d61-450f-9074-1d9fa3b9c7be\") " pod="openshift-monitoring/thanos-querier-b84f8f49b-h7fxl" Jun 10 11:59:34.533281 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:34.533059 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/29fd0022-4d61-450f-9074-1d9fa3b9c7be-metrics-client-ca\") pod \"thanos-querier-b84f8f49b-h7fxl\" (UID: \"29fd0022-4d61-450f-9074-1d9fa3b9c7be\") " pod="openshift-monitoring/thanos-querier-b84f8f49b-h7fxl" Jun 10 11:59:34.533281 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:34.533089 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/29fd0022-4d61-450f-9074-1d9fa3b9c7be-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-b84f8f49b-h7fxl\" (UID: \"29fd0022-4d61-450f-9074-1d9fa3b9c7be\") " pod="openshift-monitoring/thanos-querier-b84f8f49b-h7fxl" Jun 10 11:59:34.533956 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:34.533924 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/29fd0022-4d61-450f-9074-1d9fa3b9c7be-metrics-client-ca\") pod \"thanos-querier-b84f8f49b-h7fxl\" (UID: \"29fd0022-4d61-450f-9074-1d9fa3b9c7be\") " pod="openshift-monitoring/thanos-querier-b84f8f49b-h7fxl" Jun 10 11:59:34.536732 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:34.536637 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/29fd0022-4d61-450f-9074-1d9fa3b9c7be-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-b84f8f49b-h7fxl\" (UID: \"29fd0022-4d61-450f-9074-1d9fa3b9c7be\") " pod="openshift-monitoring/thanos-querier-b84f8f49b-h7fxl" Jun 10 11:59:34.536732 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:34.536694 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/29fd0022-4d61-450f-9074-1d9fa3b9c7be-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-b84f8f49b-h7fxl\" (UID: \"29fd0022-4d61-450f-9074-1d9fa3b9c7be\") " pod="openshift-monitoring/thanos-querier-b84f8f49b-h7fxl" Jun 10 11:59:34.537275 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:34.537255 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/29fd0022-4d61-450f-9074-1d9fa3b9c7be-secret-grpc-tls\") pod \"thanos-querier-b84f8f49b-h7fxl\" (UID: \"29fd0022-4d61-450f-9074-1d9fa3b9c7be\") " pod="openshift-monitoring/thanos-querier-b84f8f49b-h7fxl" Jun 10 11:59:34.537909 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:34.537497 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/29fd0022-4d61-450f-9074-1d9fa3b9c7be-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-b84f8f49b-h7fxl\" (UID: \"29fd0022-4d61-450f-9074-1d9fa3b9c7be\") " pod="openshift-monitoring/thanos-querier-b84f8f49b-h7fxl" Jun 10 11:59:34.537909 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:34.537672 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/29fd0022-4d61-450f-9074-1d9fa3b9c7be-secret-thanos-querier-tls\") pod \"thanos-querier-b84f8f49b-h7fxl\" (UID: \"29fd0022-4d61-450f-9074-1d9fa3b9c7be\") " pod="openshift-monitoring/thanos-querier-b84f8f49b-h7fxl" Jun 10 11:59:34.537909 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:34.537874 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/29fd0022-4d61-450f-9074-1d9fa3b9c7be-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-b84f8f49b-h7fxl\" (UID: \"29fd0022-4d61-450f-9074-1d9fa3b9c7be\") " pod="openshift-monitoring/thanos-querier-b84f8f49b-h7fxl" Jun 10 11:59:34.543330 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:34.543283 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hcls\" (UniqueName: \"kubernetes.io/projected/29fd0022-4d61-450f-9074-1d9fa3b9c7be-kube-api-access-2hcls\") pod \"thanos-querier-b84f8f49b-h7fxl\" (UID: \"29fd0022-4d61-450f-9074-1d9fa3b9c7be\") " pod="openshift-monitoring/thanos-querier-b84f8f49b-h7fxl" Jun 10 11:59:34.562692 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:34.562669 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4jjmm" Jun 10 11:59:34.624830 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:34.624594 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nprtc" event={"ID":"5929bf2e-5692-45c9-8561-9e479937f7db","Type":"ContainerStarted","Data":"5b424aa1c459e3fce2100a74c9cd1eee4f056f5cdd176bb7170975f97c07190b"} Jun 10 11:59:34.624830 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:34.624723 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nprtc" event={"ID":"5929bf2e-5692-45c9-8561-9e479937f7db","Type":"ContainerStarted","Data":"941eed17e9fa4a75ce7c4bfc8e3fe8bf5872a45fc22db5327c2e25d9bff955e0"} Jun 10 11:59:34.628154 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:34.628110 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-vb5gh" event={"ID":"d2353eea-0296-4a7d-8277-1b6943dc0e34","Type":"ContainerStarted","Data":"f430a83bbc979ac6f69580685eb1bf25a72037437fc0ed19ff348822fc7d08b9"} Jun 10 11:59:34.628299 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:34.628180 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-vb5gh" event={"ID":"d2353eea-0296-4a7d-8277-1b6943dc0e34","Type":"ContainerStarted","Data":"3d61604ade71d2e05d672c42a4fc37498ac8d2defb791798312b775364ba0bcb"} Jun 10 11:59:34.628299 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:34.628221 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-vb5gh" event={"ID":"d2353eea-0296-4a7d-8277-1b6943dc0e34","Type":"ContainerStarted","Data":"0b131be108f268eb8e103a409f7ea6e0b5c18e04f82e587b16fbd05e172a1e23"} Jun 10 11:59:34.631621 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:34.631599 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hdvmm" event={"ID":"b9a76923-27f8-4af2-9f09-8c0a69b8691d","Type":"ContainerStarted","Data":"de7e10cedf79576edb07ba87c0d6ef3ffc80341789f819e828ecdd235161121a"} Jun 10 11:59:34.645723 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:34.645700 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-b84f8f49b-h7fxl" Jun 10 11:59:34.646319 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:34.646274 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-nprtc" podStartSLOduration=2.559398072 podStartE2EDuration="3.646259862s" totalImagesPullingTime="1.008417477s" totalInitContainerRuntime="78.444313ms" isStatefulPod=true podCreationTimestamp="2026-06-10 11:59:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:59:34.645345385 +0000 UTC m=+82.851096230" watchObservedRunningTime="2026-06-10 11:59:34.646259862 +0000 UTC m=+82.852010706" Jun 10 11:59:34.666321 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:34.666267 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-vb5gh" podStartSLOduration=2.041886512 podStartE2EDuration="3.66624689s" totalImagesPullingTime="1.624360378s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:59:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:59:34.665336939 +0000 UTC m=+82.871087785" watchObservedRunningTime="2026-06-10 11:59:34.66624689 +0000 UTC m=+82.871997727" Jun 10 11:59:34.689191 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:34.689139 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hdvmm" podStartSLOduration=1.61313616 podStartE2EDuration="3.689123902s" totalImagesPullingTime="2.075987742s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:59:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:59:34.687594941 +0000 UTC m=+82.893345786" watchObservedRunningTime="2026-06-10 11:59:34.689123902 +0000 UTC m=+82.894874746" Jun 10 11:59:34.818785 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:34.818694 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-b84f8f49b-h7fxl"] Jun 10 11:59:34.822537 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:59:34.822507 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29fd0022_4d61_450f_9074_1d9fa3b9c7be.slice/crio-97a43e65ba4f6bee3c33a45a9d08307d7e64e18d6fa920bec778b46c6f68eef7 WatchSource:0}: Error finding container 97a43e65ba4f6bee3c33a45a9d08307d7e64e18d6fa920bec778b46c6f68eef7: Status 404 returned error can't find the container with id 97a43e65ba4f6bee3c33a45a9d08307d7e64e18d6fa920bec778b46c6f68eef7 Jun 10 11:59:35.638087 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:35.638013 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b84f8f49b-h7fxl" event={"ID":"29fd0022-4d61-450f-9074-1d9fa3b9c7be","Type":"ContainerStarted","Data":"97a43e65ba4f6bee3c33a45a9d08307d7e64e18d6fa920bec778b46c6f68eef7"} Jun 10 11:59:36.462508 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:36.462469 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6d8d7d74bb-4l7zl"] Jun 10 11:59:36.466499 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:36.466472 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6d8d7d74bb-4l7zl" Jun 10 11:59:36.469606 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:36.469408 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 10 11:59:36.469606 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:36.469419 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-nfhck\"" Jun 10 11:59:36.470209 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:36.469819 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 10 11:59:36.470209 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:36.469905 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 10 11:59:36.470209 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:36.470010 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 10 11:59:36.470209 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:36.470108 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 10 11:59:36.476334 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:36.476120 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 10 11:59:36.481353 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:36.481329 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6d8d7d74bb-4l7zl"] Jun 10 11:59:36.553493 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:36.553456 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd63d838-7b1d-4f6a-916d-2af4cd2500c2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6d8d7d74bb-4l7zl\" (UID: \"cd63d838-7b1d-4f6a-916d-2af4cd2500c2\") " pod="openshift-monitoring/telemeter-client-6d8d7d74bb-4l7zl" Jun 10 11:59:36.553645 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:36.553547 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cd63d838-7b1d-4f6a-916d-2af4cd2500c2-secret-telemeter-client\") pod \"telemeter-client-6d8d7d74bb-4l7zl\" (UID: \"cd63d838-7b1d-4f6a-916d-2af4cd2500c2\") " pod="openshift-monitoring/telemeter-client-6d8d7d74bb-4l7zl" Jun 10 11:59:36.553645 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:36.553581 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd63d838-7b1d-4f6a-916d-2af4cd2500c2-metrics-client-ca\") pod \"telemeter-client-6d8d7d74bb-4l7zl\" (UID: \"cd63d838-7b1d-4f6a-916d-2af4cd2500c2\") " pod="openshift-monitoring/telemeter-client-6d8d7d74bb-4l7zl" Jun 10 11:59:36.553645 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:36.553606 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cd63d838-7b1d-4f6a-916d-2af4cd2500c2-telemeter-client-tls\") pod \"telemeter-client-6d8d7d74bb-4l7zl\" (UID: \"cd63d838-7b1d-4f6a-916d-2af4cd2500c2\") " pod="openshift-monitoring/telemeter-client-6d8d7d74bb-4l7zl" Jun 10 11:59:36.553645 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:36.553625 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd63d838-7b1d-4f6a-916d-2af4cd2500c2-serving-certs-ca-bundle\") pod \"telemeter-client-6d8d7d74bb-4l7zl\" (UID: \"cd63d838-7b1d-4f6a-916d-2af4cd2500c2\") " pod="openshift-monitoring/telemeter-client-6d8d7d74bb-4l7zl" Jun 10 11:59:36.553876 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:36.553656 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cd63d838-7b1d-4f6a-916d-2af4cd2500c2-federate-client-tls\") pod \"telemeter-client-6d8d7d74bb-4l7zl\" (UID: \"cd63d838-7b1d-4f6a-916d-2af4cd2500c2\") " pod="openshift-monitoring/telemeter-client-6d8d7d74bb-4l7zl" Jun 10 11:59:36.553876 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:36.553706 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cd63d838-7b1d-4f6a-916d-2af4cd2500c2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6d8d7d74bb-4l7zl\" (UID: \"cd63d838-7b1d-4f6a-916d-2af4cd2500c2\") " pod="openshift-monitoring/telemeter-client-6d8d7d74bb-4l7zl" Jun 10 11:59:36.553876 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:36.553750 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mhgf\" (UniqueName: \"kubernetes.io/projected/cd63d838-7b1d-4f6a-916d-2af4cd2500c2-kube-api-access-9mhgf\") pod \"telemeter-client-6d8d7d74bb-4l7zl\" (UID: \"cd63d838-7b1d-4f6a-916d-2af4cd2500c2\") " pod="openshift-monitoring/telemeter-client-6d8d7d74bb-4l7zl" Jun 10 11:59:36.655133 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:36.655099 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd63d838-7b1d-4f6a-916d-2af4cd2500c2-serving-certs-ca-bundle\") pod \"telemeter-client-6d8d7d74bb-4l7zl\" (UID: \"cd63d838-7b1d-4f6a-916d-2af4cd2500c2\") " pod="openshift-monitoring/telemeter-client-6d8d7d74bb-4l7zl" Jun 10 11:59:36.655559 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:36.655148 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cd63d838-7b1d-4f6a-916d-2af4cd2500c2-federate-client-tls\") pod \"telemeter-client-6d8d7d74bb-4l7zl\" (UID: \"cd63d838-7b1d-4f6a-916d-2af4cd2500c2\") " pod="openshift-monitoring/telemeter-client-6d8d7d74bb-4l7zl" Jun 10 11:59:36.655559 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:36.655181 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cd63d838-7b1d-4f6a-916d-2af4cd2500c2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6d8d7d74bb-4l7zl\" (UID: \"cd63d838-7b1d-4f6a-916d-2af4cd2500c2\") " pod="openshift-monitoring/telemeter-client-6d8d7d74bb-4l7zl" Jun 10 11:59:36.655559 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:36.655209 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mhgf\" (UniqueName: \"kubernetes.io/projected/cd63d838-7b1d-4f6a-916d-2af4cd2500c2-kube-api-access-9mhgf\") pod \"telemeter-client-6d8d7d74bb-4l7zl\" (UID: \"cd63d838-7b1d-4f6a-916d-2af4cd2500c2\") " pod="openshift-monitoring/telemeter-client-6d8d7d74bb-4l7zl" Jun 10 11:59:36.655559 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:36.655254 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd63d838-7b1d-4f6a-916d-2af4cd2500c2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6d8d7d74bb-4l7zl\" (UID: \"cd63d838-7b1d-4f6a-916d-2af4cd2500c2\") " pod="openshift-monitoring/telemeter-client-6d8d7d74bb-4l7zl" Jun 10 11:59:36.655559 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:36.655331 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cd63d838-7b1d-4f6a-916d-2af4cd2500c2-secret-telemeter-client\") pod \"telemeter-client-6d8d7d74bb-4l7zl\" (UID: \"cd63d838-7b1d-4f6a-916d-2af4cd2500c2\") " pod="openshift-monitoring/telemeter-client-6d8d7d74bb-4l7zl" Jun 10 11:59:36.655559 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:36.655358 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd63d838-7b1d-4f6a-916d-2af4cd2500c2-metrics-client-ca\") pod \"telemeter-client-6d8d7d74bb-4l7zl\" (UID: \"cd63d838-7b1d-4f6a-916d-2af4cd2500c2\") " pod="openshift-monitoring/telemeter-client-6d8d7d74bb-4l7zl" Jun 10 11:59:36.655559 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:36.655383 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cd63d838-7b1d-4f6a-916d-2af4cd2500c2-telemeter-client-tls\") pod \"telemeter-client-6d8d7d74bb-4l7zl\" (UID: \"cd63d838-7b1d-4f6a-916d-2af4cd2500c2\") " pod="openshift-monitoring/telemeter-client-6d8d7d74bb-4l7zl" Jun 10 11:59:36.655960 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:36.655919 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd63d838-7b1d-4f6a-916d-2af4cd2500c2-serving-certs-ca-bundle\") pod \"telemeter-client-6d8d7d74bb-4l7zl\" (UID: \"cd63d838-7b1d-4f6a-916d-2af4cd2500c2\") " pod="openshift-monitoring/telemeter-client-6d8d7d74bb-4l7zl" Jun 10 11:59:36.656192 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:36.656164 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd63d838-7b1d-4f6a-916d-2af4cd2500c2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6d8d7d74bb-4l7zl\" (UID: \"cd63d838-7b1d-4f6a-916d-2af4cd2500c2\") " pod="openshift-monitoring/telemeter-client-6d8d7d74bb-4l7zl" Jun 10 11:59:36.656286 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:36.656259 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd63d838-7b1d-4f6a-916d-2af4cd2500c2-metrics-client-ca\") pod \"telemeter-client-6d8d7d74bb-4l7zl\" (UID: \"cd63d838-7b1d-4f6a-916d-2af4cd2500c2\") " pod="openshift-monitoring/telemeter-client-6d8d7d74bb-4l7zl" Jun 10 11:59:36.658067 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:36.658023 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cd63d838-7b1d-4f6a-916d-2af4cd2500c2-federate-client-tls\") pod \"telemeter-client-6d8d7d74bb-4l7zl\" (UID: \"cd63d838-7b1d-4f6a-916d-2af4cd2500c2\") " pod="openshift-monitoring/telemeter-client-6d8d7d74bb-4l7zl" Jun 10 11:59:36.658217 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:36.658193 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cd63d838-7b1d-4f6a-916d-2af4cd2500c2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6d8d7d74bb-4l7zl\" (UID: \"cd63d838-7b1d-4f6a-916d-2af4cd2500c2\") " pod="openshift-monitoring/telemeter-client-6d8d7d74bb-4l7zl" Jun 10 11:59:36.659057 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:36.659024 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cd63d838-7b1d-4f6a-916d-2af4cd2500c2-telemeter-client-tls\") pod \"telemeter-client-6d8d7d74bb-4l7zl\" (UID: \"cd63d838-7b1d-4f6a-916d-2af4cd2500c2\") " pod="openshift-monitoring/telemeter-client-6d8d7d74bb-4l7zl" Jun 10 11:59:36.659817 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:36.659781 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cd63d838-7b1d-4f6a-916d-2af4cd2500c2-secret-telemeter-client\") pod \"telemeter-client-6d8d7d74bb-4l7zl\" (UID: \"cd63d838-7b1d-4f6a-916d-2af4cd2500c2\") " pod="openshift-monitoring/telemeter-client-6d8d7d74bb-4l7zl" Jun 10 11:59:36.671312 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:36.671283 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mhgf\" (UniqueName: \"kubernetes.io/projected/cd63d838-7b1d-4f6a-916d-2af4cd2500c2-kube-api-access-9mhgf\") pod \"telemeter-client-6d8d7d74bb-4l7zl\" (UID: \"cd63d838-7b1d-4f6a-916d-2af4cd2500c2\") " pod="openshift-monitoring/telemeter-client-6d8d7d74bb-4l7zl" Jun 10 11:59:36.781770 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:36.781680 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6d8d7d74bb-4l7zl" Jun 10 11:59:37.030025 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.029985 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6d8d7d74bb-4l7zl"] Jun 10 11:59:37.035236 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:59:37.035212 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd63d838_7b1d_4f6a_916d_2af4cd2500c2.slice/crio-94e0f43704ce923c2b02829da7377006c3b92eba245ef07920e6676a0a9b2019 WatchSource:0}: Error finding container 94e0f43704ce923c2b02829da7377006c3b92eba245ef07920e6676a0a9b2019: Status 404 returned error can't find the container with id 94e0f43704ce923c2b02829da7377006c3b92eba245ef07920e6676a0a9b2019 Jun 10 11:59:37.590984 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.590942 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 11:59:37.595060 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.595019 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.597720 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.597687 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 10 11:59:37.597822 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.597689 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 10 11:59:37.598312 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.598290 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 10 11:59:37.598976 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.598953 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-ltznw\"" Jun 10 11:59:37.599422 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.599319 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 10 11:59:37.599422 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.599363 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 10 11:59:37.599422 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.599413 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 10 11:59:37.599579 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.599363 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 10 11:59:37.599579 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.599573 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 10 11:59:37.600188 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.600166 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 10 11:59:37.600295 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.600190 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 10 11:59:37.600383 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.600365 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 10 11:59:37.600461 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.600384 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 10 11:59:37.600677 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.600638 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 10 11:59:37.600921 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.600902 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-99rlht9fdlhgl\"" Jun 10 11:59:37.603021 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.602981 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 10 11:59:37.606142 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.606118 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 10 11:59:37.614179 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.614153 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 11:59:37.650321 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.650235 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b84f8f49b-h7fxl" event={"ID":"29fd0022-4d61-450f-9074-1d9fa3b9c7be","Type":"ContainerStarted","Data":"0ce55cf5cd1d349e40d9450b3589e94f950cf7860a9a25830cafd1c1a894a886"} Jun 10 11:59:37.650321 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.650304 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b84f8f49b-h7fxl" event={"ID":"29fd0022-4d61-450f-9074-1d9fa3b9c7be","Type":"ContainerStarted","Data":"8aec1f8ec8152c41094b6ac14da6d278c7eafb0b43f90f01ff61092ff3c74abe"} Jun 10 11:59:37.650527 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.650338 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b84f8f49b-h7fxl" event={"ID":"29fd0022-4d61-450f-9074-1d9fa3b9c7be","Type":"ContainerStarted","Data":"2a3978820a9abe0a9ef4e71993d2668cd3623151ed3285293b02e00b1846f30a"} Jun 10 11:59:37.651401 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.651381 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6d8d7d74bb-4l7zl" event={"ID":"cd63d838-7b1d-4f6a-916d-2af4cd2500c2","Type":"ContainerStarted","Data":"94e0f43704ce923c2b02829da7377006c3b92eba245ef07920e6676a0a9b2019"} Jun 10 11:59:37.767288 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.767253 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/200272f0-7d1b-4e29-945a-07d6a59cd605-config\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.767288 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.767296 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/200272f0-7d1b-4e29-945a-07d6a59cd605-config-out\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.767833 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.767322 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/200272f0-7d1b-4e29-945a-07d6a59cd605-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.767833 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.767343 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/200272f0-7d1b-4e29-945a-07d6a59cd605-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.767833 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.767366 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/200272f0-7d1b-4e29-945a-07d6a59cd605-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.767833 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.767392 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/200272f0-7d1b-4e29-945a-07d6a59cd605-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.767833 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.767417 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tgvf\" (UniqueName: \"kubernetes.io/projected/200272f0-7d1b-4e29-945a-07d6a59cd605-kube-api-access-2tgvf\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.767833 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.767435 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/200272f0-7d1b-4e29-945a-07d6a59cd605-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.767833 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.767489 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/200272f0-7d1b-4e29-945a-07d6a59cd605-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.767833 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.767515 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/200272f0-7d1b-4e29-945a-07d6a59cd605-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.767833 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.767561 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/200272f0-7d1b-4e29-945a-07d6a59cd605-web-config\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.767833 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.767620 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/200272f0-7d1b-4e29-945a-07d6a59cd605-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.767833 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.767657 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/200272f0-7d1b-4e29-945a-07d6a59cd605-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.767833 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.767682 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/200272f0-7d1b-4e29-945a-07d6a59cd605-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.767833 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.767725 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/200272f0-7d1b-4e29-945a-07d6a59cd605-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.767833 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.767764 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/200272f0-7d1b-4e29-945a-07d6a59cd605-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.768494 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.767851 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/200272f0-7d1b-4e29-945a-07d6a59cd605-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.768494 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.767888 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/200272f0-7d1b-4e29-945a-07d6a59cd605-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.768494 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.767916 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/200272f0-7d1b-4e29-945a-07d6a59cd605-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.768494 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.767956 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/200272f0-7d1b-4e29-945a-07d6a59cd605-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.869261 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.869224 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/200272f0-7d1b-4e29-945a-07d6a59cd605-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.869397 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.869264 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/200272f0-7d1b-4e29-945a-07d6a59cd605-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.869397 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.869290 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/200272f0-7d1b-4e29-945a-07d6a59cd605-web-config\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.869397 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.869315 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/200272f0-7d1b-4e29-945a-07d6a59cd605-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.869540 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.869396 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/200272f0-7d1b-4e29-945a-07d6a59cd605-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.869540 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.869435 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/200272f0-7d1b-4e29-945a-07d6a59cd605-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.869540 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.869470 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/200272f0-7d1b-4e29-945a-07d6a59cd605-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.869540 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.869509 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/200272f0-7d1b-4e29-945a-07d6a59cd605-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.869732 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.869571 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/200272f0-7d1b-4e29-945a-07d6a59cd605-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.869732 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.869591 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/200272f0-7d1b-4e29-945a-07d6a59cd605-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.869732 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.869610 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/200272f0-7d1b-4e29-945a-07d6a59cd605-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.869732 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.869627 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/200272f0-7d1b-4e29-945a-07d6a59cd605-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.869732 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.869643 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/200272f0-7d1b-4e29-945a-07d6a59cd605-config\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.869732 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.869662 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/200272f0-7d1b-4e29-945a-07d6a59cd605-config-out\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.869732 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.869681 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/200272f0-7d1b-4e29-945a-07d6a59cd605-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.871377 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.870072 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/200272f0-7d1b-4e29-945a-07d6a59cd605-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.871377 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.870295 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/200272f0-7d1b-4e29-945a-07d6a59cd605-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.871377 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.870727 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/200272f0-7d1b-4e29-945a-07d6a59cd605-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.872957 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.872861 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/200272f0-7d1b-4e29-945a-07d6a59cd605-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.872957 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.872950 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/200272f0-7d1b-4e29-945a-07d6a59cd605-config\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.873356 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.873313 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/200272f0-7d1b-4e29-945a-07d6a59cd605-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.873437 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.873376 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/200272f0-7d1b-4e29-945a-07d6a59cd605-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.873492 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.873435 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/200272f0-7d1b-4e29-945a-07d6a59cd605-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.873492 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.873462 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/200272f0-7d1b-4e29-945a-07d6a59cd605-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.873595 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.873491 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/200272f0-7d1b-4e29-945a-07d6a59cd605-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.873595 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.873521 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tgvf\" (UniqueName: \"kubernetes.io/projected/200272f0-7d1b-4e29-945a-07d6a59cd605-kube-api-access-2tgvf\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.873595 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.873549 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/200272f0-7d1b-4e29-945a-07d6a59cd605-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.873876 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.873842 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/200272f0-7d1b-4e29-945a-07d6a59cd605-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.874160 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.874139 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/200272f0-7d1b-4e29-945a-07d6a59cd605-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.874997 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.874447 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/200272f0-7d1b-4e29-945a-07d6a59cd605-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.875142 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.874465 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/200272f0-7d1b-4e29-945a-07d6a59cd605-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.875256 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.874856 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/200272f0-7d1b-4e29-945a-07d6a59cd605-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.875542 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.875513 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/200272f0-7d1b-4e29-945a-07d6a59cd605-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.875633 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.875597 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/200272f0-7d1b-4e29-945a-07d6a59cd605-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.876220 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.876176 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/200272f0-7d1b-4e29-945a-07d6a59cd605-config-out\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.876404 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.876382 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/200272f0-7d1b-4e29-945a-07d6a59cd605-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.876873 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.876825 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/200272f0-7d1b-4e29-945a-07d6a59cd605-web-config\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.877669 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.877646 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/200272f0-7d1b-4e29-945a-07d6a59cd605-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.878851 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.878830 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/200272f0-7d1b-4e29-945a-07d6a59cd605-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.889376 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.889358 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tgvf\" (UniqueName: \"kubernetes.io/projected/200272f0-7d1b-4e29-945a-07d6a59cd605-kube-api-access-2tgvf\") pod \"prometheus-k8s-0\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:37.907807 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:37.907782 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:38.095026 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:38.094172 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 11:59:38.095583 ip-10-0-139-86 kubenswrapper[2562]: W0610 11:59:38.095555 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod200272f0_7d1b_4e29_945a_07d6a59cd605.slice/crio-02ed611c3a09163bc317357cb682515d1b0ee7ea6524e9583e9db5bf0416ebd8 WatchSource:0}: Error finding container 02ed611c3a09163bc317357cb682515d1b0ee7ea6524e9583e9db5bf0416ebd8: Status 404 returned error can't find the container with id 02ed611c3a09163bc317357cb682515d1b0ee7ea6524e9583e9db5bf0416ebd8 Jun 10 11:59:38.662786 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:38.662592 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b84f8f49b-h7fxl" event={"ID":"29fd0022-4d61-450f-9074-1d9fa3b9c7be","Type":"ContainerStarted","Data":"20a0067eb978c907cd452ba88cf33a77fcab8ff263230bbf60319bfaa34a80c2"} Jun 10 11:59:38.662786 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:38.662679 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b84f8f49b-h7fxl" event={"ID":"29fd0022-4d61-450f-9074-1d9fa3b9c7be","Type":"ContainerStarted","Data":"5ada687e00e023edfb674be637558d2b1b8914b5943842e442cc33ef08376b35"} Jun 10 11:59:38.662786 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:38.662719 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b84f8f49b-h7fxl" event={"ID":"29fd0022-4d61-450f-9074-1d9fa3b9c7be","Type":"ContainerStarted","Data":"cd743f62ce5208db311fb41faa3240b1905c846aada22c4b0d50bf1678c79b65"} Jun 10 11:59:38.663224 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:38.663151 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-b84f8f49b-h7fxl" Jun 10 11:59:38.665266 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:38.665238 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"200272f0-7d1b-4e29-945a-07d6a59cd605","Type":"ContainerStarted","Data":"02ed611c3a09163bc317357cb682515d1b0ee7ea6524e9583e9db5bf0416ebd8"} Jun 10 11:59:38.689939 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:38.689885 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-b84f8f49b-h7fxl" podStartSLOduration=1.909634252 podStartE2EDuration="4.689871705s" totalImagesPullingTime="2.780237453s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:59:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:59:38.687534244 +0000 UTC m=+86.893285092" watchObservedRunningTime="2026-06-10 11:59:38.689871705 +0000 UTC m=+86.895622548" Jun 10 11:59:40.676389 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:40.676349 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6d8d7d74bb-4l7zl" event={"ID":"cd63d838-7b1d-4f6a-916d-2af4cd2500c2","Type":"ContainerStarted","Data":"1c732f93c67a7027eac11b086ea468a4f2e158e2814f44b078805c5431740210"} Jun 10 11:59:40.676890 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:40.676425 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6d8d7d74bb-4l7zl" event={"ID":"cd63d838-7b1d-4f6a-916d-2af4cd2500c2","Type":"ContainerStarted","Data":"f6cfd0d016e81929d9a06e048900d6b6756cda1043a890869735051ed6c24792"} Jun 10 11:59:40.676890 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:40.676451 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6d8d7d74bb-4l7zl" event={"ID":"cd63d838-7b1d-4f6a-916d-2af4cd2500c2","Type":"ContainerStarted","Data":"9f600f4fce66f6efc1f15f2aabe9c044af14b58c4c1144644eab4db388e0db19"} Jun 10 11:59:40.678020 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:40.677989 2562 generic.go:356] "Generic (PLEG): container finished" podID="200272f0-7d1b-4e29-945a-07d6a59cd605" containerID="6c8e0f855464730bc21484b33e8126b397f24264da9afd03b67dba0a41263a39" exitCode=0 Jun 10 11:59:40.678146 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:40.678077 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"200272f0-7d1b-4e29-945a-07d6a59cd605","Type":"ContainerDied","Data":"6c8e0f855464730bc21484b33e8126b397f24264da9afd03b67dba0a41263a39"} Jun 10 11:59:40.708177 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:40.708131 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6d8d7d74bb-4l7zl" podStartSLOduration=2.114452754 podStartE2EDuration="4.708112891s" totalImagesPullingTime="2.593660137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:59:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:59:40.705576684 +0000 UTC m=+88.911327528" watchObservedRunningTime="2026-06-10 11:59:40.708112891 +0000 UTC m=+88.913863736" Jun 10 11:59:41.534545 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:41.534517 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5b76d48b49-6dtdw" Jun 10 11:59:44.676402 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:44.676371 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-b84f8f49b-h7fxl" Jun 10 11:59:46.549867 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:46.549802 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5b76d48b49-6dtdw" podUID="a914f89a-e48e-44d6-8655-b019b5ab1f47" containerName="registry" containerID="cri-o://e85faf11167ba4571d6965a67908eb50655f9d919e28458fcd88dc985dfa3a42" gracePeriod=30 Jun 10 11:59:47.698112 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:47.698079 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b76d48b49-6dtdw" Jun 10 11:59:47.711967 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:47.711937 2562 generic.go:356] "Generic (PLEG): container finished" podID="a914f89a-e48e-44d6-8655-b019b5ab1f47" containerID="e85faf11167ba4571d6965a67908eb50655f9d919e28458fcd88dc985dfa3a42" exitCode=0 Jun 10 11:59:47.712148 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:47.711981 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b76d48b49-6dtdw" Jun 10 11:59:47.712148 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:47.711989 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b76d48b49-6dtdw" event={"ID":"a914f89a-e48e-44d6-8655-b019b5ab1f47","Type":"ContainerDied","Data":"e85faf11167ba4571d6965a67908eb50655f9d919e28458fcd88dc985dfa3a42"} Jun 10 11:59:47.712148 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:47.712033 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b76d48b49-6dtdw" event={"ID":"a914f89a-e48e-44d6-8655-b019b5ab1f47","Type":"ContainerDied","Data":"7bbeed86626a26d39d517e1a44835ce32054da3d19162210fc94b25b36ed1fe1"} Jun 10 11:59:47.712148 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:47.712075 2562 scope.go:117] "RemoveContainer" containerID="e85faf11167ba4571d6965a67908eb50655f9d919e28458fcd88dc985dfa3a42" Jun 10 11:59:47.771734 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:47.771702 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a914f89a-e48e-44d6-8655-b019b5ab1f47-ca-trust-extracted\") pod \"a914f89a-e48e-44d6-8655-b019b5ab1f47\" (UID: \"a914f89a-e48e-44d6-8655-b019b5ab1f47\") " Jun 10 11:59:47.771901 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:47.771744 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a914f89a-e48e-44d6-8655-b019b5ab1f47-image-registry-private-configuration\") pod \"a914f89a-e48e-44d6-8655-b019b5ab1f47\" (UID: \"a914f89a-e48e-44d6-8655-b019b5ab1f47\") " Jun 10 11:59:47.771901 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:47.771773 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a914f89a-e48e-44d6-8655-b019b5ab1f47-trusted-ca\") pod \"a914f89a-e48e-44d6-8655-b019b5ab1f47\" (UID: \"a914f89a-e48e-44d6-8655-b019b5ab1f47\") " Jun 10 11:59:47.771901 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:47.771809 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a914f89a-e48e-44d6-8655-b019b5ab1f47-bound-sa-token\") pod \"a914f89a-e48e-44d6-8655-b019b5ab1f47\" (UID: \"a914f89a-e48e-44d6-8655-b019b5ab1f47\") " Jun 10 11:59:47.771901 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:47.771834 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hwdxv\" (UniqueName: \"kubernetes.io/projected/a914f89a-e48e-44d6-8655-b019b5ab1f47-kube-api-access-hwdxv\") pod \"a914f89a-e48e-44d6-8655-b019b5ab1f47\" (UID: \"a914f89a-e48e-44d6-8655-b019b5ab1f47\") " Jun 10 11:59:47.771901 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:47.771869 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a914f89a-e48e-44d6-8655-b019b5ab1f47-installation-pull-secrets\") pod \"a914f89a-e48e-44d6-8655-b019b5ab1f47\" (UID: \"a914f89a-e48e-44d6-8655-b019b5ab1f47\") " Jun 10 11:59:47.772177 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:47.771905 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a914f89a-e48e-44d6-8655-b019b5ab1f47-registry-certificates\") pod \"a914f89a-e48e-44d6-8655-b019b5ab1f47\" (UID: \"a914f89a-e48e-44d6-8655-b019b5ab1f47\") " Jun 10 11:59:47.772177 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:47.771953 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a914f89a-e48e-44d6-8655-b019b5ab1f47-registry-tls\") pod \"a914f89a-e48e-44d6-8655-b019b5ab1f47\" (UID: \"a914f89a-e48e-44d6-8655-b019b5ab1f47\") " Jun 10 11:59:47.772375 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:47.772349 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a914f89a-e48e-44d6-8655-b019b5ab1f47-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "a914f89a-e48e-44d6-8655-b019b5ab1f47" (UID: "a914f89a-e48e-44d6-8655-b019b5ab1f47"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 11:59:47.772656 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:47.772612 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a914f89a-e48e-44d6-8655-b019b5ab1f47-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "a914f89a-e48e-44d6-8655-b019b5ab1f47" (UID: "a914f89a-e48e-44d6-8655-b019b5ab1f47"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 11:59:47.774491 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:47.774460 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a914f89a-e48e-44d6-8655-b019b5ab1f47-kube-api-access-hwdxv" (OuterVolumeSpecName: "kube-api-access-hwdxv") pod "a914f89a-e48e-44d6-8655-b019b5ab1f47" (UID: "a914f89a-e48e-44d6-8655-b019b5ab1f47"). InnerVolumeSpecName "kube-api-access-hwdxv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:59:47.774577 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:47.774485 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a914f89a-e48e-44d6-8655-b019b5ab1f47-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "a914f89a-e48e-44d6-8655-b019b5ab1f47" (UID: "a914f89a-e48e-44d6-8655-b019b5ab1f47"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 11:59:47.774577 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:47.774521 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a914f89a-e48e-44d6-8655-b019b5ab1f47-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "a914f89a-e48e-44d6-8655-b019b5ab1f47" (UID: "a914f89a-e48e-44d6-8655-b019b5ab1f47"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:59:47.774698 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:47.774568 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a914f89a-e48e-44d6-8655-b019b5ab1f47-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "a914f89a-e48e-44d6-8655-b019b5ab1f47" (UID: "a914f89a-e48e-44d6-8655-b019b5ab1f47"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 11:59:47.774783 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:47.774698 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a914f89a-e48e-44d6-8655-b019b5ab1f47-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a914f89a-e48e-44d6-8655-b019b5ab1f47" (UID: "a914f89a-e48e-44d6-8655-b019b5ab1f47"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:59:47.780058 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:47.780025 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a914f89a-e48e-44d6-8655-b019b5ab1f47-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "a914f89a-e48e-44d6-8655-b019b5ab1f47" (UID: "a914f89a-e48e-44d6-8655-b019b5ab1f47"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 11:59:47.873265 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:47.873231 2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a914f89a-e48e-44d6-8655-b019b5ab1f47-registry-tls\") on node \"ip-10-0-139-86.ec2.internal\" DevicePath \"\"" Jun 10 11:59:47.873265 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:47.873261 2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a914f89a-e48e-44d6-8655-b019b5ab1f47-ca-trust-extracted\") on node \"ip-10-0-139-86.ec2.internal\" DevicePath \"\"" Jun 10 11:59:47.873265 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:47.873272 2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a914f89a-e48e-44d6-8655-b019b5ab1f47-image-registry-private-configuration\") on node \"ip-10-0-139-86.ec2.internal\" DevicePath \"\"" Jun 10 11:59:47.873493 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:47.873282 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a914f89a-e48e-44d6-8655-b019b5ab1f47-trusted-ca\") on node \"ip-10-0-139-86.ec2.internal\" DevicePath \"\"" Jun 10 11:59:47.873493 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:47.873291 2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a914f89a-e48e-44d6-8655-b019b5ab1f47-bound-sa-token\") on node \"ip-10-0-139-86.ec2.internal\" DevicePath \"\"" Jun 10 11:59:47.873493 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:47.873298 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwdxv\" (UniqueName: \"kubernetes.io/projected/a914f89a-e48e-44d6-8655-b019b5ab1f47-kube-api-access-hwdxv\") on node \"ip-10-0-139-86.ec2.internal\" DevicePath \"\"" Jun 10 11:59:47.873493 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:47.873307 2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a914f89a-e48e-44d6-8655-b019b5ab1f47-installation-pull-secrets\") on node \"ip-10-0-139-86.ec2.internal\" DevicePath \"\"" Jun 10 11:59:47.873493 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:47.873315 2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a914f89a-e48e-44d6-8655-b019b5ab1f47-registry-certificates\") on node \"ip-10-0-139-86.ec2.internal\" DevicePath \"\"" Jun 10 11:59:47.939528 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:47.939507 2562 scope.go:117] "RemoveContainer" containerID="e85faf11167ba4571d6965a67908eb50655f9d919e28458fcd88dc985dfa3a42" Jun 10 11:59:47.939933 ip-10-0-139-86 kubenswrapper[2562]: E0610 11:59:47.939848 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e85faf11167ba4571d6965a67908eb50655f9d919e28458fcd88dc985dfa3a42\": container with ID starting with e85faf11167ba4571d6965a67908eb50655f9d919e28458fcd88dc985dfa3a42 not found: ID does not exist" containerID="e85faf11167ba4571d6965a67908eb50655f9d919e28458fcd88dc985dfa3a42" Jun 10 11:59:47.939933 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:47.939887 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e85faf11167ba4571d6965a67908eb50655f9d919e28458fcd88dc985dfa3a42"} err="failed to get container status \"e85faf11167ba4571d6965a67908eb50655f9d919e28458fcd88dc985dfa3a42\": rpc error: code = NotFound desc = could not find container \"e85faf11167ba4571d6965a67908eb50655f9d919e28458fcd88dc985dfa3a42\": container with ID starting with e85faf11167ba4571d6965a67908eb50655f9d919e28458fcd88dc985dfa3a42 not found: ID does not exist" Jun 10 11:59:48.047081 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:48.047021 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5b76d48b49-6dtdw"] Jun 10 11:59:48.053945 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:48.053919 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5b76d48b49-6dtdw"] Jun 10 11:59:48.244807 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:48.244727 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a914f89a-e48e-44d6-8655-b019b5ab1f47" path="/var/lib/kubelet/pods/a914f89a-e48e-44d6-8655-b019b5ab1f47/volumes" Jun 10 11:59:48.726704 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:48.726656 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-wzc9g" event={"ID":"05d0c844-384f-4af1-92c1-27b075cb581c","Type":"ContainerStarted","Data":"5f587d5a53973e9374f9068f86c15308563832fe424737749dca8c00142dd7ff"} Jun 10 11:59:48.727634 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:48.727565 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-wzc9g" Jun 10 11:59:48.743513 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:48.743389 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-wzc9g" Jun 10 11:59:48.753851 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:48.753805 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-wzc9g" podStartSLOduration=1.518350418 podStartE2EDuration="19.753774356s" totalImagesPullingTime="18.235423938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:59:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:59:48.75198688 +0000 UTC m=+96.957737725" watchObservedRunningTime="2026-06-10 11:59:48.753774356 +0000 UTC m=+96.959525201" Jun 10 11:59:52.749469 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:52.749426 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"200272f0-7d1b-4e29-945a-07d6a59cd605","Type":"ContainerStarted","Data":"e86053a640384e02b103d284737ba62d7a3a8a8cf7c1c15252c1e84d558b8bc4"} Jun 10 11:59:52.749931 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:52.749511 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"200272f0-7d1b-4e29-945a-07d6a59cd605","Type":"ContainerStarted","Data":"737fd032ab2e8bab532885f445a231a2c738f72618c5a38006964e7c36097161"} Jun 10 11:59:52.749931 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:52.749549 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"200272f0-7d1b-4e29-945a-07d6a59cd605","Type":"ContainerStarted","Data":"1f3a5702b04d738be1bbe4c9d5b96f2df844fe584839fa1632e7ecf214cd7862"} Jun 10 11:59:52.749931 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:52.749586 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"200272f0-7d1b-4e29-945a-07d6a59cd605","Type":"ContainerStarted","Data":"234ea0c7efbf2a37626584ca4814ab7b64ac97015c088cec83bc164da3a85567"} Jun 10 11:59:52.749931 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:52.749644 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"200272f0-7d1b-4e29-945a-07d6a59cd605","Type":"ContainerStarted","Data":"b09efa913b553ba7d6aa021f52094923c0f140c63bf22b8c548913a4040b374c"} Jun 10 11:59:52.749931 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:52.749681 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"200272f0-7d1b-4e29-945a-07d6a59cd605","Type":"ContainerStarted","Data":"aebe1e09e5dd9d4a3622c53cb5f01e071be61490797b5a0566fc0576325e635b"} Jun 10 11:59:52.784702 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:52.784595 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.206672563 podStartE2EDuration="15.784573799s" totalImagesPullingTime="12.552090542s" totalInitContainerRuntime="25.810694ms" isStatefulPod=false podCreationTimestamp="2026-06-10 11:59:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:59:52.783150928 +0000 UTC m=+100.988901773" watchObservedRunningTime="2026-06-10 11:59:52.784573799 +0000 UTC m=+100.990324645" Jun 10 11:59:52.908089 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:52.908029 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 11:59:55.563324 ip-10-0-139-86 kubenswrapper[2562]: I0610 11:59:55.563294 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lfwlq" Jun 10 12:00:37.908865 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:37.908828 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:37.962560 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:37.962530 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:37.978115 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:37.978088 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:56.021552 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.021515 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 12:00:56.022145 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.021790 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="200272f0-7d1b-4e29-945a-07d6a59cd605" containerName="prometheus" containerID="cri-o://aebe1e09e5dd9d4a3622c53cb5f01e071be61490797b5a0566fc0576325e635b" gracePeriod=600 Jun 10 12:00:56.022145 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.021836 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="200272f0-7d1b-4e29-945a-07d6a59cd605" containerName="thanos-sidecar" containerID="cri-o://234ea0c7efbf2a37626584ca4814ab7b64ac97015c088cec83bc164da3a85567" gracePeriod=600 Jun 10 12:00:56.022145 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.021836 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="200272f0-7d1b-4e29-945a-07d6a59cd605" containerName="kube-rbac-proxy" containerID="cri-o://737fd032ab2e8bab532885f445a231a2c738f72618c5a38006964e7c36097161" gracePeriod=600 Jun 10 12:00:56.022145 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.021852 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="200272f0-7d1b-4e29-945a-07d6a59cd605" containerName="kube-rbac-proxy-web" containerID="cri-o://1f3a5702b04d738be1bbe4c9d5b96f2df844fe584839fa1632e7ecf214cd7862" gracePeriod=600 Jun 10 12:00:56.022145 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.021901 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="200272f0-7d1b-4e29-945a-07d6a59cd605" containerName="kube-rbac-proxy-thanos" containerID="cri-o://e86053a640384e02b103d284737ba62d7a3a8a8cf7c1c15252c1e84d558b8bc4" gracePeriod=600 Jun 10 12:00:56.022145 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.021869 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="200272f0-7d1b-4e29-945a-07d6a59cd605" containerName="config-reloader" containerID="cri-o://b09efa913b553ba7d6aa021f52094923c0f140c63bf22b8c548913a4040b374c" gracePeriod=600 Jun 10 12:00:56.257872 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.257849 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:56.361832 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.361797 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/200272f0-7d1b-4e29-945a-07d6a59cd605-thanos-prometheus-http-client-file\") pod \"200272f0-7d1b-4e29-945a-07d6a59cd605\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " Jun 10 12:00:56.361832 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.361834 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/200272f0-7d1b-4e29-945a-07d6a59cd605-prometheus-k8s-rulefiles-1\") pod \"200272f0-7d1b-4e29-945a-07d6a59cd605\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " Jun 10 12:00:56.362119 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.361857 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/200272f0-7d1b-4e29-945a-07d6a59cd605-config\") pod \"200272f0-7d1b-4e29-945a-07d6a59cd605\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " Jun 10 12:00:56.362119 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.361876 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/200272f0-7d1b-4e29-945a-07d6a59cd605-prometheus-trusted-ca-bundle\") pod \"200272f0-7d1b-4e29-945a-07d6a59cd605\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " Jun 10 12:00:56.362119 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.361892 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/200272f0-7d1b-4e29-945a-07d6a59cd605-web-config\") pod \"200272f0-7d1b-4e29-945a-07d6a59cd605\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " Jun 10 12:00:56.362119 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.361922 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/200272f0-7d1b-4e29-945a-07d6a59cd605-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"200272f0-7d1b-4e29-945a-07d6a59cd605\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " Jun 10 12:00:56.362119 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.361951 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/200272f0-7d1b-4e29-945a-07d6a59cd605-secret-grpc-tls\") pod \"200272f0-7d1b-4e29-945a-07d6a59cd605\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " Jun 10 12:00:56.362119 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.361991 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/200272f0-7d1b-4e29-945a-07d6a59cd605-secret-kube-rbac-proxy\") pod \"200272f0-7d1b-4e29-945a-07d6a59cd605\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " Jun 10 12:00:56.362434 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.362263 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/200272f0-7d1b-4e29-945a-07d6a59cd605-prometheus-k8s-db\") pod \"200272f0-7d1b-4e29-945a-07d6a59cd605\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " Jun 10 12:00:56.362434 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.362282 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/200272f0-7d1b-4e29-945a-07d6a59cd605-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "200272f0-7d1b-4e29-945a-07d6a59cd605" (UID: "200272f0-7d1b-4e29-945a-07d6a59cd605"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 12:00:56.362434 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.362331 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/200272f0-7d1b-4e29-945a-07d6a59cd605-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "200272f0-7d1b-4e29-945a-07d6a59cd605" (UID: "200272f0-7d1b-4e29-945a-07d6a59cd605"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 12:00:56.362434 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.362344 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/200272f0-7d1b-4e29-945a-07d6a59cd605-prometheus-k8s-rulefiles-2\") pod \"200272f0-7d1b-4e29-945a-07d6a59cd605\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " Jun 10 12:00:56.362434 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.362374 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/200272f0-7d1b-4e29-945a-07d6a59cd605-config-out\") pod \"200272f0-7d1b-4e29-945a-07d6a59cd605\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " Jun 10 12:00:56.362434 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.362403 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/200272f0-7d1b-4e29-945a-07d6a59cd605-tls-assets\") pod \"200272f0-7d1b-4e29-945a-07d6a59cd605\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " Jun 10 12:00:56.362434 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.362434 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/200272f0-7d1b-4e29-945a-07d6a59cd605-configmap-serving-certs-ca-bundle\") pod \"200272f0-7d1b-4e29-945a-07d6a59cd605\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " Jun 10 12:00:56.362772 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.362462 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/200272f0-7d1b-4e29-945a-07d6a59cd605-prometheus-k8s-rulefiles-0\") pod \"200272f0-7d1b-4e29-945a-07d6a59cd605\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " Jun 10 12:00:56.362772 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.362487 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/200272f0-7d1b-4e29-945a-07d6a59cd605-configmap-metrics-client-ca\") pod \"200272f0-7d1b-4e29-945a-07d6a59cd605\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " Jun 10 12:00:56.362772 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.362522 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/200272f0-7d1b-4e29-945a-07d6a59cd605-secret-prometheus-k8s-tls\") pod \"200272f0-7d1b-4e29-945a-07d6a59cd605\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " Jun 10 12:00:56.362772 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.362557 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/200272f0-7d1b-4e29-945a-07d6a59cd605-secret-metrics-client-certs\") pod \"200272f0-7d1b-4e29-945a-07d6a59cd605\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " Jun 10 12:00:56.362772 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.362591 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/200272f0-7d1b-4e29-945a-07d6a59cd605-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"200272f0-7d1b-4e29-945a-07d6a59cd605\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " Jun 10 12:00:56.362772 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.362625 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2tgvf\" (UniqueName: \"kubernetes.io/projected/200272f0-7d1b-4e29-945a-07d6a59cd605-kube-api-access-2tgvf\") pod \"200272f0-7d1b-4e29-945a-07d6a59cd605\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " Jun 10 12:00:56.362772 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.362650 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/200272f0-7d1b-4e29-945a-07d6a59cd605-configmap-kubelet-serving-ca-bundle\") pod \"200272f0-7d1b-4e29-945a-07d6a59cd605\" (UID: \"200272f0-7d1b-4e29-945a-07d6a59cd605\") " Jun 10 12:00:56.363163 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.362927 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/200272f0-7d1b-4e29-945a-07d6a59cd605-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-139-86.ec2.internal\" DevicePath \"\"" Jun 10 12:00:56.363163 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.362947 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/200272f0-7d1b-4e29-945a-07d6a59cd605-prometheus-trusted-ca-bundle\") on node \"ip-10-0-139-86.ec2.internal\" DevicePath \"\"" Jun 10 12:00:56.363384 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.363357 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/200272f0-7d1b-4e29-945a-07d6a59cd605-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "200272f0-7d1b-4e29-945a-07d6a59cd605" (UID: "200272f0-7d1b-4e29-945a-07d6a59cd605"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 12:00:56.363730 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.363701 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/200272f0-7d1b-4e29-945a-07d6a59cd605-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "200272f0-7d1b-4e29-945a-07d6a59cd605" (UID: "200272f0-7d1b-4e29-945a-07d6a59cd605"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:00:56.364095 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.364072 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/200272f0-7d1b-4e29-945a-07d6a59cd605-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "200272f0-7d1b-4e29-945a-07d6a59cd605" (UID: "200272f0-7d1b-4e29-945a-07d6a59cd605"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 12:00:56.364228 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.364085 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/200272f0-7d1b-4e29-945a-07d6a59cd605-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "200272f0-7d1b-4e29-945a-07d6a59cd605" (UID: "200272f0-7d1b-4e29-945a-07d6a59cd605"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 12:00:56.365520 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.365486 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/200272f0-7d1b-4e29-945a-07d6a59cd605-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "200272f0-7d1b-4e29-945a-07d6a59cd605" (UID: "200272f0-7d1b-4e29-945a-07d6a59cd605"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 12:00:56.365624 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.365574 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/200272f0-7d1b-4e29-945a-07d6a59cd605-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "200272f0-7d1b-4e29-945a-07d6a59cd605" (UID: "200272f0-7d1b-4e29-945a-07d6a59cd605"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:00:56.365689 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.365627 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/200272f0-7d1b-4e29-945a-07d6a59cd605-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "200272f0-7d1b-4e29-945a-07d6a59cd605" (UID: "200272f0-7d1b-4e29-945a-07d6a59cd605"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:00:56.365749 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.365712 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/200272f0-7d1b-4e29-945a-07d6a59cd605-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "200272f0-7d1b-4e29-945a-07d6a59cd605" (UID: "200272f0-7d1b-4e29-945a-07d6a59cd605"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:00:56.365855 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.365821 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/200272f0-7d1b-4e29-945a-07d6a59cd605-config" (OuterVolumeSpecName: "config") pod "200272f0-7d1b-4e29-945a-07d6a59cd605" (UID: "200272f0-7d1b-4e29-945a-07d6a59cd605"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:00:56.366108 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.366061 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/200272f0-7d1b-4e29-945a-07d6a59cd605-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "200272f0-7d1b-4e29-945a-07d6a59cd605" (UID: "200272f0-7d1b-4e29-945a-07d6a59cd605"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:00:56.366270 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.366240 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/200272f0-7d1b-4e29-945a-07d6a59cd605-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "200272f0-7d1b-4e29-945a-07d6a59cd605" (UID: "200272f0-7d1b-4e29-945a-07d6a59cd605"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 12:00:56.366549 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.366523 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/200272f0-7d1b-4e29-945a-07d6a59cd605-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "200272f0-7d1b-4e29-945a-07d6a59cd605" (UID: "200272f0-7d1b-4e29-945a-07d6a59cd605"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:00:56.366651 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.366527 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/200272f0-7d1b-4e29-945a-07d6a59cd605-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "200272f0-7d1b-4e29-945a-07d6a59cd605" (UID: "200272f0-7d1b-4e29-945a-07d6a59cd605"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:00:56.366751 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.366729 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/200272f0-7d1b-4e29-945a-07d6a59cd605-config-out" (OuterVolumeSpecName: "config-out") pod "200272f0-7d1b-4e29-945a-07d6a59cd605" (UID: "200272f0-7d1b-4e29-945a-07d6a59cd605"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:00:56.367399 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.367373 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/200272f0-7d1b-4e29-945a-07d6a59cd605-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "200272f0-7d1b-4e29-945a-07d6a59cd605" (UID: "200272f0-7d1b-4e29-945a-07d6a59cd605"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:00:56.367550 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.367529 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/200272f0-7d1b-4e29-945a-07d6a59cd605-kube-api-access-2tgvf" (OuterVolumeSpecName: "kube-api-access-2tgvf") pod "200272f0-7d1b-4e29-945a-07d6a59cd605" (UID: "200272f0-7d1b-4e29-945a-07d6a59cd605"). InnerVolumeSpecName "kube-api-access-2tgvf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:00:56.367720 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.367705 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/200272f0-7d1b-4e29-945a-07d6a59cd605-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "200272f0-7d1b-4e29-945a-07d6a59cd605" (UID: "200272f0-7d1b-4e29-945a-07d6a59cd605"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:00:56.376138 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.376114 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/200272f0-7d1b-4e29-945a-07d6a59cd605-web-config" (OuterVolumeSpecName: "web-config") pod "200272f0-7d1b-4e29-945a-07d6a59cd605" (UID: "200272f0-7d1b-4e29-945a-07d6a59cd605"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:00:56.463580 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.463544 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/200272f0-7d1b-4e29-945a-07d6a59cd605-prometheus-k8s-db\") on node \"ip-10-0-139-86.ec2.internal\" DevicePath \"\"" Jun 10 12:00:56.463580 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.463574 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/200272f0-7d1b-4e29-945a-07d6a59cd605-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-139-86.ec2.internal\" DevicePath \"\"" Jun 10 12:00:56.463580 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.463584 2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/200272f0-7d1b-4e29-945a-07d6a59cd605-config-out\") on node \"ip-10-0-139-86.ec2.internal\" DevicePath \"\"" Jun 10 12:00:56.463793 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.463593 2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/200272f0-7d1b-4e29-945a-07d6a59cd605-tls-assets\") on node \"ip-10-0-139-86.ec2.internal\" DevicePath \"\"" Jun 10 12:00:56.463793 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.463603 2562 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/200272f0-7d1b-4e29-945a-07d6a59cd605-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-139-86.ec2.internal\" DevicePath \"\"" Jun 10 12:00:56.463793 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.463613 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/200272f0-7d1b-4e29-945a-07d6a59cd605-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-139-86.ec2.internal\" DevicePath \"\"" Jun 10 12:00:56.463793 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.463622 2562 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/200272f0-7d1b-4e29-945a-07d6a59cd605-configmap-metrics-client-ca\") on node \"ip-10-0-139-86.ec2.internal\" DevicePath \"\"" Jun 10 12:00:56.463793 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.463630 2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/200272f0-7d1b-4e29-945a-07d6a59cd605-secret-prometheus-k8s-tls\") on node \"ip-10-0-139-86.ec2.internal\" DevicePath \"\"" Jun 10 12:00:56.463793 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.463639 2562 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/200272f0-7d1b-4e29-945a-07d6a59cd605-secret-metrics-client-certs\") on node \"ip-10-0-139-86.ec2.internal\" DevicePath \"\"" Jun 10 12:00:56.463793 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.463648 2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/200272f0-7d1b-4e29-945a-07d6a59cd605-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-139-86.ec2.internal\" DevicePath \"\"" Jun 10 12:00:56.463793 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.463657 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2tgvf\" (UniqueName: \"kubernetes.io/projected/200272f0-7d1b-4e29-945a-07d6a59cd605-kube-api-access-2tgvf\") on node \"ip-10-0-139-86.ec2.internal\" DevicePath \"\"" Jun 10 12:00:56.463793 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.463665 2562 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/200272f0-7d1b-4e29-945a-07d6a59cd605-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-139-86.ec2.internal\" DevicePath \"\"" Jun 10 12:00:56.463793 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.463674 2562 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/200272f0-7d1b-4e29-945a-07d6a59cd605-thanos-prometheus-http-client-file\") on node \"ip-10-0-139-86.ec2.internal\" DevicePath \"\"" Jun 10 12:00:56.463793 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.463682 2562 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/200272f0-7d1b-4e29-945a-07d6a59cd605-config\") on node \"ip-10-0-139-86.ec2.internal\" DevicePath \"\"" Jun 10 12:00:56.463793 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.463710 2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/200272f0-7d1b-4e29-945a-07d6a59cd605-web-config\") on node \"ip-10-0-139-86.ec2.internal\" DevicePath \"\"" Jun 10 12:00:56.463793 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.463719 2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/200272f0-7d1b-4e29-945a-07d6a59cd605-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-139-86.ec2.internal\" DevicePath \"\"" Jun 10 12:00:56.463793 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.463727 2562 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/200272f0-7d1b-4e29-945a-07d6a59cd605-secret-grpc-tls\") on node \"ip-10-0-139-86.ec2.internal\" DevicePath \"\"" Jun 10 12:00:56.463793 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.463735 2562 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/200272f0-7d1b-4e29-945a-07d6a59cd605-secret-kube-rbac-proxy\") on node \"ip-10-0-139-86.ec2.internal\" DevicePath \"\"" Jun 10 12:00:56.995355 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.995324 2562 generic.go:356] "Generic (PLEG): container finished" podID="200272f0-7d1b-4e29-945a-07d6a59cd605" containerID="e86053a640384e02b103d284737ba62d7a3a8a8cf7c1c15252c1e84d558b8bc4" exitCode=0 Jun 10 12:00:56.995355 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.995354 2562 generic.go:356] "Generic (PLEG): container finished" podID="200272f0-7d1b-4e29-945a-07d6a59cd605" containerID="737fd032ab2e8bab532885f445a231a2c738f72618c5a38006964e7c36097161" exitCode=0 Jun 10 12:00:56.995355 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.995363 2562 generic.go:356] "Generic (PLEG): container finished" podID="200272f0-7d1b-4e29-945a-07d6a59cd605" containerID="1f3a5702b04d738be1bbe4c9d5b96f2df844fe584839fa1632e7ecf214cd7862" exitCode=0 Jun 10 12:00:56.995581 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.995369 2562 generic.go:356] "Generic (PLEG): container finished" podID="200272f0-7d1b-4e29-945a-07d6a59cd605" containerID="234ea0c7efbf2a37626584ca4814ab7b64ac97015c088cec83bc164da3a85567" exitCode=0 Jun 10 12:00:56.995581 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.995376 2562 generic.go:356] "Generic (PLEG): container finished" podID="200272f0-7d1b-4e29-945a-07d6a59cd605" containerID="b09efa913b553ba7d6aa021f52094923c0f140c63bf22b8c548913a4040b374c" exitCode=0 Jun 10 12:00:56.995581 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.995384 2562 generic.go:356] "Generic (PLEG): container finished" podID="200272f0-7d1b-4e29-945a-07d6a59cd605" containerID="aebe1e09e5dd9d4a3622c53cb5f01e071be61490797b5a0566fc0576325e635b" exitCode=0 Jun 10 12:00:56.995581 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.995399 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:56.995581 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.995402 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"200272f0-7d1b-4e29-945a-07d6a59cd605","Type":"ContainerDied","Data":"e86053a640384e02b103d284737ba62d7a3a8a8cf7c1c15252c1e84d558b8bc4"} Jun 10 12:00:56.995581 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.995481 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"200272f0-7d1b-4e29-945a-07d6a59cd605","Type":"ContainerDied","Data":"737fd032ab2e8bab532885f445a231a2c738f72618c5a38006964e7c36097161"} Jun 10 12:00:56.995581 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.995512 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"200272f0-7d1b-4e29-945a-07d6a59cd605","Type":"ContainerDied","Data":"1f3a5702b04d738be1bbe4c9d5b96f2df844fe584839fa1632e7ecf214cd7862"} Jun 10 12:00:56.995581 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.995543 2562 scope.go:117] "RemoveContainer" containerID="e86053a640384e02b103d284737ba62d7a3a8a8cf7c1c15252c1e84d558b8bc4" Jun 10 12:00:56.995889 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.995545 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"200272f0-7d1b-4e29-945a-07d6a59cd605","Type":"ContainerDied","Data":"234ea0c7efbf2a37626584ca4814ab7b64ac97015c088cec83bc164da3a85567"} Jun 10 12:00:56.995889 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.995660 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"200272f0-7d1b-4e29-945a-07d6a59cd605","Type":"ContainerDied","Data":"b09efa913b553ba7d6aa021f52094923c0f140c63bf22b8c548913a4040b374c"} Jun 10 12:00:56.995889 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.995689 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"200272f0-7d1b-4e29-945a-07d6a59cd605","Type":"ContainerDied","Data":"aebe1e09e5dd9d4a3622c53cb5f01e071be61490797b5a0566fc0576325e635b"} Jun 10 12:00:56.995889 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:56.995720 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"200272f0-7d1b-4e29-945a-07d6a59cd605","Type":"ContainerDied","Data":"02ed611c3a09163bc317357cb682515d1b0ee7ea6524e9583e9db5bf0416ebd8"} Jun 10 12:00:57.003992 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.003974 2562 scope.go:117] "RemoveContainer" containerID="737fd032ab2e8bab532885f445a231a2c738f72618c5a38006964e7c36097161" Jun 10 12:00:57.010811 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.010792 2562 scope.go:117] "RemoveContainer" containerID="1f3a5702b04d738be1bbe4c9d5b96f2df844fe584839fa1632e7ecf214cd7862" Jun 10 12:00:57.017238 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.017220 2562 scope.go:117] "RemoveContainer" containerID="234ea0c7efbf2a37626584ca4814ab7b64ac97015c088cec83bc164da3a85567" Jun 10 12:00:57.025508 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.025485 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 12:00:57.029090 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.028927 2562 scope.go:117] "RemoveContainer" containerID="b09efa913b553ba7d6aa021f52094923c0f140c63bf22b8c548913a4040b374c" Jun 10 12:00:57.029343 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.029324 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 12:00:57.047553 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.047536 2562 scope.go:117] "RemoveContainer" containerID="aebe1e09e5dd9d4a3622c53cb5f01e071be61490797b5a0566fc0576325e635b" Jun 10 12:00:57.054939 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.054920 2562 scope.go:117] "RemoveContainer" containerID="6c8e0f855464730bc21484b33e8126b397f24264da9afd03b67dba0a41263a39" Jun 10 12:00:57.058825 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.058803 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 12:00:57.059216 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.059195 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="200272f0-7d1b-4e29-945a-07d6a59cd605" containerName="kube-rbac-proxy-web" Jun 10 12:00:57.059216 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.059215 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="200272f0-7d1b-4e29-945a-07d6a59cd605" containerName="kube-rbac-proxy-web" Jun 10 12:00:57.059348 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.059235 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="200272f0-7d1b-4e29-945a-07d6a59cd605" containerName="thanos-sidecar" Jun 10 12:00:57.059348 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.059243 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="200272f0-7d1b-4e29-945a-07d6a59cd605" containerName="thanos-sidecar" Jun 10 12:00:57.059348 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.059254 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="200272f0-7d1b-4e29-945a-07d6a59cd605" containerName="prometheus" Jun 10 12:00:57.059348 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.059261 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="200272f0-7d1b-4e29-945a-07d6a59cd605" containerName="prometheus" Jun 10 12:00:57.059348 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.059271 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="200272f0-7d1b-4e29-945a-07d6a59cd605" containerName="kube-rbac-proxy-thanos" Jun 10 12:00:57.059348 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.059278 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="200272f0-7d1b-4e29-945a-07d6a59cd605" containerName="kube-rbac-proxy-thanos" Jun 10 12:00:57.059348 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.059288 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="200272f0-7d1b-4e29-945a-07d6a59cd605" containerName="kube-rbac-proxy" Jun 10 12:00:57.059348 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.059294 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="200272f0-7d1b-4e29-945a-07d6a59cd605" containerName="kube-rbac-proxy" Jun 10 12:00:57.059348 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.059309 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="200272f0-7d1b-4e29-945a-07d6a59cd605" containerName="config-reloader" Jun 10 12:00:57.059348 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.059317 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="200272f0-7d1b-4e29-945a-07d6a59cd605" containerName="config-reloader" Jun 10 12:00:57.059348 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.059326 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a914f89a-e48e-44d6-8655-b019b5ab1f47" containerName="registry" Jun 10 12:00:57.059348 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.059333 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a914f89a-e48e-44d6-8655-b019b5ab1f47" containerName="registry" Jun 10 12:00:57.059348 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.059340 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="200272f0-7d1b-4e29-945a-07d6a59cd605" containerName="init-config-reloader" Jun 10 12:00:57.059348 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.059347 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="200272f0-7d1b-4e29-945a-07d6a59cd605" containerName="init-config-reloader" Jun 10 12:00:57.060063 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.059421 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="200272f0-7d1b-4e29-945a-07d6a59cd605" containerName="kube-rbac-proxy-web" Jun 10 12:00:57.060063 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.059432 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="200272f0-7d1b-4e29-945a-07d6a59cd605" containerName="kube-rbac-proxy" Jun 10 12:00:57.060063 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.059439 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="200272f0-7d1b-4e29-945a-07d6a59cd605" containerName="kube-rbac-proxy-thanos" Jun 10 12:00:57.060063 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.059448 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="200272f0-7d1b-4e29-945a-07d6a59cd605" containerName="thanos-sidecar" Jun 10 12:00:57.060063 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.059454 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="200272f0-7d1b-4e29-945a-07d6a59cd605" containerName="prometheus" Jun 10 12:00:57.060063 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.059459 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="200272f0-7d1b-4e29-945a-07d6a59cd605" containerName="config-reloader" Jun 10 12:00:57.060063 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.059464 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a914f89a-e48e-44d6-8655-b019b5ab1f47" containerName="registry" Jun 10 12:00:57.062149 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.062129 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.062294 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.062263 2562 scope.go:117] "RemoveContainer" containerID="e86053a640384e02b103d284737ba62d7a3a8a8cf7c1c15252c1e84d558b8bc4" Jun 10 12:00:57.062540 ip-10-0-139-86 kubenswrapper[2562]: E0610 12:00:57.062511 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e86053a640384e02b103d284737ba62d7a3a8a8cf7c1c15252c1e84d558b8bc4\": container with ID starting with e86053a640384e02b103d284737ba62d7a3a8a8cf7c1c15252c1e84d558b8bc4 not found: ID does not exist" containerID="e86053a640384e02b103d284737ba62d7a3a8a8cf7c1c15252c1e84d558b8bc4" Jun 10 12:00:57.062651 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.062546 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e86053a640384e02b103d284737ba62d7a3a8a8cf7c1c15252c1e84d558b8bc4"} err="failed to get container status \"e86053a640384e02b103d284737ba62d7a3a8a8cf7c1c15252c1e84d558b8bc4\": rpc error: code = NotFound desc = could not find container \"e86053a640384e02b103d284737ba62d7a3a8a8cf7c1c15252c1e84d558b8bc4\": container with ID starting with e86053a640384e02b103d284737ba62d7a3a8a8cf7c1c15252c1e84d558b8bc4 not found: ID does not exist" Jun 10 12:00:57.062651 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.062569 2562 scope.go:117] "RemoveContainer" containerID="737fd032ab2e8bab532885f445a231a2c738f72618c5a38006964e7c36097161" Jun 10 12:00:57.062847 ip-10-0-139-86 kubenswrapper[2562]: E0610 12:00:57.062828 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"737fd032ab2e8bab532885f445a231a2c738f72618c5a38006964e7c36097161\": container with ID starting with 737fd032ab2e8bab532885f445a231a2c738f72618c5a38006964e7c36097161 not found: ID does not exist" containerID="737fd032ab2e8bab532885f445a231a2c738f72618c5a38006964e7c36097161" Jun 10 12:00:57.062886 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.062854 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"737fd032ab2e8bab532885f445a231a2c738f72618c5a38006964e7c36097161"} err="failed to get container status \"737fd032ab2e8bab532885f445a231a2c738f72618c5a38006964e7c36097161\": rpc error: code = NotFound desc = could not find container \"737fd032ab2e8bab532885f445a231a2c738f72618c5a38006964e7c36097161\": container with ID starting with 737fd032ab2e8bab532885f445a231a2c738f72618c5a38006964e7c36097161 not found: ID does not exist" Jun 10 12:00:57.062886 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.062871 2562 scope.go:117] "RemoveContainer" containerID="1f3a5702b04d738be1bbe4c9d5b96f2df844fe584839fa1632e7ecf214cd7862" Jun 10 12:00:57.063150 ip-10-0-139-86 kubenswrapper[2562]: E0610 12:00:57.063130 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f3a5702b04d738be1bbe4c9d5b96f2df844fe584839fa1632e7ecf214cd7862\": container with ID starting with 1f3a5702b04d738be1bbe4c9d5b96f2df844fe584839fa1632e7ecf214cd7862 not found: ID does not exist" containerID="1f3a5702b04d738be1bbe4c9d5b96f2df844fe584839fa1632e7ecf214cd7862" Jun 10 12:00:57.063205 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.063157 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f3a5702b04d738be1bbe4c9d5b96f2df844fe584839fa1632e7ecf214cd7862"} err="failed to get container status \"1f3a5702b04d738be1bbe4c9d5b96f2df844fe584839fa1632e7ecf214cd7862\": rpc error: code = NotFound desc = could not find container \"1f3a5702b04d738be1bbe4c9d5b96f2df844fe584839fa1632e7ecf214cd7862\": container with ID starting with 1f3a5702b04d738be1bbe4c9d5b96f2df844fe584839fa1632e7ecf214cd7862 not found: ID does not exist" Jun 10 12:00:57.063205 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.063173 2562 scope.go:117] "RemoveContainer" containerID="234ea0c7efbf2a37626584ca4814ab7b64ac97015c088cec83bc164da3a85567" Jun 10 12:00:57.063445 ip-10-0-139-86 kubenswrapper[2562]: E0610 12:00:57.063428 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"234ea0c7efbf2a37626584ca4814ab7b64ac97015c088cec83bc164da3a85567\": container with ID starting with 234ea0c7efbf2a37626584ca4814ab7b64ac97015c088cec83bc164da3a85567 not found: ID does not exist" containerID="234ea0c7efbf2a37626584ca4814ab7b64ac97015c088cec83bc164da3a85567" Jun 10 12:00:57.063499 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.063451 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"234ea0c7efbf2a37626584ca4814ab7b64ac97015c088cec83bc164da3a85567"} err="failed to get container status \"234ea0c7efbf2a37626584ca4814ab7b64ac97015c088cec83bc164da3a85567\": rpc error: code = NotFound desc = could not find container \"234ea0c7efbf2a37626584ca4814ab7b64ac97015c088cec83bc164da3a85567\": container with ID starting with 234ea0c7efbf2a37626584ca4814ab7b64ac97015c088cec83bc164da3a85567 not found: ID does not exist" Jun 10 12:00:57.063499 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.063466 2562 scope.go:117] "RemoveContainer" containerID="b09efa913b553ba7d6aa021f52094923c0f140c63bf22b8c548913a4040b374c" Jun 10 12:00:57.063699 ip-10-0-139-86 kubenswrapper[2562]: E0610 12:00:57.063684 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b09efa913b553ba7d6aa021f52094923c0f140c63bf22b8c548913a4040b374c\": container with ID starting with b09efa913b553ba7d6aa021f52094923c0f140c63bf22b8c548913a4040b374c not found: ID does not exist" containerID="b09efa913b553ba7d6aa021f52094923c0f140c63bf22b8c548913a4040b374c" Jun 10 12:00:57.063744 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.063702 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b09efa913b553ba7d6aa021f52094923c0f140c63bf22b8c548913a4040b374c"} err="failed to get container status \"b09efa913b553ba7d6aa021f52094923c0f140c63bf22b8c548913a4040b374c\": rpc error: code = NotFound desc = could not find container \"b09efa913b553ba7d6aa021f52094923c0f140c63bf22b8c548913a4040b374c\": container with ID starting with b09efa913b553ba7d6aa021f52094923c0f140c63bf22b8c548913a4040b374c not found: ID does not exist" Jun 10 12:00:57.063744 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.063714 2562 scope.go:117] "RemoveContainer" containerID="aebe1e09e5dd9d4a3622c53cb5f01e071be61490797b5a0566fc0576325e635b" Jun 10 12:00:57.063953 ip-10-0-139-86 kubenswrapper[2562]: E0610 12:00:57.063934 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aebe1e09e5dd9d4a3622c53cb5f01e071be61490797b5a0566fc0576325e635b\": container with ID starting with aebe1e09e5dd9d4a3622c53cb5f01e071be61490797b5a0566fc0576325e635b not found: ID does not exist" containerID="aebe1e09e5dd9d4a3622c53cb5f01e071be61490797b5a0566fc0576325e635b" Jun 10 12:00:57.064073 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.063955 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aebe1e09e5dd9d4a3622c53cb5f01e071be61490797b5a0566fc0576325e635b"} err="failed to get container status \"aebe1e09e5dd9d4a3622c53cb5f01e071be61490797b5a0566fc0576325e635b\": rpc error: code = NotFound desc = could not find container \"aebe1e09e5dd9d4a3622c53cb5f01e071be61490797b5a0566fc0576325e635b\": container with ID starting with aebe1e09e5dd9d4a3622c53cb5f01e071be61490797b5a0566fc0576325e635b not found: ID does not exist" Jun 10 12:00:57.064073 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.063972 2562 scope.go:117] "RemoveContainer" containerID="6c8e0f855464730bc21484b33e8126b397f24264da9afd03b67dba0a41263a39" Jun 10 12:00:57.064243 ip-10-0-139-86 kubenswrapper[2562]: E0610 12:00:57.064226 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c8e0f855464730bc21484b33e8126b397f24264da9afd03b67dba0a41263a39\": container with ID starting with 6c8e0f855464730bc21484b33e8126b397f24264da9afd03b67dba0a41263a39 not found: ID does not exist" containerID="6c8e0f855464730bc21484b33e8126b397f24264da9afd03b67dba0a41263a39" Jun 10 12:00:57.064294 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.064248 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c8e0f855464730bc21484b33e8126b397f24264da9afd03b67dba0a41263a39"} err="failed to get container status \"6c8e0f855464730bc21484b33e8126b397f24264da9afd03b67dba0a41263a39\": rpc error: code = NotFound desc = could not find container \"6c8e0f855464730bc21484b33e8126b397f24264da9afd03b67dba0a41263a39\": container with ID starting with 6c8e0f855464730bc21484b33e8126b397f24264da9afd03b67dba0a41263a39 not found: ID does not exist" Jun 10 12:00:57.064294 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.064262 2562 scope.go:117] "RemoveContainer" containerID="e86053a640384e02b103d284737ba62d7a3a8a8cf7c1c15252c1e84d558b8bc4" Jun 10 12:00:57.064466 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.064449 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e86053a640384e02b103d284737ba62d7a3a8a8cf7c1c15252c1e84d558b8bc4"} err="failed to get container status \"e86053a640384e02b103d284737ba62d7a3a8a8cf7c1c15252c1e84d558b8bc4\": rpc error: code = NotFound desc = could not find container \"e86053a640384e02b103d284737ba62d7a3a8a8cf7c1c15252c1e84d558b8bc4\": container with ID starting with e86053a640384e02b103d284737ba62d7a3a8a8cf7c1c15252c1e84d558b8bc4 not found: ID does not exist" Jun 10 12:00:57.064508 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.064467 2562 scope.go:117] "RemoveContainer" containerID="737fd032ab2e8bab532885f445a231a2c738f72618c5a38006964e7c36097161" Jun 10 12:00:57.064715 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.064683 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"737fd032ab2e8bab532885f445a231a2c738f72618c5a38006964e7c36097161"} err="failed to get container status \"737fd032ab2e8bab532885f445a231a2c738f72618c5a38006964e7c36097161\": rpc error: code = NotFound desc = could not find container \"737fd032ab2e8bab532885f445a231a2c738f72618c5a38006964e7c36097161\": container with ID starting with 737fd032ab2e8bab532885f445a231a2c738f72618c5a38006964e7c36097161 not found: ID does not exist" Jun 10 12:00:57.064715 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.064713 2562 scope.go:117] "RemoveContainer" containerID="1f3a5702b04d738be1bbe4c9d5b96f2df844fe584839fa1632e7ecf214cd7862" Jun 10 12:00:57.064858 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.064801 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 10 12:00:57.064907 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.064872 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 10 12:00:57.064969 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.064945 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f3a5702b04d738be1bbe4c9d5b96f2df844fe584839fa1632e7ecf214cd7862"} err="failed to get container status \"1f3a5702b04d738be1bbe4c9d5b96f2df844fe584839fa1632e7ecf214cd7862\": rpc error: code = NotFound desc = could not find container \"1f3a5702b04d738be1bbe4c9d5b96f2df844fe584839fa1632e7ecf214cd7862\": container with ID starting with 1f3a5702b04d738be1bbe4c9d5b96f2df844fe584839fa1632e7ecf214cd7862 not found: ID does not exist" Jun 10 12:00:57.065100 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.064971 2562 scope.go:117] "RemoveContainer" containerID="234ea0c7efbf2a37626584ca4814ab7b64ac97015c088cec83bc164da3a85567" Jun 10 12:00:57.065100 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.065063 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-99rlht9fdlhgl\"" Jun 10 12:00:57.065203 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.065101 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 10 12:00:57.065203 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.065164 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 10 12:00:57.065303 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.065210 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 10 12:00:57.065303 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.065251 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 10 12:00:57.065303 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.065248 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"234ea0c7efbf2a37626584ca4814ab7b64ac97015c088cec83bc164da3a85567"} err="failed to get container status \"234ea0c7efbf2a37626584ca4814ab7b64ac97015c088cec83bc164da3a85567\": rpc error: code = NotFound desc = could not find container \"234ea0c7efbf2a37626584ca4814ab7b64ac97015c088cec83bc164da3a85567\": container with ID starting with 234ea0c7efbf2a37626584ca4814ab7b64ac97015c088cec83bc164da3a85567 not found: ID does not exist" Jun 10 12:00:57.065303 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.065273 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 10 12:00:57.065303 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.065284 2562 scope.go:117] "RemoveContainer" containerID="b09efa913b553ba7d6aa021f52094923c0f140c63bf22b8c548913a4040b374c" Jun 10 12:00:57.065560 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.065545 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 10 12:00:57.065622 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.065610 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 10 12:00:57.065676 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.065615 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b09efa913b553ba7d6aa021f52094923c0f140c63bf22b8c548913a4040b374c"} err="failed to get container status \"b09efa913b553ba7d6aa021f52094923c0f140c63bf22b8c548913a4040b374c\": rpc error: code = NotFound desc = could not find container \"b09efa913b553ba7d6aa021f52094923c0f140c63bf22b8c548913a4040b374c\": container with ID starting with b09efa913b553ba7d6aa021f52094923c0f140c63bf22b8c548913a4040b374c not found: ID does not exist" Jun 10 12:00:57.065676 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.065642 2562 scope.go:117] "RemoveContainer" containerID="aebe1e09e5dd9d4a3622c53cb5f01e071be61490797b5a0566fc0576325e635b" Jun 10 12:00:57.065676 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.065663 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 10 12:00:57.065826 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.065663 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-ltznw\"" Jun 10 12:00:57.065826 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.065740 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 10 12:00:57.065980 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.065964 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 10 12:00:57.066089 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.066016 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 10 12:00:57.066089 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.066031 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aebe1e09e5dd9d4a3622c53cb5f01e071be61490797b5a0566fc0576325e635b"} err="failed to get container status \"aebe1e09e5dd9d4a3622c53cb5f01e071be61490797b5a0566fc0576325e635b\": rpc error: code = NotFound desc = could not find container \"aebe1e09e5dd9d4a3622c53cb5f01e071be61490797b5a0566fc0576325e635b\": container with ID starting with aebe1e09e5dd9d4a3622c53cb5f01e071be61490797b5a0566fc0576325e635b not found: ID does not exist" Jun 10 12:00:57.066089 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.066068 2562 scope.go:117] "RemoveContainer" containerID="6c8e0f855464730bc21484b33e8126b397f24264da9afd03b67dba0a41263a39" Jun 10 12:00:57.066329 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.066307 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c8e0f855464730bc21484b33e8126b397f24264da9afd03b67dba0a41263a39"} err="failed to get container status \"6c8e0f855464730bc21484b33e8126b397f24264da9afd03b67dba0a41263a39\": rpc error: code = NotFound desc = could not find container \"6c8e0f855464730bc21484b33e8126b397f24264da9afd03b67dba0a41263a39\": container with ID starting with 6c8e0f855464730bc21484b33e8126b397f24264da9afd03b67dba0a41263a39 not found: ID does not exist" Jun 10 12:00:57.066397 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.066331 2562 scope.go:117] "RemoveContainer" containerID="e86053a640384e02b103d284737ba62d7a3a8a8cf7c1c15252c1e84d558b8bc4" Jun 10 12:00:57.066583 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.066550 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e86053a640384e02b103d284737ba62d7a3a8a8cf7c1c15252c1e84d558b8bc4"} err="failed to get container status \"e86053a640384e02b103d284737ba62d7a3a8a8cf7c1c15252c1e84d558b8bc4\": rpc error: code = NotFound desc = could not find container \"e86053a640384e02b103d284737ba62d7a3a8a8cf7c1c15252c1e84d558b8bc4\": container with ID starting with e86053a640384e02b103d284737ba62d7a3a8a8cf7c1c15252c1e84d558b8bc4 not found: ID does not exist" Jun 10 12:00:57.066663 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.066582 2562 scope.go:117] "RemoveContainer" containerID="737fd032ab2e8bab532885f445a231a2c738f72618c5a38006964e7c36097161" Jun 10 12:00:57.066832 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.066813 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"737fd032ab2e8bab532885f445a231a2c738f72618c5a38006964e7c36097161"} err="failed to get container status \"737fd032ab2e8bab532885f445a231a2c738f72618c5a38006964e7c36097161\": rpc error: code = NotFound desc = could not find container \"737fd032ab2e8bab532885f445a231a2c738f72618c5a38006964e7c36097161\": container with ID starting with 737fd032ab2e8bab532885f445a231a2c738f72618c5a38006964e7c36097161 not found: ID does not exist" Jun 10 12:00:57.066917 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.066833 2562 scope.go:117] "RemoveContainer" containerID="1f3a5702b04d738be1bbe4c9d5b96f2df844fe584839fa1632e7ecf214cd7862" Jun 10 12:00:57.067163 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.067137 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f3a5702b04d738be1bbe4c9d5b96f2df844fe584839fa1632e7ecf214cd7862"} err="failed to get container status \"1f3a5702b04d738be1bbe4c9d5b96f2df844fe584839fa1632e7ecf214cd7862\": rpc error: code = NotFound desc = could not find container \"1f3a5702b04d738be1bbe4c9d5b96f2df844fe584839fa1632e7ecf214cd7862\": container with ID starting with 1f3a5702b04d738be1bbe4c9d5b96f2df844fe584839fa1632e7ecf214cd7862 not found: ID does not exist" Jun 10 12:00:57.067163 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.067163 2562 scope.go:117] "RemoveContainer" containerID="234ea0c7efbf2a37626584ca4814ab7b64ac97015c088cec83bc164da3a85567" Jun 10 12:00:57.067408 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.067389 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"234ea0c7efbf2a37626584ca4814ab7b64ac97015c088cec83bc164da3a85567"} err="failed to get container status \"234ea0c7efbf2a37626584ca4814ab7b64ac97015c088cec83bc164da3a85567\": rpc error: code = NotFound desc = could not find container \"234ea0c7efbf2a37626584ca4814ab7b64ac97015c088cec83bc164da3a85567\": container with ID starting with 234ea0c7efbf2a37626584ca4814ab7b64ac97015c088cec83bc164da3a85567 not found: ID does not exist" Jun 10 12:00:57.067469 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.067411 2562 scope.go:117] "RemoveContainer" containerID="b09efa913b553ba7d6aa021f52094923c0f140c63bf22b8c548913a4040b374c" Jun 10 12:00:57.067707 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.067680 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b09efa913b553ba7d6aa021f52094923c0f140c63bf22b8c548913a4040b374c"} err="failed to get container status \"b09efa913b553ba7d6aa021f52094923c0f140c63bf22b8c548913a4040b374c\": rpc error: code = NotFound desc = could not find container \"b09efa913b553ba7d6aa021f52094923c0f140c63bf22b8c548913a4040b374c\": container with ID starting with b09efa913b553ba7d6aa021f52094923c0f140c63bf22b8c548913a4040b374c not found: ID does not exist" Jun 10 12:00:57.067707 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.067706 2562 scope.go:117] "RemoveContainer" containerID="aebe1e09e5dd9d4a3622c53cb5f01e071be61490797b5a0566fc0576325e635b" Jun 10 12:00:57.067998 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.067967 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aebe1e09e5dd9d4a3622c53cb5f01e071be61490797b5a0566fc0576325e635b"} err="failed to get container status \"aebe1e09e5dd9d4a3622c53cb5f01e071be61490797b5a0566fc0576325e635b\": rpc error: code = NotFound desc = could not find container \"aebe1e09e5dd9d4a3622c53cb5f01e071be61490797b5a0566fc0576325e635b\": container with ID starting with aebe1e09e5dd9d4a3622c53cb5f01e071be61490797b5a0566fc0576325e635b not found: ID does not exist" Jun 10 12:00:57.067998 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.067989 2562 scope.go:117] "RemoveContainer" containerID="6c8e0f855464730bc21484b33e8126b397f24264da9afd03b67dba0a41263a39" Jun 10 12:00:57.068256 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.068237 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c8e0f855464730bc21484b33e8126b397f24264da9afd03b67dba0a41263a39"} err="failed to get container status \"6c8e0f855464730bc21484b33e8126b397f24264da9afd03b67dba0a41263a39\": rpc error: code = NotFound desc = could not find container \"6c8e0f855464730bc21484b33e8126b397f24264da9afd03b67dba0a41263a39\": container with ID starting with 6c8e0f855464730bc21484b33e8126b397f24264da9afd03b67dba0a41263a39 not found: ID does not exist" Jun 10 12:00:57.068256 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.068256 2562 scope.go:117] "RemoveContainer" containerID="e86053a640384e02b103d284737ba62d7a3a8a8cf7c1c15252c1e84d558b8bc4" Jun 10 12:00:57.068523 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.068506 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e86053a640384e02b103d284737ba62d7a3a8a8cf7c1c15252c1e84d558b8bc4"} err="failed to get container status \"e86053a640384e02b103d284737ba62d7a3a8a8cf7c1c15252c1e84d558b8bc4\": rpc error: code = NotFound desc = could not find container \"e86053a640384e02b103d284737ba62d7a3a8a8cf7c1c15252c1e84d558b8bc4\": container with ID starting with e86053a640384e02b103d284737ba62d7a3a8a8cf7c1c15252c1e84d558b8bc4 not found: ID does not exist" Jun 10 12:00:57.068523 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.068523 2562 scope.go:117] "RemoveContainer" containerID="737fd032ab2e8bab532885f445a231a2c738f72618c5a38006964e7c36097161" Jun 10 12:00:57.068863 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.068840 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"737fd032ab2e8bab532885f445a231a2c738f72618c5a38006964e7c36097161"} err="failed to get container status \"737fd032ab2e8bab532885f445a231a2c738f72618c5a38006964e7c36097161\": rpc error: code = NotFound desc = could not find container \"737fd032ab2e8bab532885f445a231a2c738f72618c5a38006964e7c36097161\": container with ID starting with 737fd032ab2e8bab532885f445a231a2c738f72618c5a38006964e7c36097161 not found: ID does not exist" Jun 10 12:00:57.068926 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.068866 2562 scope.go:117] "RemoveContainer" containerID="1f3a5702b04d738be1bbe4c9d5b96f2df844fe584839fa1632e7ecf214cd7862" Jun 10 12:00:57.069216 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.069169 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f3a5702b04d738be1bbe4c9d5b96f2df844fe584839fa1632e7ecf214cd7862"} err="failed to get container status \"1f3a5702b04d738be1bbe4c9d5b96f2df844fe584839fa1632e7ecf214cd7862\": rpc error: code = NotFound desc = could not find container \"1f3a5702b04d738be1bbe4c9d5b96f2df844fe584839fa1632e7ecf214cd7862\": container with ID starting with 1f3a5702b04d738be1bbe4c9d5b96f2df844fe584839fa1632e7ecf214cd7862 not found: ID does not exist" Jun 10 12:00:57.069216 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.069194 2562 scope.go:117] "RemoveContainer" containerID="234ea0c7efbf2a37626584ca4814ab7b64ac97015c088cec83bc164da3a85567" Jun 10 12:00:57.069367 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.069208 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 10 12:00:57.069476 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.069453 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"234ea0c7efbf2a37626584ca4814ab7b64ac97015c088cec83bc164da3a85567"} err="failed to get container status \"234ea0c7efbf2a37626584ca4814ab7b64ac97015c088cec83bc164da3a85567\": rpc error: code = NotFound desc = could not find container \"234ea0c7efbf2a37626584ca4814ab7b64ac97015c088cec83bc164da3a85567\": container with ID starting with 234ea0c7efbf2a37626584ca4814ab7b64ac97015c088cec83bc164da3a85567 not found: ID does not exist" Jun 10 12:00:57.069542 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.069479 2562 scope.go:117] "RemoveContainer" containerID="b09efa913b553ba7d6aa021f52094923c0f140c63bf22b8c548913a4040b374c" Jun 10 12:00:57.069726 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.069702 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b09efa913b553ba7d6aa021f52094923c0f140c63bf22b8c548913a4040b374c"} err="failed to get container status \"b09efa913b553ba7d6aa021f52094923c0f140c63bf22b8c548913a4040b374c\": rpc error: code = NotFound desc = could not find container \"b09efa913b553ba7d6aa021f52094923c0f140c63bf22b8c548913a4040b374c\": container with ID starting with b09efa913b553ba7d6aa021f52094923c0f140c63bf22b8c548913a4040b374c not found: ID does not exist" Jun 10 12:00:57.069874 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.069727 2562 scope.go:117] "RemoveContainer" containerID="aebe1e09e5dd9d4a3622c53cb5f01e071be61490797b5a0566fc0576325e635b" Jun 10 12:00:57.070075 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.070014 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aebe1e09e5dd9d4a3622c53cb5f01e071be61490797b5a0566fc0576325e635b"} err="failed to get container status \"aebe1e09e5dd9d4a3622c53cb5f01e071be61490797b5a0566fc0576325e635b\": rpc error: code = NotFound desc = could not find container \"aebe1e09e5dd9d4a3622c53cb5f01e071be61490797b5a0566fc0576325e635b\": container with ID starting with aebe1e09e5dd9d4a3622c53cb5f01e071be61490797b5a0566fc0576325e635b not found: ID does not exist" Jun 10 12:00:57.070075 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.070057 2562 scope.go:117] "RemoveContainer" containerID="6c8e0f855464730bc21484b33e8126b397f24264da9afd03b67dba0a41263a39" Jun 10 12:00:57.070360 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.070338 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c8e0f855464730bc21484b33e8126b397f24264da9afd03b67dba0a41263a39"} err="failed to get container status \"6c8e0f855464730bc21484b33e8126b397f24264da9afd03b67dba0a41263a39\": rpc error: code = NotFound desc = could not find container \"6c8e0f855464730bc21484b33e8126b397f24264da9afd03b67dba0a41263a39\": container with ID starting with 6c8e0f855464730bc21484b33e8126b397f24264da9afd03b67dba0a41263a39 not found: ID does not exist" Jun 10 12:00:57.070437 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.070362 2562 scope.go:117] "RemoveContainer" containerID="e86053a640384e02b103d284737ba62d7a3a8a8cf7c1c15252c1e84d558b8bc4" Jun 10 12:00:57.070650 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.070627 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e86053a640384e02b103d284737ba62d7a3a8a8cf7c1c15252c1e84d558b8bc4"} err="failed to get container status \"e86053a640384e02b103d284737ba62d7a3a8a8cf7c1c15252c1e84d558b8bc4\": rpc error: code = NotFound desc = could not find container \"e86053a640384e02b103d284737ba62d7a3a8a8cf7c1c15252c1e84d558b8bc4\": container with ID starting with e86053a640384e02b103d284737ba62d7a3a8a8cf7c1c15252c1e84d558b8bc4 not found: ID does not exist" Jun 10 12:00:57.070709 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.070654 2562 scope.go:117] "RemoveContainer" containerID="737fd032ab2e8bab532885f445a231a2c738f72618c5a38006964e7c36097161" Jun 10 12:00:57.070915 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.070896 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"737fd032ab2e8bab532885f445a231a2c738f72618c5a38006964e7c36097161"} err="failed to get container status \"737fd032ab2e8bab532885f445a231a2c738f72618c5a38006964e7c36097161\": rpc error: code = NotFound desc = could not find container \"737fd032ab2e8bab532885f445a231a2c738f72618c5a38006964e7c36097161\": container with ID starting with 737fd032ab2e8bab532885f445a231a2c738f72618c5a38006964e7c36097161 not found: ID does not exist" Jun 10 12:00:57.070915 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.070914 2562 scope.go:117] "RemoveContainer" containerID="1f3a5702b04d738be1bbe4c9d5b96f2df844fe584839fa1632e7ecf214cd7862" Jun 10 12:00:57.071198 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.071178 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f3a5702b04d738be1bbe4c9d5b96f2df844fe584839fa1632e7ecf214cd7862"} err="failed to get container status \"1f3a5702b04d738be1bbe4c9d5b96f2df844fe584839fa1632e7ecf214cd7862\": rpc error: code = NotFound desc = could not find container \"1f3a5702b04d738be1bbe4c9d5b96f2df844fe584839fa1632e7ecf214cd7862\": container with ID starting with 1f3a5702b04d738be1bbe4c9d5b96f2df844fe584839fa1632e7ecf214cd7862 not found: ID does not exist" Jun 10 12:00:57.071283 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.071200 2562 scope.go:117] "RemoveContainer" containerID="234ea0c7efbf2a37626584ca4814ab7b64ac97015c088cec83bc164da3a85567" Jun 10 12:00:57.071477 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.071454 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"234ea0c7efbf2a37626584ca4814ab7b64ac97015c088cec83bc164da3a85567"} err="failed to get container status \"234ea0c7efbf2a37626584ca4814ab7b64ac97015c088cec83bc164da3a85567\": rpc error: code = NotFound desc = could not find container \"234ea0c7efbf2a37626584ca4814ab7b64ac97015c088cec83bc164da3a85567\": container with ID starting with 234ea0c7efbf2a37626584ca4814ab7b64ac97015c088cec83bc164da3a85567 not found: ID does not exist" Jun 10 12:00:57.071528 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.071480 2562 scope.go:117] "RemoveContainer" containerID="b09efa913b553ba7d6aa021f52094923c0f140c63bf22b8c548913a4040b374c" Jun 10 12:00:57.071746 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.071727 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b09efa913b553ba7d6aa021f52094923c0f140c63bf22b8c548913a4040b374c"} err="failed to get container status \"b09efa913b553ba7d6aa021f52094923c0f140c63bf22b8c548913a4040b374c\": rpc error: code = NotFound desc = could not find container \"b09efa913b553ba7d6aa021f52094923c0f140c63bf22b8c548913a4040b374c\": container with ID starting with b09efa913b553ba7d6aa021f52094923c0f140c63bf22b8c548913a4040b374c not found: ID does not exist" Jun 10 12:00:57.071790 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.071749 2562 scope.go:117] "RemoveContainer" containerID="aebe1e09e5dd9d4a3622c53cb5f01e071be61490797b5a0566fc0576325e635b" Jun 10 12:00:57.071964 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.071941 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aebe1e09e5dd9d4a3622c53cb5f01e071be61490797b5a0566fc0576325e635b"} err="failed to get container status \"aebe1e09e5dd9d4a3622c53cb5f01e071be61490797b5a0566fc0576325e635b\": rpc error: code = NotFound desc = could not find container \"aebe1e09e5dd9d4a3622c53cb5f01e071be61490797b5a0566fc0576325e635b\": container with ID starting with aebe1e09e5dd9d4a3622c53cb5f01e071be61490797b5a0566fc0576325e635b not found: ID does not exist" Jun 10 12:00:57.072012 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.071966 2562 scope.go:117] "RemoveContainer" containerID="6c8e0f855464730bc21484b33e8126b397f24264da9afd03b67dba0a41263a39" Jun 10 12:00:57.072281 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.072257 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c8e0f855464730bc21484b33e8126b397f24264da9afd03b67dba0a41263a39"} err="failed to get container status \"6c8e0f855464730bc21484b33e8126b397f24264da9afd03b67dba0a41263a39\": rpc error: code = NotFound desc = could not find container \"6c8e0f855464730bc21484b33e8126b397f24264da9afd03b67dba0a41263a39\": container with ID starting with 6c8e0f855464730bc21484b33e8126b397f24264da9afd03b67dba0a41263a39 not found: ID does not exist" Jun 10 12:00:57.072334 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.072284 2562 scope.go:117] "RemoveContainer" containerID="e86053a640384e02b103d284737ba62d7a3a8a8cf7c1c15252c1e84d558b8bc4" Jun 10 12:00:57.072454 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.072430 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 10 12:00:57.072523 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.072505 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e86053a640384e02b103d284737ba62d7a3a8a8cf7c1c15252c1e84d558b8bc4"} err="failed to get container status \"e86053a640384e02b103d284737ba62d7a3a8a8cf7c1c15252c1e84d558b8bc4\": rpc error: code = NotFound desc = could not find container \"e86053a640384e02b103d284737ba62d7a3a8a8cf7c1c15252c1e84d558b8bc4\": container with ID starting with e86053a640384e02b103d284737ba62d7a3a8a8cf7c1c15252c1e84d558b8bc4 not found: ID does not exist" Jun 10 12:00:57.072565 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.072524 2562 scope.go:117] "RemoveContainer" containerID="737fd032ab2e8bab532885f445a231a2c738f72618c5a38006964e7c36097161" Jun 10 12:00:57.072742 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.072724 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"737fd032ab2e8bab532885f445a231a2c738f72618c5a38006964e7c36097161"} err="failed to get container status \"737fd032ab2e8bab532885f445a231a2c738f72618c5a38006964e7c36097161\": rpc error: code = NotFound desc = could not find container \"737fd032ab2e8bab532885f445a231a2c738f72618c5a38006964e7c36097161\": container with ID starting with 737fd032ab2e8bab532885f445a231a2c738f72618c5a38006964e7c36097161 not found: ID does not exist" Jun 10 12:00:57.072804 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.072744 2562 scope.go:117] "RemoveContainer" containerID="1f3a5702b04d738be1bbe4c9d5b96f2df844fe584839fa1632e7ecf214cd7862" Jun 10 12:00:57.072970 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.072953 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f3a5702b04d738be1bbe4c9d5b96f2df844fe584839fa1632e7ecf214cd7862"} err="failed to get container status \"1f3a5702b04d738be1bbe4c9d5b96f2df844fe584839fa1632e7ecf214cd7862\": rpc error: code = NotFound desc = could not find container \"1f3a5702b04d738be1bbe4c9d5b96f2df844fe584839fa1632e7ecf214cd7862\": container with ID starting with 1f3a5702b04d738be1bbe4c9d5b96f2df844fe584839fa1632e7ecf214cd7862 not found: ID does not exist" Jun 10 12:00:57.073028 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.072971 2562 scope.go:117] "RemoveContainer" containerID="234ea0c7efbf2a37626584ca4814ab7b64ac97015c088cec83bc164da3a85567" Jun 10 12:00:57.073178 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.073159 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"234ea0c7efbf2a37626584ca4814ab7b64ac97015c088cec83bc164da3a85567"} err="failed to get container status \"234ea0c7efbf2a37626584ca4814ab7b64ac97015c088cec83bc164da3a85567\": rpc error: code = NotFound desc = could not find container \"234ea0c7efbf2a37626584ca4814ab7b64ac97015c088cec83bc164da3a85567\": container with ID starting with 234ea0c7efbf2a37626584ca4814ab7b64ac97015c088cec83bc164da3a85567 not found: ID does not exist" Jun 10 12:00:57.073237 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.073179 2562 scope.go:117] "RemoveContainer" containerID="b09efa913b553ba7d6aa021f52094923c0f140c63bf22b8c548913a4040b374c" Jun 10 12:00:57.073386 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.073367 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b09efa913b553ba7d6aa021f52094923c0f140c63bf22b8c548913a4040b374c"} err="failed to get container status \"b09efa913b553ba7d6aa021f52094923c0f140c63bf22b8c548913a4040b374c\": rpc error: code = NotFound desc = could not find container \"b09efa913b553ba7d6aa021f52094923c0f140c63bf22b8c548913a4040b374c\": container with ID starting with b09efa913b553ba7d6aa021f52094923c0f140c63bf22b8c548913a4040b374c not found: ID does not exist" Jun 10 12:00:57.073455 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.073388 2562 scope.go:117] "RemoveContainer" containerID="aebe1e09e5dd9d4a3622c53cb5f01e071be61490797b5a0566fc0576325e635b" Jun 10 12:00:57.073604 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.073588 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aebe1e09e5dd9d4a3622c53cb5f01e071be61490797b5a0566fc0576325e635b"} err="failed to get container status \"aebe1e09e5dd9d4a3622c53cb5f01e071be61490797b5a0566fc0576325e635b\": rpc error: code = NotFound desc = could not find container \"aebe1e09e5dd9d4a3622c53cb5f01e071be61490797b5a0566fc0576325e635b\": container with ID starting with aebe1e09e5dd9d4a3622c53cb5f01e071be61490797b5a0566fc0576325e635b not found: ID does not exist" Jun 10 12:00:57.073646 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.073605 2562 scope.go:117] "RemoveContainer" containerID="6c8e0f855464730bc21484b33e8126b397f24264da9afd03b67dba0a41263a39" Jun 10 12:00:57.073809 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.073791 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c8e0f855464730bc21484b33e8126b397f24264da9afd03b67dba0a41263a39"} err="failed to get container status \"6c8e0f855464730bc21484b33e8126b397f24264da9afd03b67dba0a41263a39\": rpc error: code = NotFound desc = could not find container \"6c8e0f855464730bc21484b33e8126b397f24264da9afd03b67dba0a41263a39\": container with ID starting with 6c8e0f855464730bc21484b33e8126b397f24264da9afd03b67dba0a41263a39 not found: ID does not exist" Jun 10 12:00:57.081255 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.081235 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 12:00:57.168742 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.168708 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/815352c1-626a-4dfa-9056-13373cb74f66-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.168742 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.168744 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/815352c1-626a-4dfa-9056-13373cb74f66-config-out\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.168942 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.168763 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/815352c1-626a-4dfa-9056-13373cb74f66-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.168942 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.168815 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/815352c1-626a-4dfa-9056-13373cb74f66-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.168942 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.168857 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9j6g\" (UniqueName: \"kubernetes.io/projected/815352c1-626a-4dfa-9056-13373cb74f66-kube-api-access-b9j6g\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.168942 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.168894 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/815352c1-626a-4dfa-9056-13373cb74f66-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.168942 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.168918 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/815352c1-626a-4dfa-9056-13373cb74f66-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.168942 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.168938 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/815352c1-626a-4dfa-9056-13373cb74f66-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.169176 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.168954 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/815352c1-626a-4dfa-9056-13373cb74f66-web-config\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.169176 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.168990 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/815352c1-626a-4dfa-9056-13373cb74f66-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.169176 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.169024 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/815352c1-626a-4dfa-9056-13373cb74f66-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.169176 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.169054 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/815352c1-626a-4dfa-9056-13373cb74f66-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.169176 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.169070 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/815352c1-626a-4dfa-9056-13373cb74f66-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.169176 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.169087 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/815352c1-626a-4dfa-9056-13373cb74f66-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.169176 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.169104 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/815352c1-626a-4dfa-9056-13373cb74f66-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.169176 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.169131 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/815352c1-626a-4dfa-9056-13373cb74f66-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.169176 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.169150 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/815352c1-626a-4dfa-9056-13373cb74f66-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.169176 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.169169 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/815352c1-626a-4dfa-9056-13373cb74f66-config\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.169473 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.169185 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/815352c1-626a-4dfa-9056-13373cb74f66-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.169473 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.169212 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/815352c1-626a-4dfa-9056-13373cb74f66-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.269957 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.269858 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/815352c1-626a-4dfa-9056-13373cb74f66-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.269957 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.269908 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/815352c1-626a-4dfa-9056-13373cb74f66-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.269957 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.269927 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/815352c1-626a-4dfa-9056-13373cb74f66-config-out\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.269957 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.269950 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/815352c1-626a-4dfa-9056-13373cb74f66-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.270309 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.269976 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/815352c1-626a-4dfa-9056-13373cb74f66-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.270309 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.269992 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9j6g\" (UniqueName: \"kubernetes.io/projected/815352c1-626a-4dfa-9056-13373cb74f66-kube-api-access-b9j6g\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.270309 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.270010 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/815352c1-626a-4dfa-9056-13373cb74f66-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.270309 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.270032 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/815352c1-626a-4dfa-9056-13373cb74f66-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.270309 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.270083 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/815352c1-626a-4dfa-9056-13373cb74f66-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.270309 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.270122 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/815352c1-626a-4dfa-9056-13373cb74f66-web-config\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.270309 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.270180 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/815352c1-626a-4dfa-9056-13373cb74f66-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.270309 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.270215 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/815352c1-626a-4dfa-9056-13373cb74f66-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.270309 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.270238 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/815352c1-626a-4dfa-9056-13373cb74f66-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.270309 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.270260 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/815352c1-626a-4dfa-9056-13373cb74f66-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.270309 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.270286 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/815352c1-626a-4dfa-9056-13373cb74f66-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.270828 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.270316 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/815352c1-626a-4dfa-9056-13373cb74f66-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.270828 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.270363 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/815352c1-626a-4dfa-9056-13373cb74f66-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.270828 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.270390 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/815352c1-626a-4dfa-9056-13373cb74f66-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.270828 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.270428 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/815352c1-626a-4dfa-9056-13373cb74f66-config\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.270828 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.270457 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/815352c1-626a-4dfa-9056-13373cb74f66-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.270828 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.270647 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/815352c1-626a-4dfa-9056-13373cb74f66-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.270828 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.270692 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/815352c1-626a-4dfa-9056-13373cb74f66-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.270828 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.270758 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/815352c1-626a-4dfa-9056-13373cb74f66-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.271246 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.270966 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/815352c1-626a-4dfa-9056-13373cb74f66-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.272864 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.272833 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/815352c1-626a-4dfa-9056-13373cb74f66-config-out\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.273086 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.273063 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/815352c1-626a-4dfa-9056-13373cb74f66-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.274138 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.273314 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/815352c1-626a-4dfa-9056-13373cb74f66-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.274138 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.273387 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/815352c1-626a-4dfa-9056-13373cb74f66-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.274138 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.273444 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/815352c1-626a-4dfa-9056-13373cb74f66-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.274138 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.273821 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/815352c1-626a-4dfa-9056-13373cb74f66-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.274138 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.274061 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/815352c1-626a-4dfa-9056-13373cb74f66-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.274444 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.274181 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/815352c1-626a-4dfa-9056-13373cb74f66-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.274878 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.274855 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/815352c1-626a-4dfa-9056-13373cb74f66-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.274981 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.274906 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/815352c1-626a-4dfa-9056-13373cb74f66-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.275221 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.275203 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/815352c1-626a-4dfa-9056-13373cb74f66-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.275527 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.275477 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/815352c1-626a-4dfa-9056-13373cb74f66-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.276099 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.276072 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/815352c1-626a-4dfa-9056-13373cb74f66-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.276179 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.276139 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/815352c1-626a-4dfa-9056-13373cb74f66-config\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.276475 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.276459 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/815352c1-626a-4dfa-9056-13373cb74f66-web-config\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.279790 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.279772 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9j6g\" (UniqueName: \"kubernetes.io/projected/815352c1-626a-4dfa-9056-13373cb74f66-kube-api-access-b9j6g\") pod \"prometheus-k8s-0\" (UID: \"815352c1-626a-4dfa-9056-13373cb74f66\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.373411 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.373361 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:00:57.511097 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:57.511071 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 12:00:57.513187 ip-10-0-139-86 kubenswrapper[2562]: W0610 12:00:57.513165 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod815352c1_626a_4dfa_9056_13373cb74f66.slice/crio-30bbfbcdb3a39be8239918639db5ee3f5be08141f7c3a1590095d700048f1fcf WatchSource:0}: Error finding container 30bbfbcdb3a39be8239918639db5ee3f5be08141f7c3a1590095d700048f1fcf: Status 404 returned error can't find the container with id 30bbfbcdb3a39be8239918639db5ee3f5be08141f7c3a1590095d700048f1fcf Jun 10 12:00:58.006415 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:58.006377 2562 generic.go:356] "Generic (PLEG): container finished" podID="815352c1-626a-4dfa-9056-13373cb74f66" containerID="267fc72ede0e4fec595c01608272cb620ef96574fa2613f2215073718f9b496e" exitCode=0 Jun 10 12:00:58.006593 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:58.006449 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"815352c1-626a-4dfa-9056-13373cb74f66","Type":"ContainerDied","Data":"267fc72ede0e4fec595c01608272cb620ef96574fa2613f2215073718f9b496e"} Jun 10 12:00:58.006593 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:58.006546 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"815352c1-626a-4dfa-9056-13373cb74f66","Type":"ContainerStarted","Data":"30bbfbcdb3a39be8239918639db5ee3f5be08141f7c3a1590095d700048f1fcf"} Jun 10 12:00:58.246219 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:58.245486 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="200272f0-7d1b-4e29-945a-07d6a59cd605" path="/var/lib/kubelet/pods/200272f0-7d1b-4e29-945a-07d6a59cd605/volumes" Jun 10 12:00:59.013127 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:59.013089 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"815352c1-626a-4dfa-9056-13373cb74f66","Type":"ContainerStarted","Data":"c32ad56d29e40363bb3a2be6e1e21f0669224fafa8195db34861521e5a0d0b0c"} Jun 10 12:00:59.013269 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:59.013169 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"815352c1-626a-4dfa-9056-13373cb74f66","Type":"ContainerStarted","Data":"7be54fa5e3c5f7254db42a08d80f7ef9e29d9c06722bf764605cb275a2b38c66"} Jun 10 12:00:59.013269 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:59.013208 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"815352c1-626a-4dfa-9056-13373cb74f66","Type":"ContainerStarted","Data":"6686f2c113ed54d141ab61462a27c5e3dbaabd4a6bd6c150cae2e9e91f8e1073"} Jun 10 12:00:59.013269 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:59.013247 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"815352c1-626a-4dfa-9056-13373cb74f66","Type":"ContainerStarted","Data":"f8a77a1cd09fd2e179e821e404c399f654ae83237015b76d8eeda66f2ba02374"} Jun 10 12:00:59.013391 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:59.013288 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"815352c1-626a-4dfa-9056-13373cb74f66","Type":"ContainerStarted","Data":"d6664ac3c917960b67337cbd956d33a9db0f5590fca47d2f3616c496c930747b"} Jun 10 12:00:59.013391 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:59.013320 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"815352c1-626a-4dfa-9056-13373cb74f66","Type":"ContainerStarted","Data":"836e742b6ae17138e6dad6428f026ab05aed52d08240f6f5a4dfef93d93f4059"} Jun 10 12:00:59.046274 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:00:59.046223 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.026123741 podStartE2EDuration="2.046208811s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.08507ms" isStatefulPod=false podCreationTimestamp="2026-06-10 12:00:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:00:59.044160384 +0000 UTC m=+167.249911227" watchObservedRunningTime="2026-06-10 12:00:59.046208811 +0000 UTC m=+167.251959654" Jun 10 12:01:02.374194 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:01:02.374109 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:01:57.373687 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:01:57.373640 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:01:57.389475 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:01:57.389449 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:01:58.259310 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:01:58.259284 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:02:39.363367 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:02:39.363290 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-5s7qn"] Jun 10 12:02:39.366101 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:02:39.366084 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-5s7qn" Jun 10 12:02:39.368574 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:02:39.368546 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 10 12:02:39.368689 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:02:39.368554 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 10 12:02:39.369493 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:02:39.369476 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-nd6vt\"" Jun 10 12:02:39.376301 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:02:39.376280 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-5s7qn"] Jun 10 12:02:39.506658 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:02:39.506624 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fdf5d8b1-7287-428a-a49f-eeabd982ada0-bound-sa-token\") pod \"cert-manager-59c77684cc-5s7qn\" (UID: \"fdf5d8b1-7287-428a-a49f-eeabd982ada0\") " pod="cert-manager/cert-manager-59c77684cc-5s7qn" Jun 10 12:02:39.506811 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:02:39.506679 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24q4p\" (UniqueName: \"kubernetes.io/projected/fdf5d8b1-7287-428a-a49f-eeabd982ada0-kube-api-access-24q4p\") pod \"cert-manager-59c77684cc-5s7qn\" (UID: \"fdf5d8b1-7287-428a-a49f-eeabd982ada0\") " pod="cert-manager/cert-manager-59c77684cc-5s7qn" Jun 10 12:02:39.607631 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:02:39.607599 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fdf5d8b1-7287-428a-a49f-eeabd982ada0-bound-sa-token\") pod \"cert-manager-59c77684cc-5s7qn\" (UID: \"fdf5d8b1-7287-428a-a49f-eeabd982ada0\") " pod="cert-manager/cert-manager-59c77684cc-5s7qn" Jun 10 12:02:39.607812 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:02:39.607668 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24q4p\" (UniqueName: \"kubernetes.io/projected/fdf5d8b1-7287-428a-a49f-eeabd982ada0-kube-api-access-24q4p\") pod \"cert-manager-59c77684cc-5s7qn\" (UID: \"fdf5d8b1-7287-428a-a49f-eeabd982ada0\") " pod="cert-manager/cert-manager-59c77684cc-5s7qn" Jun 10 12:02:39.618820 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:02:39.618764 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fdf5d8b1-7287-428a-a49f-eeabd982ada0-bound-sa-token\") pod \"cert-manager-59c77684cc-5s7qn\" (UID: \"fdf5d8b1-7287-428a-a49f-eeabd982ada0\") " pod="cert-manager/cert-manager-59c77684cc-5s7qn" Jun 10 12:02:39.618934 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:02:39.618918 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24q4p\" (UniqueName: \"kubernetes.io/projected/fdf5d8b1-7287-428a-a49f-eeabd982ada0-kube-api-access-24q4p\") pod \"cert-manager-59c77684cc-5s7qn\" (UID: \"fdf5d8b1-7287-428a-a49f-eeabd982ada0\") " pod="cert-manager/cert-manager-59c77684cc-5s7qn" Jun 10 12:02:39.682596 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:02:39.682571 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-5s7qn" Jun 10 12:02:39.810097 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:02:39.810075 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-5s7qn"] Jun 10 12:02:39.811993 ip-10-0-139-86 kubenswrapper[2562]: W0610 12:02:39.811964 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfdf5d8b1_7287_428a_a49f_eeabd982ada0.slice/crio-4c6010ec125ccd6a9b5e7d3bbc4e4136b5a0a4114118d895dd5450490a6a927a WatchSource:0}: Error finding container 4c6010ec125ccd6a9b5e7d3bbc4e4136b5a0a4114118d895dd5450490a6a927a: Status 404 returned error can't find the container with id 4c6010ec125ccd6a9b5e7d3bbc4e4136b5a0a4114118d895dd5450490a6a927a Jun 10 12:02:40.399702 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:02:40.399671 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-5s7qn" event={"ID":"fdf5d8b1-7287-428a-a49f-eeabd982ada0","Type":"ContainerStarted","Data":"4c6010ec125ccd6a9b5e7d3bbc4e4136b5a0a4114118d895dd5450490a6a927a"} Jun 10 12:02:43.421575 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:02:43.421532 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-5s7qn" event={"ID":"fdf5d8b1-7287-428a-a49f-eeabd982ada0","Type":"ContainerStarted","Data":"07070002916d0372ba4669b830853f825476e6e9440946669d48bdb5e03b2689"} Jun 10 12:02:43.440603 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:02:43.440557 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-5s7qn" podStartSLOduration=1.496509281 podStartE2EDuration="4.44054382s" totalImagesPullingTime="2.944034539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:02:43.439875515 +0000 UTC m=+271.645626359" watchObservedRunningTime="2026-06-10 12:02:43.44054382 +0000 UTC m=+271.646294663" Jun 10 12:03:04.312541 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:04.312509 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76c45549f7-fxbs9"] Jun 10 12:03:04.314831 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:04.314815 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-76c45549f7-fxbs9" Jun 10 12:03:04.317883 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:04.317857 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 10 12:03:04.318003 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:04.317966 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 10 12:03:04.318106 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:04.318086 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 10 12:03:04.318178 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:04.318089 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 10 12:03:04.318178 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:04.318173 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-wc264\"" Jun 10 12:03:04.333254 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:04.333224 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76c45549f7-fxbs9"] Jun 10 12:03:04.416005 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:04.415974 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7bab442d-9251-4f8c-a2c1-080431fae04b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76c45549f7-fxbs9\" (UID: \"7bab442d-9251-4f8c-a2c1-080431fae04b\") " pod="opendatahub/opendatahub-operator-controller-manager-76c45549f7-fxbs9" Jun 10 12:03:04.416162 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:04.416015 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7bab442d-9251-4f8c-a2c1-080431fae04b-tmp\") pod \"opendatahub-operator-controller-manager-76c45549f7-fxbs9\" (UID: \"7bab442d-9251-4f8c-a2c1-080431fae04b\") " pod="opendatahub/opendatahub-operator-controller-manager-76c45549f7-fxbs9" Jun 10 12:03:04.416162 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:04.416063 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7bab442d-9251-4f8c-a2c1-080431fae04b-manifests\") pod \"opendatahub-operator-controller-manager-76c45549f7-fxbs9\" (UID: \"7bab442d-9251-4f8c-a2c1-080431fae04b\") " pod="opendatahub/opendatahub-operator-controller-manager-76c45549f7-fxbs9" Jun 10 12:03:04.416234 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:04.416184 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzpxv\" (UniqueName: \"kubernetes.io/projected/7bab442d-9251-4f8c-a2c1-080431fae04b-kube-api-access-vzpxv\") pod \"opendatahub-operator-controller-manager-76c45549f7-fxbs9\" (UID: \"7bab442d-9251-4f8c-a2c1-080431fae04b\") " pod="opendatahub/opendatahub-operator-controller-manager-76c45549f7-fxbs9" Jun 10 12:03:04.416234 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:04.416227 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7bab442d-9251-4f8c-a2c1-080431fae04b-webhook-cert\") pod \"opendatahub-operator-controller-manager-76c45549f7-fxbs9\" (UID: \"7bab442d-9251-4f8c-a2c1-080431fae04b\") " pod="opendatahub/opendatahub-operator-controller-manager-76c45549f7-fxbs9" Jun 10 12:03:04.517081 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:04.517036 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7bab442d-9251-4f8c-a2c1-080431fae04b-manifests\") pod \"opendatahub-operator-controller-manager-76c45549f7-fxbs9\" (UID: \"7bab442d-9251-4f8c-a2c1-080431fae04b\") " pod="opendatahub/opendatahub-operator-controller-manager-76c45549f7-fxbs9" Jun 10 12:03:04.517209 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:04.517121 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzpxv\" (UniqueName: \"kubernetes.io/projected/7bab442d-9251-4f8c-a2c1-080431fae04b-kube-api-access-vzpxv\") pod \"opendatahub-operator-controller-manager-76c45549f7-fxbs9\" (UID: \"7bab442d-9251-4f8c-a2c1-080431fae04b\") " pod="opendatahub/opendatahub-operator-controller-manager-76c45549f7-fxbs9" Jun 10 12:03:04.517209 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:04.517149 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7bab442d-9251-4f8c-a2c1-080431fae04b-webhook-cert\") pod \"opendatahub-operator-controller-manager-76c45549f7-fxbs9\" (UID: \"7bab442d-9251-4f8c-a2c1-080431fae04b\") " pod="opendatahub/opendatahub-operator-controller-manager-76c45549f7-fxbs9" Jun 10 12:03:04.517209 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:04.517175 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7bab442d-9251-4f8c-a2c1-080431fae04b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76c45549f7-fxbs9\" (UID: \"7bab442d-9251-4f8c-a2c1-080431fae04b\") " pod="opendatahub/opendatahub-operator-controller-manager-76c45549f7-fxbs9" Jun 10 12:03:04.517209 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:04.517198 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7bab442d-9251-4f8c-a2c1-080431fae04b-tmp\") pod \"opendatahub-operator-controller-manager-76c45549f7-fxbs9\" (UID: \"7bab442d-9251-4f8c-a2c1-080431fae04b\") " pod="opendatahub/opendatahub-operator-controller-manager-76c45549f7-fxbs9" Jun 10 12:03:04.517504 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:04.517470 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7bab442d-9251-4f8c-a2c1-080431fae04b-manifests\") pod \"opendatahub-operator-controller-manager-76c45549f7-fxbs9\" (UID: \"7bab442d-9251-4f8c-a2c1-080431fae04b\") " pod="opendatahub/opendatahub-operator-controller-manager-76c45549f7-fxbs9" Jun 10 12:03:04.519311 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:04.519286 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7bab442d-9251-4f8c-a2c1-080431fae04b-tmp\") pod \"opendatahub-operator-controller-manager-76c45549f7-fxbs9\" (UID: \"7bab442d-9251-4f8c-a2c1-080431fae04b\") " pod="opendatahub/opendatahub-operator-controller-manager-76c45549f7-fxbs9" Jun 10 12:03:04.519531 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:04.519510 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7bab442d-9251-4f8c-a2c1-080431fae04b-webhook-cert\") pod \"opendatahub-operator-controller-manager-76c45549f7-fxbs9\" (UID: \"7bab442d-9251-4f8c-a2c1-080431fae04b\") " pod="opendatahub/opendatahub-operator-controller-manager-76c45549f7-fxbs9" Jun 10 12:03:04.519612 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:04.519589 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7bab442d-9251-4f8c-a2c1-080431fae04b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76c45549f7-fxbs9\" (UID: \"7bab442d-9251-4f8c-a2c1-080431fae04b\") " pod="opendatahub/opendatahub-operator-controller-manager-76c45549f7-fxbs9" Jun 10 12:03:04.527720 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:04.527697 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzpxv\" (UniqueName: \"kubernetes.io/projected/7bab442d-9251-4f8c-a2c1-080431fae04b-kube-api-access-vzpxv\") pod \"opendatahub-operator-controller-manager-76c45549f7-fxbs9\" (UID: \"7bab442d-9251-4f8c-a2c1-080431fae04b\") " pod="opendatahub/opendatahub-operator-controller-manager-76c45549f7-fxbs9" Jun 10 12:03:04.625605 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:04.625580 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-76c45549f7-fxbs9" Jun 10 12:03:04.765902 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:04.765864 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76c45549f7-fxbs9"] Jun 10 12:03:04.770683 ip-10-0-139-86 kubenswrapper[2562]: W0610 12:03:04.770659 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bab442d_9251_4f8c_a2c1_080431fae04b.slice/crio-baed49bcf40af2e960b8a407e83179fafc7be424456754ef5221c4f17cf125aa WatchSource:0}: Error finding container baed49bcf40af2e960b8a407e83179fafc7be424456754ef5221c4f17cf125aa: Status 404 returned error can't find the container with id baed49bcf40af2e960b8a407e83179fafc7be424456754ef5221c4f17cf125aa Jun 10 12:03:05.507940 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:05.507885 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76c45549f7-fxbs9" event={"ID":"7bab442d-9251-4f8c-a2c1-080431fae04b","Type":"ContainerStarted","Data":"baed49bcf40af2e960b8a407e83179fafc7be424456754ef5221c4f17cf125aa"} Jun 10 12:03:08.524090 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:08.524055 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76c45549f7-fxbs9" event={"ID":"7bab442d-9251-4f8c-a2c1-080431fae04b","Type":"ContainerStarted","Data":"692fd7267ef452d37ffbee1bf4dac1058f5cb1bb301ed40b49a9ad153b4403f6"} Jun 10 12:03:09.530275 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:09.530244 2562 generic.go:356] "Generic (PLEG): container finished" podID="7bab442d-9251-4f8c-a2c1-080431fae04b" containerID="692fd7267ef452d37ffbee1bf4dac1058f5cb1bb301ed40b49a9ad153b4403f6" exitCode=0 Jun 10 12:03:09.530770 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:09.530331 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76c45549f7-fxbs9" event={"ID":"7bab442d-9251-4f8c-a2c1-080431fae04b","Type":"ContainerDied","Data":"692fd7267ef452d37ffbee1bf4dac1058f5cb1bb301ed40b49a9ad153b4403f6"} Jun 10 12:03:10.536979 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:10.536940 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76c45549f7-fxbs9" event={"ID":"7bab442d-9251-4f8c-a2c1-080431fae04b","Type":"ContainerStarted","Data":"87337fff0dc7b96c8089c844d63a2b1ff37c16efdccf90c7a0b2e476e6c44c34"} Jun 10 12:03:10.537439 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:10.537197 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-76c45549f7-fxbs9" Jun 10 12:03:10.579428 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:10.579365 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-76c45549f7-fxbs9" podStartSLOduration=2.407497069 podStartE2EDuration="6.579343605s" totalImagesPullingTime="3.20300872s" totalInitContainerRuntime="968.837816ms" isStatefulPod=false podCreationTimestamp="2026-06-10 12:03:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:03:10.57596175 +0000 UTC m=+298.781712594" watchObservedRunningTime="2026-06-10 12:03:10.579343605 +0000 UTC m=+298.785094454" Jun 10 12:03:12.204013 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:12.203990 2562 kubelet.go:1648] "Image garbage collection succeeded" Jun 10 12:03:21.543174 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:21.543135 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-76c45549f7-fxbs9" Jun 10 12:03:33.708740 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:33.708708 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-85c5ffbff9-2j9cb"] Jun 10 12:03:33.711310 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:33.711291 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-85c5ffbff9-2j9cb" Jun 10 12:03:33.716524 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:33.716500 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 10 12:03:33.716961 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:33.716943 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 10 12:03:33.718137 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:33.718054 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 10 12:03:33.718322 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:33.718293 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 10 12:03:33.718423 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:33.718360 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 10 12:03:33.718594 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:33.718578 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-vrkxr\"" Jun 10 12:03:33.774307 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:33.774281 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mm4k\" (UniqueName: \"kubernetes.io/projected/d2e980fe-0534-45e7-b85d-a926603001e2-kube-api-access-4mm4k\") pod \"lws-controller-manager-85c5ffbff9-2j9cb\" (UID: \"d2e980fe-0534-45e7-b85d-a926603001e2\") " pod="openshift-lws-operator/lws-controller-manager-85c5ffbff9-2j9cb" Jun 10 12:03:33.774442 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:33.774401 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d2e980fe-0534-45e7-b85d-a926603001e2-metrics-cert\") pod \"lws-controller-manager-85c5ffbff9-2j9cb\" (UID: \"d2e980fe-0534-45e7-b85d-a926603001e2\") " pod="openshift-lws-operator/lws-controller-manager-85c5ffbff9-2j9cb" Jun 10 12:03:33.774513 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:33.774462 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2e980fe-0534-45e7-b85d-a926603001e2-cert\") pod \"lws-controller-manager-85c5ffbff9-2j9cb\" (UID: \"d2e980fe-0534-45e7-b85d-a926603001e2\") " pod="openshift-lws-operator/lws-controller-manager-85c5ffbff9-2j9cb" Jun 10 12:03:33.774513 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:33.774493 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d2e980fe-0534-45e7-b85d-a926603001e2-manager-config\") pod \"lws-controller-manager-85c5ffbff9-2j9cb\" (UID: \"d2e980fe-0534-45e7-b85d-a926603001e2\") " pod="openshift-lws-operator/lws-controller-manager-85c5ffbff9-2j9cb" Jun 10 12:03:33.788982 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:33.788949 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-85c5ffbff9-2j9cb"] Jun 10 12:03:33.875335 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:33.875307 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mm4k\" (UniqueName: \"kubernetes.io/projected/d2e980fe-0534-45e7-b85d-a926603001e2-kube-api-access-4mm4k\") pod \"lws-controller-manager-85c5ffbff9-2j9cb\" (UID: \"d2e980fe-0534-45e7-b85d-a926603001e2\") " pod="openshift-lws-operator/lws-controller-manager-85c5ffbff9-2j9cb" Jun 10 12:03:33.875504 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:33.875370 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d2e980fe-0534-45e7-b85d-a926603001e2-metrics-cert\") pod \"lws-controller-manager-85c5ffbff9-2j9cb\" (UID: \"d2e980fe-0534-45e7-b85d-a926603001e2\") " pod="openshift-lws-operator/lws-controller-manager-85c5ffbff9-2j9cb" Jun 10 12:03:33.875504 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:33.875414 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2e980fe-0534-45e7-b85d-a926603001e2-cert\") pod \"lws-controller-manager-85c5ffbff9-2j9cb\" (UID: \"d2e980fe-0534-45e7-b85d-a926603001e2\") " pod="openshift-lws-operator/lws-controller-manager-85c5ffbff9-2j9cb" Jun 10 12:03:33.875504 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:33.875441 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d2e980fe-0534-45e7-b85d-a926603001e2-manager-config\") pod \"lws-controller-manager-85c5ffbff9-2j9cb\" (UID: \"d2e980fe-0534-45e7-b85d-a926603001e2\") " pod="openshift-lws-operator/lws-controller-manager-85c5ffbff9-2j9cb" Jun 10 12:03:33.876193 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:33.876172 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d2e980fe-0534-45e7-b85d-a926603001e2-manager-config\") pod \"lws-controller-manager-85c5ffbff9-2j9cb\" (UID: \"d2e980fe-0534-45e7-b85d-a926603001e2\") " pod="openshift-lws-operator/lws-controller-manager-85c5ffbff9-2j9cb" Jun 10 12:03:33.877791 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:33.877761 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2e980fe-0534-45e7-b85d-a926603001e2-cert\") pod \"lws-controller-manager-85c5ffbff9-2j9cb\" (UID: \"d2e980fe-0534-45e7-b85d-a926603001e2\") " pod="openshift-lws-operator/lws-controller-manager-85c5ffbff9-2j9cb" Jun 10 12:03:33.877895 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:33.877810 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d2e980fe-0534-45e7-b85d-a926603001e2-metrics-cert\") pod \"lws-controller-manager-85c5ffbff9-2j9cb\" (UID: \"d2e980fe-0534-45e7-b85d-a926603001e2\") " pod="openshift-lws-operator/lws-controller-manager-85c5ffbff9-2j9cb" Jun 10 12:03:33.886186 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:33.886163 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mm4k\" (UniqueName: \"kubernetes.io/projected/d2e980fe-0534-45e7-b85d-a926603001e2-kube-api-access-4mm4k\") pod \"lws-controller-manager-85c5ffbff9-2j9cb\" (UID: \"d2e980fe-0534-45e7-b85d-a926603001e2\") " pod="openshift-lws-operator/lws-controller-manager-85c5ffbff9-2j9cb" Jun 10 12:03:34.021057 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:34.020959 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-85c5ffbff9-2j9cb" Jun 10 12:03:34.182221 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:34.179836 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-85c5ffbff9-2j9cb"] Jun 10 12:03:34.189017 ip-10-0-139-86 kubenswrapper[2562]: W0610 12:03:34.188979 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2e980fe_0534_45e7_b85d_a926603001e2.slice/crio-83b7ed496aff3fc081f02a66007ffb4082b28e39154161b5e5656848a1bf5283 WatchSource:0}: Error finding container 83b7ed496aff3fc081f02a66007ffb4082b28e39154161b5e5656848a1bf5283: Status 404 returned error can't find the container with id 83b7ed496aff3fc081f02a66007ffb4082b28e39154161b5e5656848a1bf5283 Jun 10 12:03:34.191562 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:34.191543 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 12:03:34.648616 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:34.648582 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-85c5ffbff9-2j9cb" event={"ID":"d2e980fe-0534-45e7-b85d-a926603001e2","Type":"ContainerStarted","Data":"83b7ed496aff3fc081f02a66007ffb4082b28e39154161b5e5656848a1bf5283"} Jun 10 12:03:37.666441 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:37.666402 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-85c5ffbff9-2j9cb" event={"ID":"d2e980fe-0534-45e7-b85d-a926603001e2","Type":"ContainerStarted","Data":"03f1873aa93bd72578c7d16ba788005a8b6d63f3ebec6d1783b6a183cab70b3d"} Jun 10 12:03:37.666985 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:37.666521 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-85c5ffbff9-2j9cb" Jun 10 12:03:37.703165 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:37.703118 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-85c5ffbff9-2j9cb" podStartSLOduration=1.816362488 podStartE2EDuration="4.703105527s" totalImagesPullingTime="2.886743039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:03:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:03:37.702492369 +0000 UTC m=+325.908243214" watchObservedRunningTime="2026-06-10 12:03:37.703105527 +0000 UTC m=+325.908856371" Jun 10 12:03:48.673182 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:48.673151 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-85c5ffbff9-2j9cb" Jun 10 12:03:58.388378 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:58.388344 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-56dc4c55d-mnvvh"] Jun 10 12:03:58.395685 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:58.395664 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-56dc4c55d-mnvvh" Jun 10 12:03:58.414829 ip-10-0-139-86 kubenswrapper[2562]: E0610 12:03:58.414769 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"dashboard-redirect-56dc4c55d-mnvvh\" is forbidden: User \"system:node:ip-10-0-139-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-86.ec2.internal' and this object" podUID="e776db1d-e35b-45e6-a136-1f7adb8c9abb" pod="opendatahub/dashboard-redirect-56dc4c55d-mnvvh" Jun 10 12:03:58.415150 ip-10-0-139-86 kubenswrapper[2562]: E0610 12:03:58.414863 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"dashboard-redirect-config\" is forbidden: User \"system:node:ip-10-0-139-86.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-86.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" type="*v1.ConfigMap" Jun 10 12:03:58.415276 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:58.415119 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-7wgwq\"" Jun 10 12:03:58.415670 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:58.415605 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-56dc4c55d-mnvvh"] Jun 10 12:03:58.489065 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:58.489013 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/e776db1d-e35b-45e6-a136-1f7adb8c9abb-redirect-config\") pod \"dashboard-redirect-56dc4c55d-mnvvh\" (UID: \"e776db1d-e35b-45e6-a136-1f7adb8c9abb\") " pod="opendatahub/dashboard-redirect-56dc4c55d-mnvvh" Jun 10 12:03:58.489217 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:58.489086 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6lx5\" (UniqueName: \"kubernetes.io/projected/e776db1d-e35b-45e6-a136-1f7adb8c9abb-kube-api-access-h6lx5\") pod \"dashboard-redirect-56dc4c55d-mnvvh\" (UID: \"e776db1d-e35b-45e6-a136-1f7adb8c9abb\") " pod="opendatahub/dashboard-redirect-56dc4c55d-mnvvh" Jun 10 12:03:58.589987 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:58.589958 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/e776db1d-e35b-45e6-a136-1f7adb8c9abb-redirect-config\") pod \"dashboard-redirect-56dc4c55d-mnvvh\" (UID: \"e776db1d-e35b-45e6-a136-1f7adb8c9abb\") " pod="opendatahub/dashboard-redirect-56dc4c55d-mnvvh" Jun 10 12:03:58.590187 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:58.590003 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6lx5\" (UniqueName: \"kubernetes.io/projected/e776db1d-e35b-45e6-a136-1f7adb8c9abb-kube-api-access-h6lx5\") pod \"dashboard-redirect-56dc4c55d-mnvvh\" (UID: \"e776db1d-e35b-45e6-a136-1f7adb8c9abb\") " pod="opendatahub/dashboard-redirect-56dc4c55d-mnvvh" Jun 10 12:03:58.619239 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:58.619208 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6lx5\" (UniqueName: \"kubernetes.io/projected/e776db1d-e35b-45e6-a136-1f7adb8c9abb-kube-api-access-h6lx5\") pod \"dashboard-redirect-56dc4c55d-mnvvh\" (UID: \"e776db1d-e35b-45e6-a136-1f7adb8c9abb\") " pod="opendatahub/dashboard-redirect-56dc4c55d-mnvvh" Jun 10 12:03:59.591127 ip-10-0-139-86 kubenswrapper[2562]: E0610 12:03:59.591099 2562 configmap.go:193] Couldn't get configMap opendatahub/dashboard-redirect-config: failed to sync configmap cache: timed out waiting for the condition Jun 10 12:03:59.591569 ip-10-0-139-86 kubenswrapper[2562]: E0610 12:03:59.591202 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e776db1d-e35b-45e6-a136-1f7adb8c9abb-redirect-config podName:e776db1d-e35b-45e6-a136-1f7adb8c9abb nodeName:}" failed. No retries permitted until 2026-06-10 12:04:00.091177658 +0000 UTC m=+348.296928499 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "redirect-config" (UniqueName: "kubernetes.io/configmap/e776db1d-e35b-45e6-a136-1f7adb8c9abb-redirect-config") pod "dashboard-redirect-56dc4c55d-mnvvh" (UID: "e776db1d-e35b-45e6-a136-1f7adb8c9abb") : failed to sync configmap cache: timed out waiting for the condition Jun 10 12:03:59.971747 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:03:59.971669 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 10 12:04:00.103118 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:00.103074 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/e776db1d-e35b-45e6-a136-1f7adb8c9abb-redirect-config\") pod \"dashboard-redirect-56dc4c55d-mnvvh\" (UID: \"e776db1d-e35b-45e6-a136-1f7adb8c9abb\") " pod="opendatahub/dashboard-redirect-56dc4c55d-mnvvh" Jun 10 12:04:00.103782 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:00.103756 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/e776db1d-e35b-45e6-a136-1f7adb8c9abb-redirect-config\") pod \"dashboard-redirect-56dc4c55d-mnvvh\" (UID: \"e776db1d-e35b-45e6-a136-1f7adb8c9abb\") " pod="opendatahub/dashboard-redirect-56dc4c55d-mnvvh" Jun 10 12:04:00.206556 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:00.206510 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-56dc4c55d-mnvvh" Jun 10 12:04:00.558994 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:00.558965 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-56dc4c55d-mnvvh"] Jun 10 12:04:00.560533 ip-10-0-139-86 kubenswrapper[2562]: W0610 12:04:00.560504 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode776db1d_e35b_45e6_a136_1f7adb8c9abb.slice/crio-edb8df23a3d4ffc3fc79006d37c0b8a521a7961dc094d38c8a775096d0aed357 WatchSource:0}: Error finding container edb8df23a3d4ffc3fc79006d37c0b8a521a7961dc094d38c8a775096d0aed357: Status 404 returned error can't find the container with id edb8df23a3d4ffc3fc79006d37c0b8a521a7961dc094d38c8a775096d0aed357 Jun 10 12:04:00.765339 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:00.765301 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-56dc4c55d-mnvvh" event={"ID":"e776db1d-e35b-45e6-a136-1f7adb8c9abb","Type":"ContainerStarted","Data":"edb8df23a3d4ffc3fc79006d37c0b8a521a7961dc094d38c8a775096d0aed357"} Jun 10 12:04:05.795218 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:05.795179 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-56dc4c55d-mnvvh" event={"ID":"e776db1d-e35b-45e6-a136-1f7adb8c9abb","Type":"ContainerStarted","Data":"b5c57b91ffd6d216041c9a82cdc8f892ad279141b39e9efc69892fa79b2d8bf5"} Jun 10 12:04:05.830716 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:05.830664 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-56dc4c55d-mnvvh" podStartSLOduration=3.628117239 podStartE2EDuration="7.830649828s" totalImagesPullingTime="4.202532589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:03:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:04:05.824944687 +0000 UTC m=+354.030695532" watchObservedRunningTime="2026-06-10 12:04:05.830649828 +0000 UTC m=+354.036400672" Jun 10 12:04:06.083623 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:06.083530 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rwzth"] Jun 10 12:04:06.086210 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:06.086185 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rwzth" Jun 10 12:04:06.091082 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:06.091057 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 10 12:04:06.091224 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:06.091169 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-lwnnt\"" Jun 10 12:04:06.092522 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:06.092501 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 10 12:04:06.094281 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:06.094264 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 10 12:04:06.138712 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:06.138686 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rwzth"] Jun 10 12:04:06.155101 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:06.155079 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cbac9d68-b054-43af-8ca8-7fea047af7f3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rwzth\" (UID: \"cbac9d68-b054-43af-8ca8-7fea047af7f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rwzth" Jun 10 12:04:06.155223 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:06.155108 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbac9d68-b054-43af-8ca8-7fea047af7f3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rwzth\" (UID: \"cbac9d68-b054-43af-8ca8-7fea047af7f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rwzth" Jun 10 12:04:06.155223 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:06.155129 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbac9d68-b054-43af-8ca8-7fea047af7f3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rwzth\" (UID: \"cbac9d68-b054-43af-8ca8-7fea047af7f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rwzth" Jun 10 12:04:06.155223 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:06.155151 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cbac9d68-b054-43af-8ca8-7fea047af7f3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rwzth\" (UID: \"cbac9d68-b054-43af-8ca8-7fea047af7f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rwzth" Jun 10 12:04:06.155223 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:06.155176 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cbac9d68-b054-43af-8ca8-7fea047af7f3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rwzth\" (UID: \"cbac9d68-b054-43af-8ca8-7fea047af7f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rwzth" Jun 10 12:04:06.155429 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:06.155244 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbac9d68-b054-43af-8ca8-7fea047af7f3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rwzth\" (UID: \"cbac9d68-b054-43af-8ca8-7fea047af7f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rwzth" Jun 10 12:04:06.155429 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:06.155274 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vgl7\" (UniqueName: \"kubernetes.io/projected/cbac9d68-b054-43af-8ca8-7fea047af7f3-kube-api-access-9vgl7\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rwzth\" (UID: \"cbac9d68-b054-43af-8ca8-7fea047af7f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rwzth" Jun 10 12:04:06.155429 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:06.155321 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbac9d68-b054-43af-8ca8-7fea047af7f3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rwzth\" (UID: \"cbac9d68-b054-43af-8ca8-7fea047af7f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rwzth" Jun 10 12:04:06.155429 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:06.155352 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cbac9d68-b054-43af-8ca8-7fea047af7f3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rwzth\" (UID: \"cbac9d68-b054-43af-8ca8-7fea047af7f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rwzth" Jun 10 12:04:06.256625 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:06.256596 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cbac9d68-b054-43af-8ca8-7fea047af7f3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rwzth\" (UID: \"cbac9d68-b054-43af-8ca8-7fea047af7f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rwzth" Jun 10 12:04:06.256767 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:06.256643 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cbac9d68-b054-43af-8ca8-7fea047af7f3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rwzth\" (UID: \"cbac9d68-b054-43af-8ca8-7fea047af7f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rwzth" Jun 10 12:04:06.256767 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:06.256660 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbac9d68-b054-43af-8ca8-7fea047af7f3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rwzth\" (UID: \"cbac9d68-b054-43af-8ca8-7fea047af7f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rwzth" Jun 10 12:04:06.256767 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:06.256682 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbac9d68-b054-43af-8ca8-7fea047af7f3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rwzth\" (UID: \"cbac9d68-b054-43af-8ca8-7fea047af7f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rwzth" Jun 10 12:04:06.256767 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:06.256710 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cbac9d68-b054-43af-8ca8-7fea047af7f3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rwzth\" (UID: \"cbac9d68-b054-43af-8ca8-7fea047af7f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rwzth" Jun 10 12:04:06.256767 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:06.256736 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cbac9d68-b054-43af-8ca8-7fea047af7f3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rwzth\" (UID: \"cbac9d68-b054-43af-8ca8-7fea047af7f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rwzth" Jun 10 12:04:06.257017 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:06.256771 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbac9d68-b054-43af-8ca8-7fea047af7f3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rwzth\" (UID: \"cbac9d68-b054-43af-8ca8-7fea047af7f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rwzth" Jun 10 12:04:06.257017 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:06.256795 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vgl7\" (UniqueName: \"kubernetes.io/projected/cbac9d68-b054-43af-8ca8-7fea047af7f3-kube-api-access-9vgl7\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rwzth\" (UID: \"cbac9d68-b054-43af-8ca8-7fea047af7f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rwzth" Jun 10 12:04:06.257017 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:06.256847 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbac9d68-b054-43af-8ca8-7fea047af7f3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rwzth\" (UID: \"cbac9d68-b054-43af-8ca8-7fea047af7f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rwzth" Jun 10 12:04:06.257264 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:06.257129 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cbac9d68-b054-43af-8ca8-7fea047af7f3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rwzth\" (UID: \"cbac9d68-b054-43af-8ca8-7fea047af7f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rwzth" Jun 10 12:04:06.257264 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:06.257189 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbac9d68-b054-43af-8ca8-7fea047af7f3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rwzth\" (UID: \"cbac9d68-b054-43af-8ca8-7fea047af7f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rwzth" Jun 10 12:04:06.257264 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:06.257248 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbac9d68-b054-43af-8ca8-7fea047af7f3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rwzth\" (UID: \"cbac9d68-b054-43af-8ca8-7fea047af7f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rwzth" Jun 10 12:04:06.257423 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:06.257398 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbac9d68-b054-43af-8ca8-7fea047af7f3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rwzth\" (UID: \"cbac9d68-b054-43af-8ca8-7fea047af7f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rwzth" Jun 10 12:04:06.257480 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:06.257456 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cbac9d68-b054-43af-8ca8-7fea047af7f3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rwzth\" (UID: \"cbac9d68-b054-43af-8ca8-7fea047af7f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rwzth" Jun 10 12:04:06.259017 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:06.258998 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cbac9d68-b054-43af-8ca8-7fea047af7f3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rwzth\" (UID: \"cbac9d68-b054-43af-8ca8-7fea047af7f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rwzth" Jun 10 12:04:06.259272 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:06.259253 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cbac9d68-b054-43af-8ca8-7fea047af7f3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rwzth\" (UID: \"cbac9d68-b054-43af-8ca8-7fea047af7f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rwzth" Jun 10 12:04:06.271776 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:06.271753 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbac9d68-b054-43af-8ca8-7fea047af7f3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rwzth\" (UID: \"cbac9d68-b054-43af-8ca8-7fea047af7f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rwzth" Jun 10 12:04:06.271906 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:06.271885 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vgl7\" (UniqueName: \"kubernetes.io/projected/cbac9d68-b054-43af-8ca8-7fea047af7f3-kube-api-access-9vgl7\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rwzth\" (UID: \"cbac9d68-b054-43af-8ca8-7fea047af7f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rwzth" Jun 10 12:04:06.396250 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:06.396219 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rwzth" Jun 10 12:04:06.610253 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:06.610223 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rwzth"] Jun 10 12:04:06.616786 ip-10-0-139-86 kubenswrapper[2562]: W0610 12:04:06.616763 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbac9d68_b054_43af_8ca8_7fea047af7f3.slice/crio-99a9a30cd27e4067467247088cb8e2c56abab33abb2b15934e9a7e0dcf71e774 WatchSource:0}: Error finding container 99a9a30cd27e4067467247088cb8e2c56abab33abb2b15934e9a7e0dcf71e774: Status 404 returned error can't find the container with id 99a9a30cd27e4067467247088cb8e2c56abab33abb2b15934e9a7e0dcf71e774 Jun 10 12:04:06.800837 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:06.800763 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rwzth" event={"ID":"cbac9d68-b054-43af-8ca8-7fea047af7f3","Type":"ContainerStarted","Data":"99a9a30cd27e4067467247088cb8e2c56abab33abb2b15934e9a7e0dcf71e774"} Jun 10 12:04:09.881710 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:09.881673 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 12:04:09.882120 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:09.881764 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 12:04:09.882120 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:09.881809 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 12:04:10.821279 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:10.821241 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rwzth" event={"ID":"cbac9d68-b054-43af-8ca8-7fea047af7f3","Type":"ContainerStarted","Data":"4b88eb0a026ed599e8272726ceb2ba07d82e7dc86841260b12aa70beb32ce918"} Jun 10 12:04:10.849972 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:10.849915 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rwzth" podStartSLOduration=1.587218902 podStartE2EDuration="4.849896689s" totalImagesPullingTime="3.262677787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:04:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:04:10.849549538 +0000 UTC m=+359.055300376" watchObservedRunningTime="2026-06-10 12:04:10.849896689 +0000 UTC m=+359.055647535" Jun 10 12:04:11.396415 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:11.396386 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rwzth" Jun 10 12:04:11.400535 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:11.400514 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rwzth" Jun 10 12:04:11.825453 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:11.825370 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rwzth" Jun 10 12:04:11.826248 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:11.826227 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rwzth" Jun 10 12:04:25.765210 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:25.765170 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-npmqk"] Jun 10 12:04:25.770097 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:25.770078 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-npmqk" Jun 10 12:04:25.774599 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:25.774580 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 10 12:04:25.774709 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:25.774613 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-l9ggs\"" Jun 10 12:04:25.775498 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:25.775478 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 10 12:04:25.781669 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:25.781644 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-npmqk"] Jun 10 12:04:25.831248 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:25.831225 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlbhn\" (UniqueName: \"kubernetes.io/projected/dcc35ce5-5b3b-4a67-99b0-5c8378bc9486-kube-api-access-nlbhn\") pod \"kuadrant-operator-catalog-npmqk\" (UID: \"dcc35ce5-5b3b-4a67-99b0-5c8378bc9486\") " pod="kuadrant-system/kuadrant-operator-catalog-npmqk" Jun 10 12:04:25.932380 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:25.932353 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlbhn\" (UniqueName: \"kubernetes.io/projected/dcc35ce5-5b3b-4a67-99b0-5c8378bc9486-kube-api-access-nlbhn\") pod \"kuadrant-operator-catalog-npmqk\" (UID: \"dcc35ce5-5b3b-4a67-99b0-5c8378bc9486\") " pod="kuadrant-system/kuadrant-operator-catalog-npmqk" Jun 10 12:04:25.943355 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:25.943329 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlbhn\" (UniqueName: \"kubernetes.io/projected/dcc35ce5-5b3b-4a67-99b0-5c8378bc9486-kube-api-access-nlbhn\") pod \"kuadrant-operator-catalog-npmqk\" (UID: \"dcc35ce5-5b3b-4a67-99b0-5c8378bc9486\") " pod="kuadrant-system/kuadrant-operator-catalog-npmqk" Jun 10 12:04:26.079328 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:26.079242 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-npmqk" Jun 10 12:04:26.084806 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:26.084781 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-npmqk"] Jun 10 12:04:26.212923 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:26.212880 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-npmqk"] Jun 10 12:04:26.309468 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:26.309439 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fs8qt"] Jun 10 12:04:26.313094 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:26.313078 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fs8qt" Jun 10 12:04:26.323349 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:26.323325 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fs8qt"] Jun 10 12:04:26.436211 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:26.436183 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xbks\" (UniqueName: \"kubernetes.io/projected/f04aecf8-3e9e-4569-a6d5-68e4cbb2bfba-kube-api-access-9xbks\") pod \"kuadrant-operator-catalog-fs8qt\" (UID: \"f04aecf8-3e9e-4569-a6d5-68e4cbb2bfba\") " pod="kuadrant-system/kuadrant-operator-catalog-fs8qt" Jun 10 12:04:26.537059 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:26.537018 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xbks\" (UniqueName: \"kubernetes.io/projected/f04aecf8-3e9e-4569-a6d5-68e4cbb2bfba-kube-api-access-9xbks\") pod \"kuadrant-operator-catalog-fs8qt\" (UID: \"f04aecf8-3e9e-4569-a6d5-68e4cbb2bfba\") " pod="kuadrant-system/kuadrant-operator-catalog-fs8qt" Jun 10 12:04:26.548907 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:26.548883 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xbks\" (UniqueName: \"kubernetes.io/projected/f04aecf8-3e9e-4569-a6d5-68e4cbb2bfba-kube-api-access-9xbks\") pod \"kuadrant-operator-catalog-fs8qt\" (UID: \"f04aecf8-3e9e-4569-a6d5-68e4cbb2bfba\") " pod="kuadrant-system/kuadrant-operator-catalog-fs8qt" Jun 10 12:04:26.622452 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:26.622421 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fs8qt" Jun 10 12:04:26.767127 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:26.766833 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fs8qt"] Jun 10 12:04:26.769290 ip-10-0-139-86 kubenswrapper[2562]: W0610 12:04:26.769254 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf04aecf8_3e9e_4569_a6d5_68e4cbb2bfba.slice/crio-881d9e2a87573272d86e61c64a4920a0dd175f2dbf613980567fa91af913d6c2 WatchSource:0}: Error finding container 881d9e2a87573272d86e61c64a4920a0dd175f2dbf613980567fa91af913d6c2: Status 404 returned error can't find the container with id 881d9e2a87573272d86e61c64a4920a0dd175f2dbf613980567fa91af913d6c2 Jun 10 12:04:26.892808 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:26.892734 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fs8qt" event={"ID":"f04aecf8-3e9e-4569-a6d5-68e4cbb2bfba","Type":"ContainerStarted","Data":"881d9e2a87573272d86e61c64a4920a0dd175f2dbf613980567fa91af913d6c2"} Jun 10 12:04:26.894377 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:26.894348 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-npmqk" event={"ID":"dcc35ce5-5b3b-4a67-99b0-5c8378bc9486","Type":"ContainerStarted","Data":"92b2b70686329a6652368fca82c763e657eaeca0f4a2cae74b96edfcb923213b"} Jun 10 12:04:28.905683 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:28.905647 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-npmqk" event={"ID":"dcc35ce5-5b3b-4a67-99b0-5c8378bc9486","Type":"ContainerStarted","Data":"d838ba0a0f516eb192a53c8a95c0e21e533778a421f8261969d676d82d14f1b3"} Jun 10 12:04:28.906151 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:28.905690 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-npmqk" podUID="dcc35ce5-5b3b-4a67-99b0-5c8378bc9486" containerName="registry-server" containerID="cri-o://d838ba0a0f516eb192a53c8a95c0e21e533778a421f8261969d676d82d14f1b3" gracePeriod=2 Jun 10 12:04:28.907234 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:28.907208 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fs8qt" event={"ID":"f04aecf8-3e9e-4569-a6d5-68e4cbb2bfba","Type":"ContainerStarted","Data":"1b57d6baed17170d82e12fe217338db470f3973b1725f813f572f693033b145f"} Jun 10 12:04:28.925453 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:28.925415 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-npmqk" podStartSLOduration=1.7446185939999999 podStartE2EDuration="3.925400432s" totalImagesPullingTime="2.180781838s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:04:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:04:28.924060651 +0000 UTC m=+377.129811496" watchObservedRunningTime="2026-06-10 12:04:28.925400432 +0000 UTC m=+377.131151276" Jun 10 12:04:28.944462 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:28.944423 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-fs8qt" podStartSLOduration=1.313624154 podStartE2EDuration="2.944410108s" totalImagesPullingTime="1.630785954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:04:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:04:28.943416368 +0000 UTC m=+377.149167211" watchObservedRunningTime="2026-06-10 12:04:28.944410108 +0000 UTC m=+377.150160953" Jun 10 12:04:29.154416 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:29.154394 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-npmqk" Jun 10 12:04:29.263662 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:29.263588 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nlbhn\" (UniqueName: \"kubernetes.io/projected/dcc35ce5-5b3b-4a67-99b0-5c8378bc9486-kube-api-access-nlbhn\") pod \"dcc35ce5-5b3b-4a67-99b0-5c8378bc9486\" (UID: \"dcc35ce5-5b3b-4a67-99b0-5c8378bc9486\") " Jun 10 12:04:29.265690 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:29.265658 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcc35ce5-5b3b-4a67-99b0-5c8378bc9486-kube-api-access-nlbhn" (OuterVolumeSpecName: "kube-api-access-nlbhn") pod "dcc35ce5-5b3b-4a67-99b0-5c8378bc9486" (UID: "dcc35ce5-5b3b-4a67-99b0-5c8378bc9486"). InnerVolumeSpecName "kube-api-access-nlbhn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:04:29.364851 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:29.364822 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nlbhn\" (UniqueName: \"kubernetes.io/projected/dcc35ce5-5b3b-4a67-99b0-5c8378bc9486-kube-api-access-nlbhn\") on node \"ip-10-0-139-86.ec2.internal\" DevicePath \"\"" Jun 10 12:04:29.913341 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:29.913310 2562 generic.go:356] "Generic (PLEG): container finished" podID="dcc35ce5-5b3b-4a67-99b0-5c8378bc9486" containerID="d838ba0a0f516eb192a53c8a95c0e21e533778a421f8261969d676d82d14f1b3" exitCode=0 Jun 10 12:04:29.913767 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:29.913349 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-npmqk" Jun 10 12:04:29.913767 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:29.913385 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-npmqk" event={"ID":"dcc35ce5-5b3b-4a67-99b0-5c8378bc9486","Type":"ContainerDied","Data":"d838ba0a0f516eb192a53c8a95c0e21e533778a421f8261969d676d82d14f1b3"} Jun 10 12:04:29.913767 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:29.913432 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-npmqk" event={"ID":"dcc35ce5-5b3b-4a67-99b0-5c8378bc9486","Type":"ContainerDied","Data":"92b2b70686329a6652368fca82c763e657eaeca0f4a2cae74b96edfcb923213b"} Jun 10 12:04:29.913767 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:29.913450 2562 scope.go:117] "RemoveContainer" containerID="d838ba0a0f516eb192a53c8a95c0e21e533778a421f8261969d676d82d14f1b3" Jun 10 12:04:29.922388 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:29.922370 2562 scope.go:117] "RemoveContainer" containerID="d838ba0a0f516eb192a53c8a95c0e21e533778a421f8261969d676d82d14f1b3" Jun 10 12:04:29.922626 ip-10-0-139-86 kubenswrapper[2562]: E0610 12:04:29.922609 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d838ba0a0f516eb192a53c8a95c0e21e533778a421f8261969d676d82d14f1b3\": container with ID starting with d838ba0a0f516eb192a53c8a95c0e21e533778a421f8261969d676d82d14f1b3 not found: ID does not exist" containerID="d838ba0a0f516eb192a53c8a95c0e21e533778a421f8261969d676d82d14f1b3" Jun 10 12:04:29.922673 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:29.922635 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d838ba0a0f516eb192a53c8a95c0e21e533778a421f8261969d676d82d14f1b3"} err="failed to get container status \"d838ba0a0f516eb192a53c8a95c0e21e533778a421f8261969d676d82d14f1b3\": rpc error: code = NotFound desc = could not find container \"d838ba0a0f516eb192a53c8a95c0e21e533778a421f8261969d676d82d14f1b3\": container with ID starting with d838ba0a0f516eb192a53c8a95c0e21e533778a421f8261969d676d82d14f1b3 not found: ID does not exist" Jun 10 12:04:29.937200 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:29.937176 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-npmqk"] Jun 10 12:04:29.939899 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:29.939876 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-npmqk"] Jun 10 12:04:30.243415 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:30.243338 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcc35ce5-5b3b-4a67-99b0-5c8378bc9486" path="/var/lib/kubelet/pods/dcc35ce5-5b3b-4a67-99b0-5c8378bc9486/volumes" Jun 10 12:04:36.623367 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:36.623331 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-fs8qt" Jun 10 12:04:36.623872 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:36.623389 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-fs8qt" Jun 10 12:04:36.645407 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:36.645384 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-fs8qt" Jun 10 12:04:36.970304 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:36.970237 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-fs8qt" Jun 10 12:04:52.718623 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:52.718586 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-zsznv"] Jun 10 12:04:52.719155 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:52.719138 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcc35ce5-5b3b-4a67-99b0-5c8378bc9486" containerName="registry-server" Jun 10 12:04:52.719239 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:52.719158 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcc35ce5-5b3b-4a67-99b0-5c8378bc9486" containerName="registry-server" Jun 10 12:04:52.719239 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:52.719232 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="dcc35ce5-5b3b-4a67-99b0-5c8378bc9486" containerName="registry-server" Jun 10 12:04:52.741660 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:52.741637 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-zsznv"] Jun 10 12:04:52.741781 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:52.741727 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zsznv" Jun 10 12:04:52.744744 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:52.744721 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-ptb56\"" Jun 10 12:04:52.769439 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:52.769409 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6x2r\" (UniqueName: \"kubernetes.io/projected/3aad49b0-1d26-4747-8ba1-2aa3d166d944-kube-api-access-k6x2r\") pod \"authorino-operator-75cc8d5cb7-zsznv\" (UID: \"3aad49b0-1d26-4747-8ba1-2aa3d166d944\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-zsznv" Jun 10 12:04:52.870165 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:52.870138 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6x2r\" (UniqueName: \"kubernetes.io/projected/3aad49b0-1d26-4747-8ba1-2aa3d166d944-kube-api-access-k6x2r\") pod \"authorino-operator-75cc8d5cb7-zsznv\" (UID: \"3aad49b0-1d26-4747-8ba1-2aa3d166d944\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-zsznv" Jun 10 12:04:52.883295 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:52.883272 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6x2r\" (UniqueName: \"kubernetes.io/projected/3aad49b0-1d26-4747-8ba1-2aa3d166d944-kube-api-access-k6x2r\") pod \"authorino-operator-75cc8d5cb7-zsznv\" (UID: \"3aad49b0-1d26-4747-8ba1-2aa3d166d944\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-zsznv" Jun 10 12:04:53.053623 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:53.053542 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zsznv" Jun 10 12:04:53.184208 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:53.184180 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-zsznv"] Jun 10 12:04:53.187012 ip-10-0-139-86 kubenswrapper[2562]: W0610 12:04:53.186978 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3aad49b0_1d26_4747_8ba1_2aa3d166d944.slice/crio-fcc0f6fba9dbd4309fc74c40d53bb2215a35e3633b585b64bc9f29a93005ce0e WatchSource:0}: Error finding container fcc0f6fba9dbd4309fc74c40d53bb2215a35e3633b585b64bc9f29a93005ce0e: Status 404 returned error can't find the container with id fcc0f6fba9dbd4309fc74c40d53bb2215a35e3633b585b64bc9f29a93005ce0e Jun 10 12:04:54.025916 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:54.025874 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zsznv" event={"ID":"3aad49b0-1d26-4747-8ba1-2aa3d166d944","Type":"ContainerStarted","Data":"fcc0f6fba9dbd4309fc74c40d53bb2215a35e3633b585b64bc9f29a93005ce0e"} Jun 10 12:04:55.888970 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:55.888937 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qcchh"] Jun 10 12:04:55.891955 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:55.891939 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qcchh" Jun 10 12:04:55.894519 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:55.894498 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-fbkdf\"" Jun 10 12:04:55.902750 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:55.902727 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qcchh"] Jun 10 12:04:55.998947 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:55.998907 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd57l\" (UniqueName: \"kubernetes.io/projected/8779824a-0608-4a14-9872-5b8c4800bc01-kube-api-access-zd57l\") pod \"limitador-operator-controller-manager-859d7b78bd-qcchh\" (UID: \"8779824a-0608-4a14-9872-5b8c4800bc01\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qcchh" Jun 10 12:04:56.038360 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:56.038325 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zsznv" event={"ID":"3aad49b0-1d26-4747-8ba1-2aa3d166d944","Type":"ContainerStarted","Data":"7a04e046ac48cffb59d1c3b49b06e6fe242fa8a8026108a6014547b25c6dbba8"} Jun 10 12:04:56.038526 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:56.038399 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zsznv" Jun 10 12:04:56.069128 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:56.069065 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zsznv" podStartSLOduration=1.833360416 podStartE2EDuration="4.069030286s" totalImagesPullingTime="2.23566987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:04:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:04:56.067742833 +0000 UTC m=+404.273493679" watchObservedRunningTime="2026-06-10 12:04:56.069030286 +0000 UTC m=+404.274781132" Jun 10 12:04:56.099643 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:56.099612 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zd57l\" (UniqueName: \"kubernetes.io/projected/8779824a-0608-4a14-9872-5b8c4800bc01-kube-api-access-zd57l\") pod \"limitador-operator-controller-manager-859d7b78bd-qcchh\" (UID: \"8779824a-0608-4a14-9872-5b8c4800bc01\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qcchh" Jun 10 12:04:56.113567 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:56.113542 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd57l\" (UniqueName: \"kubernetes.io/projected/8779824a-0608-4a14-9872-5b8c4800bc01-kube-api-access-zd57l\") pod \"limitador-operator-controller-manager-859d7b78bd-qcchh\" (UID: \"8779824a-0608-4a14-9872-5b8c4800bc01\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qcchh" Jun 10 12:04:56.203334 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:56.203264 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qcchh" Jun 10 12:04:56.344723 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:56.344697 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qcchh"] Jun 10 12:04:56.347394 ip-10-0-139-86 kubenswrapper[2562]: W0610 12:04:56.347370 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8779824a_0608_4a14_9872_5b8c4800bc01.slice/crio-1ecf609235e01a7556b686cbd0e55ad400a5709949155d0f80c4e60c3fc25f2e WatchSource:0}: Error finding container 1ecf609235e01a7556b686cbd0e55ad400a5709949155d0f80c4e60c3fc25f2e: Status 404 returned error can't find the container with id 1ecf609235e01a7556b686cbd0e55ad400a5709949155d0f80c4e60c3fc25f2e Jun 10 12:04:57.044340 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:57.044307 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qcchh" event={"ID":"8779824a-0608-4a14-9872-5b8c4800bc01","Type":"ContainerStarted","Data":"1ecf609235e01a7556b686cbd0e55ad400a5709949155d0f80c4e60c3fc25f2e"} Jun 10 12:04:59.055087 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:59.055021 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qcchh" event={"ID":"8779824a-0608-4a14-9872-5b8c4800bc01","Type":"ContainerStarted","Data":"d9ce377e5b5039f52ddadfe9a122582ad988c61069711905c581fd27b2ac8861"} Jun 10 12:04:59.055466 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:59.055213 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qcchh" Jun 10 12:04:59.075739 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:04:59.075692 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qcchh" podStartSLOduration=1.928195581 podStartE2EDuration="4.075678675s" totalImagesPullingTime="2.147483094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:04:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:04:59.074519193 +0000 UTC m=+407.280270048" watchObservedRunningTime="2026-06-10 12:04:59.075678675 +0000 UTC m=+407.281429519" Jun 10 12:05:01.844868 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:01.844837 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-hvfvk"] Jun 10 12:05:01.848082 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:01.848067 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hvfvk" Jun 10 12:05:01.851207 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:01.851179 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 10 12:05:01.851207 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:01.851199 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-zcrkp\"" Jun 10 12:05:01.862341 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:01.862321 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-hvfvk"] Jun 10 12:05:01.949222 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:01.949189 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-688f5\" (UniqueName: \"kubernetes.io/projected/e5c6a5b8-3efa-473b-a4de-0364d67a9deb-kube-api-access-688f5\") pod \"dns-operator-controller-manager-864dd78c4c-hvfvk\" (UID: \"e5c6a5b8-3efa-473b-a4de-0364d67a9deb\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hvfvk" Jun 10 12:05:02.050420 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:02.050385 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-688f5\" (UniqueName: \"kubernetes.io/projected/e5c6a5b8-3efa-473b-a4de-0364d67a9deb-kube-api-access-688f5\") pod \"dns-operator-controller-manager-864dd78c4c-hvfvk\" (UID: \"e5c6a5b8-3efa-473b-a4de-0364d67a9deb\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hvfvk" Jun 10 12:05:02.061678 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:02.061653 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-688f5\" (UniqueName: \"kubernetes.io/projected/e5c6a5b8-3efa-473b-a4de-0364d67a9deb-kube-api-access-688f5\") pod \"dns-operator-controller-manager-864dd78c4c-hvfvk\" (UID: \"e5c6a5b8-3efa-473b-a4de-0364d67a9deb\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hvfvk" Jun 10 12:05:02.158229 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:02.158156 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hvfvk" Jun 10 12:05:02.292920 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:02.292892 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-hvfvk"] Jun 10 12:05:02.293367 ip-10-0-139-86 kubenswrapper[2562]: W0610 12:05:02.293342 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5c6a5b8_3efa_473b_a4de_0364d67a9deb.slice/crio-03452385bb0957d300e0b4a14e7aeef13ea1dfcc0fe1589f35f56e4375fed072 WatchSource:0}: Error finding container 03452385bb0957d300e0b4a14e7aeef13ea1dfcc0fe1589f35f56e4375fed072: Status 404 returned error can't find the container with id 03452385bb0957d300e0b4a14e7aeef13ea1dfcc0fe1589f35f56e4375fed072 Jun 10 12:05:03.076175 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:03.076148 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hvfvk" event={"ID":"e5c6a5b8-3efa-473b-a4de-0364d67a9deb","Type":"ContainerStarted","Data":"03452385bb0957d300e0b4a14e7aeef13ea1dfcc0fe1589f35f56e4375fed072"} Jun 10 12:05:05.087224 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:05.087190 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hvfvk" event={"ID":"e5c6a5b8-3efa-473b-a4de-0364d67a9deb","Type":"ContainerStarted","Data":"0df040b0dc654cd14a7ea5c96b7104bde2a320f8a6fae62698f7b70361dd6647"} Jun 10 12:05:05.087623 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:05.087321 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hvfvk" Jun 10 12:05:05.116783 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:05.116733 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hvfvk" podStartSLOduration=1.856048311 podStartE2EDuration="4.116719298s" totalImagesPullingTime="2.260670987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:05:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:05:05.115781391 +0000 UTC m=+413.321532230" watchObservedRunningTime="2026-06-10 12:05:05.116719298 +0000 UTC m=+413.322470142" Jun 10 12:05:07.046719 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:07.046688 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zsznv" Jun 10 12:05:10.062560 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:10.062528 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qcchh" Jun 10 12:05:16.094548 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:16.094513 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hvfvk" Jun 10 12:05:21.431397 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:21.431361 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-msmv5"] Jun 10 12:05:21.435300 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:21.435283 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-msmv5" Jun 10 12:05:21.442689 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:21.442627 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-n4xt6\"" Jun 10 12:05:21.507689 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:21.507660 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-msmv5"] Jun 10 12:05:21.520105 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:21.520080 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7114d385-fb63-421a-b268-1e21d15fa7bf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-msmv5\" (UID: \"7114d385-fb63-421a-b268-1e21d15fa7bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-msmv5" Jun 10 12:05:21.520230 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:21.520185 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqtn8\" (UniqueName: \"kubernetes.io/projected/7114d385-fb63-421a-b268-1e21d15fa7bf-kube-api-access-bqtn8\") pod \"kuadrant-operator-controller-manager-55467d9f7-msmv5\" (UID: \"7114d385-fb63-421a-b268-1e21d15fa7bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-msmv5" Jun 10 12:05:21.621284 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:21.621259 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqtn8\" (UniqueName: \"kubernetes.io/projected/7114d385-fb63-421a-b268-1e21d15fa7bf-kube-api-access-bqtn8\") pod \"kuadrant-operator-controller-manager-55467d9f7-msmv5\" (UID: \"7114d385-fb63-421a-b268-1e21d15fa7bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-msmv5" Jun 10 12:05:21.621416 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:21.621310 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7114d385-fb63-421a-b268-1e21d15fa7bf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-msmv5\" (UID: \"7114d385-fb63-421a-b268-1e21d15fa7bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-msmv5" Jun 10 12:05:21.621677 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:21.621654 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7114d385-fb63-421a-b268-1e21d15fa7bf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-msmv5\" (UID: \"7114d385-fb63-421a-b268-1e21d15fa7bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-msmv5" Jun 10 12:05:21.632957 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:21.632937 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqtn8\" (UniqueName: \"kubernetes.io/projected/7114d385-fb63-421a-b268-1e21d15fa7bf-kube-api-access-bqtn8\") pod \"kuadrant-operator-controller-manager-55467d9f7-msmv5\" (UID: \"7114d385-fb63-421a-b268-1e21d15fa7bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-msmv5" Jun 10 12:05:21.745336 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:21.745258 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-msmv5" Jun 10 12:05:21.884919 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:21.884893 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-msmv5"] Jun 10 12:05:21.888317 ip-10-0-139-86 kubenswrapper[2562]: W0610 12:05:21.888280 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7114d385_fb63_421a_b268_1e21d15fa7bf.slice/crio-6d0d683c29db7a1b6b3af6377308ef71aa9d2536a59624d4913ea14526b58e3c WatchSource:0}: Error finding container 6d0d683c29db7a1b6b3af6377308ef71aa9d2536a59624d4913ea14526b58e3c: Status 404 returned error can't find the container with id 6d0d683c29db7a1b6b3af6377308ef71aa9d2536a59624d4913ea14526b58e3c Jun 10 12:05:21.912449 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:21.912416 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-msmv5"] Jun 10 12:05:21.922152 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:21.922130 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-msmv5"] Jun 10 12:05:21.944316 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:21.944285 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nf5k8"] Jun 10 12:05:21.948453 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:21.948435 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nf5k8" Jun 10 12:05:21.962204 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:21.962102 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nf5k8"] Jun 10 12:05:21.964574 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:21.964554 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qcchh"] Jun 10 12:05:21.964738 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:21.964720 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qcchh" podUID="8779824a-0608-4a14-9872-5b8c4800bc01" containerName="manager" containerID="cri-o://d9ce377e5b5039f52ddadfe9a122582ad988c61069711905c581fd27b2ac8861" gracePeriod=2 Jun 10 12:05:21.977603 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:21.977573 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qcchh"] Jun 10 12:05:21.979971 ip-10-0-139-86 kubenswrapper[2562]: E0610 12:05:21.979927 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-qcchh\" is forbidden: User \"system:node:ip-10-0-139-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-86.ec2.internal' and this object" podUID="8779824a-0608-4a14-9872-5b8c4800bc01" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qcchh" Jun 10 12:05:21.991675 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:21.991655 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lqqbg"] Jun 10 12:05:21.992004 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:21.991993 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8779824a-0608-4a14-9872-5b8c4800bc01" containerName="manager" Jun 10 12:05:21.992059 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:21.992006 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8779824a-0608-4a14-9872-5b8c4800bc01" containerName="manager" Jun 10 12:05:21.992131 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:21.992121 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8779824a-0608-4a14-9872-5b8c4800bc01" containerName="manager" Jun 10 12:05:21.994134 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:21.994120 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lqqbg" Jun 10 12:05:22.007853 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:22.007774 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lqqbg"] Jun 10 12:05:22.026077 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:22.026032 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8nhn\" (UniqueName: \"kubernetes.io/projected/5fb0f4bf-4805-4d6d-b3bc-aedf0c9823f5-kube-api-access-q8nhn\") pod \"kuadrant-operator-controller-manager-55467d9f7-nf5k8\" (UID: \"5fb0f4bf-4805-4d6d-b3bc-aedf0c9823f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nf5k8" Jun 10 12:05:22.026206 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:22.026117 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5fb0f4bf-4805-4d6d-b3bc-aedf0c9823f5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-nf5k8\" (UID: \"5fb0f4bf-4805-4d6d-b3bc-aedf0c9823f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nf5k8" Jun 10 12:05:22.037355 ip-10-0-139-86 kubenswrapper[2562]: E0610 12:05:22.037326 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-qcchh\" is forbidden: User \"system:node:ip-10-0-139-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-86.ec2.internal' and this object" podUID="8779824a-0608-4a14-9872-5b8c4800bc01" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qcchh" Jun 10 12:05:22.127058 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:22.127016 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8nhn\" (UniqueName: \"kubernetes.io/projected/5fb0f4bf-4805-4d6d-b3bc-aedf0c9823f5-kube-api-access-q8nhn\") pod \"kuadrant-operator-controller-manager-55467d9f7-nf5k8\" (UID: \"5fb0f4bf-4805-4d6d-b3bc-aedf0c9823f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nf5k8" Jun 10 12:05:22.127231 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:22.127112 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5fb0f4bf-4805-4d6d-b3bc-aedf0c9823f5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-nf5k8\" (UID: \"5fb0f4bf-4805-4d6d-b3bc-aedf0c9823f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nf5k8" Jun 10 12:05:22.127231 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:22.127205 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpcrq\" (UniqueName: \"kubernetes.io/projected/c723e2ae-66ae-4674-9e6b-743e07293f71-kube-api-access-jpcrq\") pod \"limitador-operator-controller-manager-859d7b78bd-lqqbg\" (UID: \"c723e2ae-66ae-4674-9e6b-743e07293f71\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lqqbg" Jun 10 12:05:22.127467 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:22.127442 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5fb0f4bf-4805-4d6d-b3bc-aedf0c9823f5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-nf5k8\" (UID: \"5fb0f4bf-4805-4d6d-b3bc-aedf0c9823f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nf5k8" Jun 10 12:05:22.147119 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:22.147094 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8nhn\" (UniqueName: \"kubernetes.io/projected/5fb0f4bf-4805-4d6d-b3bc-aedf0c9823f5-kube-api-access-q8nhn\") pod \"kuadrant-operator-controller-manager-55467d9f7-nf5k8\" (UID: \"5fb0f4bf-4805-4d6d-b3bc-aedf0c9823f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nf5k8" Jun 10 12:05:22.167761 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:22.167734 2562 generic.go:356] "Generic (PLEG): container finished" podID="8779824a-0608-4a14-9872-5b8c4800bc01" containerID="d9ce377e5b5039f52ddadfe9a122582ad988c61069711905c581fd27b2ac8861" exitCode=0 Jun 10 12:05:22.196839 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:22.196819 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qcchh" Jun 10 12:05:22.199116 ip-10-0-139-86 kubenswrapper[2562]: E0610 12:05:22.199093 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-qcchh\" is forbidden: User \"system:node:ip-10-0-139-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-86.ec2.internal' and this object" podUID="8779824a-0608-4a14-9872-5b8c4800bc01" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qcchh" Jun 10 12:05:22.228483 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:22.228455 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpcrq\" (UniqueName: \"kubernetes.io/projected/c723e2ae-66ae-4674-9e6b-743e07293f71-kube-api-access-jpcrq\") pod \"limitador-operator-controller-manager-859d7b78bd-lqqbg\" (UID: \"c723e2ae-66ae-4674-9e6b-743e07293f71\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lqqbg" Jun 10 12:05:22.242181 ip-10-0-139-86 kubenswrapper[2562]: E0610 12:05:22.242149 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-qcchh\" is forbidden: User \"system:node:ip-10-0-139-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-86.ec2.internal' and this object" podUID="8779824a-0608-4a14-9872-5b8c4800bc01" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qcchh" Jun 10 12:05:22.242535 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:22.242513 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpcrq\" (UniqueName: \"kubernetes.io/projected/c723e2ae-66ae-4674-9e6b-743e07293f71-kube-api-access-jpcrq\") pod \"limitador-operator-controller-manager-859d7b78bd-lqqbg\" (UID: \"c723e2ae-66ae-4674-9e6b-743e07293f71\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lqqbg" Jun 10 12:05:22.264291 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:22.264225 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nf5k8" Jun 10 12:05:22.329819 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:22.329789 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zd57l\" (UniqueName: \"kubernetes.io/projected/8779824a-0608-4a14-9872-5b8c4800bc01-kube-api-access-zd57l\") pod \"8779824a-0608-4a14-9872-5b8c4800bc01\" (UID: \"8779824a-0608-4a14-9872-5b8c4800bc01\") " Jun 10 12:05:22.331660 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:22.331636 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8779824a-0608-4a14-9872-5b8c4800bc01-kube-api-access-zd57l" (OuterVolumeSpecName: "kube-api-access-zd57l") pod "8779824a-0608-4a14-9872-5b8c4800bc01" (UID: "8779824a-0608-4a14-9872-5b8c4800bc01"). InnerVolumeSpecName "kube-api-access-zd57l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:05:22.335752 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:22.335729 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lqqbg" Jun 10 12:05:22.413371 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:22.413275 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nf5k8"] Jun 10 12:05:22.415403 ip-10-0-139-86 kubenswrapper[2562]: W0610 12:05:22.415348 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fb0f4bf_4805_4d6d_b3bc_aedf0c9823f5.slice/crio-e310ffc9dc2ca713692b60ea0d23abac16b8e76f3ae34d13bf6735c6e311bdfd WatchSource:0}: Error finding container e310ffc9dc2ca713692b60ea0d23abac16b8e76f3ae34d13bf6735c6e311bdfd: Status 404 returned error can't find the container with id e310ffc9dc2ca713692b60ea0d23abac16b8e76f3ae34d13bf6735c6e311bdfd Jun 10 12:05:22.431341 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:22.431309 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zd57l\" (UniqueName: \"kubernetes.io/projected/8779824a-0608-4a14-9872-5b8c4800bc01-kube-api-access-zd57l\") on node \"ip-10-0-139-86.ec2.internal\" DevicePath \"\"" Jun 10 12:05:22.500083 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:22.499918 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lqqbg"] Jun 10 12:05:22.502752 ip-10-0-139-86 kubenswrapper[2562]: W0610 12:05:22.502723 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc723e2ae_66ae_4674_9e6b_743e07293f71.slice/crio-eb00bdf8d757438495bc4c3ab46c772182924fe9a005d1fbc226042c70093323 WatchSource:0}: Error finding container eb00bdf8d757438495bc4c3ab46c772182924fe9a005d1fbc226042c70093323: Status 404 returned error can't find the container with id eb00bdf8d757438495bc4c3ab46c772182924fe9a005d1fbc226042c70093323 Jun 10 12:05:23.175402 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:23.175357 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nf5k8" event={"ID":"5fb0f4bf-4805-4d6d-b3bc-aedf0c9823f5","Type":"ContainerStarted","Data":"e310ffc9dc2ca713692b60ea0d23abac16b8e76f3ae34d13bf6735c6e311bdfd"} Jun 10 12:05:23.176891 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:23.176860 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qcchh" Jun 10 12:05:23.177032 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:23.176874 2562 scope.go:117] "RemoveContainer" containerID="d9ce377e5b5039f52ddadfe9a122582ad988c61069711905c581fd27b2ac8861" Jun 10 12:05:23.178754 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:23.178724 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lqqbg" event={"ID":"c723e2ae-66ae-4674-9e6b-743e07293f71","Type":"ContainerStarted","Data":"dca3b241577ed6153c05aec04f6f084c56fc5c895ece315e6f6d4b2231ae93fb"} Jun 10 12:05:23.178876 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:23.178777 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lqqbg" event={"ID":"c723e2ae-66ae-4674-9e6b-743e07293f71","Type":"ContainerStarted","Data":"eb00bdf8d757438495bc4c3ab46c772182924fe9a005d1fbc226042c70093323"} Jun 10 12:05:23.178944 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:23.178913 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lqqbg" Jun 10 12:05:23.202349 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:23.202306 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lqqbg" podStartSLOduration=2.202290371 podStartE2EDuration="2.202290371s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:05:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:05:23.201591879 +0000 UTC m=+431.407342723" watchObservedRunningTime="2026-06-10 12:05:23.202290371 +0000 UTC m=+431.408041217" Jun 10 12:05:24.244385 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:24.244345 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8779824a-0608-4a14-9872-5b8c4800bc01" path="/var/lib/kubelet/pods/8779824a-0608-4a14-9872-5b8c4800bc01/volumes" Jun 10 12:05:27.203226 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:27.203189 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nf5k8" event={"ID":"5fb0f4bf-4805-4d6d-b3bc-aedf0c9823f5","Type":"ContainerStarted","Data":"3cc6a0b053cfcba2407e6dcbd8d55222154d81982b834ef606ab89bf4c1fbf12"} Jun 10 12:05:27.203708 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:27.203296 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nf5k8" Jun 10 12:05:27.204897 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:27.204849 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-msmv5" podUID="7114d385-fb63-421a-b268-1e21d15fa7bf" containerName="manager" containerID="cri-o://5d78cb4abd2922061bd3d0622bfa743f16a35fb1ffcc646cd26ac516185cc871" gracePeriod=2 Jun 10 12:05:27.225786 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:27.225717 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nf5k8" podStartSLOduration=2.433753833 podStartE2EDuration="6.225700491s" totalImagesPullingTime="3.791946658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:05:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:05:27.224498338 +0000 UTC m=+435.430249182" watchObservedRunningTime="2026-06-10 12:05:27.225700491 +0000 UTC m=+435.431451334" Jun 10 12:05:27.451818 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:27.451783 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-msmv5" Jun 10 12:05:27.454112 ip-10-0-139-86 kubenswrapper[2562]: E0610 12:05:27.454055 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-msmv5\" is forbidden: User \"system:node:ip-10-0-139-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-86.ec2.internal' and this object" podUID="7114d385-fb63-421a-b268-1e21d15fa7bf" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-msmv5" Jun 10 12:05:27.579824 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:27.579791 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7114d385-fb63-421a-b268-1e21d15fa7bf-extensions-socket-volume\") pod \"7114d385-fb63-421a-b268-1e21d15fa7bf\" (UID: \"7114d385-fb63-421a-b268-1e21d15fa7bf\") " Jun 10 12:05:27.579978 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:27.579885 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqtn8\" (UniqueName: \"kubernetes.io/projected/7114d385-fb63-421a-b268-1e21d15fa7bf-kube-api-access-bqtn8\") pod \"7114d385-fb63-421a-b268-1e21d15fa7bf\" (UID: \"7114d385-fb63-421a-b268-1e21d15fa7bf\") " Jun 10 12:05:27.580092 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:27.580067 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7114d385-fb63-421a-b268-1e21d15fa7bf-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7114d385-fb63-421a-b268-1e21d15fa7bf" (UID: "7114d385-fb63-421a-b268-1e21d15fa7bf"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:05:27.580189 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:27.580172 2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7114d385-fb63-421a-b268-1e21d15fa7bf-extensions-socket-volume\") on node \"ip-10-0-139-86.ec2.internal\" DevicePath \"\"" Jun 10 12:05:27.581873 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:27.581845 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7114d385-fb63-421a-b268-1e21d15fa7bf-kube-api-access-bqtn8" (OuterVolumeSpecName: "kube-api-access-bqtn8") pod "7114d385-fb63-421a-b268-1e21d15fa7bf" (UID: "7114d385-fb63-421a-b268-1e21d15fa7bf"). InnerVolumeSpecName "kube-api-access-bqtn8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:05:27.681304 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:27.681275 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqtn8\" (UniqueName: \"kubernetes.io/projected/7114d385-fb63-421a-b268-1e21d15fa7bf-kube-api-access-bqtn8\") on node \"ip-10-0-139-86.ec2.internal\" DevicePath \"\"" Jun 10 12:05:28.211952 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:28.211917 2562 generic.go:356] "Generic (PLEG): container finished" podID="7114d385-fb63-421a-b268-1e21d15fa7bf" containerID="5d78cb4abd2922061bd3d0622bfa743f16a35fb1ffcc646cd26ac516185cc871" exitCode=2 Jun 10 12:05:28.212439 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:28.211965 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-msmv5" Jun 10 12:05:28.212439 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:28.212025 2562 scope.go:117] "RemoveContainer" containerID="5d78cb4abd2922061bd3d0622bfa743f16a35fb1ffcc646cd26ac516185cc871" Jun 10 12:05:28.214436 ip-10-0-139-86 kubenswrapper[2562]: E0610 12:05:28.214403 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-msmv5\" is forbidden: User \"system:node:ip-10-0-139-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-86.ec2.internal' and this object" podUID="7114d385-fb63-421a-b268-1e21d15fa7bf" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-msmv5" Jun 10 12:05:28.220687 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:28.220669 2562 scope.go:117] "RemoveContainer" containerID="5d78cb4abd2922061bd3d0622bfa743f16a35fb1ffcc646cd26ac516185cc871" Jun 10 12:05:28.220926 ip-10-0-139-86 kubenswrapper[2562]: E0610 12:05:28.220909 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d78cb4abd2922061bd3d0622bfa743f16a35fb1ffcc646cd26ac516185cc871\": container with ID starting with 5d78cb4abd2922061bd3d0622bfa743f16a35fb1ffcc646cd26ac516185cc871 not found: ID does not exist" containerID="5d78cb4abd2922061bd3d0622bfa743f16a35fb1ffcc646cd26ac516185cc871" Jun 10 12:05:28.220985 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:28.220938 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d78cb4abd2922061bd3d0622bfa743f16a35fb1ffcc646cd26ac516185cc871"} err="failed to get container status \"5d78cb4abd2922061bd3d0622bfa743f16a35fb1ffcc646cd26ac516185cc871\": rpc error: code = NotFound desc = could not find container \"5d78cb4abd2922061bd3d0622bfa743f16a35fb1ffcc646cd26ac516185cc871\": container with ID starting with 5d78cb4abd2922061bd3d0622bfa743f16a35fb1ffcc646cd26ac516185cc871 not found: ID does not exist" Jun 10 12:05:28.222536 ip-10-0-139-86 kubenswrapper[2562]: E0610 12:05:28.222512 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-msmv5\" is forbidden: User \"system:node:ip-10-0-139-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-86.ec2.internal' and this object" podUID="7114d385-fb63-421a-b268-1e21d15fa7bf" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-msmv5" Jun 10 12:05:28.243119 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:28.243100 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7114d385-fb63-421a-b268-1e21d15fa7bf" path="/var/lib/kubelet/pods/7114d385-fb63-421a-b268-1e21d15fa7bf/volumes" Jun 10 12:05:34.187456 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:34.187372 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lqqbg" Jun 10 12:05:38.214547 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:38.214510 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nf5k8" Jun 10 12:05:50.253934 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:50.253486 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nf5k8"] Jun 10 12:05:50.253934 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:50.253648 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nf5k8" podUID="5fb0f4bf-4805-4d6d-b3bc-aedf0c9823f5" containerName="manager" containerID="cri-o://3cc6a0b053cfcba2407e6dcbd8d55222154d81982b834ef606ab89bf4c1fbf12" gracePeriod=10 Jun 10 12:05:50.505398 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:50.505343 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nf5k8" Jun 10 12:05:50.579628 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:50.579601 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5fb0f4bf-4805-4d6d-b3bc-aedf0c9823f5-extensions-socket-volume\") pod \"5fb0f4bf-4805-4d6d-b3bc-aedf0c9823f5\" (UID: \"5fb0f4bf-4805-4d6d-b3bc-aedf0c9823f5\") " Jun 10 12:05:50.579810 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:50.579651 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q8nhn\" (UniqueName: \"kubernetes.io/projected/5fb0f4bf-4805-4d6d-b3bc-aedf0c9823f5-kube-api-access-q8nhn\") pod \"5fb0f4bf-4805-4d6d-b3bc-aedf0c9823f5\" (UID: \"5fb0f4bf-4805-4d6d-b3bc-aedf0c9823f5\") " Jun 10 12:05:50.580078 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:50.580032 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fb0f4bf-4805-4d6d-b3bc-aedf0c9823f5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5fb0f4bf-4805-4d6d-b3bc-aedf0c9823f5" (UID: "5fb0f4bf-4805-4d6d-b3bc-aedf0c9823f5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:05:50.581785 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:50.581763 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fb0f4bf-4805-4d6d-b3bc-aedf0c9823f5-kube-api-access-q8nhn" (OuterVolumeSpecName: "kube-api-access-q8nhn") pod "5fb0f4bf-4805-4d6d-b3bc-aedf0c9823f5" (UID: "5fb0f4bf-4805-4d6d-b3bc-aedf0c9823f5"). InnerVolumeSpecName "kube-api-access-q8nhn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:05:50.681218 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:50.681189 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q8nhn\" (UniqueName: \"kubernetes.io/projected/5fb0f4bf-4805-4d6d-b3bc-aedf0c9823f5-kube-api-access-q8nhn\") on node \"ip-10-0-139-86.ec2.internal\" DevicePath \"\"" Jun 10 12:05:50.681218 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:50.681213 2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5fb0f4bf-4805-4d6d-b3bc-aedf0c9823f5-extensions-socket-volume\") on node \"ip-10-0-139-86.ec2.internal\" DevicePath \"\"" Jun 10 12:05:51.327193 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:51.327155 2562 generic.go:356] "Generic (PLEG): container finished" podID="5fb0f4bf-4805-4d6d-b3bc-aedf0c9823f5" containerID="3cc6a0b053cfcba2407e6dcbd8d55222154d81982b834ef606ab89bf4c1fbf12" exitCode=0 Jun 10 12:05:51.327585 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:51.327205 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nf5k8" Jun 10 12:05:51.327585 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:51.327204 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nf5k8" event={"ID":"5fb0f4bf-4805-4d6d-b3bc-aedf0c9823f5","Type":"ContainerDied","Data":"3cc6a0b053cfcba2407e6dcbd8d55222154d81982b834ef606ab89bf4c1fbf12"} Jun 10 12:05:51.327585 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:51.327311 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nf5k8" event={"ID":"5fb0f4bf-4805-4d6d-b3bc-aedf0c9823f5","Type":"ContainerDied","Data":"e310ffc9dc2ca713692b60ea0d23abac16b8e76f3ae34d13bf6735c6e311bdfd"} Jun 10 12:05:51.327585 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:51.327338 2562 scope.go:117] "RemoveContainer" containerID="3cc6a0b053cfcba2407e6dcbd8d55222154d81982b834ef606ab89bf4c1fbf12" Jun 10 12:05:51.335912 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:51.335894 2562 scope.go:117] "RemoveContainer" containerID="3cc6a0b053cfcba2407e6dcbd8d55222154d81982b834ef606ab89bf4c1fbf12" Jun 10 12:05:51.336180 ip-10-0-139-86 kubenswrapper[2562]: E0610 12:05:51.336161 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cc6a0b053cfcba2407e6dcbd8d55222154d81982b834ef606ab89bf4c1fbf12\": container with ID starting with 3cc6a0b053cfcba2407e6dcbd8d55222154d81982b834ef606ab89bf4c1fbf12 not found: ID does not exist" containerID="3cc6a0b053cfcba2407e6dcbd8d55222154d81982b834ef606ab89bf4c1fbf12" Jun 10 12:05:51.336232 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:51.336188 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cc6a0b053cfcba2407e6dcbd8d55222154d81982b834ef606ab89bf4c1fbf12"} err="failed to get container status \"3cc6a0b053cfcba2407e6dcbd8d55222154d81982b834ef606ab89bf4c1fbf12\": rpc error: code = NotFound desc = could not find container \"3cc6a0b053cfcba2407e6dcbd8d55222154d81982b834ef606ab89bf4c1fbf12\": container with ID starting with 3cc6a0b053cfcba2407e6dcbd8d55222154d81982b834ef606ab89bf4c1fbf12 not found: ID does not exist" Jun 10 12:05:51.350996 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:51.350973 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nf5k8"] Jun 10 12:05:51.359917 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:51.359896 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nf5k8"] Jun 10 12:05:52.243396 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:52.243366 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fb0f4bf-4805-4d6d-b3bc-aedf0c9823f5" path="/var/lib/kubelet/pods/5fb0f4bf-4805-4d6d-b3bc-aedf0c9823f5/volumes" Jun 10 12:05:54.684696 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:54.684664 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mcwg"] Jun 10 12:05:54.685243 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:54.685220 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7114d385-fb63-421a-b268-1e21d15fa7bf" containerName="manager" Jun 10 12:05:54.685458 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:54.685436 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7114d385-fb63-421a-b268-1e21d15fa7bf" containerName="manager" Jun 10 12:05:54.685575 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:54.685492 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fb0f4bf-4805-4d6d-b3bc-aedf0c9823f5" containerName="manager" Jun 10 12:05:54.685575 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:54.685503 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fb0f4bf-4805-4d6d-b3bc-aedf0c9823f5" containerName="manager" Jun 10 12:05:54.685711 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:54.685620 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fb0f4bf-4805-4d6d-b3bc-aedf0c9823f5" containerName="manager" Jun 10 12:05:54.685711 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:54.685637 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7114d385-fb63-421a-b268-1e21d15fa7bf" containerName="manager" Jun 10 12:05:54.688700 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:54.688682 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mcwg" Jun 10 12:05:54.691246 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:54.691224 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-5fb5v\"" Jun 10 12:05:54.704865 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:54.704842 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mcwg"] Jun 10 12:05:54.817835 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:54.817807 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d2589db-da8b-477e-b85f-61fe499661ca-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-7mcwg\" (UID: \"0d2589db-da8b-477e-b85f-61fe499661ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mcwg" Jun 10 12:05:54.818005 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:54.817846 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d2589db-da8b-477e-b85f-61fe499661ca-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-7mcwg\" (UID: \"0d2589db-da8b-477e-b85f-61fe499661ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mcwg" Jun 10 12:05:54.818005 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:54.817865 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d2589db-da8b-477e-b85f-61fe499661ca-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-7mcwg\" (UID: \"0d2589db-da8b-477e-b85f-61fe499661ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mcwg" Jun 10 12:05:54.818005 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:54.817885 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d2589db-da8b-477e-b85f-61fe499661ca-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-7mcwg\" (UID: \"0d2589db-da8b-477e-b85f-61fe499661ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mcwg" Jun 10 12:05:54.818005 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:54.817914 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d2589db-da8b-477e-b85f-61fe499661ca-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-7mcwg\" (UID: \"0d2589db-da8b-477e-b85f-61fe499661ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mcwg" Jun 10 12:05:54.818005 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:54.817951 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d2589db-da8b-477e-b85f-61fe499661ca-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-7mcwg\" (UID: \"0d2589db-da8b-477e-b85f-61fe499661ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mcwg" Jun 10 12:05:54.818197 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:54.818034 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d2589db-da8b-477e-b85f-61fe499661ca-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-7mcwg\" (UID: \"0d2589db-da8b-477e-b85f-61fe499661ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mcwg" Jun 10 12:05:54.818197 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:54.818086 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nb5v7\" (UniqueName: \"kubernetes.io/projected/0d2589db-da8b-477e-b85f-61fe499661ca-kube-api-access-nb5v7\") pod \"maas-default-gateway-openshift-default-687ff6996-7mcwg\" (UID: \"0d2589db-da8b-477e-b85f-61fe499661ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mcwg" Jun 10 12:05:54.818197 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:54.818118 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d2589db-da8b-477e-b85f-61fe499661ca-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-7mcwg\" (UID: \"0d2589db-da8b-477e-b85f-61fe499661ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mcwg" Jun 10 12:05:54.918876 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:54.918846 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d2589db-da8b-477e-b85f-61fe499661ca-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-7mcwg\" (UID: \"0d2589db-da8b-477e-b85f-61fe499661ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mcwg" Jun 10 12:05:54.919100 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:54.918888 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb5v7\" (UniqueName: \"kubernetes.io/projected/0d2589db-da8b-477e-b85f-61fe499661ca-kube-api-access-nb5v7\") pod \"maas-default-gateway-openshift-default-687ff6996-7mcwg\" (UID: \"0d2589db-da8b-477e-b85f-61fe499661ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mcwg" Jun 10 12:05:54.919100 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:54.918926 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d2589db-da8b-477e-b85f-61fe499661ca-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-7mcwg\" (UID: \"0d2589db-da8b-477e-b85f-61fe499661ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mcwg" Jun 10 12:05:54.919100 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:54.918966 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d2589db-da8b-477e-b85f-61fe499661ca-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-7mcwg\" (UID: \"0d2589db-da8b-477e-b85f-61fe499661ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mcwg" Jun 10 12:05:54.919100 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:54.919002 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d2589db-da8b-477e-b85f-61fe499661ca-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-7mcwg\" (UID: \"0d2589db-da8b-477e-b85f-61fe499661ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mcwg" Jun 10 12:05:54.919100 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:54.919027 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d2589db-da8b-477e-b85f-61fe499661ca-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-7mcwg\" (UID: \"0d2589db-da8b-477e-b85f-61fe499661ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mcwg" Jun 10 12:05:54.919100 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:54.919075 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d2589db-da8b-477e-b85f-61fe499661ca-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-7mcwg\" (UID: \"0d2589db-da8b-477e-b85f-61fe499661ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mcwg" Jun 10 12:05:54.919366 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:54.919103 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d2589db-da8b-477e-b85f-61fe499661ca-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-7mcwg\" (UID: \"0d2589db-da8b-477e-b85f-61fe499661ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mcwg" Jun 10 12:05:54.919366 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:54.919156 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d2589db-da8b-477e-b85f-61fe499661ca-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-7mcwg\" (UID: \"0d2589db-da8b-477e-b85f-61fe499661ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mcwg" Jun 10 12:05:54.919366 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:54.919293 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d2589db-da8b-477e-b85f-61fe499661ca-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-7mcwg\" (UID: \"0d2589db-da8b-477e-b85f-61fe499661ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mcwg" Jun 10 12:05:54.919366 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:54.919313 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d2589db-da8b-477e-b85f-61fe499661ca-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-7mcwg\" (UID: \"0d2589db-da8b-477e-b85f-61fe499661ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mcwg" Jun 10 12:05:54.919519 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:54.919497 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d2589db-da8b-477e-b85f-61fe499661ca-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-7mcwg\" (UID: \"0d2589db-da8b-477e-b85f-61fe499661ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mcwg" Jun 10 12:05:54.919568 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:54.919534 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d2589db-da8b-477e-b85f-61fe499661ca-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-7mcwg\" (UID: \"0d2589db-da8b-477e-b85f-61fe499661ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mcwg" Jun 10 12:05:54.919818 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:54.919801 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d2589db-da8b-477e-b85f-61fe499661ca-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-7mcwg\" (UID: \"0d2589db-da8b-477e-b85f-61fe499661ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mcwg" Jun 10 12:05:54.921477 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:54.921450 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d2589db-da8b-477e-b85f-61fe499661ca-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-7mcwg\" (UID: \"0d2589db-da8b-477e-b85f-61fe499661ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mcwg" Jun 10 12:05:54.921682 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:54.921662 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d2589db-da8b-477e-b85f-61fe499661ca-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-7mcwg\" (UID: \"0d2589db-da8b-477e-b85f-61fe499661ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mcwg" Jun 10 12:05:54.931829 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:54.931807 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nb5v7\" (UniqueName: \"kubernetes.io/projected/0d2589db-da8b-477e-b85f-61fe499661ca-kube-api-access-nb5v7\") pod \"maas-default-gateway-openshift-default-687ff6996-7mcwg\" (UID: \"0d2589db-da8b-477e-b85f-61fe499661ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mcwg" Jun 10 12:05:54.940331 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:54.940263 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d2589db-da8b-477e-b85f-61fe499661ca-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-7mcwg\" (UID: \"0d2589db-da8b-477e-b85f-61fe499661ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mcwg" Jun 10 12:05:54.999021 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:54.999001 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mcwg" Jun 10 12:05:55.142953 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:55.142928 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mcwg"] Jun 10 12:05:55.145184 ip-10-0-139-86 kubenswrapper[2562]: W0610 12:05:55.145158 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d2589db_da8b_477e_b85f_61fe499661ca.slice/crio-d5d8c194829de82fe84bec677401af6c2f44065fa8c708e240497c8636fb4160 WatchSource:0}: Error finding container d5d8c194829de82fe84bec677401af6c2f44065fa8c708e240497c8636fb4160: Status 404 returned error can't find the container with id d5d8c194829de82fe84bec677401af6c2f44065fa8c708e240497c8636fb4160 Jun 10 12:05:55.147221 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:55.147192 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 12:05:55.147311 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:55.147252 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 12:05:55.147311 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:55.147279 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 12:05:55.348485 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:55.348449 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mcwg" event={"ID":"0d2589db-da8b-477e-b85f-61fe499661ca","Type":"ContainerStarted","Data":"325830d6420e23e394bafe5260c4df691c355ebd8150c41224241ad94d694134"} Jun 10 12:05:55.348648 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:55.348501 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mcwg" event={"ID":"0d2589db-da8b-477e-b85f-61fe499661ca","Type":"ContainerStarted","Data":"d5d8c194829de82fe84bec677401af6c2f44065fa8c708e240497c8636fb4160"} Jun 10 12:05:55.384894 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:55.384834 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mcwg" podStartSLOduration=1.384817204 podStartE2EDuration="1.384817204s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:05:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:05:55.382858814 +0000 UTC m=+463.588609659" watchObservedRunningTime="2026-06-10 12:05:55.384817204 +0000 UTC m=+463.590568048" Jun 10 12:05:55.999356 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:55.999327 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mcwg" Jun 10 12:05:57.004646 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:57.004615 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mcwg" Jun 10 12:05:57.357316 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:57.357286 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mcwg" Jun 10 12:05:57.358290 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:05:57.358272 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mcwg" Jun 10 12:06:09.995818 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:06:09.995782 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:06:09.999457 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:06:09.999437 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-gjp6l" Jun 10 12:06:10.002599 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:06:10.002544 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 10 12:06:10.002842 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:06:10.002824 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-bq68q\"" Jun 10 12:06:10.010127 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:06:10.010104 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:06:10.052689 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:06:10.052660 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:06:10.152967 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:06:10.152940 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwg4l\" (UniqueName: \"kubernetes.io/projected/1a7a982b-f7e7-4d1c-8db7-f83d36bc6f02-kube-api-access-wwg4l\") pod \"limitador-limitador-54d6d988d5-gjp6l\" (UID: \"1a7a982b-f7e7-4d1c-8db7-f83d36bc6f02\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gjp6l" Jun 10 12:06:10.153154 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:06:10.153117 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1a7a982b-f7e7-4d1c-8db7-f83d36bc6f02-config-file\") pod \"limitador-limitador-54d6d988d5-gjp6l\" (UID: \"1a7a982b-f7e7-4d1c-8db7-f83d36bc6f02\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gjp6l" Jun 10 12:06:10.254228 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:06:10.254154 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwg4l\" (UniqueName: \"kubernetes.io/projected/1a7a982b-f7e7-4d1c-8db7-f83d36bc6f02-kube-api-access-wwg4l\") pod \"limitador-limitador-54d6d988d5-gjp6l\" (UID: \"1a7a982b-f7e7-4d1c-8db7-f83d36bc6f02\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gjp6l" Jun 10 12:06:10.254369 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:06:10.254285 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1a7a982b-f7e7-4d1c-8db7-f83d36bc6f02-config-file\") pod \"limitador-limitador-54d6d988d5-gjp6l\" (UID: \"1a7a982b-f7e7-4d1c-8db7-f83d36bc6f02\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gjp6l" Jun 10 12:06:10.254886 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:06:10.254863 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1a7a982b-f7e7-4d1c-8db7-f83d36bc6f02-config-file\") pod \"limitador-limitador-54d6d988d5-gjp6l\" (UID: \"1a7a982b-f7e7-4d1c-8db7-f83d36bc6f02\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gjp6l" Jun 10 12:06:10.264776 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:06:10.264750 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwg4l\" (UniqueName: \"kubernetes.io/projected/1a7a982b-f7e7-4d1c-8db7-f83d36bc6f02-kube-api-access-wwg4l\") pod \"limitador-limitador-54d6d988d5-gjp6l\" (UID: \"1a7a982b-f7e7-4d1c-8db7-f83d36bc6f02\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gjp6l" Jun 10 12:06:10.310757 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:06:10.310736 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-gjp6l" Jun 10 12:06:10.445424 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:06:10.445399 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:06:10.447210 ip-10-0-139-86 kubenswrapper[2562]: W0610 12:06:10.447184 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a7a982b_f7e7_4d1c_8db7_f83d36bc6f02.slice/crio-63a80ee4d4097b1539e8b27a0c872dbf0514aa29629c4078684c0c0ad75a7fe0 WatchSource:0}: Error finding container 63a80ee4d4097b1539e8b27a0c872dbf0514aa29629c4078684c0c0ad75a7fe0: Status 404 returned error can't find the container with id 63a80ee4d4097b1539e8b27a0c872dbf0514aa29629c4078684c0c0ad75a7fe0 Jun 10 12:06:11.429756 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:06:11.429711 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-gjp6l" event={"ID":"1a7a982b-f7e7-4d1c-8db7-f83d36bc6f02","Type":"ContainerStarted","Data":"63a80ee4d4097b1539e8b27a0c872dbf0514aa29629c4078684c0c0ad75a7fe0"} Jun 10 12:06:13.439816 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:06:13.439781 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-gjp6l" event={"ID":"1a7a982b-f7e7-4d1c-8db7-f83d36bc6f02","Type":"ContainerStarted","Data":"934d09ff61b8eff6f83027eb97ac3382074e247f6700c947e98f44eaae9298ad"} Jun 10 12:06:13.440343 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:06:13.439918 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-gjp6l" Jun 10 12:06:13.462117 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:06:13.462065 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-gjp6l" podStartSLOduration=1.910262611 podStartE2EDuration="4.462026135s" totalImagesPullingTime="2.551763524s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:06:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:06:13.461417911 +0000 UTC m=+481.667168755" watchObservedRunningTime="2026-06-10 12:06:13.462026135 +0000 UTC m=+481.667776980" Jun 10 12:06:24.446567 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:06:24.446534 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-gjp6l" Jun 10 12:08:23.807994 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:08:23.807950 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:08:32.101357 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:08:32.101324 2562 generic.go:356] "Generic (PLEG): container finished" podID="0d2589db-da8b-477e-b85f-61fe499661ca" containerID="325830d6420e23e394bafe5260c4df691c355ebd8150c41224241ad94d694134" exitCode=0 Jun 10 12:08:32.101872 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:08:32.101401 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mcwg" event={"ID":"0d2589db-da8b-477e-b85f-61fe499661ca","Type":"ContainerDied","Data":"325830d6420e23e394bafe5260c4df691c355ebd8150c41224241ad94d694134"} Jun 10 12:08:32.101942 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:08:32.101881 2562 scope.go:117] "RemoveContainer" containerID="325830d6420e23e394bafe5260c4df691c355ebd8150c41224241ad94d694134" Jun 10 12:08:32.102893 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:08:32.102865 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 12:08:32.102963 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:08:32.102946 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 12:08:32.103013 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:08:32.102996 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 12:08:33.108299 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:08:33.108267 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mcwg" event={"ID":"0d2589db-da8b-477e-b85f-61fe499661ca","Type":"ContainerStarted","Data":"bcbe42acba273815241f867e14860d445bbc5e8b9dace260785e91be2bd3c354"} Jun 10 12:08:33.999388 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:08:33.999361 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mcwg" Jun 10 12:08:33.999582 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:08:33.999557 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-7mcwg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jun 10 12:08:33.999649 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:08:33.999622 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mcwg" podUID="0d2589db-da8b-477e-b85f-61fe499661ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jun 10 12:08:35.000331 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:08:35.000285 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-7mcwg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jun 10 12:08:35.000722 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:08:35.000360 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mcwg" podUID="0d2589db-da8b-477e-b85f-61fe499661ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jun 10 12:08:35.999473 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:08:35.999437 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-7mcwg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jun 10 12:08:35.999729 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:08:35.999695 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mcwg" podUID="0d2589db-da8b-477e-b85f-61fe499661ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jun 10 12:08:37.002987 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:08:37.002958 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mcwg" Jun 10 12:08:37.003429 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:08:37.003291 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mcwg" Jun 10 12:08:37.004070 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:08:37.004020 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7mcwg" Jun 10 12:09:38.004623 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:38.004590 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nfxxn"] Jun 10 12:09:38.008597 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:38.008579 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nfxxn" Jun 10 12:09:38.011092 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:38.011071 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 10 12:09:38.012166 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:38.012147 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-7ktg4\"" Jun 10 12:09:38.012268 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:38.012192 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 10 12:09:38.012268 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:38.012195 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 10 12:09:38.020397 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:38.020372 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nfxxn"] Jun 10 12:09:38.095130 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:38.095095 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3434c9e5-2e50-437b-988f-33c7615456c1-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nfxxn\" (UID: \"3434c9e5-2e50-437b-988f-33c7615456c1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nfxxn" Jun 10 12:09:38.095303 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:38.095190 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3434c9e5-2e50-437b-988f-33c7615456c1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nfxxn\" (UID: \"3434c9e5-2e50-437b-988f-33c7615456c1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nfxxn" Jun 10 12:09:38.095303 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:38.095229 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3434c9e5-2e50-437b-988f-33c7615456c1-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nfxxn\" (UID: \"3434c9e5-2e50-437b-988f-33c7615456c1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nfxxn" Jun 10 12:09:38.095303 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:38.095254 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3434c9e5-2e50-437b-988f-33c7615456c1-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nfxxn\" (UID: \"3434c9e5-2e50-437b-988f-33c7615456c1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nfxxn" Jun 10 12:09:38.095409 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:38.095346 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3434c9e5-2e50-437b-988f-33c7615456c1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nfxxn\" (UID: \"3434c9e5-2e50-437b-988f-33c7615456c1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nfxxn" Jun 10 12:09:38.095409 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:38.095386 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7trr\" (UniqueName: \"kubernetes.io/projected/3434c9e5-2e50-437b-988f-33c7615456c1-kube-api-access-z7trr\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nfxxn\" (UID: \"3434c9e5-2e50-437b-988f-33c7615456c1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nfxxn" Jun 10 12:09:38.196797 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:38.196766 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3434c9e5-2e50-437b-988f-33c7615456c1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nfxxn\" (UID: \"3434c9e5-2e50-437b-988f-33c7615456c1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nfxxn" Jun 10 12:09:38.196976 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:38.196803 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3434c9e5-2e50-437b-988f-33c7615456c1-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nfxxn\" (UID: \"3434c9e5-2e50-437b-988f-33c7615456c1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nfxxn" Jun 10 12:09:38.196976 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:38.196825 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3434c9e5-2e50-437b-988f-33c7615456c1-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nfxxn\" (UID: \"3434c9e5-2e50-437b-988f-33c7615456c1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nfxxn" Jun 10 12:09:38.196976 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:38.196871 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3434c9e5-2e50-437b-988f-33c7615456c1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nfxxn\" (UID: \"3434c9e5-2e50-437b-988f-33c7615456c1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nfxxn" Jun 10 12:09:38.196976 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:38.196895 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7trr\" (UniqueName: \"kubernetes.io/projected/3434c9e5-2e50-437b-988f-33c7615456c1-kube-api-access-z7trr\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nfxxn\" (UID: \"3434c9e5-2e50-437b-988f-33c7615456c1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nfxxn" Jun 10 12:09:38.196976 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:38.196916 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3434c9e5-2e50-437b-988f-33c7615456c1-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nfxxn\" (UID: \"3434c9e5-2e50-437b-988f-33c7615456c1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nfxxn" Jun 10 12:09:38.197297 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:38.197273 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3434c9e5-2e50-437b-988f-33c7615456c1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nfxxn\" (UID: \"3434c9e5-2e50-437b-988f-33c7615456c1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nfxxn" Jun 10 12:09:38.197297 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:38.197287 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3434c9e5-2e50-437b-988f-33c7615456c1-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nfxxn\" (UID: \"3434c9e5-2e50-437b-988f-33c7615456c1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nfxxn" Jun 10 12:09:38.197416 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:38.197399 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3434c9e5-2e50-437b-988f-33c7615456c1-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nfxxn\" (UID: \"3434c9e5-2e50-437b-988f-33c7615456c1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nfxxn" Jun 10 12:09:38.199196 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:38.199164 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3434c9e5-2e50-437b-988f-33c7615456c1-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nfxxn\" (UID: \"3434c9e5-2e50-437b-988f-33c7615456c1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nfxxn" Jun 10 12:09:38.199526 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:38.199506 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3434c9e5-2e50-437b-988f-33c7615456c1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nfxxn\" (UID: \"3434c9e5-2e50-437b-988f-33c7615456c1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nfxxn" Jun 10 12:09:38.207684 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:38.207661 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7trr\" (UniqueName: \"kubernetes.io/projected/3434c9e5-2e50-437b-988f-33c7615456c1-kube-api-access-z7trr\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nfxxn\" (UID: \"3434c9e5-2e50-437b-988f-33c7615456c1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nfxxn" Jun 10 12:09:38.319457 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:38.319362 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nfxxn" Jun 10 12:09:38.469206 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:38.469178 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nfxxn"] Jun 10 12:09:38.471756 ip-10-0-139-86 kubenswrapper[2562]: W0610 12:09:38.471722 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3434c9e5_2e50_437b_988f_33c7615456c1.slice/crio-28df618cbf9a894039210972b8f04c91fe44f6d4381343ee03b6ffbbff65661a WatchSource:0}: Error finding container 28df618cbf9a894039210972b8f04c91fe44f6d4381343ee03b6ffbbff65661a: Status 404 returned error can't find the container with id 28df618cbf9a894039210972b8f04c91fe44f6d4381343ee03b6ffbbff65661a Jun 10 12:09:38.473625 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:38.473608 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 12:09:38.774492 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:38.774458 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:09:39.426371 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:39.426332 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nfxxn" event={"ID":"3434c9e5-2e50-437b-988f-33c7615456c1","Type":"ContainerStarted","Data":"28df618cbf9a894039210972b8f04c91fe44f6d4381343ee03b6ffbbff65661a"} Jun 10 12:09:43.452645 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:43.452603 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nfxxn" event={"ID":"3434c9e5-2e50-437b-988f-33c7615456c1","Type":"ContainerStarted","Data":"14179a0e39a3e37b2f307b7af4d0996d16397830d8cea54f5670124e04a8032d"} Jun 10 12:09:44.458875 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:44.458843 2562 generic.go:356] "Generic (PLEG): container finished" podID="3434c9e5-2e50-437b-988f-33c7615456c1" containerID="14179a0e39a3e37b2f307b7af4d0996d16397830d8cea54f5670124e04a8032d" exitCode=0 Jun 10 12:09:44.459269 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:44.458919 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nfxxn" event={"ID":"3434c9e5-2e50-437b-988f-33c7615456c1","Type":"ContainerDied","Data":"14179a0e39a3e37b2f307b7af4d0996d16397830d8cea54f5670124e04a8032d"} Jun 10 12:09:46.470110 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:46.470068 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nfxxn" event={"ID":"3434c9e5-2e50-437b-988f-33c7615456c1","Type":"ContainerStarted","Data":"ada266b05e68d99c6cc3aca2a6450c111cebc2cb1c99aced8dd8048f7c970746"} Jun 10 12:09:46.497600 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:46.497548 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nfxxn" podStartSLOduration=2.9793698920000002 podStartE2EDuration="9.497533363s" totalImagesPullingTime="4.96250062s" totalInitContainerRuntime="1.555662851s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:09:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:09:46.494124012 +0000 UTC m=+694.699874856" watchObservedRunningTime="2026-06-10 12:09:46.497533363 +0000 UTC m=+694.703284206" Jun 10 12:09:47.494417 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:47.494387 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:09:48.320501 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:48.320468 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nfxxn" Jun 10 12:09:48.320676 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:48.320523 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nfxxn" Jun 10 12:09:48.333278 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:48.333255 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nfxxn" Jun 10 12:09:48.490231 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:48.490202 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nfxxn" Jun 10 12:09:52.896963 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:52.896922 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xmz4z"] Jun 10 12:09:52.903522 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:52.903499 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xmz4z" Jun 10 12:09:52.905994 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:52.905972 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 10 12:09:52.915508 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:52.915479 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xmz4z"] Jun 10 12:09:53.042518 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:53.042484 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/aa07d635-db63-4641-8e7a-8f8dacce3e02-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-xmz4z\" (UID: \"aa07d635-db63-4641-8e7a-8f8dacce3e02\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xmz4z" Jun 10 12:09:53.042518 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:53.042523 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa07d635-db63-4641-8e7a-8f8dacce3e02-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-xmz4z\" (UID: \"aa07d635-db63-4641-8e7a-8f8dacce3e02\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xmz4z" Jun 10 12:09:53.042724 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:53.042540 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa07d635-db63-4641-8e7a-8f8dacce3e02-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-xmz4z\" (UID: \"aa07d635-db63-4641-8e7a-8f8dacce3e02\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xmz4z" Jun 10 12:09:53.042724 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:53.042564 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zngn\" (UniqueName: \"kubernetes.io/projected/aa07d635-db63-4641-8e7a-8f8dacce3e02-kube-api-access-2zngn\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-xmz4z\" (UID: \"aa07d635-db63-4641-8e7a-8f8dacce3e02\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xmz4z" Jun 10 12:09:53.042724 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:53.042638 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa07d635-db63-4641-8e7a-8f8dacce3e02-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-xmz4z\" (UID: \"aa07d635-db63-4641-8e7a-8f8dacce3e02\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xmz4z" Jun 10 12:09:53.042724 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:53.042714 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa07d635-db63-4641-8e7a-8f8dacce3e02-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-xmz4z\" (UID: \"aa07d635-db63-4641-8e7a-8f8dacce3e02\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xmz4z" Jun 10 12:09:53.143688 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:53.143658 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa07d635-db63-4641-8e7a-8f8dacce3e02-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-xmz4z\" (UID: \"aa07d635-db63-4641-8e7a-8f8dacce3e02\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xmz4z" Jun 10 12:09:53.143858 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:53.143741 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/aa07d635-db63-4641-8e7a-8f8dacce3e02-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-xmz4z\" (UID: \"aa07d635-db63-4641-8e7a-8f8dacce3e02\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xmz4z" Jun 10 12:09:53.143858 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:53.143775 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa07d635-db63-4641-8e7a-8f8dacce3e02-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-xmz4z\" (UID: \"aa07d635-db63-4641-8e7a-8f8dacce3e02\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xmz4z" Jun 10 12:09:53.143858 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:53.143799 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa07d635-db63-4641-8e7a-8f8dacce3e02-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-xmz4z\" (UID: \"aa07d635-db63-4641-8e7a-8f8dacce3e02\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xmz4z" Jun 10 12:09:53.143858 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:53.143834 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zngn\" (UniqueName: \"kubernetes.io/projected/aa07d635-db63-4641-8e7a-8f8dacce3e02-kube-api-access-2zngn\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-xmz4z\" (UID: \"aa07d635-db63-4641-8e7a-8f8dacce3e02\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xmz4z" Jun 10 12:09:53.144065 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:53.143874 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa07d635-db63-4641-8e7a-8f8dacce3e02-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-xmz4z\" (UID: \"aa07d635-db63-4641-8e7a-8f8dacce3e02\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xmz4z" Jun 10 12:09:53.144171 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:53.144151 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa07d635-db63-4641-8e7a-8f8dacce3e02-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-xmz4z\" (UID: \"aa07d635-db63-4641-8e7a-8f8dacce3e02\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xmz4z" Jun 10 12:09:53.144231 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:53.144199 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa07d635-db63-4641-8e7a-8f8dacce3e02-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-xmz4z\" (UID: \"aa07d635-db63-4641-8e7a-8f8dacce3e02\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xmz4z" Jun 10 12:09:53.144231 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:53.144221 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/aa07d635-db63-4641-8e7a-8f8dacce3e02-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-xmz4z\" (UID: \"aa07d635-db63-4641-8e7a-8f8dacce3e02\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xmz4z" Jun 10 12:09:53.146122 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:53.146104 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa07d635-db63-4641-8e7a-8f8dacce3e02-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-xmz4z\" (UID: \"aa07d635-db63-4641-8e7a-8f8dacce3e02\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xmz4z" Jun 10 12:09:53.146365 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:53.146347 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa07d635-db63-4641-8e7a-8f8dacce3e02-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-xmz4z\" (UID: \"aa07d635-db63-4641-8e7a-8f8dacce3e02\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xmz4z" Jun 10 12:09:53.154112 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:53.154055 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zngn\" (UniqueName: \"kubernetes.io/projected/aa07d635-db63-4641-8e7a-8f8dacce3e02-kube-api-access-2zngn\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-xmz4z\" (UID: \"aa07d635-db63-4641-8e7a-8f8dacce3e02\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xmz4z" Jun 10 12:09:53.215034 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:53.215003 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xmz4z" Jun 10 12:09:53.366206 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:53.366177 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xmz4z"] Jun 10 12:09:53.368900 ip-10-0-139-86 kubenswrapper[2562]: W0610 12:09:53.368863 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa07d635_db63_4641_8e7a_8f8dacce3e02.slice/crio-fe1062e2cf48eca0ccc74b21ec7f11a596c081682607bfc7c3141ff2924bba94 WatchSource:0}: Error finding container fe1062e2cf48eca0ccc74b21ec7f11a596c081682607bfc7c3141ff2924bba94: Status 404 returned error can't find the container with id fe1062e2cf48eca0ccc74b21ec7f11a596c081682607bfc7c3141ff2924bba94 Jun 10 12:09:53.503940 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:53.503907 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xmz4z" event={"ID":"aa07d635-db63-4641-8e7a-8f8dacce3e02","Type":"ContainerStarted","Data":"0b88b48d8482b2f68c814fd501ce12e1e9d873e8dfb06e2e14b764d0046ea140"} Jun 10 12:09:53.504154 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:53.503960 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xmz4z" event={"ID":"aa07d635-db63-4641-8e7a-8f8dacce3e02","Type":"ContainerStarted","Data":"fe1062e2cf48eca0ccc74b21ec7f11a596c081682607bfc7c3141ff2924bba94"} Jun 10 12:09:53.513401 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:53.513375 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:09:55.515763 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:55.515726 2562 generic.go:356] "Generic (PLEG): container finished" podID="aa07d635-db63-4641-8e7a-8f8dacce3e02" containerID="0b88b48d8482b2f68c814fd501ce12e1e9d873e8dfb06e2e14b764d0046ea140" exitCode=0 Jun 10 12:09:55.516190 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:55.515803 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xmz4z" event={"ID":"aa07d635-db63-4641-8e7a-8f8dacce3e02","Type":"ContainerDied","Data":"0b88b48d8482b2f68c814fd501ce12e1e9d873e8dfb06e2e14b764d0046ea140"} Jun 10 12:09:56.522907 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:56.522870 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xmz4z" event={"ID":"aa07d635-db63-4641-8e7a-8f8dacce3e02","Type":"ContainerStarted","Data":"982a646006923b2c9932da7705f04c2622010fb0d7eab53bebb2b8a769a8678d"} Jun 10 12:09:56.547745 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:09:56.547697 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xmz4z" podStartSLOduration=2.709964492 podStartE2EDuration="4.547682099s" totalImagesPullingTime="509.768229ms" totalInitContainerRuntime="1.327949378s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:09:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:09:56.545184813 +0000 UTC m=+704.750935656" watchObservedRunningTime="2026-06-10 12:09:56.547682099 +0000 UTC m=+704.753432943" Jun 10 12:10:00.361650 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:00.361615 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mpz4"] Jun 10 12:10:00.386025 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:00.385994 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mpz4" Jun 10 12:10:00.388602 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:00.388569 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mpz4"] Jun 10 12:10:00.394541 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:00.394519 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 10 12:10:00.512692 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:00.512661 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6124664a-cd5c-4a04-8a31-957ce5869e26-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mpz4\" (UID: \"6124664a-cd5c-4a04-8a31-957ce5869e26\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mpz4" Jun 10 12:10:00.512871 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:00.512722 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6124664a-cd5c-4a04-8a31-957ce5869e26-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mpz4\" (UID: \"6124664a-cd5c-4a04-8a31-957ce5869e26\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mpz4" Jun 10 12:10:00.512871 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:00.512784 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhvd8\" (UniqueName: \"kubernetes.io/projected/6124664a-cd5c-4a04-8a31-957ce5869e26-kube-api-access-dhvd8\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mpz4\" (UID: \"6124664a-cd5c-4a04-8a31-957ce5869e26\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mpz4" Jun 10 12:10:00.512871 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:00.512843 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6124664a-cd5c-4a04-8a31-957ce5869e26-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mpz4\" (UID: \"6124664a-cd5c-4a04-8a31-957ce5869e26\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mpz4" Jun 10 12:10:00.512980 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:00.512897 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6124664a-cd5c-4a04-8a31-957ce5869e26-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mpz4\" (UID: \"6124664a-cd5c-4a04-8a31-957ce5869e26\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mpz4" Jun 10 12:10:00.512980 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:00.512922 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6124664a-cd5c-4a04-8a31-957ce5869e26-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mpz4\" (UID: \"6124664a-cd5c-4a04-8a31-957ce5869e26\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mpz4" Jun 10 12:10:00.613564 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:00.613488 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6124664a-cd5c-4a04-8a31-957ce5869e26-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mpz4\" (UID: \"6124664a-cd5c-4a04-8a31-957ce5869e26\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mpz4" Jun 10 12:10:00.613564 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:00.613523 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6124664a-cd5c-4a04-8a31-957ce5869e26-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mpz4\" (UID: \"6124664a-cd5c-4a04-8a31-957ce5869e26\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mpz4" Jun 10 12:10:00.613564 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:00.613556 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6124664a-cd5c-4a04-8a31-957ce5869e26-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mpz4\" (UID: \"6124664a-cd5c-4a04-8a31-957ce5869e26\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mpz4" Jun 10 12:10:00.613803 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:00.613597 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6124664a-cd5c-4a04-8a31-957ce5869e26-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mpz4\" (UID: \"6124664a-cd5c-4a04-8a31-957ce5869e26\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mpz4" Jun 10 12:10:00.613803 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:00.613619 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhvd8\" (UniqueName: \"kubernetes.io/projected/6124664a-cd5c-4a04-8a31-957ce5869e26-kube-api-access-dhvd8\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mpz4\" (UID: \"6124664a-cd5c-4a04-8a31-957ce5869e26\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mpz4" Jun 10 12:10:00.613803 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:00.613642 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6124664a-cd5c-4a04-8a31-957ce5869e26-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mpz4\" (UID: \"6124664a-cd5c-4a04-8a31-957ce5869e26\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mpz4" Jun 10 12:10:00.614099 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:00.614066 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6124664a-cd5c-4a04-8a31-957ce5869e26-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mpz4\" (UID: \"6124664a-cd5c-4a04-8a31-957ce5869e26\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mpz4" Jun 10 12:10:00.614099 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:00.614086 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6124664a-cd5c-4a04-8a31-957ce5869e26-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mpz4\" (UID: \"6124664a-cd5c-4a04-8a31-957ce5869e26\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mpz4" Jun 10 12:10:00.614284 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:00.614147 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6124664a-cd5c-4a04-8a31-957ce5869e26-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mpz4\" (UID: \"6124664a-cd5c-4a04-8a31-957ce5869e26\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mpz4" Jun 10 12:10:00.615737 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:00.615720 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6124664a-cd5c-4a04-8a31-957ce5869e26-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mpz4\" (UID: \"6124664a-cd5c-4a04-8a31-957ce5869e26\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mpz4" Jun 10 12:10:00.616151 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:00.616132 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6124664a-cd5c-4a04-8a31-957ce5869e26-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mpz4\" (UID: \"6124664a-cd5c-4a04-8a31-957ce5869e26\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mpz4" Jun 10 12:10:00.626401 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:00.626381 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhvd8\" (UniqueName: \"kubernetes.io/projected/6124664a-cd5c-4a04-8a31-957ce5869e26-kube-api-access-dhvd8\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mpz4\" (UID: \"6124664a-cd5c-4a04-8a31-957ce5869e26\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mpz4" Jun 10 12:10:00.698690 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:00.698653 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mpz4" Jun 10 12:10:00.837198 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:00.837174 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mpz4"] Jun 10 12:10:00.838906 ip-10-0-139-86 kubenswrapper[2562]: W0610 12:10:00.838880 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6124664a_cd5c_4a04_8a31_957ce5869e26.slice/crio-e0e3bea292fef6b380aeeb6ab72b86eeff597b9504245480e15d825d28d578d0 WatchSource:0}: Error finding container e0e3bea292fef6b380aeeb6ab72b86eeff597b9504245480e15d825d28d578d0: Status 404 returned error can't find the container with id e0e3bea292fef6b380aeeb6ab72b86eeff597b9504245480e15d825d28d578d0 Jun 10 12:10:01.183829 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:01.183746 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:10:01.548068 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:01.547965 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mpz4" event={"ID":"6124664a-cd5c-4a04-8a31-957ce5869e26","Type":"ContainerStarted","Data":"5c3df72690e388e90b2cbed698a9049f2807a2d39422b0d6e9aee86259fbd9cc"} Jun 10 12:10:01.548068 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:01.548015 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mpz4" event={"ID":"6124664a-cd5c-4a04-8a31-957ce5869e26","Type":"ContainerStarted","Data":"e0e3bea292fef6b380aeeb6ab72b86eeff597b9504245480e15d825d28d578d0"} Jun 10 12:10:03.215804 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:03.215768 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xmz4z" Jun 10 12:10:03.216208 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:03.215837 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xmz4z" Jun 10 12:10:03.228364 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:03.228331 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xmz4z" Jun 10 12:10:03.559256 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:03.559223 2562 generic.go:356] "Generic (PLEG): container finished" podID="6124664a-cd5c-4a04-8a31-957ce5869e26" containerID="5c3df72690e388e90b2cbed698a9049f2807a2d39422b0d6e9aee86259fbd9cc" exitCode=0 Jun 10 12:10:03.559377 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:03.559297 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mpz4" event={"ID":"6124664a-cd5c-4a04-8a31-957ce5869e26","Type":"ContainerDied","Data":"5c3df72690e388e90b2cbed698a9049f2807a2d39422b0d6e9aee86259fbd9cc"} Jun 10 12:10:03.571301 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:03.571285 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-xmz4z" Jun 10 12:10:04.565805 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:04.565771 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mpz4" event={"ID":"6124664a-cd5c-4a04-8a31-957ce5869e26","Type":"ContainerStarted","Data":"8fdc4463dda6da8aa4072e7303d69d7c5efc1595350bf0ae41502c176b66cde1"} Jun 10 12:10:04.589657 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:04.589601 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mpz4" podStartSLOduration=1.679253635 podStartE2EDuration="4.589582941s" totalImagesPullingTime="292.785599ms" totalInitContainerRuntime="2.617543707s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:10:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:10:04.589286737 +0000 UTC m=+712.795037582" watchObservedRunningTime="2026-06-10 12:10:04.589582941 +0000 UTC m=+712.795333785" Jun 10 12:10:10.699158 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:10.699124 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mpz4" Jun 10 12:10:10.699714 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:10.699212 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mpz4" Jun 10 12:10:10.711626 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:10.711602 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mpz4" Jun 10 12:10:11.610739 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:11.610710 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mpz4" Jun 10 12:10:11.712213 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:11.712177 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-mp4mv"] Jun 10 12:10:11.716050 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:11.716021 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mp4mv" Jun 10 12:10:11.718975 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:11.718953 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 10 12:10:11.729582 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:11.729561 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-mp4mv"] Jun 10 12:10:11.798271 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:11.798246 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32897bde-350b-4911-8ca1-87e79dff9cbf-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mp4mv\" (UID: \"32897bde-350b-4911-8ca1-87e79dff9cbf\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mp4mv" Jun 10 12:10:11.798398 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:11.798345 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/32897bde-350b-4911-8ca1-87e79dff9cbf-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mp4mv\" (UID: \"32897bde-350b-4911-8ca1-87e79dff9cbf\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mp4mv" Jun 10 12:10:11.798398 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:11.798387 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4q8lt\" (UniqueName: \"kubernetes.io/projected/32897bde-350b-4911-8ca1-87e79dff9cbf-kube-api-access-4q8lt\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mp4mv\" (UID: \"32897bde-350b-4911-8ca1-87e79dff9cbf\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mp4mv" Jun 10 12:10:11.798475 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:11.798437 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32897bde-350b-4911-8ca1-87e79dff9cbf-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mp4mv\" (UID: \"32897bde-350b-4911-8ca1-87e79dff9cbf\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mp4mv" Jun 10 12:10:11.798509 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:11.798476 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32897bde-350b-4911-8ca1-87e79dff9cbf-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mp4mv\" (UID: \"32897bde-350b-4911-8ca1-87e79dff9cbf\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mp4mv" Jun 10 12:10:11.798509 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:11.798501 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32897bde-350b-4911-8ca1-87e79dff9cbf-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mp4mv\" (UID: \"32897bde-350b-4911-8ca1-87e79dff9cbf\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mp4mv" Jun 10 12:10:11.899081 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:11.898977 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/32897bde-350b-4911-8ca1-87e79dff9cbf-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mp4mv\" (UID: \"32897bde-350b-4911-8ca1-87e79dff9cbf\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mp4mv" Jun 10 12:10:11.899081 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:11.899020 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4q8lt\" (UniqueName: \"kubernetes.io/projected/32897bde-350b-4911-8ca1-87e79dff9cbf-kube-api-access-4q8lt\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mp4mv\" (UID: \"32897bde-350b-4911-8ca1-87e79dff9cbf\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mp4mv" Jun 10 12:10:11.899284 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:11.899111 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32897bde-350b-4911-8ca1-87e79dff9cbf-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mp4mv\" (UID: \"32897bde-350b-4911-8ca1-87e79dff9cbf\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mp4mv" Jun 10 12:10:11.899284 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:11.899138 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32897bde-350b-4911-8ca1-87e79dff9cbf-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mp4mv\" (UID: \"32897bde-350b-4911-8ca1-87e79dff9cbf\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mp4mv" Jun 10 12:10:11.899284 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:11.899168 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32897bde-350b-4911-8ca1-87e79dff9cbf-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mp4mv\" (UID: \"32897bde-350b-4911-8ca1-87e79dff9cbf\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mp4mv" Jun 10 12:10:11.899284 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:11.899202 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32897bde-350b-4911-8ca1-87e79dff9cbf-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mp4mv\" (UID: \"32897bde-350b-4911-8ca1-87e79dff9cbf\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mp4mv" Jun 10 12:10:11.899485 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:11.899412 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/32897bde-350b-4911-8ca1-87e79dff9cbf-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mp4mv\" (UID: \"32897bde-350b-4911-8ca1-87e79dff9cbf\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mp4mv" Jun 10 12:10:11.899485 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:11.899432 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32897bde-350b-4911-8ca1-87e79dff9cbf-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mp4mv\" (UID: \"32897bde-350b-4911-8ca1-87e79dff9cbf\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mp4mv" Jun 10 12:10:11.899623 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:11.899606 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32897bde-350b-4911-8ca1-87e79dff9cbf-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mp4mv\" (UID: \"32897bde-350b-4911-8ca1-87e79dff9cbf\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mp4mv" Jun 10 12:10:11.901352 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:11.901328 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32897bde-350b-4911-8ca1-87e79dff9cbf-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mp4mv\" (UID: \"32897bde-350b-4911-8ca1-87e79dff9cbf\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mp4mv" Jun 10 12:10:11.901628 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:11.901609 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32897bde-350b-4911-8ca1-87e79dff9cbf-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mp4mv\" (UID: \"32897bde-350b-4911-8ca1-87e79dff9cbf\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mp4mv" Jun 10 12:10:11.909214 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:11.909192 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4q8lt\" (UniqueName: \"kubernetes.io/projected/32897bde-350b-4911-8ca1-87e79dff9cbf-kube-api-access-4q8lt\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mp4mv\" (UID: \"32897bde-350b-4911-8ca1-87e79dff9cbf\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mp4mv" Jun 10 12:10:12.027316 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:12.027282 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mp4mv" Jun 10 12:10:12.180284 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:12.180216 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-mp4mv"] Jun 10 12:10:12.185653 ip-10-0-139-86 kubenswrapper[2562]: W0610 12:10:12.185624 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32897bde_350b_4911_8ca1_87e79dff9cbf.slice/crio-0dc93760fd6389c5057003835776c96a714eb30c6841f96b419ad7d79002ece3 WatchSource:0}: Error finding container 0dc93760fd6389c5057003835776c96a714eb30c6841f96b419ad7d79002ece3: Status 404 returned error can't find the container with id 0dc93760fd6389c5057003835776c96a714eb30c6841f96b419ad7d79002ece3 Jun 10 12:10:12.424076 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:12.424024 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:10:12.606535 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:12.606503 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mp4mv" event={"ID":"32897bde-350b-4911-8ca1-87e79dff9cbf","Type":"ContainerStarted","Data":"06d787d052be10725d27ee0c25c04fdeec8c77f90b7ffec86a3dff0e10ef17d0"} Jun 10 12:10:12.606709 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:12.606554 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mp4mv" event={"ID":"32897bde-350b-4911-8ca1-87e79dff9cbf","Type":"ContainerStarted","Data":"0dc93760fd6389c5057003835776c96a714eb30c6841f96b419ad7d79002ece3"} Jun 10 12:10:13.612922 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:13.612887 2562 generic.go:356] "Generic (PLEG): container finished" podID="32897bde-350b-4911-8ca1-87e79dff9cbf" containerID="06d787d052be10725d27ee0c25c04fdeec8c77f90b7ffec86a3dff0e10ef17d0" exitCode=0 Jun 10 12:10:13.613265 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:13.612958 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mp4mv" event={"ID":"32897bde-350b-4911-8ca1-87e79dff9cbf","Type":"ContainerDied","Data":"06d787d052be10725d27ee0c25c04fdeec8c77f90b7ffec86a3dff0e10ef17d0"} Jun 10 12:10:14.625701 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:14.625667 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mp4mv" event={"ID":"32897bde-350b-4911-8ca1-87e79dff9cbf","Type":"ContainerStarted","Data":"4a8c573291d2e8507862026ffc67da4f7e1f2773fcdec5700d321ca41c086505"} Jun 10 12:10:14.650544 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:14.650494 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mp4mv" podStartSLOduration=2.113111116 podStartE2EDuration="3.650477225s" totalImagesPullingTime="203.130239ms" totalInitContainerRuntime="1.33423587s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:10:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:10:14.648308521 +0000 UTC m=+722.854059365" watchObservedRunningTime="2026-06-10 12:10:14.650477225 +0000 UTC m=+722.856228068" Jun 10 12:10:15.631417 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:15.631386 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-4nsgb"] Jun 10 12:10:15.635093 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:15.635077 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4nsgb" Jun 10 12:10:15.637764 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:15.637741 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 10 12:10:15.652116 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:15.652093 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-4nsgb"] Jun 10 12:10:15.738769 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:15.738740 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e24b0748-56c1-4612-ab5b-e1c16ae07b88-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-4nsgb\" (UID: \"e24b0748-56c1-4612-ab5b-e1c16ae07b88\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4nsgb" Jun 10 12:10:15.738957 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:15.738802 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e24b0748-56c1-4612-ab5b-e1c16ae07b88-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-4nsgb\" (UID: \"e24b0748-56c1-4612-ab5b-e1c16ae07b88\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4nsgb" Jun 10 12:10:15.738957 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:15.738888 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e24b0748-56c1-4612-ab5b-e1c16ae07b88-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-4nsgb\" (UID: \"e24b0748-56c1-4612-ab5b-e1c16ae07b88\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4nsgb" Jun 10 12:10:15.739122 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:15.738963 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e24b0748-56c1-4612-ab5b-e1c16ae07b88-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-4nsgb\" (UID: \"e24b0748-56c1-4612-ab5b-e1c16ae07b88\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4nsgb" Jun 10 12:10:15.739122 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:15.739027 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e24b0748-56c1-4612-ab5b-e1c16ae07b88-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-4nsgb\" (UID: \"e24b0748-56c1-4612-ab5b-e1c16ae07b88\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4nsgb" Jun 10 12:10:15.739122 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:15.739096 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48r6s\" (UniqueName: \"kubernetes.io/projected/e24b0748-56c1-4612-ab5b-e1c16ae07b88-kube-api-access-48r6s\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-4nsgb\" (UID: \"e24b0748-56c1-4612-ab5b-e1c16ae07b88\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4nsgb" Jun 10 12:10:15.840197 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:15.840154 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e24b0748-56c1-4612-ab5b-e1c16ae07b88-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-4nsgb\" (UID: \"e24b0748-56c1-4612-ab5b-e1c16ae07b88\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4nsgb" Jun 10 12:10:15.840197 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:15.840202 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48r6s\" (UniqueName: \"kubernetes.io/projected/e24b0748-56c1-4612-ab5b-e1c16ae07b88-kube-api-access-48r6s\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-4nsgb\" (UID: \"e24b0748-56c1-4612-ab5b-e1c16ae07b88\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4nsgb" Jun 10 12:10:15.840632 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:15.840241 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e24b0748-56c1-4612-ab5b-e1c16ae07b88-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-4nsgb\" (UID: \"e24b0748-56c1-4612-ab5b-e1c16ae07b88\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4nsgb" Jun 10 12:10:15.840632 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:15.840275 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e24b0748-56c1-4612-ab5b-e1c16ae07b88-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-4nsgb\" (UID: \"e24b0748-56c1-4612-ab5b-e1c16ae07b88\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4nsgb" Jun 10 12:10:15.840632 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:15.840293 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e24b0748-56c1-4612-ab5b-e1c16ae07b88-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-4nsgb\" (UID: \"e24b0748-56c1-4612-ab5b-e1c16ae07b88\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4nsgb" Jun 10 12:10:15.840632 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:15.840346 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e24b0748-56c1-4612-ab5b-e1c16ae07b88-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-4nsgb\" (UID: \"e24b0748-56c1-4612-ab5b-e1c16ae07b88\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4nsgb" Jun 10 12:10:15.840632 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:15.840604 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e24b0748-56c1-4612-ab5b-e1c16ae07b88-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-4nsgb\" (UID: \"e24b0748-56c1-4612-ab5b-e1c16ae07b88\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4nsgb" Jun 10 12:10:15.840817 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:15.840658 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e24b0748-56c1-4612-ab5b-e1c16ae07b88-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-4nsgb\" (UID: \"e24b0748-56c1-4612-ab5b-e1c16ae07b88\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4nsgb" Jun 10 12:10:15.840817 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:15.840762 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e24b0748-56c1-4612-ab5b-e1c16ae07b88-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-4nsgb\" (UID: \"e24b0748-56c1-4612-ab5b-e1c16ae07b88\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4nsgb" Jun 10 12:10:15.842600 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:15.842576 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e24b0748-56c1-4612-ab5b-e1c16ae07b88-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-4nsgb\" (UID: \"e24b0748-56c1-4612-ab5b-e1c16ae07b88\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4nsgb" Jun 10 12:10:15.842829 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:15.842811 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e24b0748-56c1-4612-ab5b-e1c16ae07b88-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-4nsgb\" (UID: \"e24b0748-56c1-4612-ab5b-e1c16ae07b88\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4nsgb" Jun 10 12:10:15.850293 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:15.850272 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48r6s\" (UniqueName: \"kubernetes.io/projected/e24b0748-56c1-4612-ab5b-e1c16ae07b88-kube-api-access-48r6s\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-4nsgb\" (UID: \"e24b0748-56c1-4612-ab5b-e1c16ae07b88\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4nsgb" Jun 10 12:10:15.944477 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:15.944395 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4nsgb" Jun 10 12:10:16.082745 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:16.082721 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-4nsgb"] Jun 10 12:10:16.084944 ip-10-0-139-86 kubenswrapper[2562]: W0610 12:10:16.084915 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode24b0748_56c1_4612_ab5b_e1c16ae07b88.slice/crio-10c2704dd7f202e8cc4984e2f8f21798b09179598a83a416e16458297c43755a WatchSource:0}: Error finding container 10c2704dd7f202e8cc4984e2f8f21798b09179598a83a416e16458297c43755a: Status 404 returned error can't find the container with id 10c2704dd7f202e8cc4984e2f8f21798b09179598a83a416e16458297c43755a Jun 10 12:10:16.442484 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:16.442451 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:10:16.637434 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:16.637402 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4nsgb" event={"ID":"e24b0748-56c1-4612-ab5b-e1c16ae07b88","Type":"ContainerStarted","Data":"54aa8df820ff1258b25af15b6cdd55e78f8e9b5eb461a5bf6002495fd97c0820"} Jun 10 12:10:16.637791 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:16.637449 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4nsgb" event={"ID":"e24b0748-56c1-4612-ab5b-e1c16ae07b88","Type":"ContainerStarted","Data":"10c2704dd7f202e8cc4984e2f8f21798b09179598a83a416e16458297c43755a"} Jun 10 12:10:22.027796 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:22.027765 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mp4mv" Jun 10 12:10:22.028256 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:22.027814 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mp4mv" Jun 10 12:10:22.039976 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:22.039953 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mp4mv" Jun 10 12:10:22.680339 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:10:22.680305 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mp4mv" Jun 10 12:11:09.913701 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:11:09.913665 2562 generic.go:356] "Generic (PLEG): container finished" podID="e24b0748-56c1-4612-ab5b-e1c16ae07b88" containerID="54aa8df820ff1258b25af15b6cdd55e78f8e9b5eb461a5bf6002495fd97c0820" exitCode=0 Jun 10 12:11:09.914109 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:11:09.913740 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4nsgb" event={"ID":"e24b0748-56c1-4612-ab5b-e1c16ae07b88","Type":"ContainerDied","Data":"54aa8df820ff1258b25af15b6cdd55e78f8e9b5eb461a5bf6002495fd97c0820"} Jun 10 12:11:10.920722 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:11:10.920683 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4nsgb" event={"ID":"e24b0748-56c1-4612-ab5b-e1c16ae07b88","Type":"ContainerStarted","Data":"83a0ed9441c22268e8e7106417746db4a1e8a34e0b822e5b071d88f853973a3b"} Jun 10 12:11:10.950836 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:11:10.950789 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4nsgb" podStartSLOduration=1.963960041 podStartE2EDuration="55.950775782s" totalImagesPullingTime="287.322364ms" totalInitContainerRuntime="53.699493377s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:10:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:11:10.948494906 +0000 UTC m=+779.154245751" watchObservedRunningTime="2026-06-10 12:11:10.950775782 +0000 UTC m=+779.156526644" Jun 10 12:11:15.944585 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:11:15.944552 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4nsgb" Jun 10 12:11:15.944585 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:11:15.944593 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4nsgb" Jun 10 12:11:15.958168 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:11:15.958140 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4nsgb" Jun 10 12:11:16.967709 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:11:16.967676 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4nsgb" Jun 10 12:12:47.189745 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:12:47.189708 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:12:57.402192 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:12:57.402158 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:13:06.481548 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:13:06.481469 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:13:16.582580 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:13:16.582541 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:13:25.805453 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:13:25.805418 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:13:35.303565 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:13:35.303524 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:14:11.693205 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:14:11.693171 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:14:14.987555 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:14:14.987515 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:14:52.280660 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:14:52.280622 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:15:08.588547 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:15:08.588508 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:15:47.489856 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:15:47.489819 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:16:05.585287 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:16:05.585203 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:16:19.699667 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:16:19.699633 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:16:36.176705 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:16:36.176670 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:17:02.292671 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:17:02.292637 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:17:06.487833 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:17:06.487798 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:17:20.404836 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:17:20.404798 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:17:23.496735 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:17:23.496698 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:17:45.979585 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:17:45.979546 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:17:55.103449 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:17:55.103418 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:18:11.288252 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:18:11.288220 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:18:20.398754 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:18:20.398720 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:18:37.087341 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:18:37.087307 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:18:46.297468 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:18:46.297432 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:19:18.311413 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:19:18.311333 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:19:26.898932 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:19:26.898901 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:19:35.196602 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:19:35.196564 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:19:43.584715 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:19:43.584681 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:19:52.089235 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:19:52.089202 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:20:00.771762 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:20:00.771728 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:20:04.087957 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:20:04.087923 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:20:09.181884 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:20:09.181851 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:20:21.285681 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:20:21.285648 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:20:58.582416 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:20:58.582380 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:21:00.588754 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:21:00.588719 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:21:08.884287 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:21:08.884248 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:21:12.478071 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:21:12.478007 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:21:20.300374 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:21:20.300331 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:21:28.081758 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:21:28.081723 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:21:38.008762 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:21:38.008720 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:21:47.082834 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:21:47.082803 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:21:54.986740 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:21:54.986707 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:21:58.880938 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:21:58.880892 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:22:03.583954 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:22:03.583875 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:22:12.982952 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:22:12.982914 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:22:21.175387 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:22:21.175351 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:22:31.188408 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:22:31.188374 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:22:38.883297 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:22:38.883258 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:22:48.481856 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:22:48.481814 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:22:56.978924 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:22:56.978891 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:23:05.799731 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:23:05.799697 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:23:13.388570 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:23:13.388536 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:23:23.395575 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:23:23.395534 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:23:32.185672 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:23:32.185589 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:25:50.708345 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:25:50.708304 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:25:54.110077 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:25:54.110029 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:26:19.495168 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:26:19.495136 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:26:24.384396 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:26:24.384360 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:26:33.777626 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:26:33.777539 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:26:43.805823 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:26:43.805783 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:26:53.183096 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:26:53.183059 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:27:04.179780 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:27:04.179740 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:27:12.992753 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:27:12.992720 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:27:23.102621 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:27:23.102590 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:27:31.887320 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:27:31.887286 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:27:42.393941 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:27:42.393908 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:27:51.993563 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:27:51.993524 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:27:55.975540 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:27:55.975506 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:28:24.580348 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:28:24.580312 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:29:07.703577 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:29:07.703539 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:29:16.398913 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:29:16.398876 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:29:25.108440 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:29:25.108397 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:29:33.502761 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:29:33.502616 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:29:42.539282 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:29:42.539247 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:29:53.301363 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:29:53.301327 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:30:02.030992 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:30:02.030960 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:30:08.205981 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:30:08.205935 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:30:16.717627 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:30:16.717589 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:30:25.422201 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:30:25.422164 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:30:33.513214 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:30:33.513178 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:30:43.899301 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:30:43.899265 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:31:01.796565 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:31:01.796488 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:31:10.095457 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:31:10.095424 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:31:19.609594 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:31:19.609557 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:31:27.114022 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:31:27.113988 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:31:44.601700 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:31:44.601664 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:31:53.595687 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:31:53.595647 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:32:01.918079 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:32:01.918028 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:32:10.786454 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:32:10.786415 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:32:19.207716 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:32:19.207680 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:32:28.281663 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:32:28.281631 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:32:36.682258 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:32:36.682180 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:32:48.191491 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:32:48.191457 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:32:57.082527 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:32:57.082495 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:33:08.380945 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:33:08.380906 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:33:17.483730 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:33:17.483690 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:33:23.282059 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:33:23.282014 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:33:32.187351 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:33:32.187312 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:33:39.599257 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:33:39.599219 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:33:56.182005 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:33:56.181967 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:34:05.083020 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:34:05.082938 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjp6l"] Jun 10 12:34:52.613992 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:34:52.613952 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-56dc4c55d-mnvvh_e776db1d-e35b-45e6-a136-1f7adb8c9abb/nginx/0.log" Jun 10 12:34:53.577980 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:34:53.577952 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76c45549f7-fxbs9_7bab442d-9251-4f8c-a2c1-080431fae04b/copy-manifests/0.log" Jun 10 12:34:53.594107 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:34:53.594074 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76c45549f7-fxbs9_7bab442d-9251-4f8c-a2c1-080431fae04b/manager/0.log" Jun 10 12:34:55.040053 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:34:55.040008 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-zsznv_3aad49b0-1d26-4747-8ba1-2aa3d166d944/manager/0.log" Jun 10 12:34:55.151120 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:34:55.151093 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-hvfvk_e5c6a5b8-3efa-473b-a4de-0364d67a9deb/manager/0.log" Jun 10 12:34:55.377313 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:34:55.377288 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-fs8qt_f04aecf8-3e9e-4569-a6d5-68e4cbb2bfba/registry-server/0.log" Jun 10 12:34:55.621269 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:34:55.621240 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-gjp6l_1a7a982b-f7e7-4d1c-8db7-f83d36bc6f02/limitador/0.log" Jun 10 12:34:55.738444 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:34:55.738365 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-lqqbg_c723e2ae-66ae-4674-9e6b-743e07293f71/manager/0.log" Jun 10 12:34:56.091096 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:34:56.091071 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795rwzth_cbac9d68-b054-43af-8ca8-7fea047af7f3/istio-proxy/0.log" Jun 10 12:34:56.575124 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:34:56.575030 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-7mcwg_0d2589db-da8b-477e-b85f-61fe499661ca/istio-proxy/1.log" Jun 10 12:34:57.311385 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:34:57.311355 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-nfxxn_3434c9e5-2e50-437b-988f-33c7615456c1/storage-initializer/0.log" Jun 10 12:34:57.320559 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:34:57.320533 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-nfxxn_3434c9e5-2e50-437b-988f-33c7615456c1/main/0.log" Jun 10 12:34:57.572364 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:34:57.572274 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-xmz4z_aa07d635-db63-4641-8e7a-8f8dacce3e02/storage-initializer/0.log" Jun 10 12:34:57.585473 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:34:57.585438 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-xmz4z_aa07d635-db63-4641-8e7a-8f8dacce3e02/main/0.log" Jun 10 12:34:57.700575 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:34:57.700550 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mpz4_6124664a-cd5c-4a04-8a31-957ce5869e26/main/0.log" Jun 10 12:34:57.709134 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:34:57.709115 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mpz4_6124664a-cd5c-4a04-8a31-957ce5869e26/storage-initializer/0.log" Jun 10 12:34:57.826102 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:34:57.826001 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-mp4mv_32897bde-350b-4911-8ca1-87e79dff9cbf/storage-initializer/0.log" Jun 10 12:34:57.835282 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:34:57.835262 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-mp4mv_32897bde-350b-4911-8ca1-87e79dff9cbf/main/0.log" Jun 10 12:34:57.955820 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:34:57.955786 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-4nsgb_e24b0748-56c1-4612-ab5b-e1c16ae07b88/storage-initializer/0.log" Jun 10 12:34:57.965252 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:34:57.965229 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-4nsgb_e24b0748-56c1-4612-ab5b-e1c16ae07b88/main/0.log" Jun 10 12:35:05.791425 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:05.791395 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-v9bc6_735eadd6-c42b-4044-95b8-cd0b4762e0eb/global-pull-secret-syncer/0.log" Jun 10 12:35:05.924764 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:05.924730 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xjx89_f11fac11-8429-4106-8c42-06e081bc5a56/konnectivity-agent/0.log" Jun 10 12:35:06.020722 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:06.020694 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-86.ec2.internal_40ca37db0a7b4f65e597e689e3ee3fae/haproxy/0.log" Jun 10 12:35:10.721891 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:10.721855 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-zsznv_3aad49b0-1d26-4747-8ba1-2aa3d166d944/manager/0.log" Jun 10 12:35:10.750175 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:10.750145 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-hvfvk_e5c6a5b8-3efa-473b-a4de-0364d67a9deb/manager/0.log" Jun 10 12:35:10.825838 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:10.825805 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-fs8qt_f04aecf8-3e9e-4569-a6d5-68e4cbb2bfba/registry-server/0.log" Jun 10 12:35:10.942200 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:10.942161 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-gjp6l_1a7a982b-f7e7-4d1c-8db7-f83d36bc6f02/limitador/0.log" Jun 10 12:35:11.016658 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:11.016573 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-lqqbg_c723e2ae-66ae-4674-9e6b-743e07293f71/manager/0.log" Jun 10 12:35:13.026497 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:13.026471 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-vb5gh_d2353eea-0296-4a7d-8277-1b6943dc0e34/kube-state-metrics/0.log" Jun 10 12:35:13.060217 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:13.060191 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-vb5gh_d2353eea-0296-4a7d-8277-1b6943dc0e34/kube-rbac-proxy-main/0.log" Jun 10 12:35:13.091866 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:13.091827 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-vb5gh_d2353eea-0296-4a7d-8277-1b6943dc0e34/kube-rbac-proxy-self/0.log" Jun 10 12:35:13.318732 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:13.318649 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nprtc_5929bf2e-5692-45c9-8561-9e479937f7db/node-exporter/0.log" Jun 10 12:35:13.357483 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:13.357462 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nprtc_5929bf2e-5692-45c9-8561-9e479937f7db/kube-rbac-proxy/0.log" Jun 10 12:35:13.397905 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:13.397880 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nprtc_5929bf2e-5692-45c9-8561-9e479937f7db/init-textfile/0.log" Jun 10 12:35:13.549179 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:13.549146 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-hdvmm_b9a76923-27f8-4af2-9f09-8c0a69b8691d/kube-rbac-proxy-main/0.log" Jun 10 12:35:13.585424 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:13.585348 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-hdvmm_b9a76923-27f8-4af2-9f09-8c0a69b8691d/kube-rbac-proxy-self/0.log" Jun 10 12:35:13.631461 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:13.631431 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-hdvmm_b9a76923-27f8-4af2-9f09-8c0a69b8691d/openshift-state-metrics/0.log" Jun 10 12:35:13.684868 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:13.684836 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_815352c1-626a-4dfa-9056-13373cb74f66/prometheus/0.log" Jun 10 12:35:13.717177 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:13.717154 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_815352c1-626a-4dfa-9056-13373cb74f66/config-reloader/0.log" Jun 10 12:35:13.751558 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:13.751531 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_815352c1-626a-4dfa-9056-13373cb74f66/thanos-sidecar/0.log" Jun 10 12:35:13.785472 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:13.785449 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_815352c1-626a-4dfa-9056-13373cb74f66/kube-rbac-proxy-web/0.log" Jun 10 12:35:13.813443 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:13.813418 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_815352c1-626a-4dfa-9056-13373cb74f66/kube-rbac-proxy/0.log" Jun 10 12:35:13.843745 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:13.843723 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_815352c1-626a-4dfa-9056-13373cb74f66/kube-rbac-proxy-thanos/0.log" Jun 10 12:35:13.877506 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:13.877481 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_815352c1-626a-4dfa-9056-13373cb74f66/init-config-reloader/0.log" Jun 10 12:35:13.978531 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:13.978499 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-pn9pz_cfe9684c-b09b-4df2-82f5-83e568a8e7af/prometheus-operator-admission-webhook/0.log" Jun 10 12:35:14.019240 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:14.019212 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6d8d7d74bb-4l7zl_cd63d838-7b1d-4f6a-916d-2af4cd2500c2/telemeter-client/0.log" Jun 10 12:35:14.054982 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:14.054952 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6d8d7d74bb-4l7zl_cd63d838-7b1d-4f6a-916d-2af4cd2500c2/reload/0.log" Jun 10 12:35:14.085391 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:14.085361 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6d8d7d74bb-4l7zl_cd63d838-7b1d-4f6a-916d-2af4cd2500c2/kube-rbac-proxy/0.log" Jun 10 12:35:14.134700 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:14.134628 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b84f8f49b-h7fxl_29fd0022-4d61-450f-9074-1d9fa3b9c7be/thanos-query/0.log" Jun 10 12:35:14.165408 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:14.165382 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b84f8f49b-h7fxl_29fd0022-4d61-450f-9074-1d9fa3b9c7be/kube-rbac-proxy-web/0.log" Jun 10 12:35:14.197475 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:14.197445 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b84f8f49b-h7fxl_29fd0022-4d61-450f-9074-1d9fa3b9c7be/kube-rbac-proxy/0.log" Jun 10 12:35:14.224625 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:14.224597 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b84f8f49b-h7fxl_29fd0022-4d61-450f-9074-1d9fa3b9c7be/prom-label-proxy/0.log" Jun 10 12:35:14.281027 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:14.280997 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b84f8f49b-h7fxl_29fd0022-4d61-450f-9074-1d9fa3b9c7be/kube-rbac-proxy-rules/0.log" Jun 10 12:35:14.307177 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:14.307151 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b84f8f49b-h7fxl_29fd0022-4d61-450f-9074-1d9fa3b9c7be/kube-rbac-proxy-metrics/0.log" Jun 10 12:35:15.564945 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:15.564917 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-465ht_54ab14ef-0e83-468a-8795-3aa3df8bd004/networking-console-plugin/0.log" Jun 10 12:35:16.947249 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:16.947219 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-wzc9g_05d0c844-384f-4af1-92c1-27b075cb581c/download-server/0.log" Jun 10 12:35:17.592286 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:17.592244 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vd9h2/perf-node-gather-daemonset-5scxk"] Jun 10 12:35:17.596360 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:17.596335 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vd9h2/perf-node-gather-daemonset-5scxk" Jun 10 12:35:17.599055 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:17.599017 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vd9h2\"/\"kube-root-ca.crt\"" Jun 10 12:35:17.599188 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:17.599127 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vd9h2\"/\"default-dockercfg-27c5p\"" Jun 10 12:35:17.600087 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:17.600070 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vd9h2\"/\"openshift-service-ca.crt\"" Jun 10 12:35:17.606325 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:17.606302 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vd9h2/perf-node-gather-daemonset-5scxk"] Jun 10 12:35:17.636067 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:17.636009 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pm9h\" (UniqueName: \"kubernetes.io/projected/f07d6405-e49c-4cf7-89a3-54794c6134f3-kube-api-access-5pm9h\") pod \"perf-node-gather-daemonset-5scxk\" (UID: \"f07d6405-e49c-4cf7-89a3-54794c6134f3\") " pod="openshift-must-gather-vd9h2/perf-node-gather-daemonset-5scxk" Jun 10 12:35:17.636248 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:17.636082 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f07d6405-e49c-4cf7-89a3-54794c6134f3-proc\") pod \"perf-node-gather-daemonset-5scxk\" (UID: \"f07d6405-e49c-4cf7-89a3-54794c6134f3\") " pod="openshift-must-gather-vd9h2/perf-node-gather-daemonset-5scxk" Jun 10 12:35:17.636248 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:17.636199 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f07d6405-e49c-4cf7-89a3-54794c6134f3-sys\") pod \"perf-node-gather-daemonset-5scxk\" (UID: \"f07d6405-e49c-4cf7-89a3-54794c6134f3\") " pod="openshift-must-gather-vd9h2/perf-node-gather-daemonset-5scxk" Jun 10 12:35:17.636366 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:17.636255 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f07d6405-e49c-4cf7-89a3-54794c6134f3-podres\") pod \"perf-node-gather-daemonset-5scxk\" (UID: \"f07d6405-e49c-4cf7-89a3-54794c6134f3\") " pod="openshift-must-gather-vd9h2/perf-node-gather-daemonset-5scxk" Jun 10 12:35:17.636366 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:17.636316 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f07d6405-e49c-4cf7-89a3-54794c6134f3-lib-modules\") pod \"perf-node-gather-daemonset-5scxk\" (UID: \"f07d6405-e49c-4cf7-89a3-54794c6134f3\") " pod="openshift-must-gather-vd9h2/perf-node-gather-daemonset-5scxk" Jun 10 12:35:17.737408 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:17.737370 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f07d6405-e49c-4cf7-89a3-54794c6134f3-sys\") pod \"perf-node-gather-daemonset-5scxk\" (UID: \"f07d6405-e49c-4cf7-89a3-54794c6134f3\") " pod="openshift-must-gather-vd9h2/perf-node-gather-daemonset-5scxk" Jun 10 12:35:17.737617 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:17.737423 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f07d6405-e49c-4cf7-89a3-54794c6134f3-podres\") pod \"perf-node-gather-daemonset-5scxk\" (UID: \"f07d6405-e49c-4cf7-89a3-54794c6134f3\") " pod="openshift-must-gather-vd9h2/perf-node-gather-daemonset-5scxk" Jun 10 12:35:17.737617 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:17.737464 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f07d6405-e49c-4cf7-89a3-54794c6134f3-lib-modules\") pod \"perf-node-gather-daemonset-5scxk\" (UID: \"f07d6405-e49c-4cf7-89a3-54794c6134f3\") " pod="openshift-must-gather-vd9h2/perf-node-gather-daemonset-5scxk" Jun 10 12:35:17.737617 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:17.737495 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pm9h\" (UniqueName: \"kubernetes.io/projected/f07d6405-e49c-4cf7-89a3-54794c6134f3-kube-api-access-5pm9h\") pod \"perf-node-gather-daemonset-5scxk\" (UID: \"f07d6405-e49c-4cf7-89a3-54794c6134f3\") " pod="openshift-must-gather-vd9h2/perf-node-gather-daemonset-5scxk" Jun 10 12:35:17.737617 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:17.737514 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f07d6405-e49c-4cf7-89a3-54794c6134f3-sys\") pod \"perf-node-gather-daemonset-5scxk\" (UID: \"f07d6405-e49c-4cf7-89a3-54794c6134f3\") " pod="openshift-must-gather-vd9h2/perf-node-gather-daemonset-5scxk" Jun 10 12:35:17.737617 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:17.737526 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f07d6405-e49c-4cf7-89a3-54794c6134f3-proc\") pod \"perf-node-gather-daemonset-5scxk\" (UID: \"f07d6405-e49c-4cf7-89a3-54794c6134f3\") " pod="openshift-must-gather-vd9h2/perf-node-gather-daemonset-5scxk" Jun 10 12:35:17.737617 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:17.737574 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f07d6405-e49c-4cf7-89a3-54794c6134f3-proc\") pod \"perf-node-gather-daemonset-5scxk\" (UID: \"f07d6405-e49c-4cf7-89a3-54794c6134f3\") " pod="openshift-must-gather-vd9h2/perf-node-gather-daemonset-5scxk" Jun 10 12:35:17.737847 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:17.737620 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f07d6405-e49c-4cf7-89a3-54794c6134f3-lib-modules\") pod \"perf-node-gather-daemonset-5scxk\" (UID: \"f07d6405-e49c-4cf7-89a3-54794c6134f3\") " pod="openshift-must-gather-vd9h2/perf-node-gather-daemonset-5scxk" Jun 10 12:35:17.737847 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:17.737621 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f07d6405-e49c-4cf7-89a3-54794c6134f3-podres\") pod \"perf-node-gather-daemonset-5scxk\" (UID: \"f07d6405-e49c-4cf7-89a3-54794c6134f3\") " pod="openshift-must-gather-vd9h2/perf-node-gather-daemonset-5scxk" Jun 10 12:35:17.747257 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:17.747229 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pm9h\" (UniqueName: \"kubernetes.io/projected/f07d6405-e49c-4cf7-89a3-54794c6134f3-kube-api-access-5pm9h\") pod \"perf-node-gather-daemonset-5scxk\" (UID: \"f07d6405-e49c-4cf7-89a3-54794c6134f3\") " pod="openshift-must-gather-vd9h2/perf-node-gather-daemonset-5scxk" Jun 10 12:35:17.907995 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:17.907893 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vd9h2/perf-node-gather-daemonset-5scxk" Jun 10 12:35:18.042152 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:18.042122 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vd9h2/perf-node-gather-daemonset-5scxk"] Jun 10 12:35:18.044904 ip-10-0-139-86 kubenswrapper[2562]: W0610 12:35:18.044880 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf07d6405_e49c_4cf7_89a3_54794c6134f3.slice/crio-ef6b771a50155de7c0476309366e618d01400a57c5bd631bd57d7f37b3a75a04 WatchSource:0}: Error finding container ef6b771a50155de7c0476309366e618d01400a57c5bd631bd57d7f37b3a75a04: Status 404 returned error can't find the container with id ef6b771a50155de7c0476309366e618d01400a57c5bd631bd57d7f37b3a75a04 Jun 10 12:35:18.340285 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:18.340252 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vd9h2/perf-node-gather-daemonset-5scxk" event={"ID":"f07d6405-e49c-4cf7-89a3-54794c6134f3","Type":"ContainerStarted","Data":"8567272f8ab9dd1be52838198654affdb256b30736b17e8a0c61f80a98026b6c"} Jun 10 12:35:18.340505 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:18.340411 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vd9h2/perf-node-gather-daemonset-5scxk" Jun 10 12:35:18.340505 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:18.340434 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vd9h2/perf-node-gather-daemonset-5scxk" event={"ID":"f07d6405-e49c-4cf7-89a3-54794c6134f3","Type":"ContainerStarted","Data":"ef6b771a50155de7c0476309366e618d01400a57c5bd631bd57d7f37b3a75a04"} Jun 10 12:35:18.361053 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:18.361000 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vd9h2/perf-node-gather-daemonset-5scxk" podStartSLOduration=1.360985101 podStartE2EDuration="1.360985101s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:35:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:35:18.359399853 +0000 UTC m=+2226.565150698" watchObservedRunningTime="2026-06-10 12:35:18.360985101 +0000 UTC m=+2226.566735944" Jun 10 12:35:19.001084 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:19.001013 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4jjmm_80531a6e-51be-47ad-ac4a-e7f636b8e77b/dns/0.log" Jun 10 12:35:19.035493 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:19.035466 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4jjmm_80531a6e-51be-47ad-ac4a-e7f636b8e77b/kube-rbac-proxy/0.log" Jun 10 12:35:19.244201 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:19.244173 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dhw7b_e73f01dd-034a-4de7-a873-15dccbae3921/dns-node-resolver/0.log" Jun 10 12:35:20.052593 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:20.052543 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fnfcg_0b9f91bb-de66-4959-b25d-c8c4f3f6bb79/node-ca/0.log" Jun 10 12:35:21.087964 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:21.087935 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795rwzth_cbac9d68-b054-43af-8ca8-7fea047af7f3/istio-proxy/0.log" Jun 10 12:35:21.267616 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:21.267576 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-7mcwg_0d2589db-da8b-477e-b85f-61fe499661ca/istio-proxy/0.log" Jun 10 12:35:21.295197 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:21.295143 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-7mcwg_0d2589db-da8b-477e-b85f-61fe499661ca/istio-proxy/1.log" Jun 10 12:35:22.196495 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:22.196461 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jlk9m_bab0f8f5-7a24-4e8e-a4fe-a1eb8faed110/serve-healthcheck-canary/0.log" Jun 10 12:35:22.909604 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:22.909576 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-llx7r_4cee9ada-9799-42b4-a209-3b55df25b91f/kube-rbac-proxy/0.log" Jun 10 12:35:22.937864 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:22.937836 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-llx7r_4cee9ada-9799-42b4-a209-3b55df25b91f/exporter/0.log" Jun 10 12:35:22.966831 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:22.966804 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-llx7r_4cee9ada-9799-42b4-a209-3b55df25b91f/extractor/0.log" Jun 10 12:35:24.355356 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:24.355331 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vd9h2/perf-node-gather-daemonset-5scxk" Jun 10 12:35:25.393118 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:25.393089 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-56dc4c55d-mnvvh_e776db1d-e35b-45e6-a136-1f7adb8c9abb/nginx/0.log" Jun 10 12:35:25.949739 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:25.949709 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76c45549f7-fxbs9_7bab442d-9251-4f8c-a2c1-080431fae04b/manager/0.log" Jun 10 12:35:25.970834 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:25.970810 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76c45549f7-fxbs9_7bab442d-9251-4f8c-a2c1-080431fae04b/copy-manifests/0.log" Jun 10 12:35:27.776029 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:27.775944 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-85c5ffbff9-2j9cb_d2e980fe-0534-45e7-b85d-a926603001e2/manager/0.log" Jun 10 12:35:30.242658 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:30.242624 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795rwzth_cbac9d68-b054-43af-8ca8-7fea047af7f3/istio-proxy/0.log" Jun 10 12:35:30.399303 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:30.399275 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-7mcwg_0d2589db-da8b-477e-b85f-61fe499661ca/istio-proxy/0.log" Jun 10 12:35:30.431811 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:30.431775 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-7mcwg_0d2589db-da8b-477e-b85f-61fe499661ca/istio-proxy/1.log" Jun 10 12:35:31.688093 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:31.687980 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795rwzth_cbac9d68-b054-43af-8ca8-7fea047af7f3/istio-proxy/0.log" Jun 10 12:35:31.842268 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:31.842237 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-7mcwg_0d2589db-da8b-477e-b85f-61fe499661ca/istio-proxy/0.log" Jun 10 12:35:31.877091 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:31.877063 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-7mcwg_0d2589db-da8b-477e-b85f-61fe499661ca/istio-proxy/1.log" Jun 10 12:35:33.823999 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:33.823964 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795rwzth_cbac9d68-b054-43af-8ca8-7fea047af7f3/istio-proxy/0.log" Jun 10 12:35:33.893906 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:33.893878 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-q5mnd_55db9178-02ce-4f84-a852-e83d475bc16c/migrator/0.log" Jun 10 12:35:33.923392 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:33.923365 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-q5mnd_55db9178-02ce-4f84-a852-e83d475bc16c/graceful-termination/0.log" Jun 10 12:35:33.948308 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:33.948280 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-7mcwg_0d2589db-da8b-477e-b85f-61fe499661ca/istio-proxy/0.log" Jun 10 12:35:33.977189 ip-10-0-139-86 kubenswrapper[2562]: I0610 12:35:33.977111 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-7mcwg_0d2589db-da8b-477e-b85f-61fe499661ca/istio-proxy/1.log"