Jun 08 16:44:42.225639 ip-10-0-135-83 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 08 16:44:42.225654 ip-10-0-135-83 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 08 16:44:42.225663 ip-10-0-135-83 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 08 16:44:42.225863 ip-10-0-135-83 systemd[1]: Failed to start Kubernetes Kubelet. Jun 08 16:44:52.374206 ip-10-0-135-83 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 08 16:44:52.374227 ip-10-0-135-83 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 7e3de0a09d6f419ca2f8159f09547869 -- Jun 08 16:47:27.985501 ip-10-0-135-83 systemd[1]: Starting Kubernetes Kubelet... Jun 08 16:47:28.367040 ip-10-0-135-83 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 16:47:28.367040 ip-10-0-135-83 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 08 16:47:28.367040 ip-10-0-135-83 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 16:47:28.367040 ip-10-0-135-83 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 08 16:47:28.367040 ip-10-0-135-83 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 16:47:28.367960 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.367891 2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 08 16:47:28.371180 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371166 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 16:47:28.371180 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371180 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 16:47:28.371263 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371184 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 16:47:28.371263 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371187 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 16:47:28.371263 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371190 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 16:47:28.371263 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371193 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 16:47:28.371263 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371196 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 16:47:28.371263 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371198 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 16:47:28.371263 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371201 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 16:47:28.371263 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371203 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 16:47:28.371263 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371206 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 16:47:28.371263 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371209 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 16:47:28.371263 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371212 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 16:47:28.371263 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371214 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 16:47:28.371263 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371216 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 16:47:28.371263 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371219 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 16:47:28.371263 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371222 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 16:47:28.371263 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371224 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 16:47:28.371263 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371228 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 16:47:28.371263 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371232 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 16:47:28.371263 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371248 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 16:47:28.371713 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371252 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 16:47:28.371713 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371255 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 16:47:28.371713 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371257 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 16:47:28.371713 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371260 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 16:47:28.371713 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371263 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 08 16:47:28.371713 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371267 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 16:47:28.371713 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371271 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 16:47:28.371713 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371273 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 16:47:28.371713 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371283 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 16:47:28.371713 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371286 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 16:47:28.371713 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371289 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 16:47:28.371713 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371291 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 16:47:28.371713 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371293 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 16:47:28.371713 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371296 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 16:47:28.371713 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371298 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 16:47:28.371713 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371301 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 16:47:28.371713 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371303 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 16:47:28.371713 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371305 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 16:47:28.371713 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371308 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 16:47:28.371713 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371310 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 16:47:28.372189 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371312 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 16:47:28.372189 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371315 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 16:47:28.372189 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371317 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 16:47:28.372189 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371320 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 16:47:28.372189 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371322 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 16:47:28.372189 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371325 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 16:47:28.372189 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371327 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 16:47:28.372189 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371329 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 16:47:28.372189 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371332 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 16:47:28.372189 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371335 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 16:47:28.372189 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371337 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 16:47:28.372189 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371340 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 16:47:28.372189 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371342 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 16:47:28.372189 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371345 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 16:47:28.372189 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371348 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 16:47:28.372189 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371350 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 16:47:28.372189 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371353 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 16:47:28.372189 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371355 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 16:47:28.372189 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371358 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 16:47:28.372662 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371360 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 16:47:28.372662 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371362 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 16:47:28.372662 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371365 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 16:47:28.372662 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371367 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 16:47:28.372662 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371370 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 16:47:28.372662 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371372 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 16:47:28.372662 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371376 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 16:47:28.372662 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371379 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 16:47:28.372662 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371382 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 16:47:28.372662 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371385 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 16:47:28.372662 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371387 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 16:47:28.372662 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371389 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 16:47:28.372662 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371391 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 16:47:28.372662 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371394 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 16:47:28.372662 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371396 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 16:47:28.372662 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371399 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 16:47:28.372662 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371401 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 16:47:28.372662 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371403 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 16:47:28.372662 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371406 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 16:47:28.372662 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371409 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 16:47:28.373139 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371411 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 16:47:28.373139 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371415 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 16:47:28.373139 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371417 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 16:47:28.373139 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371419 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 16:47:28.373139 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371422 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 16:47:28.373139 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371424 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 16:47:28.373139 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371427 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 16:47:28.373139 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371430 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 16:47:28.373139 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371432 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 16:47:28.373139 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371435 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 16:47:28.373139 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371437 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 16:47:28.373139 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371440 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 16:47:28.373139 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371442 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 16:47:28.373139 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371445 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 16:47:28.373139 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371447 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 16:47:28.373139 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371449 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 16:47:28.373139 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371452 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 16:47:28.373139 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371454 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 16:47:28.373139 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.371457 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 16:47:28.373139 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372111 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 16:47:28.373637 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372117 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 16:47:28.373637 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372120 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 16:47:28.373637 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372123 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 16:47:28.373637 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372125 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 16:47:28.373637 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372128 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 16:47:28.373637 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372130 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 16:47:28.373637 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372133 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 16:47:28.373637 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372136 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 16:47:28.373637 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372139 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 16:47:28.373637 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372141 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 16:47:28.373637 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372144 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 16:47:28.373637 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372146 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 16:47:28.373637 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372149 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 16:47:28.373637 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372152 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 16:47:28.373637 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372155 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 08 16:47:28.373637 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372157 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 16:47:28.373637 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372160 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 16:47:28.373637 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372162 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 16:47:28.373637 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372166 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 16:47:28.373637 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372169 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 16:47:28.374225 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372221 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 16:47:28.374225 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372225 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 16:47:28.374225 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372229 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 16:47:28.374225 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372232 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 16:47:28.374225 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372252 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 16:47:28.374225 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372255 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 16:47:28.374225 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372258 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 16:47:28.374225 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372261 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 16:47:28.374225 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372264 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 16:47:28.374225 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372267 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 16:47:28.374225 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372269 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 16:47:28.374225 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372272 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 16:47:28.374225 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372275 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 16:47:28.374225 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372277 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 16:47:28.374225 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372280 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 16:47:28.374225 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372282 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 16:47:28.374225 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372285 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 16:47:28.374225 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372287 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 16:47:28.374225 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372290 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 16:47:28.374225 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372292 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 16:47:28.374735 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372295 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 16:47:28.374735 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372298 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 16:47:28.374735 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372300 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 16:47:28.374735 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372302 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 16:47:28.374735 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372305 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 16:47:28.374735 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372308 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 16:47:28.374735 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372311 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 16:47:28.374735 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372313 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 16:47:28.374735 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372316 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 16:47:28.374735 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372321 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 16:47:28.374735 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372325 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 16:47:28.374735 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372328 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 16:47:28.374735 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372331 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 16:47:28.374735 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372333 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 16:47:28.374735 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372336 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 16:47:28.374735 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372339 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 16:47:28.374735 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372341 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 16:47:28.374735 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372343 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 16:47:28.374735 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372346 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 16:47:28.375204 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372348 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 16:47:28.375204 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372351 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 16:47:28.375204 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372355 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 16:47:28.375204 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372358 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 16:47:28.375204 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372360 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 16:47:28.375204 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372363 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 16:47:28.375204 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372366 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 16:47:28.375204 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372368 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 16:47:28.375204 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372371 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 16:47:28.375204 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372374 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 16:47:28.375204 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372377 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 16:47:28.375204 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372379 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 16:47:28.375204 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372382 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 16:47:28.375204 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372385 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 16:47:28.375204 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372387 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 16:47:28.375204 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372390 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 16:47:28.375204 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372392 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 16:47:28.375204 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372395 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 16:47:28.375204 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372398 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 16:47:28.375204 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372401 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 16:47:28.375733 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372403 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 16:47:28.375733 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372407 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 16:47:28.375733 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372409 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 16:47:28.375733 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372412 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 16:47:28.375733 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372415 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 16:47:28.375733 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372417 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 16:47:28.375733 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372420 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 16:47:28.375733 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372422 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 16:47:28.375733 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372425 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 16:47:28.375733 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372427 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 16:47:28.375733 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372429 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 16:47:28.375733 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372431 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 16:47:28.375733 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372434 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 16:47:28.375733 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372436 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 16:47:28.375733 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372440 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 16:47:28.375733 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372443 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 16:47:28.375733 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372446 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 16:47:28.375733 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372448 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 16:47:28.375733 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372451 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 16:47:28.376188 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372787 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 16:47:28.376188 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372791 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 16:47:28.376188 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372794 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 16:47:28.376188 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372797 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 16:47:28.376188 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372799 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 16:47:28.376188 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372802 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 16:47:28.376188 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372805 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 16:47:28.376188 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372807 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 16:47:28.376188 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372810 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 16:47:28.376188 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372813 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 16:47:28.376188 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372816 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 16:47:28.376188 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372818 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 16:47:28.376188 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372821 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 16:47:28.376188 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372824 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 16:47:28.376188 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372827 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 16:47:28.376188 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372830 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 16:47:28.376188 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372832 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 16:47:28.376188 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372834 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 16:47:28.376188 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372837 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 16:47:28.376188 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372839 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 16:47:28.376705 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372843 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 16:47:28.376705 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372847 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 16:47:28.376705 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372850 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 16:47:28.376705 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372853 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 16:47:28.376705 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372855 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 16:47:28.376705 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372858 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 16:47:28.376705 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372860 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 16:47:28.376705 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372864 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 16:47:28.376705 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372867 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 16:47:28.376705 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372869 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 16:47:28.376705 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372872 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 16:47:28.376705 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372874 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 16:47:28.376705 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372877 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 16:47:28.376705 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372879 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 16:47:28.376705 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372882 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 16:47:28.376705 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372885 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 16:47:28.376705 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372887 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 16:47:28.376705 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372890 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 16:47:28.376705 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372893 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 16:47:28.377160 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372896 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 16:47:28.377160 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372899 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 16:47:28.377160 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372902 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 16:47:28.377160 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372906 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 16:47:28.377160 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372909 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 16:47:28.377160 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372912 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 16:47:28.377160 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372915 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 16:47:28.377160 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372917 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 16:47:28.377160 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372920 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 16:47:28.377160 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372922 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 16:47:28.377160 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372926 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 16:47:28.377160 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372930 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 16:47:28.377160 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372933 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 16:47:28.377160 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372935 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 08 16:47:28.377160 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372938 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 16:47:28.377160 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372941 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 16:47:28.377160 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372944 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 16:47:28.377160 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372946 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 16:47:28.377160 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372949 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 16:47:28.377661 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372951 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 16:47:28.377661 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372954 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 16:47:28.377661 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372956 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 16:47:28.377661 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372959 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 16:47:28.377661 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372961 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 16:47:28.377661 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372964 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 16:47:28.377661 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372966 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 16:47:28.377661 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372968 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 16:47:28.377661 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372971 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 16:47:28.377661 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372973 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 16:47:28.377661 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372975 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 16:47:28.377661 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372978 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 16:47:28.377661 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372980 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 16:47:28.377661 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372983 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 16:47:28.377661 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372989 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 16:47:28.377661 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372991 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 16:47:28.377661 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372995 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 16:47:28.377661 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.372997 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 16:47:28.377661 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373000 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 16:47:28.377661 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373003 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 16:47:28.378141 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373006 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 16:47:28.378141 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373019 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 16:47:28.378141 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373021 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 16:47:28.378141 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373023 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 16:47:28.378141 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373026 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 16:47:28.378141 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373029 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 16:47:28.378141 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373031 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 16:47:28.378141 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373034 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 16:47:28.378141 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373036 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 16:47:28.378141 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373038 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 16:47:28.378141 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373041 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 16:47:28.378141 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373043 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 16:47:28.378141 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373046 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 16:47:28.378141 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373048 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 16:47:28.378141 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373051 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 16:47:28.378141 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373053 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 16:47:28.378141 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373055 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 16:47:28.378141 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373058 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 16:47:28.378141 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373061 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 16:47:28.378141 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373063 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 16:47:28.378636 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373065 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 16:47:28.378636 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373131 2579 flags.go:64] FLAG: --address="0.0.0.0" Jun 08 16:47:28.378636 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373138 2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 08 16:47:28.378636 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373143 2579 flags.go:64] FLAG: --anonymous-auth="true" Jun 08 16:47:28.378636 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373148 2579 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 08 16:47:28.378636 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373152 2579 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 08 16:47:28.378636 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373156 2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 08 16:47:28.378636 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373160 2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 08 16:47:28.378636 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373165 2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 08 16:47:28.378636 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373169 2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 08 16:47:28.378636 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373171 2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 08 16:47:28.378636 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373174 2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 08 16:47:28.378636 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373177 2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 08 16:47:28.378636 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373181 2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 08 16:47:28.378636 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373184 2579 flags.go:64] FLAG: --cgroup-root="" Jun 08 16:47:28.378636 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373187 2579 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 08 16:47:28.378636 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373190 2579 flags.go:64] FLAG: --client-ca-file="" Jun 08 16:47:28.378636 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373192 2579 flags.go:64] FLAG: --cloud-provider="external" Jun 08 16:47:28.378636 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373195 2579 flags.go:64] FLAG: --cluster-dns="[]" Jun 08 16:47:28.378636 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373199 2579 flags.go:64] FLAG: --cluster-domain="" Jun 08 16:47:28.378636 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373201 2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 08 16:47:28.378636 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373204 2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 08 16:47:28.378636 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373207 2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 08 16:47:28.378636 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373210 2579 flags.go:64] FLAG: --container-log-max-files="5" Jun 08 16:47:28.379268 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373213 2579 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 08 16:47:28.379268 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373216 2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 08 16:47:28.379268 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373219 2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 08 16:47:28.379268 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373222 2579 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 08 16:47:28.379268 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373224 2579 flags.go:64] FLAG: --contention-profiling="false" Jun 08 16:47:28.379268 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373227 2579 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 08 16:47:28.379268 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373230 2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 08 16:47:28.379268 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373233 2579 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 08 16:47:28.379268 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373251 2579 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 08 16:47:28.379268 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373257 2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 08 16:47:28.379268 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373261 2579 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 08 16:47:28.379268 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373265 2579 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 08 16:47:28.379268 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373267 2579 flags.go:64] FLAG: --enable-load-reader="false" Jun 08 16:47:28.379268 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373270 2579 flags.go:64] FLAG: --enable-server="true" Jun 08 16:47:28.379268 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373274 2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 08 16:47:28.379268 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373278 2579 flags.go:64] FLAG: --event-burst="100" Jun 08 16:47:28.379268 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373282 2579 flags.go:64] FLAG: --event-qps="50" Jun 08 16:47:28.379268 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373285 2579 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 08 16:47:28.379268 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373287 2579 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 08 16:47:28.379268 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373290 2579 flags.go:64] FLAG: --eviction-hard="" Jun 08 16:47:28.379268 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373294 2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 08 16:47:28.379268 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373296 2579 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 08 16:47:28.379268 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373300 2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 08 16:47:28.379268 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373302 2579 flags.go:64] FLAG: --eviction-soft="" Jun 08 16:47:28.379268 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373305 2579 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 08 16:47:28.379895 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373308 2579 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 08 16:47:28.379895 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373311 2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 08 16:47:28.379895 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373313 2579 flags.go:64] FLAG: --experimental-mounter-path="" Jun 08 16:47:28.379895 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373316 2579 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 08 16:47:28.379895 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373319 2579 flags.go:64] FLAG: --fail-swap-on="true" Jun 08 16:47:28.379895 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373321 2579 flags.go:64] FLAG: --feature-gates="" Jun 08 16:47:28.379895 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373325 2579 flags.go:64] FLAG: --file-check-frequency="20s" Jun 08 16:47:28.379895 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373327 2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 08 16:47:28.379895 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373330 2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 08 16:47:28.379895 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373333 2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 08 16:47:28.379895 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373336 2579 flags.go:64] FLAG: --healthz-port="10248" Jun 08 16:47:28.379895 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373338 2579 flags.go:64] FLAG: --help="false" Jun 08 16:47:28.379895 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373341 2579 flags.go:64] FLAG: --hostname-override="ip-10-0-135-83.ec2.internal" Jun 08 16:47:28.379895 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373344 2579 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 08 16:47:28.379895 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373347 2579 flags.go:64] FLAG: --http-check-frequency="20s" Jun 08 16:47:28.379895 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373349 2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 08 16:47:28.379895 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373352 2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 08 16:47:28.379895 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373355 2579 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 08 16:47:28.379895 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373358 2579 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 08 16:47:28.379895 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373360 2579 flags.go:64] FLAG: --image-service-endpoint="" Jun 08 16:47:28.379895 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373363 2579 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 08 16:47:28.379895 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373367 2579 flags.go:64] FLAG: --kube-api-burst="100" Jun 08 16:47:28.379895 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373369 2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 08 16:47:28.380506 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373373 2579 flags.go:64] FLAG: --kube-api-qps="50" Jun 08 16:47:28.380506 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373376 2579 flags.go:64] FLAG: --kube-reserved="" Jun 08 16:47:28.380506 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373379 2579 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 08 16:47:28.380506 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373381 2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 08 16:47:28.380506 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373384 2579 flags.go:64] FLAG: --kubelet-cgroups="" Jun 08 16:47:28.380506 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373387 2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 08 16:47:28.380506 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373389 2579 flags.go:64] FLAG: --lock-file="" Jun 08 16:47:28.380506 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373392 2579 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 08 16:47:28.380506 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373395 2579 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 08 16:47:28.380506 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373397 2579 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 08 16:47:28.380506 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373402 2579 flags.go:64] FLAG: --log-json-split-stream="false" Jun 08 16:47:28.380506 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373405 2579 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 08 16:47:28.380506 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373408 2579 flags.go:64] FLAG: --log-text-split-stream="false" Jun 08 16:47:28.380506 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373410 2579 flags.go:64] FLAG: --logging-format="text" Jun 08 16:47:28.380506 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373413 2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 08 16:47:28.380506 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373416 2579 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 08 16:47:28.380506 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373419 2579 flags.go:64] FLAG: --manifest-url="" Jun 08 16:47:28.380506 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373422 2579 flags.go:64] FLAG: --manifest-url-header="" Jun 08 16:47:28.380506 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373425 2579 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 08 16:47:28.380506 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373428 2579 flags.go:64] FLAG: --max-open-files="1000000" Jun 08 16:47:28.380506 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373432 2579 flags.go:64] FLAG: --max-pods="110" Jun 08 16:47:28.380506 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373434 2579 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 08 16:47:28.380506 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373437 2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 08 16:47:28.380506 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373440 2579 flags.go:64] FLAG: --memory-manager-policy="None" Jun 08 16:47:28.380506 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373442 2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 08 16:47:28.381111 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373445 2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 08 16:47:28.381111 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373448 2579 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 08 16:47:28.381111 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373450 2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 08 16:47:28.381111 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373457 2579 flags.go:64] FLAG: --node-status-max-images="50" Jun 08 16:47:28.381111 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373460 2579 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 08 16:47:28.381111 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373463 2579 flags.go:64] FLAG: --oom-score-adj="-999" Jun 08 16:47:28.381111 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373466 2579 flags.go:64] FLAG: --pod-cidr="" Jun 08 16:47:28.381111 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373470 2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 08 16:47:28.381111 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373474 2579 flags.go:64] FLAG: --pod-manifest-path="" Jun 08 16:47:28.381111 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373477 2579 flags.go:64] FLAG: --pod-max-pids="-1" Jun 08 16:47:28.381111 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373480 2579 flags.go:64] FLAG: --pods-per-core="0" Jun 08 16:47:28.381111 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373483 2579 flags.go:64] FLAG: --port="10250" Jun 08 16:47:28.381111 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373485 2579 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 08 16:47:28.381111 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373488 2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0990bf8ae82f7ce04" Jun 08 16:47:28.381111 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373491 2579 flags.go:64] FLAG: --qos-reserved="" Jun 08 16:47:28.381111 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373494 2579 flags.go:64] FLAG: --read-only-port="10255" Jun 08 16:47:28.381111 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373497 2579 flags.go:64] FLAG: --register-node="true" Jun 08 16:47:28.381111 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373500 2579 flags.go:64] FLAG: --register-with-taints="" Jun 08 16:47:28.381111 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373504 2579 flags.go:64] FLAG: --registry-burst="10" Jun 08 16:47:28.381111 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373506 2579 flags.go:64] FLAG: --registry-qps="5" Jun 08 16:47:28.381111 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373509 2579 flags.go:64] FLAG: --reserved-cpus="" Jun 08 16:47:28.381111 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373512 2579 flags.go:64] FLAG: --reserved-memory="" Jun 08 16:47:28.381111 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373515 2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 08 16:47:28.381111 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373518 2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 08 16:47:28.381111 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373521 2579 flags.go:64] FLAG: --rotate-certificates="false" Jun 08 16:47:28.382282 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373523 2579 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 08 16:47:28.382282 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373526 2579 flags.go:64] FLAG: --runonce="false" Jun 08 16:47:28.382282 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373529 2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 08 16:47:28.382282 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373532 2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 08 16:47:28.382282 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373534 2579 flags.go:64] FLAG: --seccomp-default="false" Jun 08 16:47:28.382282 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373537 2579 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 08 16:47:28.382282 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373540 2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 08 16:47:28.382282 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373542 2579 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 08 16:47:28.382282 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373545 2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 08 16:47:28.382282 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373548 2579 flags.go:64] FLAG: --storage-driver-password="root" Jun 08 16:47:28.382282 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373550 2579 flags.go:64] FLAG: --storage-driver-secure="false" Jun 08 16:47:28.382282 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373553 2579 flags.go:64] FLAG: --storage-driver-table="stats" Jun 08 16:47:28.382282 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373556 2579 flags.go:64] FLAG: --storage-driver-user="root" Jun 08 16:47:28.382282 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373559 2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 08 16:47:28.382282 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373564 2579 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 08 16:47:28.382282 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373566 2579 flags.go:64] FLAG: --system-cgroups="" Jun 08 16:47:28.382282 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373569 2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 08 16:47:28.382282 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373574 2579 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 08 16:47:28.382282 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373577 2579 flags.go:64] FLAG: --tls-cert-file="" Jun 08 16:47:28.382282 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373580 2579 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 08 16:47:28.382282 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373584 2579 flags.go:64] FLAG: --tls-min-version="" Jun 08 16:47:28.382282 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373586 2579 flags.go:64] FLAG: --tls-private-key-file="" Jun 08 16:47:28.382282 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373589 2579 flags.go:64] FLAG: --topology-manager-policy="none" Jun 08 16:47:28.382282 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373592 2579 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 08 16:47:28.382282 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373595 2579 flags.go:64] FLAG: --topology-manager-scope="container" Jun 08 16:47:28.382879 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373598 2579 flags.go:64] FLAG: --v="2" Jun 08 16:47:28.382879 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373602 2579 flags.go:64] FLAG: --version="false" Jun 08 16:47:28.382879 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373605 2579 flags.go:64] FLAG: --vmodule="" Jun 08 16:47:28.382879 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373609 2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 08 16:47:28.382879 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.373612 2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 08 16:47:28.382879 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373717 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 16:47:28.382879 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373720 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 16:47:28.382879 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373723 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 16:47:28.382879 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373725 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 16:47:28.382879 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373743 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 16:47:28.382879 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373747 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 16:47:28.382879 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373750 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 16:47:28.382879 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373754 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 16:47:28.382879 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373757 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 16:47:28.382879 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373759 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 16:47:28.382879 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373762 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 16:47:28.382879 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373764 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 16:47:28.382879 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373767 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 16:47:28.382879 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373769 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 16:47:28.382879 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373772 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 16:47:28.382879 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373775 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 16:47:28.383471 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373778 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 16:47:28.383471 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373781 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 16:47:28.383471 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373783 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 16:47:28.383471 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373785 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 16:47:28.383471 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373788 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 16:47:28.383471 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373791 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 16:47:28.383471 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373793 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 16:47:28.383471 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373796 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 16:47:28.383471 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373798 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 16:47:28.383471 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373801 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 16:47:28.383471 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373804 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 16:47:28.383471 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373806 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 16:47:28.383471 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373809 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 16:47:28.383471 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373811 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 16:47:28.383471 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373814 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 16:47:28.383471 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373823 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 16:47:28.383471 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373826 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 16:47:28.383471 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373829 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 16:47:28.383471 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373831 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 08 16:47:28.383471 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373834 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 16:47:28.383973 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373837 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 16:47:28.383973 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373839 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 16:47:28.383973 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373842 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 16:47:28.383973 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373844 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 16:47:28.383973 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373847 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 16:47:28.383973 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373849 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 16:47:28.383973 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373852 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 16:47:28.383973 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373854 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 16:47:28.383973 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373857 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 16:47:28.383973 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373859 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 16:47:28.383973 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373862 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 16:47:28.383973 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373865 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 16:47:28.383973 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373869 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 16:47:28.383973 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373872 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 16:47:28.383973 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373875 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 16:47:28.383973 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373878 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 16:47:28.383973 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373881 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 16:47:28.383973 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373884 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 16:47:28.383973 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373886 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 16:47:28.383973 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373889 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 16:47:28.384523 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373891 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 16:47:28.384523 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373893 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 16:47:28.384523 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373896 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 16:47:28.384523 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373899 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 16:47:28.384523 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373901 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 16:47:28.384523 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373904 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 16:47:28.384523 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373906 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 16:47:28.384523 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373909 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 16:47:28.384523 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373911 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 16:47:28.384523 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373913 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 16:47:28.384523 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373916 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 16:47:28.384523 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373918 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 16:47:28.384523 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373921 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 16:47:28.384523 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373923 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 16:47:28.384523 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373925 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 16:47:28.384523 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373928 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 16:47:28.384523 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373930 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 16:47:28.384523 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373933 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 16:47:28.384523 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373936 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 16:47:28.384990 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373939 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 16:47:28.384990 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373942 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 16:47:28.384990 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373945 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 16:47:28.384990 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373947 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 16:47:28.384990 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373951 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 16:47:28.384990 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373954 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 16:47:28.384990 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373957 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 16:47:28.384990 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373959 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 16:47:28.384990 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373962 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 16:47:28.384990 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373964 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 16:47:28.384990 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373967 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 16:47:28.384990 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373969 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 16:47:28.384990 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373972 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 16:47:28.384990 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373974 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 16:47:28.384990 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373977 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 16:47:28.384990 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373979 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 16:47:28.384990 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373981 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 16:47:28.384990 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373985 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 16:47:28.384990 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373987 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 16:47:28.384990 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373990 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 16:47:28.385497 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373992 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 16:47:28.385497 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373994 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 16:47:28.385497 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373997 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 16:47:28.385497 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.373999 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 16:47:28.385497 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.374650 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 16:47:28.385497 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.380775 2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 08 16:47:28.385497 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.380787 2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 08 16:47:28.385497 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.380806 2579 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 08 16:47:28.385497 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.380811 2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 08 16:47:28.385497 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.380863 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 16:47:28.385497 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.380868 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 16:47:28.385497 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.380871 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 16:47:28.385497 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.380874 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 16:47:28.385497 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.380877 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 16:47:28.385497 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.380879 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 16:47:28.385863 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.380882 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 08 16:47:28.385863 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.380885 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 16:47:28.385863 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.380888 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 16:47:28.385863 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.380891 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 16:47:28.385863 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.380893 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 16:47:28.385863 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.380896 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 16:47:28.385863 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.380899 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 16:47:28.385863 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.380901 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 16:47:28.385863 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.380904 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 16:47:28.385863 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.380906 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 16:47:28.385863 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.380909 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 16:47:28.385863 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.380912 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 16:47:28.385863 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.380915 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 16:47:28.385863 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.380917 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 16:47:28.385863 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.380920 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 16:47:28.385863 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.380924 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 16:47:28.385863 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.380928 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 16:47:28.385863 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.380931 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 16:47:28.385863 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.380934 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 16:47:28.385863 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.380937 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 16:47:28.386371 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.380940 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 16:47:28.386371 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.380943 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 16:47:28.386371 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.380947 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 16:47:28.386371 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.380951 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 16:47:28.386371 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.380954 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 16:47:28.386371 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.380956 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 16:47:28.386371 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.380959 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 16:47:28.386371 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.380961 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 16:47:28.386371 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.380964 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 16:47:28.386371 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.380966 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 16:47:28.386371 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.380969 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 16:47:28.386371 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.380971 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 16:47:28.386371 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.380974 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 16:47:28.386371 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.380976 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 16:47:28.386371 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.380979 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 16:47:28.386371 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.380982 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 16:47:28.386371 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.380985 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 16:47:28.386371 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.380987 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 16:47:28.386371 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.380990 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 16:47:28.386834 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.380992 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 16:47:28.386834 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.380995 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 16:47:28.386834 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.380997 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 16:47:28.386834 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381000 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 16:47:28.386834 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381002 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 16:47:28.386834 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381005 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 16:47:28.386834 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381007 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 16:47:28.386834 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381010 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 16:47:28.386834 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381013 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 16:47:28.386834 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381016 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 16:47:28.386834 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381018 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 16:47:28.386834 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381021 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 16:47:28.386834 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381023 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 16:47:28.386834 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381025 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 16:47:28.386834 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381028 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 16:47:28.386834 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381031 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 16:47:28.386834 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381033 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 16:47:28.386834 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381035 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 16:47:28.386834 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381038 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 16:47:28.386834 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381040 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 16:47:28.387364 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381043 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 16:47:28.387364 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381045 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 16:47:28.387364 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381048 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 16:47:28.387364 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381051 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 16:47:28.387364 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381053 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 16:47:28.387364 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381056 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 16:47:28.387364 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381058 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 16:47:28.387364 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381061 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 16:47:28.387364 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381063 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 16:47:28.387364 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381066 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 16:47:28.387364 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381068 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 16:47:28.387364 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381072 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 16:47:28.387364 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381075 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 16:47:28.387364 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381078 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 16:47:28.387364 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381080 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 16:47:28.387364 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381083 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 16:47:28.387364 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381085 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 16:47:28.387364 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381088 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 16:47:28.387364 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381090 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 16:47:28.387837 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381092 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 16:47:28.387837 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381095 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 16:47:28.387837 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381098 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 16:47:28.387837 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381100 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 16:47:28.387837 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381103 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 16:47:28.387837 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381105 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 16:47:28.387837 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381108 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 16:47:28.387837 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381110 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 16:47:28.387837 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381112 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 16:47:28.387837 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381115 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 16:47:28.387837 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381117 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 16:47:28.387837 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381120 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 16:47:28.387837 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381123 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 16:47:28.387837 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381126 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 16:47:28.387837 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381128 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 16:47:28.388206 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.381133 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 16:47:28.388206 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381253 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 16:47:28.388206 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381260 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 16:47:28.388206 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381263 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 16:47:28.388206 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381265 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 16:47:28.388206 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381268 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 16:47:28.388206 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381272 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 16:47:28.388206 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381276 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 16:47:28.388206 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381279 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 16:47:28.388206 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381282 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 16:47:28.388206 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381285 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 16:47:28.388206 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381287 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 16:47:28.388206 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381290 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 16:47:28.388206 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381292 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 16:47:28.388661 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381295 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 16:47:28.388661 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381297 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 16:47:28.388661 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381299 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 16:47:28.388661 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381302 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 16:47:28.388661 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381304 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 16:47:28.388661 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381307 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 16:47:28.388661 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381310 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 16:47:28.388661 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381312 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 16:47:28.388661 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381315 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 16:47:28.388661 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381317 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 16:47:28.388661 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381320 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 16:47:28.388661 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381322 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 16:47:28.388661 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381325 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 16:47:28.388661 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381327 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 16:47:28.388661 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381329 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 16:47:28.388661 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381332 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 16:47:28.388661 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381334 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 16:47:28.388661 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381337 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 16:47:28.388661 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381339 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 16:47:28.389186 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381343 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 16:47:28.389186 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381346 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 16:47:28.389186 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381348 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 16:47:28.389186 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381351 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 16:47:28.389186 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381354 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 16:47:28.389186 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381357 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 16:47:28.389186 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381360 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 08 16:47:28.389186 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381362 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 16:47:28.389186 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381365 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 16:47:28.389186 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381368 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 16:47:28.389186 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381370 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 16:47:28.389186 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381373 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 16:47:28.389186 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381375 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 16:47:28.389186 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381378 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 16:47:28.389186 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381381 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 16:47:28.389186 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381383 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 16:47:28.389186 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381386 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 16:47:28.389186 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381388 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 16:47:28.389186 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381391 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 16:47:28.389186 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381393 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 16:47:28.389690 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381396 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 16:47:28.389690 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381398 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 16:47:28.389690 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381401 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 16:47:28.389690 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381403 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 16:47:28.389690 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381406 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 16:47:28.389690 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381408 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 16:47:28.389690 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381410 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 16:47:28.389690 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381413 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 16:47:28.389690 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381415 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 16:47:28.389690 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381417 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 16:47:28.389690 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381420 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 16:47:28.389690 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381422 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 16:47:28.389690 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381424 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 16:47:28.389690 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381427 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 16:47:28.389690 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381429 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 16:47:28.389690 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381432 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 16:47:28.389690 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381434 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 16:47:28.389690 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381437 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 16:47:28.389690 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381440 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 16:47:28.389690 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381443 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 16:47:28.390164 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381446 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 16:47:28.390164 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381449 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 16:47:28.390164 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381451 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 16:47:28.390164 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381454 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 16:47:28.390164 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381456 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 16:47:28.390164 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381458 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 16:47:28.390164 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381461 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 16:47:28.390164 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381463 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 16:47:28.390164 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381465 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 16:47:28.390164 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381468 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 16:47:28.390164 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381470 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 16:47:28.390164 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381473 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 16:47:28.390164 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381475 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 16:47:28.390164 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381478 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 16:47:28.390164 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381480 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 16:47:28.390164 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381483 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 16:47:28.390164 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381486 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 16:47:28.390164 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381488 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 16:47:28.390164 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381491 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 16:47:28.390164 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381493 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 16:47:28.390667 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381495 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 16:47:28.390667 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381498 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 16:47:28.390667 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381502 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 16:47:28.390667 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381505 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 16:47:28.390667 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381507 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 16:47:28.390667 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381509 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 16:47:28.390667 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:28.381512 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 16:47:28.390667 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.381516 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 16:47:28.390667 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.381598 2579 server.go:962] "Client rotation is on, will bootstrap in background" Jun 08 16:47:28.390667 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.383420 2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 08 16:47:28.390667 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.384648 2579 server.go:1019] "Starting client certificate rotation" Jun 08 16:47:28.390667 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.384752 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 16:47:28.390667 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.384792 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 16:47:28.391099 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.387039 2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 16:47:28.391099 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.388424 2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 16:47:28.397747 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.397726 2579 log.go:25] "Validated CRI v1 runtime API" Jun 08 16:47:28.399967 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.399953 2579 log.go:25] "Validated CRI v1 image API" Jun 08 16:47:28.400746 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.400729 2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 08 16:47:28.403163 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.403146 2579 fs.go:135] Filesystem UUIDs: map[182fac10-51c7-4865-8e46-5f372cdc4de5:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 85cbe5d9-a348-4dd8-9fc7-08a8168f213e:/dev/nvme0n1p3] Jun 08 16:47:28.403255 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.403163 2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 08 16:47:28.408791 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.408690 2579 manager.go:216] Machine: {Timestamp:2026-06-08 16:47:28.40814066 +0000 UTC m=+0.304918129 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103276 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c5fea516ca01be8014db2aece6b29 SystemUUID:ec2c5fea-516c-a01b-e801-4db2aece6b29 BootID:7e3de0a0-9d6f-419c-a2f8-159f09547869 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:47:9a:f5:3e:07 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:47:9a:f5:3e:07 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9e:52:d1:08:8d:b4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 08 16:47:28.408791 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.408786 2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 08 16:47:28.408917 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.408901 2579 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 08 16:47:28.411444 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.411421 2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 08 16:47:28.411569 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.411448 2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-83.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 08 16:47:28.412112 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.412101 2579 topology_manager.go:138] "Creating topology manager with none policy" Jun 08 16:47:28.412157 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.412115 2579 container_manager_linux.go:309] "Creating device plugin manager" Jun 08 16:47:28.412157 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.412123 2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 16:47:28.413464 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.413453 2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 16:47:28.413858 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.413842 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 16:47:28.414222 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.414211 2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 08 16:47:28.416747 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.416735 2579 state_mem.go:36] "Initialized new in-memory state store" Jun 08 16:47:28.416854 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.416844 2579 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 08 16:47:28.416891 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.416875 2579 kubelet.go:486] "Attempting to sync node with API server" Jun 08 16:47:28.416921 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.416890 2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 08 16:47:28.416921 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.416912 2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 08 16:47:28.416975 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.416925 2579 kubelet.go:398] "Adding apiserver pod source" Jun 08 16:47:28.416975 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.416939 2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 08 16:47:28.417352 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.417330 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 16:47:28.417411 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.417358 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 16:47:28.419407 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.419393 2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 08 16:47:28.420583 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.420571 2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 08 16:47:28.420620 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.420601 2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 08 16:47:28.421130 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.421118 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 08 16:47:28.421162 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.421147 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 08 16:47:28.421162 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.421153 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 08 16:47:28.421162 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.421158 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 08 16:47:28.421254 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.421166 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 08 16:47:28.421254 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.421171 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 08 16:47:28.421254 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.421179 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 08 16:47:28.421254 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.421184 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 08 16:47:28.421254 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.421190 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 08 16:47:28.421254 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.421194 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 08 16:47:28.421254 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.421202 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 08 16:47:28.421254 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.421207 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 08 16:47:28.421903 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.421893 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 08 16:47:28.421939 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.421905 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 08 16:47:28.425137 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.425126 2579 server.go:1268] "Started kubelet" Jun 08 16:47:28.425218 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.425199 2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 08 16:47:28.425479 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.425360 2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 08 16:47:28.425606 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.425592 2579 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 08 16:47:28.426352 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:28.426318 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 08 16:47:28.426337 ip-10-0-135-83 systemd[1]: Started Kubernetes Kubelet. Jun 08 16:47:28.426915 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.426714 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-83.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 08 16:47:28.426915 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:28.426719 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-83.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 08 16:47:28.430302 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.430228 2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 08 16:47:28.432669 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.432652 2579 server.go:310] "Adding debug handlers to kubelet server" Jun 08 16:47:28.432908 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:28.432856 2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 08 16:47:28.435707 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:28.434796 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-83.ec2.internal.18b728fddba3c68a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-83.ec2.internal,UID:ip-10-0-135-83.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-83.ec2.internal,},FirstTimestamp:2026-06-08 16:47:28.425100938 +0000 UTC m=+0.321878403,LastTimestamp:2026-06-08 16:47:28.425100938 +0000 UTC m=+0.321878403,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-83.ec2.internal,}" Jun 08 16:47:28.435925 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.435911 2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 08 16:47:28.435985 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.435946 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 08 16:47:28.436267 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:28.436004 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-83.ec2.internal\" not found" Jun 08 16:47:28.436673 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.436658 2579 factory.go:55] Registering systemd factory Jun 08 16:47:28.436673 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.436675 2579 factory.go:223] Registration of the systemd container factory successfully Jun 08 16:47:28.436840 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.436825 2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 08 16:47:28.436904 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.436827 2579 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 08 16:47:28.436904 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.436860 2579 factory.go:153] Registering CRI-O factory Jun 08 16:47:28.436904 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.436867 2579 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 08 16:47:28.436904 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.436873 2579 factory.go:223] Registration of the crio container factory successfully Jun 08 16:47:28.437073 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.436957 2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 08 16:47:28.437073 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.436987 2579 factory.go:103] Registering Raw factory Jun 08 16:47:28.437073 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.437002 2579 reconstruct.go:97] "Volume reconstruction finished" Jun 08 16:47:28.437073 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.437016 2579 reconciler.go:29] "Reconciler: start to sync state" Jun 08 16:47:28.437073 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.437006 2579 manager.go:1196] Started watching for new ooms in manager Jun 08 16:47:28.437488 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.437475 2579 manager.go:349] Starting recovery of all containers Jun 08 16:47:28.441721 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:28.441637 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 08 16:47:28.441721 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:28.441673 2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-83.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 08 16:47:28.447965 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.447948 2579 manager.go:354] Recovery completed Jun 08 16:47:28.449278 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:28.449258 2579 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 08 16:47:28.452052 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.452035 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 16:47:28.453999 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.453972 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-83.ec2.internal" event="NodeHasSufficientMemory" Jun 08 16:47:28.454074 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.454009 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-83.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 16:47:28.454074 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.454024 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-83.ec2.internal" event="NodeHasSufficientPID" Jun 08 16:47:28.454514 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.454499 2579 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 08 16:47:28.454514 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.454507 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 16:47:28.454640 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.454511 2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 08 16:47:28.454640 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.454566 2579 state_mem.go:36] "Initialized new in-memory state store" Jun 08 16:47:28.455571 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.455190 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-83.ec2.internal" event="NodeHasSufficientMemory" Jun 08 16:47:28.455571 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.455219 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-83.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 16:47:28.455571 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.455268 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-83.ec2.internal" event="NodeHasSufficientPID" Jun 08 16:47:28.455751 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.455652 2579 policy_none.go:49] "None policy: Start" Jun 08 16:47:28.455751 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.455669 2579 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 08 16:47:28.455751 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.455680 2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 08 16:47:28.467484 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.467462 2579 policy_none.go:47] "Start" Jun 08 16:47:28.467886 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.467845 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-f878d" Jun 08 16:47:28.468003 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:28.467910 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-83.ec2.internal.18b728fddd5cacda default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-83.ec2.internal,UID:ip-10-0-135-83.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-83.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-83.ec2.internal,},FirstTimestamp:2026-06-08 16:47:28.453995738 +0000 UTC m=+0.350773204,LastTimestamp:2026-06-08 16:47:28.453995738 +0000 UTC m=+0.350773204,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-83.ec2.internal,}" Jun 08 16:47:28.470756 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.470742 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-f878d" Jun 08 16:47:28.512807 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.512793 2579 manager.go:337] "Starting Device Plugin manager" Jun 08 16:47:28.519522 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:28.512861 2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 08 16:47:28.519522 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.512873 2579 server.go:87] "Starting device plugin registration server" Jun 08 16:47:28.519522 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.513102 2579 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 08 16:47:28.519522 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.513115 2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 08 16:47:28.519522 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.513220 2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 08 16:47:28.519522 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.513313 2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 08 16:47:28.519522 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.513320 2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 08 16:47:28.519522 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:28.516313 2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 08 16:47:28.519522 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:28.516359 2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-83.ec2.internal\" not found" Jun 08 16:47:28.519522 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.518220 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 08 16:47:28.519855 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.519588 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 08 16:47:28.519855 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.519628 2579 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 08 16:47:28.519855 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.519650 2579 kubelet.go:2448] "Starting kubelet main sync loop" Jun 08 16:47:28.519855 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:28.519686 2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 08 16:47:28.522297 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.522277 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 16:47:28.614066 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.614036 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 16:47:28.614978 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.614963 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-83.ec2.internal" event="NodeHasSufficientMemory" Jun 08 16:47:28.615034 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.614990 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-83.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 16:47:28.615034 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.615000 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-83.ec2.internal" event="NodeHasSufficientPID" Jun 08 16:47:28.615034 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.615018 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-83.ec2.internal" Jun 08 16:47:28.620648 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.620613 2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-135-83.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-83.ec2.internal"] Jun 08 16:47:28.620692 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.620660 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 16:47:28.623577 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.623562 2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-83.ec2.internal" Jun 08 16:47:28.623672 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:28.623582 2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-83.ec2.internal\": node \"ip-10-0-135-83.ec2.internal\" not found" Jun 08 16:47:28.623672 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.623603 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-83.ec2.internal" event="NodeHasSufficientMemory" Jun 08 16:47:28.623672 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.623628 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-83.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 16:47:28.623672 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.623639 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-83.ec2.internal" event="NodeHasSufficientPID" Jun 08 16:47:28.624671 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.624658 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 16:47:28.624762 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.624749 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-83.ec2.internal" Jun 08 16:47:28.624814 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.624786 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 16:47:28.625334 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.625318 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-83.ec2.internal" event="NodeHasSufficientMemory" Jun 08 16:47:28.625419 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.625349 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-83.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 16:47:28.625419 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.625363 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-83.ec2.internal" event="NodeHasSufficientPID" Jun 08 16:47:28.626132 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.626115 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-83.ec2.internal" event="NodeHasSufficientMemory" Jun 08 16:47:28.626214 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.626146 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-83.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 16:47:28.626214 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.626162 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-83.ec2.internal" event="NodeHasSufficientPID" Jun 08 16:47:28.627213 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.627196 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-83.ec2.internal" Jun 08 16:47:28.627308 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.627255 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 16:47:28.627924 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.627905 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-83.ec2.internal" event="NodeHasSufficientMemory" Jun 08 16:47:28.628010 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.627939 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-83.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 16:47:28.628010 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.627954 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-83.ec2.internal" event="NodeHasSufficientPID" Jun 08 16:47:28.638336 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.638321 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9aa4eed84fc7574a1d3167c11c94bf11-config\") pod \"kube-apiserver-proxy-ip-10-0-135-83.ec2.internal\" (UID: \"9aa4eed84fc7574a1d3167c11c94bf11\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-83.ec2.internal" Jun 08 16:47:28.638399 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.638343 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/33189211f39fbdf362fe0672528406c3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-83.ec2.internal\" (UID: \"33189211f39fbdf362fe0672528406c3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-83.ec2.internal" Jun 08 16:47:28.638399 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.638364 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/33189211f39fbdf362fe0672528406c3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-83.ec2.internal\" (UID: \"33189211f39fbdf362fe0672528406c3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-83.ec2.internal" Jun 08 16:47:28.640621 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:28.640604 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-83.ec2.internal\" not found" Jun 08 16:47:28.640798 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:28.640786 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-83.ec2.internal\" not found" node="ip-10-0-135-83.ec2.internal" Jun 08 16:47:28.644052 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:28.644037 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-83.ec2.internal\" not found" node="ip-10-0-135-83.ec2.internal" Jun 08 16:47:28.739133 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.739109 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9aa4eed84fc7574a1d3167c11c94bf11-config\") pod \"kube-apiserver-proxy-ip-10-0-135-83.ec2.internal\" (UID: \"9aa4eed84fc7574a1d3167c11c94bf11\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-83.ec2.internal" Jun 08 16:47:28.739226 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.739134 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/33189211f39fbdf362fe0672528406c3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-83.ec2.internal\" (UID: \"33189211f39fbdf362fe0672528406c3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-83.ec2.internal" Jun 08 16:47:28.739226 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.739159 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/33189211f39fbdf362fe0672528406c3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-83.ec2.internal\" (UID: \"33189211f39fbdf362fe0672528406c3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-83.ec2.internal" Jun 08 16:47:28.739226 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.739200 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/33189211f39fbdf362fe0672528406c3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-83.ec2.internal\" (UID: \"33189211f39fbdf362fe0672528406c3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-83.ec2.internal" Jun 08 16:47:28.739226 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.739204 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9aa4eed84fc7574a1d3167c11c94bf11-config\") pod \"kube-apiserver-proxy-ip-10-0-135-83.ec2.internal\" (UID: \"9aa4eed84fc7574a1d3167c11c94bf11\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-83.ec2.internal" Jun 08 16:47:28.739376 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.739268 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/33189211f39fbdf362fe0672528406c3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-83.ec2.internal\" (UID: \"33189211f39fbdf362fe0672528406c3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-83.ec2.internal" Jun 08 16:47:28.741233 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:28.741217 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-83.ec2.internal\" not found" Jun 08 16:47:28.842158 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:28.842136 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-83.ec2.internal\" not found" Jun 08 16:47:28.942934 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:28.942870 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-83.ec2.internal\" not found" Jun 08 16:47:28.945030 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.945015 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-83.ec2.internal" Jun 08 16:47:28.948014 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:28.947849 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-83.ec2.internal" Jun 08 16:47:29.043034 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:29.042978 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-83.ec2.internal\" not found" Jun 08 16:47:29.143480 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:29.143457 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-83.ec2.internal\" not found" Jun 08 16:47:29.244044 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:29.243978 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-83.ec2.internal\" not found" Jun 08 16:47:29.344513 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:29.344480 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-83.ec2.internal\" not found" Jun 08 16:47:29.384655 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:29.384632 2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 08 16:47:29.385194 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:29.384785 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 08 16:47:29.445129 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:29.445099 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-83.ec2.internal\" not found" Jun 08 16:47:29.459026 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:29.459003 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33189211f39fbdf362fe0672528406c3.slice/crio-e115c113863f59e2785ea36e9ae92c42983fbfb292331aa604896ec95803a3b2 WatchSource:0}: Error finding container e115c113863f59e2785ea36e9ae92c42983fbfb292331aa604896ec95803a3b2: Status 404 returned error can't find the container with id e115c113863f59e2785ea36e9ae92c42983fbfb292331aa604896ec95803a3b2 Jun 08 16:47:29.459445 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:29.459425 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9aa4eed84fc7574a1d3167c11c94bf11.slice/crio-c4d889cd90fc997197945bbdbe3836c9352858dbfe91c68304804da0fd952068 WatchSource:0}: Error finding container c4d889cd90fc997197945bbdbe3836c9352858dbfe91c68304804da0fd952068: Status 404 returned error can't find the container with id c4d889cd90fc997197945bbdbe3836c9352858dbfe91c68304804da0fd952068 Jun 08 16:47:29.466634 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:29.466614 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 16:47:29.472516 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:29.472480 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-07 16:42:28 +0000 UTC" deadline="2028-01-28 13:35:18.303907258 +0000 UTC" Jun 08 16:47:29.472603 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:29.472516 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14372h47m48.831395826s" Jun 08 16:47:29.502091 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:29.502049 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 16:47:29.522095 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:29.522050 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-83.ec2.internal" event={"ID":"33189211f39fbdf362fe0672528406c3","Type":"ContainerStarted","Data":"e115c113863f59e2785ea36e9ae92c42983fbfb292331aa604896ec95803a3b2"} Jun 08 16:47:29.522989 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:29.522968 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-83.ec2.internal" event={"ID":"9aa4eed84fc7574a1d3167c11c94bf11","Type":"ContainerStarted","Data":"c4d889cd90fc997197945bbdbe3836c9352858dbfe91c68304804da0fd952068"} Jun 08 16:47:29.545331 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:29.545302 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-83.ec2.internal\" not found" Jun 08 16:47:29.640759 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:29.640744 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 16:47:29.646284 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:29.646265 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-83.ec2.internal\" not found" Jun 08 16:47:29.746769 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:29.746749 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-83.ec2.internal\" not found" Jun 08 16:47:29.847222 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:29.847196 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-83.ec2.internal\" not found" Jun 08 16:47:29.948068 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:29.948033 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-83.ec2.internal\" not found" Jun 08 16:47:30.005155 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.005129 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 16:47:30.036377 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.036349 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-83.ec2.internal" Jun 08 16:47:30.047700 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.047673 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 16:47:30.048782 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.048583 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-83.ec2.internal" Jun 08 16:47:30.056192 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.056089 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 16:47:30.418532 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.418496 2579 apiserver.go:52] "Watching apiserver" Jun 08 16:47:30.427547 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.427511 2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 08 16:47:30.429002 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.428971 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-52225","openshift-network-operator/iptables-alerter-tf49l","openshift-ovn-kubernetes/ovnkube-node-vkrbj","kube-system/global-pull-secret-syncer-8d9t8","kube-system/konnectivity-agent-92hf8","kube-system/kube-apiserver-proxy-ip-10-0-135-83.ec2.internal","openshift-cluster-node-tuning-operator/tuned-m8296","openshift-dns/node-resolver-9bmtp","openshift-multus/multus-additional-cni-plugins-tpm7n","openshift-network-diagnostics/network-check-target-hp28s","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmkwf","openshift-image-registry/node-ca-jvrlj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-83.ec2.internal","openshift-multus/multus-4lzgx"] Jun 08 16:47:30.430716 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.430696 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m8296" Jun 08 16:47:30.431761 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.431741 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmkwf" Jun 08 16:47:30.433155 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.433130 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.433367 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.433351 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mttlk\"" Jun 08 16:47:30.433453 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.433364 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 08 16:47:30.433828 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.433806 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 08 16:47:30.436956 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.434047 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8d9t8" Jun 08 16:47:30.436956 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.434072 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 08 16:47:30.436956 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.434082 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tc8w2\"" Jun 08 16:47:30.436956 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:30.434131 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8d9t8" podUID="5ee7062a-14dc-4eba-8adb-3c93000940f1" Jun 08 16:47:30.436956 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.434084 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 08 16:47:30.436956 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.434224 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 08 16:47:30.436956 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.435289 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-92hf8" Jun 08 16:47:30.436956 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.435829 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 08 16:47:30.436956 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.436041 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 08 16:47:30.436956 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.436067 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 08 16:47:30.436956 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.436081 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 08 16:47:30.436956 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.436099 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 08 16:47:30.436956 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.436587 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 08 16:47:30.436956 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.436613 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 08 16:47:30.436956 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.436675 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mxnz9\"" Jun 08 16:47:30.436956 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.436900 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4lzgx" Jun 08 16:47:30.438109 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.438084 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 08 16:47:30.438109 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.438106 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 08 16:47:30.438269 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.438151 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jznqj\"" Jun 08 16:47:30.438460 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.438445 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tpm7n" Jun 08 16:47:30.439736 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.439719 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 08 16:47:30.439867 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.439849 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 08 16:47:30.439983 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.439968 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 08 16:47:30.440070 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.440053 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9m6qp\"" Jun 08 16:47:30.440127 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.439722 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 08 16:47:30.440340 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.440320 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9bmtp" Jun 08 16:47:30.440878 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.440860 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 08 16:47:30.441146 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.441129 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 08 16:47:30.441215 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.441147 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-dj5k7\"" Jun 08 16:47:30.441455 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.441432 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tf49l" Jun 08 16:47:30.443311 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.443293 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hp28s" Jun 08 16:47:30.443424 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:30.443356 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hp28s" podUID="7f09988e-c137-49af-8f80-a100a01cc2c0" Jun 08 16:47:30.444077 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.444060 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 08 16:47:30.444219 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.444202 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 08 16:47:30.444354 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.444304 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 08 16:47:30.444354 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.444321 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 08 16:47:30.444354 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.444344 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rg7qj\"" Jun 08 16:47:30.444528 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.444508 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 08 16:47:30.444712 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.444697 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vrx8k\"" Jun 08 16:47:30.444869 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.444856 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-52225" Jun 08 16:47:30.445020 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:30.444998 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-52225" podUID="cc8ed935-c565-44cd-93bf-b2699dd09b1b" Jun 08 16:47:30.445758 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.445740 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jvrlj" Jun 08 16:47:30.448205 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.448062 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 08 16:47:30.448205 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.448075 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 08 16:47:30.448205 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.448124 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-k8928\"" Jun 08 16:47:30.448205 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.448139 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 08 16:47:30.450272 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.450232 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5ee7062a-14dc-4eba-8adb-3c93000940f1-dbus\") pod \"global-pull-secret-syncer-8d9t8\" (UID: \"5ee7062a-14dc-4eba-8adb-3c93000940f1\") " pod="kube-system/global-pull-secret-syncer-8d9t8" Jun 08 16:47:30.450371 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.450283 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cb99c500-61a5-432d-93dc-24d07ebd5c1a-multus-daemon-config\") pod \"multus-4lzgx\" (UID: \"cb99c500-61a5-432d-93dc-24d07ebd5c1a\") " pod="openshift-multus/multus-4lzgx" Jun 08 16:47:30.450371 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.450306 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f8cc15b-8e39-4661-ba32-9298034d36d4-etc-kubernetes\") pod \"tuned-m8296\" (UID: \"1f8cc15b-8e39-4661-ba32-9298034d36d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m8296" Jun 08 16:47:30.450371 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.450355 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/559d75ed-52d7-4430-8f9f-09a01958d3f4-env-overrides\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.450533 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.450401 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a00cfd6c-ccf8-4a08-94d8-1d08c4233bef-cnibin\") pod \"multus-additional-cni-plugins-tpm7n\" (UID: \"a00cfd6c-ccf8-4a08-94d8-1d08c4233bef\") " pod="openshift-multus/multus-additional-cni-plugins-tpm7n" Jun 08 16:47:30.450533 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.450427 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbqz5\" (UniqueName: \"kubernetes.io/projected/a00cfd6c-ccf8-4a08-94d8-1d08c4233bef-kube-api-access-wbqz5\") pod \"multus-additional-cni-plugins-tpm7n\" (UID: \"a00cfd6c-ccf8-4a08-94d8-1d08c4233bef\") " pod="openshift-multus/multus-additional-cni-plugins-tpm7n" Jun 08 16:47:30.450533 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.450457 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb99c500-61a5-432d-93dc-24d07ebd5c1a-multus-cni-dir\") pod \"multus-4lzgx\" (UID: \"cb99c500-61a5-432d-93dc-24d07ebd5c1a\") " pod="openshift-multus/multus-4lzgx" Jun 08 16:47:30.450533 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.450481 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cb99c500-61a5-432d-93dc-24d07ebd5c1a-os-release\") pod \"multus-4lzgx\" (UID: \"cb99c500-61a5-432d-93dc-24d07ebd5c1a\") " pod="openshift-multus/multus-4lzgx" Jun 08 16:47:30.450533 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.450508 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cb99c500-61a5-432d-93dc-24d07ebd5c1a-etc-kubernetes\") pod \"multus-4lzgx\" (UID: \"cb99c500-61a5-432d-93dc-24d07ebd5c1a\") " pod="openshift-multus/multus-4lzgx" Jun 08 16:47:30.450759 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.450532 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a00cfd6c-ccf8-4a08-94d8-1d08c4233bef-system-cni-dir\") pod \"multus-additional-cni-plugins-tpm7n\" (UID: \"a00cfd6c-ccf8-4a08-94d8-1d08c4233bef\") " pod="openshift-multus/multus-additional-cni-plugins-tpm7n" Jun 08 16:47:30.450759 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.450556 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4g8k\" (UniqueName: \"kubernetes.io/projected/cb99c500-61a5-432d-93dc-24d07ebd5c1a-kube-api-access-s4g8k\") pod \"multus-4lzgx\" (UID: \"cb99c500-61a5-432d-93dc-24d07ebd5c1a\") " pod="openshift-multus/multus-4lzgx" Jun 08 16:47:30.450759 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.450578 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e2559512-11a8-49bb-8c55-66f746104f95-sys-fs\") pod \"aws-ebs-csi-driver-node-cmkwf\" (UID: \"e2559512-11a8-49bb-8c55-66f746104f95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmkwf" Jun 08 16:47:30.450759 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.450612 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/559d75ed-52d7-4430-8f9f-09a01958d3f4-host-cni-bin\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.450759 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.450635 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7ebab24f-4a53-4e31-bff3-c20586cf3da6-agent-certs\") pod \"konnectivity-agent-92hf8\" (UID: \"7ebab24f-4a53-4e31-bff3-c20586cf3da6\") " pod="kube-system/konnectivity-agent-92hf8" Jun 08 16:47:30.450759 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.450663 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb99c500-61a5-432d-93dc-24d07ebd5c1a-system-cni-dir\") pod \"multus-4lzgx\" (UID: \"cb99c500-61a5-432d-93dc-24d07ebd5c1a\") " pod="openshift-multus/multus-4lzgx" Jun 08 16:47:30.450759 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.450683 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cb99c500-61a5-432d-93dc-24d07ebd5c1a-cnibin\") pod \"multus-4lzgx\" (UID: \"cb99c500-61a5-432d-93dc-24d07ebd5c1a\") " pod="openshift-multus/multus-4lzgx" Jun 08 16:47:30.450759 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.450721 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cb99c500-61a5-432d-93dc-24d07ebd5c1a-multus-socket-dir-parent\") pod \"multus-4lzgx\" (UID: \"cb99c500-61a5-432d-93dc-24d07ebd5c1a\") " pod="openshift-multus/multus-4lzgx" Jun 08 16:47:30.451101 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.450761 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cb99c500-61a5-432d-93dc-24d07ebd5c1a-host-run-netns\") pod \"multus-4lzgx\" (UID: \"cb99c500-61a5-432d-93dc-24d07ebd5c1a\") " pod="openshift-multus/multus-4lzgx" Jun 08 16:47:30.451101 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.450792 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cb99c500-61a5-432d-93dc-24d07ebd5c1a-multus-conf-dir\") pod \"multus-4lzgx\" (UID: \"cb99c500-61a5-432d-93dc-24d07ebd5c1a\") " pod="openshift-multus/multus-4lzgx" Jun 08 16:47:30.451101 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.450815 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1f8cc15b-8e39-4661-ba32-9298034d36d4-etc-systemd\") pod \"tuned-m8296\" (UID: \"1f8cc15b-8e39-4661-ba32-9298034d36d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m8296" Jun 08 16:47:30.451101 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.450846 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/559d75ed-52d7-4430-8f9f-09a01958d3f4-var-lib-openvswitch\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.451101 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.450880 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/559d75ed-52d7-4430-8f9f-09a01958d3f4-etc-openvswitch\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.451101 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.450905 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ee7062a-14dc-4eba-8adb-3c93000940f1-original-pull-secret\") pod \"global-pull-secret-syncer-8d9t8\" (UID: \"5ee7062a-14dc-4eba-8adb-3c93000940f1\") " pod="kube-system/global-pull-secret-syncer-8d9t8" Jun 08 16:47:30.451101 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.450939 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f8cc15b-8e39-4661-ba32-9298034d36d4-var-lib-kubelet\") pod \"tuned-m8296\" (UID: \"1f8cc15b-8e39-4661-ba32-9298034d36d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m8296" Jun 08 16:47:30.451101 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.450971 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e2559512-11a8-49bb-8c55-66f746104f95-registration-dir\") pod \"aws-ebs-csi-driver-node-cmkwf\" (UID: \"e2559512-11a8-49bb-8c55-66f746104f95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmkwf" Jun 08 16:47:30.451101 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.450996 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a00cfd6c-ccf8-4a08-94d8-1d08c4233bef-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tpm7n\" (UID: \"a00cfd6c-ccf8-4a08-94d8-1d08c4233bef\") " pod="openshift-multus/multus-additional-cni-plugins-tpm7n" Jun 08 16:47:30.451101 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.451028 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1f8cc15b-8e39-4661-ba32-9298034d36d4-lib-modules\") pod \"tuned-m8296\" (UID: \"1f8cc15b-8e39-4661-ba32-9298034d36d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m8296" Jun 08 16:47:30.451101 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.451049 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/559d75ed-52d7-4430-8f9f-09a01958d3f4-host-run-netns\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.451101 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.451077 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a00cfd6c-ccf8-4a08-94d8-1d08c4233bef-os-release\") pod \"multus-additional-cni-plugins-tpm7n\" (UID: \"a00cfd6c-ccf8-4a08-94d8-1d08c4233bef\") " pod="openshift-multus/multus-additional-cni-plugins-tpm7n" Jun 08 16:47:30.451624 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.451108 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1f8cc15b-8e39-4661-ba32-9298034d36d4-run\") pod \"tuned-m8296\" (UID: \"1f8cc15b-8e39-4661-ba32-9298034d36d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m8296" Jun 08 16:47:30.451624 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.451130 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e2559512-11a8-49bb-8c55-66f746104f95-socket-dir\") pod \"aws-ebs-csi-driver-node-cmkwf\" (UID: \"e2559512-11a8-49bb-8c55-66f746104f95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmkwf" Jun 08 16:47:30.451624 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.451153 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/559d75ed-52d7-4430-8f9f-09a01958d3f4-run-openvswitch\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.451624 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.451185 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/559d75ed-52d7-4430-8f9f-09a01958d3f4-log-socket\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.451624 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.451208 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/559d75ed-52d7-4430-8f9f-09a01958d3f4-host-cni-netd\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.451624 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.451230 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/559d75ed-52d7-4430-8f9f-09a01958d3f4-ovnkube-script-lib\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.451624 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.451280 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f8cc15b-8e39-4661-ba32-9298034d36d4-sys\") pod \"tuned-m8296\" (UID: \"1f8cc15b-8e39-4661-ba32-9298034d36d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m8296" Jun 08 16:47:30.451624 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.451317 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a00cfd6c-ccf8-4a08-94d8-1d08c4233bef-cni-binary-copy\") pod \"multus-additional-cni-plugins-tpm7n\" (UID: \"a00cfd6c-ccf8-4a08-94d8-1d08c4233bef\") " pod="openshift-multus/multus-additional-cni-plugins-tpm7n" Jun 08 16:47:30.451624 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.451349 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f8cc15b-8e39-4661-ba32-9298034d36d4-tmp\") pod \"tuned-m8296\" (UID: \"1f8cc15b-8e39-4661-ba32-9298034d36d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m8296" Jun 08 16:47:30.451624 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.451383 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1f8cc15b-8e39-4661-ba32-9298034d36d4-etc-sysctl-d\") pod \"tuned-m8296\" (UID: \"1f8cc15b-8e39-4661-ba32-9298034d36d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m8296" Jun 08 16:47:30.451624 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.451402 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1f8cc15b-8e39-4661-ba32-9298034d36d4-etc-sysctl-conf\") pod \"tuned-m8296\" (UID: \"1f8cc15b-8e39-4661-ba32-9298034d36d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m8296" Jun 08 16:47:30.451624 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.451425 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5ee7062a-14dc-4eba-8adb-3c93000940f1-kubelet-config\") pod \"global-pull-secret-syncer-8d9t8\" (UID: \"5ee7062a-14dc-4eba-8adb-3c93000940f1\") " pod="kube-system/global-pull-secret-syncer-8d9t8" Jun 08 16:47:30.451624 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.451445 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cb99c500-61a5-432d-93dc-24d07ebd5c1a-hostroot\") pod \"multus-4lzgx\" (UID: \"cb99c500-61a5-432d-93dc-24d07ebd5c1a\") " pod="openshift-multus/multus-4lzgx" Jun 08 16:47:30.451624 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.451458 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cb99c500-61a5-432d-93dc-24d07ebd5c1a-host-run-multus-certs\") pod \"multus-4lzgx\" (UID: \"cb99c500-61a5-432d-93dc-24d07ebd5c1a\") " pod="openshift-multus/multus-4lzgx" Jun 08 16:47:30.451624 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.451494 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1f8cc15b-8e39-4661-ba32-9298034d36d4-etc-sysconfig\") pod \"tuned-m8296\" (UID: \"1f8cc15b-8e39-4661-ba32-9298034d36d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m8296" Jun 08 16:47:30.451624 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.451495 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 16:47:30.451624 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.451529 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb99c500-61a5-432d-93dc-24d07ebd5c1a-host-var-lib-kubelet\") pod \"multus-4lzgx\" (UID: \"cb99c500-61a5-432d-93dc-24d07ebd5c1a\") " pod="openshift-multus/multus-4lzgx" Jun 08 16:47:30.452367 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.451556 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1f8cc15b-8e39-4661-ba32-9298034d36d4-host\") pod \"tuned-m8296\" (UID: \"1f8cc15b-8e39-4661-ba32-9298034d36d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m8296" Jun 08 16:47:30.452367 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.451573 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/559d75ed-52d7-4430-8f9f-09a01958d3f4-ovn-node-metrics-cert\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.452367 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.451586 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7ebab24f-4a53-4e31-bff3-c20586cf3da6-konnectivity-ca\") pod \"konnectivity-agent-92hf8\" (UID: \"7ebab24f-4a53-4e31-bff3-c20586cf3da6\") " pod="kube-system/konnectivity-agent-92hf8" Jun 08 16:47:30.452367 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.451602 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cb99c500-61a5-432d-93dc-24d07ebd5c1a-host-var-lib-cni-multus\") pod \"multus-4lzgx\" (UID: \"cb99c500-61a5-432d-93dc-24d07ebd5c1a\") " pod="openshift-multus/multus-4lzgx" Jun 08 16:47:30.452367 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.451625 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e2559512-11a8-49bb-8c55-66f746104f95-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cmkwf\" (UID: \"e2559512-11a8-49bb-8c55-66f746104f95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmkwf" Jun 08 16:47:30.452367 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.451645 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/559d75ed-52d7-4430-8f9f-09a01958d3f4-host-slash\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.452367 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.451670 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/559d75ed-52d7-4430-8f9f-09a01958d3f4-node-log\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.452367 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.451694 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/559d75ed-52d7-4430-8f9f-09a01958d3f4-host-run-ovn-kubernetes\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.452367 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.451716 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srmjq\" (UniqueName: \"kubernetes.io/projected/559d75ed-52d7-4430-8f9f-09a01958d3f4-kube-api-access-srmjq\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.452367 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.451748 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1f8cc15b-8e39-4661-ba32-9298034d36d4-etc-modprobe-d\") pod \"tuned-m8296\" (UID: \"1f8cc15b-8e39-4661-ba32-9298034d36d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m8296" Jun 08 16:47:30.452367 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.451767 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdm9t\" (UniqueName: \"kubernetes.io/projected/1f8cc15b-8e39-4661-ba32-9298034d36d4-kube-api-access-jdm9t\") pod \"tuned-m8296\" (UID: \"1f8cc15b-8e39-4661-ba32-9298034d36d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m8296" Jun 08 16:47:30.452367 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.451785 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e2559512-11a8-49bb-8c55-66f746104f95-etc-selinux\") pod \"aws-ebs-csi-driver-node-cmkwf\" (UID: \"e2559512-11a8-49bb-8c55-66f746104f95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmkwf" Jun 08 16:47:30.452367 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.451808 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/559d75ed-52d7-4430-8f9f-09a01958d3f4-run-ovn\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.452367 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.451833 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a00cfd6c-ccf8-4a08-94d8-1d08c4233bef-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tpm7n\" (UID: \"a00cfd6c-ccf8-4a08-94d8-1d08c4233bef\") " pod="openshift-multus/multus-additional-cni-plugins-tpm7n" Jun 08 16:47:30.452367 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.451856 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a00cfd6c-ccf8-4a08-94d8-1d08c4233bef-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tpm7n\" (UID: \"a00cfd6c-ccf8-4a08-94d8-1d08c4233bef\") " pod="openshift-multus/multus-additional-cni-plugins-tpm7n" Jun 08 16:47:30.452367 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.451888 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cb99c500-61a5-432d-93dc-24d07ebd5c1a-cni-binary-copy\") pod \"multus-4lzgx\" (UID: \"cb99c500-61a5-432d-93dc-24d07ebd5c1a\") " pod="openshift-multus/multus-4lzgx" Jun 08 16:47:30.453187 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.451923 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e2559512-11a8-49bb-8c55-66f746104f95-device-dir\") pod \"aws-ebs-csi-driver-node-cmkwf\" (UID: \"e2559512-11a8-49bb-8c55-66f746104f95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmkwf" Jun 08 16:47:30.453187 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.451952 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/559d75ed-52d7-4430-8f9f-09a01958d3f4-host-kubelet\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.453187 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.451979 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/559d75ed-52d7-4430-8f9f-09a01958d3f4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.453187 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.452003 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/559d75ed-52d7-4430-8f9f-09a01958d3f4-ovnkube-config\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.453187 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.452017 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cb99c500-61a5-432d-93dc-24d07ebd5c1a-host-run-k8s-cni-cncf-io\") pod \"multus-4lzgx\" (UID: \"cb99c500-61a5-432d-93dc-24d07ebd5c1a\") " pod="openshift-multus/multus-4lzgx" Jun 08 16:47:30.453187 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.452032 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cb99c500-61a5-432d-93dc-24d07ebd5c1a-host-var-lib-cni-bin\") pod \"multus-4lzgx\" (UID: \"cb99c500-61a5-432d-93dc-24d07ebd5c1a\") " pod="openshift-multus/multus-4lzgx" Jun 08 16:47:30.453187 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.452052 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1f8cc15b-8e39-4661-ba32-9298034d36d4-etc-tuned\") pod \"tuned-m8296\" (UID: \"1f8cc15b-8e39-4661-ba32-9298034d36d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m8296" Jun 08 16:47:30.453187 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.452075 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/559d75ed-52d7-4430-8f9f-09a01958d3f4-systemd-units\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.453187 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.452098 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvgzg\" (UniqueName: \"kubernetes.io/projected/e2559512-11a8-49bb-8c55-66f746104f95-kube-api-access-xvgzg\") pod \"aws-ebs-csi-driver-node-cmkwf\" (UID: \"e2559512-11a8-49bb-8c55-66f746104f95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmkwf" Jun 08 16:47:30.453187 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.452117 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/559d75ed-52d7-4430-8f9f-09a01958d3f4-run-systemd\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.473257 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.473216 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-tvd67" Jun 08 16:47:30.486155 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.486135 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-tvd67" Jun 08 16:47:30.520457 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.520432 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 16:47:30.537821 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.537796 2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 08 16:47:30.552645 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.552619 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cb99c500-61a5-432d-93dc-24d07ebd5c1a-host-var-lib-cni-multus\") pod \"multus-4lzgx\" (UID: \"cb99c500-61a5-432d-93dc-24d07ebd5c1a\") " pod="openshift-multus/multus-4lzgx" Jun 08 16:47:30.552796 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.552657 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e2559512-11a8-49bb-8c55-66f746104f95-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cmkwf\" (UID: \"e2559512-11a8-49bb-8c55-66f746104f95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmkwf" Jun 08 16:47:30.552796 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.552682 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/559d75ed-52d7-4430-8f9f-09a01958d3f4-host-slash\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.552796 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.552704 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/559d75ed-52d7-4430-8f9f-09a01958d3f4-node-log\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.552796 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.552719 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/559d75ed-52d7-4430-8f9f-09a01958d3f4-host-run-ovn-kubernetes\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.552796 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.552733 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srmjq\" (UniqueName: \"kubernetes.io/projected/559d75ed-52d7-4430-8f9f-09a01958d3f4-kube-api-access-srmjq\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.552796 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.552752 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cb99c500-61a5-432d-93dc-24d07ebd5c1a-host-var-lib-cni-multus\") pod \"multus-4lzgx\" (UID: \"cb99c500-61a5-432d-93dc-24d07ebd5c1a\") " pod="openshift-multus/multus-4lzgx" Jun 08 16:47:30.552796 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.552753 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/559d75ed-52d7-4430-8f9f-09a01958d3f4-host-slash\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.552796 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.552757 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vbgl\" (UniqueName: \"kubernetes.io/projected/5690029c-2d74-407e-9f78-f55d7a9d216b-kube-api-access-6vbgl\") pod \"node-ca-jvrlj\" (UID: \"5690029c-2d74-407e-9f78-f55d7a9d216b\") " pod="openshift-image-registry/node-ca-jvrlj" Jun 08 16:47:30.552796 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.552755 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e2559512-11a8-49bb-8c55-66f746104f95-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cmkwf\" (UID: \"e2559512-11a8-49bb-8c55-66f746104f95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmkwf" Jun 08 16:47:30.553226 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.552800 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/559d75ed-52d7-4430-8f9f-09a01958d3f4-host-run-ovn-kubernetes\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.553226 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.552817 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1f8cc15b-8e39-4661-ba32-9298034d36d4-etc-modprobe-d\") pod \"tuned-m8296\" (UID: \"1f8cc15b-8e39-4661-ba32-9298034d36d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m8296" Jun 08 16:47:30.553226 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.552839 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/559d75ed-52d7-4430-8f9f-09a01958d3f4-node-log\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.553226 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.552858 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdm9t\" (UniqueName: \"kubernetes.io/projected/1f8cc15b-8e39-4661-ba32-9298034d36d4-kube-api-access-jdm9t\") pod \"tuned-m8296\" (UID: \"1f8cc15b-8e39-4661-ba32-9298034d36d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m8296" Jun 08 16:47:30.553226 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.552896 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e2559512-11a8-49bb-8c55-66f746104f95-etc-selinux\") pod \"aws-ebs-csi-driver-node-cmkwf\" (UID: \"e2559512-11a8-49bb-8c55-66f746104f95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmkwf" Jun 08 16:47:30.553226 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.552925 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/559d75ed-52d7-4430-8f9f-09a01958d3f4-run-ovn\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.553226 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.552949 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a00cfd6c-ccf8-4a08-94d8-1d08c4233bef-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tpm7n\" (UID: \"a00cfd6c-ccf8-4a08-94d8-1d08c4233bef\") " pod="openshift-multus/multus-additional-cni-plugins-tpm7n" Jun 08 16:47:30.553226 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.552963 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1f8cc15b-8e39-4661-ba32-9298034d36d4-etc-modprobe-d\") pod \"tuned-m8296\" (UID: \"1f8cc15b-8e39-4661-ba32-9298034d36d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m8296" Jun 08 16:47:30.553226 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.552991 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a00cfd6c-ccf8-4a08-94d8-1d08c4233bef-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tpm7n\" (UID: \"a00cfd6c-ccf8-4a08-94d8-1d08c4233bef\") " pod="openshift-multus/multus-additional-cni-plugins-tpm7n" Jun 08 16:47:30.553226 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.553021 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxzbr\" (UniqueName: \"kubernetes.io/projected/2d4b91d7-69b6-4cb8-821c-6313ccdae4fe-kube-api-access-jxzbr\") pod \"node-resolver-9bmtp\" (UID: \"2d4b91d7-69b6-4cb8-821c-6313ccdae4fe\") " pod="openshift-dns/node-resolver-9bmtp" Jun 08 16:47:30.553226 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.553035 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e2559512-11a8-49bb-8c55-66f746104f95-etc-selinux\") pod \"aws-ebs-csi-driver-node-cmkwf\" (UID: \"e2559512-11a8-49bb-8c55-66f746104f95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmkwf" Jun 08 16:47:30.553226 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.553088 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cb99c500-61a5-432d-93dc-24d07ebd5c1a-cni-binary-copy\") pod \"multus-4lzgx\" (UID: \"cb99c500-61a5-432d-93dc-24d07ebd5c1a\") " pod="openshift-multus/multus-4lzgx" Jun 08 16:47:30.553226 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.553110 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/559d75ed-52d7-4430-8f9f-09a01958d3f4-run-ovn\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.553226 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.553137 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a00cfd6c-ccf8-4a08-94d8-1d08c4233bef-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tpm7n\" (UID: \"a00cfd6c-ccf8-4a08-94d8-1d08c4233bef\") " pod="openshift-multus/multus-additional-cni-plugins-tpm7n" Jun 08 16:47:30.553226 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.553183 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e2559512-11a8-49bb-8c55-66f746104f95-device-dir\") pod \"aws-ebs-csi-driver-node-cmkwf\" (UID: \"e2559512-11a8-49bb-8c55-66f746104f95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmkwf" Jun 08 16:47:30.553226 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.553233 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/559d75ed-52d7-4430-8f9f-09a01958d3f4-host-kubelet\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.553835 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.553283 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e2559512-11a8-49bb-8c55-66f746104f95-device-dir\") pod \"aws-ebs-csi-driver-node-cmkwf\" (UID: \"e2559512-11a8-49bb-8c55-66f746104f95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmkwf" Jun 08 16:47:30.553835 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.553330 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d4b91d7-69b6-4cb8-821c-6313ccdae4fe-tmp-dir\") pod \"node-resolver-9bmtp\" (UID: \"2d4b91d7-69b6-4cb8-821c-6313ccdae4fe\") " pod="openshift-dns/node-resolver-9bmtp" Jun 08 16:47:30.553835 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.553358 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/559d75ed-52d7-4430-8f9f-09a01958d3f4-host-kubelet\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.553835 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.553392 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8e0b775b-0b05-45f0-a071-d8ffc91e8b50-iptables-alerter-script\") pod \"iptables-alerter-tf49l\" (UID: \"8e0b775b-0b05-45f0-a071-d8ffc91e8b50\") " pod="openshift-network-operator/iptables-alerter-tf49l" Jun 08 16:47:30.553835 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.553424 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/559d75ed-52d7-4430-8f9f-09a01958d3f4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.553835 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.553446 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/559d75ed-52d7-4430-8f9f-09a01958d3f4-ovnkube-config\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.553835 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.553462 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx6h2\" (UniqueName: \"kubernetes.io/projected/8e0b775b-0b05-45f0-a071-d8ffc91e8b50-kube-api-access-wx6h2\") pod \"iptables-alerter-tf49l\" (UID: \"8e0b775b-0b05-45f0-a071-d8ffc91e8b50\") " pod="openshift-network-operator/iptables-alerter-tf49l" Jun 08 16:47:30.553835 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.553518 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cb99c500-61a5-432d-93dc-24d07ebd5c1a-host-run-k8s-cni-cncf-io\") pod \"multus-4lzgx\" (UID: \"cb99c500-61a5-432d-93dc-24d07ebd5c1a\") " pod="openshift-multus/multus-4lzgx" Jun 08 16:47:30.553835 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.553546 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/559d75ed-52d7-4430-8f9f-09a01958d3f4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.553835 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.553596 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cb99c500-61a5-432d-93dc-24d07ebd5c1a-host-var-lib-cni-bin\") pod \"multus-4lzgx\" (UID: \"cb99c500-61a5-432d-93dc-24d07ebd5c1a\") " pod="openshift-multus/multus-4lzgx" Jun 08 16:47:30.553835 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.553605 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cb99c500-61a5-432d-93dc-24d07ebd5c1a-host-run-k8s-cni-cncf-io\") pod \"multus-4lzgx\" (UID: \"cb99c500-61a5-432d-93dc-24d07ebd5c1a\") " pod="openshift-multus/multus-4lzgx" Jun 08 16:47:30.553835 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.553629 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a00cfd6c-ccf8-4a08-94d8-1d08c4233bef-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tpm7n\" (UID: \"a00cfd6c-ccf8-4a08-94d8-1d08c4233bef\") " pod="openshift-multus/multus-additional-cni-plugins-tpm7n" Jun 08 16:47:30.553835 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.553642 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1f8cc15b-8e39-4661-ba32-9298034d36d4-etc-tuned\") pod \"tuned-m8296\" (UID: \"1f8cc15b-8e39-4661-ba32-9298034d36d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m8296" Jun 08 16:47:30.553835 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.553655 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cb99c500-61a5-432d-93dc-24d07ebd5c1a-cni-binary-copy\") pod \"multus-4lzgx\" (UID: \"cb99c500-61a5-432d-93dc-24d07ebd5c1a\") " pod="openshift-multus/multus-4lzgx" Jun 08 16:47:30.553835 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.553680 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cb99c500-61a5-432d-93dc-24d07ebd5c1a-host-var-lib-cni-bin\") pod \"multus-4lzgx\" (UID: \"cb99c500-61a5-432d-93dc-24d07ebd5c1a\") " pod="openshift-multus/multus-4lzgx" Jun 08 16:47:30.553835 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.553726 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/559d75ed-52d7-4430-8f9f-09a01958d3f4-systemd-units\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.553835 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.553766 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvgzg\" (UniqueName: \"kubernetes.io/projected/e2559512-11a8-49bb-8c55-66f746104f95-kube-api-access-xvgzg\") pod \"aws-ebs-csi-driver-node-cmkwf\" (UID: \"e2559512-11a8-49bb-8c55-66f746104f95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmkwf" Jun 08 16:47:30.554664 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.553796 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/559d75ed-52d7-4430-8f9f-09a01958d3f4-systemd-units\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.554664 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.553873 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/559d75ed-52d7-4430-8f9f-09a01958d3f4-run-systemd\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.554664 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.553936 2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 08 16:47:30.554664 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.553960 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/559d75ed-52d7-4430-8f9f-09a01958d3f4-ovnkube-config\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.554664 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.553983 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5690029c-2d74-407e-9f78-f55d7a9d216b-host\") pod \"node-ca-jvrlj\" (UID: \"5690029c-2d74-407e-9f78-f55d7a9d216b\") " pod="openshift-image-registry/node-ca-jvrlj" Jun 08 16:47:30.554664 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.554017 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/559d75ed-52d7-4430-8f9f-09a01958d3f4-run-systemd\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.554664 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.554056 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5ee7062a-14dc-4eba-8adb-3c93000940f1-dbus\") pod \"global-pull-secret-syncer-8d9t8\" (UID: \"5ee7062a-14dc-4eba-8adb-3c93000940f1\") " pod="kube-system/global-pull-secret-syncer-8d9t8" Jun 08 16:47:30.554664 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.554094 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cb99c500-61a5-432d-93dc-24d07ebd5c1a-multus-daemon-config\") pod \"multus-4lzgx\" (UID: \"cb99c500-61a5-432d-93dc-24d07ebd5c1a\") " pod="openshift-multus/multus-4lzgx" Jun 08 16:47:30.554664 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.554125 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f8cc15b-8e39-4661-ba32-9298034d36d4-etc-kubernetes\") pod \"tuned-m8296\" (UID: \"1f8cc15b-8e39-4661-ba32-9298034d36d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m8296" Jun 08 16:47:30.554664 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.554150 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/559d75ed-52d7-4430-8f9f-09a01958d3f4-env-overrides\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.554664 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.554167 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5ee7062a-14dc-4eba-8adb-3c93000940f1-dbus\") pod \"global-pull-secret-syncer-8d9t8\" (UID: \"5ee7062a-14dc-4eba-8adb-3c93000940f1\") " pod="kube-system/global-pull-secret-syncer-8d9t8" Jun 08 16:47:30.554664 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.554176 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a00cfd6c-ccf8-4a08-94d8-1d08c4233bef-cnibin\") pod \"multus-additional-cni-plugins-tpm7n\" (UID: \"a00cfd6c-ccf8-4a08-94d8-1d08c4233bef\") " pod="openshift-multus/multus-additional-cni-plugins-tpm7n" Jun 08 16:47:30.554664 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.554205 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbqz5\" (UniqueName: \"kubernetes.io/projected/a00cfd6c-ccf8-4a08-94d8-1d08c4233bef-kube-api-access-wbqz5\") pod \"multus-additional-cni-plugins-tpm7n\" (UID: \"a00cfd6c-ccf8-4a08-94d8-1d08c4233bef\") " pod="openshift-multus/multus-additional-cni-plugins-tpm7n" Jun 08 16:47:30.554664 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.554217 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a00cfd6c-ccf8-4a08-94d8-1d08c4233bef-cnibin\") pod \"multus-additional-cni-plugins-tpm7n\" (UID: \"a00cfd6c-ccf8-4a08-94d8-1d08c4233bef\") " pod="openshift-multus/multus-additional-cni-plugins-tpm7n" Jun 08 16:47:30.554664 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.554251 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb99c500-61a5-432d-93dc-24d07ebd5c1a-multus-cni-dir\") pod \"multus-4lzgx\" (UID: \"cb99c500-61a5-432d-93dc-24d07ebd5c1a\") " pod="openshift-multus/multus-4lzgx" Jun 08 16:47:30.554664 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.554275 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cb99c500-61a5-432d-93dc-24d07ebd5c1a-os-release\") pod \"multus-4lzgx\" (UID: \"cb99c500-61a5-432d-93dc-24d07ebd5c1a\") " pod="openshift-multus/multus-4lzgx" Jun 08 16:47:30.554664 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.554301 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cb99c500-61a5-432d-93dc-24d07ebd5c1a-etc-kubernetes\") pod \"multus-4lzgx\" (UID: \"cb99c500-61a5-432d-93dc-24d07ebd5c1a\") " pod="openshift-multus/multus-4lzgx" Jun 08 16:47:30.554664 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.554326 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a00cfd6c-ccf8-4a08-94d8-1d08c4233bef-system-cni-dir\") pod \"multus-additional-cni-plugins-tpm7n\" (UID: \"a00cfd6c-ccf8-4a08-94d8-1d08c4233bef\") " pod="openshift-multus/multus-additional-cni-plugins-tpm7n" Jun 08 16:47:30.555600 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.554349 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4g8k\" (UniqueName: \"kubernetes.io/projected/cb99c500-61a5-432d-93dc-24d07ebd5c1a-kube-api-access-s4g8k\") pod \"multus-4lzgx\" (UID: \"cb99c500-61a5-432d-93dc-24d07ebd5c1a\") " pod="openshift-multus/multus-4lzgx" Jun 08 16:47:30.555600 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.554371 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e2559512-11a8-49bb-8c55-66f746104f95-sys-fs\") pod \"aws-ebs-csi-driver-node-cmkwf\" (UID: \"e2559512-11a8-49bb-8c55-66f746104f95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmkwf" Jun 08 16:47:30.555600 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.554394 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/559d75ed-52d7-4430-8f9f-09a01958d3f4-host-cni-bin\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.555600 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.554416 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7ebab24f-4a53-4e31-bff3-c20586cf3da6-agent-certs\") pod \"konnectivity-agent-92hf8\" (UID: \"7ebab24f-4a53-4e31-bff3-c20586cf3da6\") " pod="kube-system/konnectivity-agent-92hf8" Jun 08 16:47:30.555600 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.554442 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2d4b91d7-69b6-4cb8-821c-6313ccdae4fe-hosts-file\") pod \"node-resolver-9bmtp\" (UID: \"2d4b91d7-69b6-4cb8-821c-6313ccdae4fe\") " pod="openshift-dns/node-resolver-9bmtp" Jun 08 16:47:30.555600 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.554470 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb99c500-61a5-432d-93dc-24d07ebd5c1a-system-cni-dir\") pod \"multus-4lzgx\" (UID: \"cb99c500-61a5-432d-93dc-24d07ebd5c1a\") " pod="openshift-multus/multus-4lzgx" Jun 08 16:47:30.555600 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.554495 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cb99c500-61a5-432d-93dc-24d07ebd5c1a-cnibin\") pod \"multus-4lzgx\" (UID: \"cb99c500-61a5-432d-93dc-24d07ebd5c1a\") " pod="openshift-multus/multus-4lzgx" Jun 08 16:47:30.555600 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.554521 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cb99c500-61a5-432d-93dc-24d07ebd5c1a-multus-socket-dir-parent\") pod \"multus-4lzgx\" (UID: \"cb99c500-61a5-432d-93dc-24d07ebd5c1a\") " pod="openshift-multus/multus-4lzgx" Jun 08 16:47:30.555600 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.554546 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cb99c500-61a5-432d-93dc-24d07ebd5c1a-host-run-netns\") pod \"multus-4lzgx\" (UID: \"cb99c500-61a5-432d-93dc-24d07ebd5c1a\") " pod="openshift-multus/multus-4lzgx" Jun 08 16:47:30.555600 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.554570 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cb99c500-61a5-432d-93dc-24d07ebd5c1a-multus-conf-dir\") pod \"multus-4lzgx\" (UID: \"cb99c500-61a5-432d-93dc-24d07ebd5c1a\") " pod="openshift-multus/multus-4lzgx" Jun 08 16:47:30.555600 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.554583 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/559d75ed-52d7-4430-8f9f-09a01958d3f4-env-overrides\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.555600 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.554619 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1f8cc15b-8e39-4661-ba32-9298034d36d4-etc-systemd\") pod \"tuned-m8296\" (UID: \"1f8cc15b-8e39-4661-ba32-9298034d36d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m8296" Jun 08 16:47:30.555600 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.554645 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/559d75ed-52d7-4430-8f9f-09a01958d3f4-var-lib-openvswitch\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.555600 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.554662 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cb99c500-61a5-432d-93dc-24d07ebd5c1a-os-release\") pod \"multus-4lzgx\" (UID: \"cb99c500-61a5-432d-93dc-24d07ebd5c1a\") " pod="openshift-multus/multus-4lzgx" Jun 08 16:47:30.555600 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.554670 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/559d75ed-52d7-4430-8f9f-09a01958d3f4-etc-openvswitch\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.555600 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.554675 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cb99c500-61a5-432d-93dc-24d07ebd5c1a-etc-kubernetes\") pod \"multus-4lzgx\" (UID: \"cb99c500-61a5-432d-93dc-24d07ebd5c1a\") " pod="openshift-multus/multus-4lzgx" Jun 08 16:47:30.555600 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.554684 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb99c500-61a5-432d-93dc-24d07ebd5c1a-multus-cni-dir\") pod \"multus-4lzgx\" (UID: \"cb99c500-61a5-432d-93dc-24d07ebd5c1a\") " pod="openshift-multus/multus-4lzgx" Jun 08 16:47:30.555600 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.554698 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ee7062a-14dc-4eba-8adb-3c93000940f1-original-pull-secret\") pod \"global-pull-secret-syncer-8d9t8\" (UID: \"5ee7062a-14dc-4eba-8adb-3c93000940f1\") " pod="kube-system/global-pull-secret-syncer-8d9t8" Jun 08 16:47:30.556419 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.554710 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f8cc15b-8e39-4661-ba32-9298034d36d4-etc-kubernetes\") pod \"tuned-m8296\" (UID: \"1f8cc15b-8e39-4661-ba32-9298034d36d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m8296" Jun 08 16:47:30.556419 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.554724 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f8cc15b-8e39-4661-ba32-9298034d36d4-var-lib-kubelet\") pod \"tuned-m8296\" (UID: \"1f8cc15b-8e39-4661-ba32-9298034d36d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m8296" Jun 08 16:47:30.556419 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.554733 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a00cfd6c-ccf8-4a08-94d8-1d08c4233bef-system-cni-dir\") pod \"multus-additional-cni-plugins-tpm7n\" (UID: \"a00cfd6c-ccf8-4a08-94d8-1d08c4233bef\") " pod="openshift-multus/multus-additional-cni-plugins-tpm7n" Jun 08 16:47:30.556419 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.554741 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cb99c500-61a5-432d-93dc-24d07ebd5c1a-cnibin\") pod \"multus-4lzgx\" (UID: \"cb99c500-61a5-432d-93dc-24d07ebd5c1a\") " pod="openshift-multus/multus-4lzgx" Jun 08 16:47:30.556419 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.554749 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e2559512-11a8-49bb-8c55-66f746104f95-registration-dir\") pod \"aws-ebs-csi-driver-node-cmkwf\" (UID: \"e2559512-11a8-49bb-8c55-66f746104f95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmkwf" Jun 08 16:47:30.556419 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.554760 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1f8cc15b-8e39-4661-ba32-9298034d36d4-etc-systemd\") pod \"tuned-m8296\" (UID: \"1f8cc15b-8e39-4661-ba32-9298034d36d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m8296" Jun 08 16:47:30.556419 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.554768 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/559d75ed-52d7-4430-8f9f-09a01958d3f4-var-lib-openvswitch\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.556419 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.554774 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a00cfd6c-ccf8-4a08-94d8-1d08c4233bef-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tpm7n\" (UID: \"a00cfd6c-ccf8-4a08-94d8-1d08c4233bef\") " pod="openshift-multus/multus-additional-cni-plugins-tpm7n" Jun 08 16:47:30.556419 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.554812 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5690029c-2d74-407e-9f78-f55d7a9d216b-serviceca\") pod \"node-ca-jvrlj\" (UID: \"5690029c-2d74-407e-9f78-f55d7a9d216b\") " pod="openshift-image-registry/node-ca-jvrlj" Jun 08 16:47:30.556419 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.554821 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e2559512-11a8-49bb-8c55-66f746104f95-sys-fs\") pod \"aws-ebs-csi-driver-node-cmkwf\" (UID: \"e2559512-11a8-49bb-8c55-66f746104f95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmkwf" Jun 08 16:47:30.556419 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.554838 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1f8cc15b-8e39-4661-ba32-9298034d36d4-lib-modules\") pod \"tuned-m8296\" (UID: \"1f8cc15b-8e39-4661-ba32-9298034d36d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m8296" Jun 08 16:47:30.556419 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:30.554851 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 16:47:30.556419 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.554848 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f8cc15b-8e39-4661-ba32-9298034d36d4-var-lib-kubelet\") pod \"tuned-m8296\" (UID: \"1f8cc15b-8e39-4661-ba32-9298034d36d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m8296" Jun 08 16:47:30.556419 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:30.554913 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ee7062a-14dc-4eba-8adb-3c93000940f1-original-pull-secret podName:5ee7062a-14dc-4eba-8adb-3c93000940f1 nodeName:}" failed. No retries permitted until 2026-06-08 16:47:31.054891363 +0000 UTC m=+2.951668823 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ee7062a-14dc-4eba-8adb-3c93000940f1-original-pull-secret") pod "global-pull-secret-syncer-8d9t8" (UID: "5ee7062a-14dc-4eba-8adb-3c93000940f1") : object "kube-system"/"original-pull-secret" not registered Jun 08 16:47:30.556419 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.554863 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/559d75ed-52d7-4430-8f9f-09a01958d3f4-host-cni-bin\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.556419 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.554914 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cb99c500-61a5-432d-93dc-24d07ebd5c1a-host-run-netns\") pod \"multus-4lzgx\" (UID: \"cb99c500-61a5-432d-93dc-24d07ebd5c1a\") " pod="openshift-multus/multus-4lzgx" Jun 08 16:47:30.556419 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.554927 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e2559512-11a8-49bb-8c55-66f746104f95-registration-dir\") pod \"aws-ebs-csi-driver-node-cmkwf\" (UID: \"e2559512-11a8-49bb-8c55-66f746104f95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmkwf" Jun 08 16:47:30.559682 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.554862 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/559d75ed-52d7-4430-8f9f-09a01958d3f4-host-run-netns\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.559682 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.554974 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cb99c500-61a5-432d-93dc-24d07ebd5c1a-multus-conf-dir\") pod \"multus-4lzgx\" (UID: \"cb99c500-61a5-432d-93dc-24d07ebd5c1a\") " pod="openshift-multus/multus-4lzgx" Jun 08 16:47:30.559682 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.554975 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a00cfd6c-ccf8-4a08-94d8-1d08c4233bef-os-release\") pod \"multus-additional-cni-plugins-tpm7n\" (UID: \"a00cfd6c-ccf8-4a08-94d8-1d08c4233bef\") " pod="openshift-multus/multus-additional-cni-plugins-tpm7n" Jun 08 16:47:30.559682 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.555009 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vdxd\" (UniqueName: \"kubernetes.io/projected/7f09988e-c137-49af-8f80-a100a01cc2c0-kube-api-access-5vdxd\") pod \"network-check-target-hp28s\" (UID: \"7f09988e-c137-49af-8f80-a100a01cc2c0\") " pod="openshift-network-diagnostics/network-check-target-hp28s" Jun 08 16:47:30.559682 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.555021 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a00cfd6c-ccf8-4a08-94d8-1d08c4233bef-os-release\") pod \"multus-additional-cni-plugins-tpm7n\" (UID: \"a00cfd6c-ccf8-4a08-94d8-1d08c4233bef\") " pod="openshift-multus/multus-additional-cni-plugins-tpm7n" Jun 08 16:47:30.559682 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.555034 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqhnm\" (UniqueName: \"kubernetes.io/projected/cc8ed935-c565-44cd-93bf-b2699dd09b1b-kube-api-access-vqhnm\") pod \"network-metrics-daemon-52225\" (UID: \"cc8ed935-c565-44cd-93bf-b2699dd09b1b\") " pod="openshift-multus/network-metrics-daemon-52225" Jun 08 16:47:30.559682 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.554812 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cb99c500-61a5-432d-93dc-24d07ebd5c1a-multus-socket-dir-parent\") pod \"multus-4lzgx\" (UID: \"cb99c500-61a5-432d-93dc-24d07ebd5c1a\") " pod="openshift-multus/multus-4lzgx" Jun 08 16:47:30.559682 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.555120 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1f8cc15b-8e39-4661-ba32-9298034d36d4-lib-modules\") pod \"tuned-m8296\" (UID: \"1f8cc15b-8e39-4661-ba32-9298034d36d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m8296" Jun 08 16:47:30.559682 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.555133 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/559d75ed-52d7-4430-8f9f-09a01958d3f4-host-run-netns\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.559682 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.554932 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb99c500-61a5-432d-93dc-24d07ebd5c1a-system-cni-dir\") pod \"multus-4lzgx\" (UID: \"cb99c500-61a5-432d-93dc-24d07ebd5c1a\") " pod="openshift-multus/multus-4lzgx" Jun 08 16:47:30.559682 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.554778 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/559d75ed-52d7-4430-8f9f-09a01958d3f4-etc-openvswitch\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.559682 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.555151 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1f8cc15b-8e39-4661-ba32-9298034d36d4-run\") pod \"tuned-m8296\" (UID: \"1f8cc15b-8e39-4661-ba32-9298034d36d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m8296" Jun 08 16:47:30.559682 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.555198 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e2559512-11a8-49bb-8c55-66f746104f95-socket-dir\") pod \"aws-ebs-csi-driver-node-cmkwf\" (UID: \"e2559512-11a8-49bb-8c55-66f746104f95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmkwf" Jun 08 16:47:30.559682 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.555223 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/559d75ed-52d7-4430-8f9f-09a01958d3f4-run-openvswitch\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.559682 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.555249 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1f8cc15b-8e39-4661-ba32-9298034d36d4-run\") pod \"tuned-m8296\" (UID: \"1f8cc15b-8e39-4661-ba32-9298034d36d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m8296" Jun 08 16:47:30.559682 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.555275 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/559d75ed-52d7-4430-8f9f-09a01958d3f4-log-socket\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.559682 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.555294 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/559d75ed-52d7-4430-8f9f-09a01958d3f4-run-openvswitch\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.560515 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.555300 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/559d75ed-52d7-4430-8f9f-09a01958d3f4-host-cni-netd\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.560515 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.555327 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/559d75ed-52d7-4430-8f9f-09a01958d3f4-ovnkube-script-lib\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.560515 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.555342 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/559d75ed-52d7-4430-8f9f-09a01958d3f4-log-socket\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.560515 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.555350 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f8cc15b-8e39-4661-ba32-9298034d36d4-sys\") pod \"tuned-m8296\" (UID: \"1f8cc15b-8e39-4661-ba32-9298034d36d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m8296" Jun 08 16:47:30.560515 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.555364 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e2559512-11a8-49bb-8c55-66f746104f95-socket-dir\") pod \"aws-ebs-csi-driver-node-cmkwf\" (UID: \"e2559512-11a8-49bb-8c55-66f746104f95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmkwf" Jun 08 16:47:30.560515 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.555374 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a00cfd6c-ccf8-4a08-94d8-1d08c4233bef-cni-binary-copy\") pod \"multus-additional-cni-plugins-tpm7n\" (UID: \"a00cfd6c-ccf8-4a08-94d8-1d08c4233bef\") " pod="openshift-multus/multus-additional-cni-plugins-tpm7n" Jun 08 16:47:30.560515 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.555387 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/559d75ed-52d7-4430-8f9f-09a01958d3f4-host-cni-netd\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.560515 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.555401 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc8ed935-c565-44cd-93bf-b2699dd09b1b-metrics-certs\") pod \"network-metrics-daemon-52225\" (UID: \"cc8ed935-c565-44cd-93bf-b2699dd09b1b\") " pod="openshift-multus/network-metrics-daemon-52225" Jun 08 16:47:30.560515 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.555407 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a00cfd6c-ccf8-4a08-94d8-1d08c4233bef-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tpm7n\" (UID: \"a00cfd6c-ccf8-4a08-94d8-1d08c4233bef\") " pod="openshift-multus/multus-additional-cni-plugins-tpm7n" Jun 08 16:47:30.560515 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.555427 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f8cc15b-8e39-4661-ba32-9298034d36d4-tmp\") pod \"tuned-m8296\" (UID: \"1f8cc15b-8e39-4661-ba32-9298034d36d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m8296" Jun 08 16:47:30.560515 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.555456 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1f8cc15b-8e39-4661-ba32-9298034d36d4-etc-sysctl-d\") pod \"tuned-m8296\" (UID: \"1f8cc15b-8e39-4661-ba32-9298034d36d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m8296" Jun 08 16:47:30.560515 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.555464 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f8cc15b-8e39-4661-ba32-9298034d36d4-sys\") pod \"tuned-m8296\" (UID: \"1f8cc15b-8e39-4661-ba32-9298034d36d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m8296" Jun 08 16:47:30.560515 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.555479 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1f8cc15b-8e39-4661-ba32-9298034d36d4-etc-sysctl-conf\") pod \"tuned-m8296\" (UID: \"1f8cc15b-8e39-4661-ba32-9298034d36d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m8296" Jun 08 16:47:30.560515 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.555503 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5ee7062a-14dc-4eba-8adb-3c93000940f1-kubelet-config\") pod \"global-pull-secret-syncer-8d9t8\" (UID: \"5ee7062a-14dc-4eba-8adb-3c93000940f1\") " pod="kube-system/global-pull-secret-syncer-8d9t8" Jun 08 16:47:30.560515 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.555552 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cb99c500-61a5-432d-93dc-24d07ebd5c1a-hostroot\") pod \"multus-4lzgx\" (UID: \"cb99c500-61a5-432d-93dc-24d07ebd5c1a\") " pod="openshift-multus/multus-4lzgx" Jun 08 16:47:30.560515 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.555591 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cb99c500-61a5-432d-93dc-24d07ebd5c1a-host-run-multus-certs\") pod \"multus-4lzgx\" (UID: \"cb99c500-61a5-432d-93dc-24d07ebd5c1a\") " pod="openshift-multus/multus-4lzgx" Jun 08 16:47:30.560515 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.555602 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1f8cc15b-8e39-4661-ba32-9298034d36d4-etc-sysctl-d\") pod \"tuned-m8296\" (UID: \"1f8cc15b-8e39-4661-ba32-9298034d36d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m8296" Jun 08 16:47:30.561397 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.555616 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1f8cc15b-8e39-4661-ba32-9298034d36d4-etc-sysconfig\") pod \"tuned-m8296\" (UID: \"1f8cc15b-8e39-4661-ba32-9298034d36d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m8296" Jun 08 16:47:30.561397 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.555671 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1f8cc15b-8e39-4661-ba32-9298034d36d4-etc-sysconfig\") pod \"tuned-m8296\" (UID: \"1f8cc15b-8e39-4661-ba32-9298034d36d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m8296" Jun 08 16:47:30.561397 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.555810 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1f8cc15b-8e39-4661-ba32-9298034d36d4-etc-sysctl-conf\") pod \"tuned-m8296\" (UID: \"1f8cc15b-8e39-4661-ba32-9298034d36d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m8296" Jun 08 16:47:30.561397 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.555852 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a00cfd6c-ccf8-4a08-94d8-1d08c4233bef-cni-binary-copy\") pod \"multus-additional-cni-plugins-tpm7n\" (UID: \"a00cfd6c-ccf8-4a08-94d8-1d08c4233bef\") " pod="openshift-multus/multus-additional-cni-plugins-tpm7n" Jun 08 16:47:30.561397 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.555866 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5ee7062a-14dc-4eba-8adb-3c93000940f1-kubelet-config\") pod \"global-pull-secret-syncer-8d9t8\" (UID: \"5ee7062a-14dc-4eba-8adb-3c93000940f1\") " pod="kube-system/global-pull-secret-syncer-8d9t8" Jun 08 16:47:30.561397 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.555910 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cb99c500-61a5-432d-93dc-24d07ebd5c1a-hostroot\") pod \"multus-4lzgx\" (UID: \"cb99c500-61a5-432d-93dc-24d07ebd5c1a\") " pod="openshift-multus/multus-4lzgx" Jun 08 16:47:30.561397 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.555925 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/559d75ed-52d7-4430-8f9f-09a01958d3f4-ovnkube-script-lib\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.561397 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.555935 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cb99c500-61a5-432d-93dc-24d07ebd5c1a-host-run-multus-certs\") pod \"multus-4lzgx\" (UID: \"cb99c500-61a5-432d-93dc-24d07ebd5c1a\") " pod="openshift-multus/multus-4lzgx" Jun 08 16:47:30.561397 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.556024 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb99c500-61a5-432d-93dc-24d07ebd5c1a-host-var-lib-kubelet\") pod \"multus-4lzgx\" (UID: \"cb99c500-61a5-432d-93dc-24d07ebd5c1a\") " pod="openshift-multus/multus-4lzgx" Jun 08 16:47:30.561397 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.556070 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1f8cc15b-8e39-4661-ba32-9298034d36d4-host\") pod \"tuned-m8296\" (UID: \"1f8cc15b-8e39-4661-ba32-9298034d36d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m8296" Jun 08 16:47:30.561397 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.556095 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/559d75ed-52d7-4430-8f9f-09a01958d3f4-ovn-node-metrics-cert\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.561397 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.556109 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb99c500-61a5-432d-93dc-24d07ebd5c1a-host-var-lib-kubelet\") pod \"multus-4lzgx\" (UID: \"cb99c500-61a5-432d-93dc-24d07ebd5c1a\") " pod="openshift-multus/multus-4lzgx" Jun 08 16:47:30.561397 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.556121 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7ebab24f-4a53-4e31-bff3-c20586cf3da6-konnectivity-ca\") pod \"konnectivity-agent-92hf8\" (UID: \"7ebab24f-4a53-4e31-bff3-c20586cf3da6\") " pod="kube-system/konnectivity-agent-92hf8" Jun 08 16:47:30.561397 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.556149 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8e0b775b-0b05-45f0-a071-d8ffc91e8b50-host-slash\") pod \"iptables-alerter-tf49l\" (UID: \"8e0b775b-0b05-45f0-a071-d8ffc91e8b50\") " pod="openshift-network-operator/iptables-alerter-tf49l" Jun 08 16:47:30.561397 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.556230 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1f8cc15b-8e39-4661-ba32-9298034d36d4-host\") pod \"tuned-m8296\" (UID: \"1f8cc15b-8e39-4661-ba32-9298034d36d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m8296" Jun 08 16:47:30.561397 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.556623 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7ebab24f-4a53-4e31-bff3-c20586cf3da6-konnectivity-ca\") pod \"konnectivity-agent-92hf8\" (UID: \"7ebab24f-4a53-4e31-bff3-c20586cf3da6\") " pod="kube-system/konnectivity-agent-92hf8" Jun 08 16:47:30.561397 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.557284 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1f8cc15b-8e39-4661-ba32-9298034d36d4-etc-tuned\") pod \"tuned-m8296\" (UID: \"1f8cc15b-8e39-4661-ba32-9298034d36d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m8296" Jun 08 16:47:30.561397 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.557353 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cb99c500-61a5-432d-93dc-24d07ebd5c1a-multus-daemon-config\") pod \"multus-4lzgx\" (UID: \"cb99c500-61a5-432d-93dc-24d07ebd5c1a\") " pod="openshift-multus/multus-4lzgx" Jun 08 16:47:30.562332 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.558081 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7ebab24f-4a53-4e31-bff3-c20586cf3da6-agent-certs\") pod \"konnectivity-agent-92hf8\" (UID: \"7ebab24f-4a53-4e31-bff3-c20586cf3da6\") " pod="kube-system/konnectivity-agent-92hf8" Jun 08 16:47:30.562332 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.558098 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f8cc15b-8e39-4661-ba32-9298034d36d4-tmp\") pod \"tuned-m8296\" (UID: \"1f8cc15b-8e39-4661-ba32-9298034d36d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m8296" Jun 08 16:47:30.562332 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.558601 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/559d75ed-52d7-4430-8f9f-09a01958d3f4-ovn-node-metrics-cert\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.565115 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.565050 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srmjq\" (UniqueName: \"kubernetes.io/projected/559d75ed-52d7-4430-8f9f-09a01958d3f4-kube-api-access-srmjq\") pod \"ovnkube-node-vkrbj\" (UID: \"559d75ed-52d7-4430-8f9f-09a01958d3f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.566070 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.566023 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4g8k\" (UniqueName: \"kubernetes.io/projected/cb99c500-61a5-432d-93dc-24d07ebd5c1a-kube-api-access-s4g8k\") pod \"multus-4lzgx\" (UID: \"cb99c500-61a5-432d-93dc-24d07ebd5c1a\") " pod="openshift-multus/multus-4lzgx" Jun 08 16:47:30.566634 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.566614 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdm9t\" (UniqueName: \"kubernetes.io/projected/1f8cc15b-8e39-4661-ba32-9298034d36d4-kube-api-access-jdm9t\") pod \"tuned-m8296\" (UID: \"1f8cc15b-8e39-4661-ba32-9298034d36d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m8296" Jun 08 16:47:30.567020 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.567000 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvgzg\" (UniqueName: \"kubernetes.io/projected/e2559512-11a8-49bb-8c55-66f746104f95-kube-api-access-xvgzg\") pod \"aws-ebs-csi-driver-node-cmkwf\" (UID: \"e2559512-11a8-49bb-8c55-66f746104f95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmkwf" Jun 08 16:47:30.567276 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.567212 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbqz5\" (UniqueName: \"kubernetes.io/projected/a00cfd6c-ccf8-4a08-94d8-1d08c4233bef-kube-api-access-wbqz5\") pod \"multus-additional-cni-plugins-tpm7n\" (UID: \"a00cfd6c-ccf8-4a08-94d8-1d08c4233bef\") " pod="openshift-multus/multus-additional-cni-plugins-tpm7n" Jun 08 16:47:30.656621 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.656588 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8e0b775b-0b05-45f0-a071-d8ffc91e8b50-host-slash\") pod \"iptables-alerter-tf49l\" (UID: \"8e0b775b-0b05-45f0-a071-d8ffc91e8b50\") " pod="openshift-network-operator/iptables-alerter-tf49l" Jun 08 16:47:30.656816 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.656631 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vbgl\" (UniqueName: \"kubernetes.io/projected/5690029c-2d74-407e-9f78-f55d7a9d216b-kube-api-access-6vbgl\") pod \"node-ca-jvrlj\" (UID: \"5690029c-2d74-407e-9f78-f55d7a9d216b\") " pod="openshift-image-registry/node-ca-jvrlj" Jun 08 16:47:30.656816 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.656692 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8e0b775b-0b05-45f0-a071-d8ffc91e8b50-host-slash\") pod \"iptables-alerter-tf49l\" (UID: \"8e0b775b-0b05-45f0-a071-d8ffc91e8b50\") " pod="openshift-network-operator/iptables-alerter-tf49l" Jun 08 16:47:30.656816 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.656794 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxzbr\" (UniqueName: \"kubernetes.io/projected/2d4b91d7-69b6-4cb8-821c-6313ccdae4fe-kube-api-access-jxzbr\") pod \"node-resolver-9bmtp\" (UID: \"2d4b91d7-69b6-4cb8-821c-6313ccdae4fe\") " pod="openshift-dns/node-resolver-9bmtp" Jun 08 16:47:30.656973 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.656849 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d4b91d7-69b6-4cb8-821c-6313ccdae4fe-tmp-dir\") pod \"node-resolver-9bmtp\" (UID: \"2d4b91d7-69b6-4cb8-821c-6313ccdae4fe\") " pod="openshift-dns/node-resolver-9bmtp" Jun 08 16:47:30.656973 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.656871 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8e0b775b-0b05-45f0-a071-d8ffc91e8b50-iptables-alerter-script\") pod \"iptables-alerter-tf49l\" (UID: \"8e0b775b-0b05-45f0-a071-d8ffc91e8b50\") " pod="openshift-network-operator/iptables-alerter-tf49l" Jun 08 16:47:30.656973 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.656898 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx6h2\" (UniqueName: \"kubernetes.io/projected/8e0b775b-0b05-45f0-a071-d8ffc91e8b50-kube-api-access-wx6h2\") pod \"iptables-alerter-tf49l\" (UID: \"8e0b775b-0b05-45f0-a071-d8ffc91e8b50\") " pod="openshift-network-operator/iptables-alerter-tf49l" Jun 08 16:47:30.656973 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.656927 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5690029c-2d74-407e-9f78-f55d7a9d216b-host\") pod \"node-ca-jvrlj\" (UID: \"5690029c-2d74-407e-9f78-f55d7a9d216b\") " pod="openshift-image-registry/node-ca-jvrlj" Jun 08 16:47:30.656973 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.656966 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2d4b91d7-69b6-4cb8-821c-6313ccdae4fe-hosts-file\") pod \"node-resolver-9bmtp\" (UID: \"2d4b91d7-69b6-4cb8-821c-6313ccdae4fe\") " pod="openshift-dns/node-resolver-9bmtp" Jun 08 16:47:30.657221 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.657009 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5690029c-2d74-407e-9f78-f55d7a9d216b-serviceca\") pod \"node-ca-jvrlj\" (UID: \"5690029c-2d74-407e-9f78-f55d7a9d216b\") " pod="openshift-image-registry/node-ca-jvrlj" Jun 08 16:47:30.657221 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.657036 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vdxd\" (UniqueName: \"kubernetes.io/projected/7f09988e-c137-49af-8f80-a100a01cc2c0-kube-api-access-5vdxd\") pod \"network-check-target-hp28s\" (UID: \"7f09988e-c137-49af-8f80-a100a01cc2c0\") " pod="openshift-network-diagnostics/network-check-target-hp28s" Jun 08 16:47:30.657221 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.657061 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqhnm\" (UniqueName: \"kubernetes.io/projected/cc8ed935-c565-44cd-93bf-b2699dd09b1b-kube-api-access-vqhnm\") pod \"network-metrics-daemon-52225\" (UID: \"cc8ed935-c565-44cd-93bf-b2699dd09b1b\") " pod="openshift-multus/network-metrics-daemon-52225" Jun 08 16:47:30.657221 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.657080 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2d4b91d7-69b6-4cb8-821c-6313ccdae4fe-hosts-file\") pod \"node-resolver-9bmtp\" (UID: \"2d4b91d7-69b6-4cb8-821c-6313ccdae4fe\") " pod="openshift-dns/node-resolver-9bmtp" Jun 08 16:47:30.657221 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.657090 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc8ed935-c565-44cd-93bf-b2699dd09b1b-metrics-certs\") pod \"network-metrics-daemon-52225\" (UID: \"cc8ed935-c565-44cd-93bf-b2699dd09b1b\") " pod="openshift-multus/network-metrics-daemon-52225" Jun 08 16:47:30.657221 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.657117 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5690029c-2d74-407e-9f78-f55d7a9d216b-host\") pod \"node-ca-jvrlj\" (UID: \"5690029c-2d74-407e-9f78-f55d7a9d216b\") " pod="openshift-image-registry/node-ca-jvrlj" Jun 08 16:47:30.657493 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:30.657353 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 16:47:30.657493 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:30.657441 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc8ed935-c565-44cd-93bf-b2699dd09b1b-metrics-certs podName:cc8ed935-c565-44cd-93bf-b2699dd09b1b nodeName:}" failed. No retries permitted until 2026-06-08 16:47:31.157421014 +0000 UTC m=+3.054198477 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cc8ed935-c565-44cd-93bf-b2699dd09b1b-metrics-certs") pod "network-metrics-daemon-52225" (UID: "cc8ed935-c565-44cd-93bf-b2699dd09b1b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 16:47:30.657572 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.657523 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5690029c-2d74-407e-9f78-f55d7a9d216b-serviceca\") pod \"node-ca-jvrlj\" (UID: \"5690029c-2d74-407e-9f78-f55d7a9d216b\") " pod="openshift-image-registry/node-ca-jvrlj" Jun 08 16:47:30.657572 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.657520 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8e0b775b-0b05-45f0-a071-d8ffc91e8b50-iptables-alerter-script\") pod \"iptables-alerter-tf49l\" (UID: \"8e0b775b-0b05-45f0-a071-d8ffc91e8b50\") " pod="openshift-network-operator/iptables-alerter-tf49l" Jun 08 16:47:30.657783 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.657751 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d4b91d7-69b6-4cb8-821c-6313ccdae4fe-tmp-dir\") pod \"node-resolver-9bmtp\" (UID: \"2d4b91d7-69b6-4cb8-821c-6313ccdae4fe\") " pod="openshift-dns/node-resolver-9bmtp" Jun 08 16:47:30.666179 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:30.665908 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 16:47:30.666179 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:30.665931 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 16:47:30.666179 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:30.665945 2579 projected.go:196] Error preparing data for projected volume kube-api-access-5vdxd for pod openshift-network-diagnostics/network-check-target-hp28s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 16:47:30.666179 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:30.666015 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f09988e-c137-49af-8f80-a100a01cc2c0-kube-api-access-5vdxd podName:7f09988e-c137-49af-8f80-a100a01cc2c0 nodeName:}" failed. No retries permitted until 2026-06-08 16:47:31.165997204 +0000 UTC m=+3.062774659 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5vdxd" (UniqueName: "kubernetes.io/projected/7f09988e-c137-49af-8f80-a100a01cc2c0-kube-api-access-5vdxd") pod "network-check-target-hp28s" (UID: "7f09988e-c137-49af-8f80-a100a01cc2c0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 16:47:30.666834 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.666811 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx6h2\" (UniqueName: \"kubernetes.io/projected/8e0b775b-0b05-45f0-a071-d8ffc91e8b50-kube-api-access-wx6h2\") pod \"iptables-alerter-tf49l\" (UID: \"8e0b775b-0b05-45f0-a071-d8ffc91e8b50\") " pod="openshift-network-operator/iptables-alerter-tf49l" Jun 08 16:47:30.667363 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.667341 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqhnm\" (UniqueName: \"kubernetes.io/projected/cc8ed935-c565-44cd-93bf-b2699dd09b1b-kube-api-access-vqhnm\") pod \"network-metrics-daemon-52225\" (UID: \"cc8ed935-c565-44cd-93bf-b2699dd09b1b\") " pod="openshift-multus/network-metrics-daemon-52225" Jun 08 16:47:30.667980 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.667954 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vbgl\" (UniqueName: \"kubernetes.io/projected/5690029c-2d74-407e-9f78-f55d7a9d216b-kube-api-access-6vbgl\") pod \"node-ca-jvrlj\" (UID: \"5690029c-2d74-407e-9f78-f55d7a9d216b\") " pod="openshift-image-registry/node-ca-jvrlj" Jun 08 16:47:30.668078 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.668049 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxzbr\" (UniqueName: \"kubernetes.io/projected/2d4b91d7-69b6-4cb8-821c-6313ccdae4fe-kube-api-access-jxzbr\") pod \"node-resolver-9bmtp\" (UID: \"2d4b91d7-69b6-4cb8-821c-6313ccdae4fe\") " pod="openshift-dns/node-resolver-9bmtp" Jun 08 16:47:30.742745 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.742667 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m8296" Jun 08 16:47:30.750140 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.750115 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmkwf" Jun 08 16:47:30.760484 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.760462 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:30.765210 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.765188 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-92hf8" Jun 08 16:47:30.771756 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.771736 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4lzgx" Jun 08 16:47:30.778413 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.778394 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tpm7n" Jun 08 16:47:30.785931 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.785912 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9bmtp" Jun 08 16:47:30.792490 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.792463 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tf49l" Jun 08 16:47:30.797939 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:30.797923 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jvrlj" Jun 08 16:47:31.060086 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:31.059995 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ee7062a-14dc-4eba-8adb-3c93000940f1-original-pull-secret\") pod \"global-pull-secret-syncer-8d9t8\" (UID: \"5ee7062a-14dc-4eba-8adb-3c93000940f1\") " pod="kube-system/global-pull-secret-syncer-8d9t8" Jun 08 16:47:31.060252 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:31.060174 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 16:47:31.060303 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:31.060261 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ee7062a-14dc-4eba-8adb-3c93000940f1-original-pull-secret podName:5ee7062a-14dc-4eba-8adb-3c93000940f1 nodeName:}" failed. No retries permitted until 2026-06-08 16:47:32.06022255 +0000 UTC m=+3.957000008 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ee7062a-14dc-4eba-8adb-3c93000940f1-original-pull-secret") pod "global-pull-secret-syncer-8d9t8" (UID: "5ee7062a-14dc-4eba-8adb-3c93000940f1") : object "kube-system"/"original-pull-secret" not registered Jun 08 16:47:31.161298 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:31.161262 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc8ed935-c565-44cd-93bf-b2699dd09b1b-metrics-certs\") pod \"network-metrics-daemon-52225\" (UID: \"cc8ed935-c565-44cd-93bf-b2699dd09b1b\") " pod="openshift-multus/network-metrics-daemon-52225" Jun 08 16:47:31.161469 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:31.161407 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 16:47:31.161469 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:31.161467 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc8ed935-c565-44cd-93bf-b2699dd09b1b-metrics-certs podName:cc8ed935-c565-44cd-93bf-b2699dd09b1b nodeName:}" failed. No retries permitted until 2026-06-08 16:47:32.161451357 +0000 UTC m=+4.058228810 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cc8ed935-c565-44cd-93bf-b2699dd09b1b-metrics-certs") pod "network-metrics-daemon-52225" (UID: "cc8ed935-c565-44cd-93bf-b2699dd09b1b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 16:47:31.262551 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:31.262506 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vdxd\" (UniqueName: \"kubernetes.io/projected/7f09988e-c137-49af-8f80-a100a01cc2c0-kube-api-access-5vdxd\") pod \"network-check-target-hp28s\" (UID: \"7f09988e-c137-49af-8f80-a100a01cc2c0\") " pod="openshift-network-diagnostics/network-check-target-hp28s" Jun 08 16:47:31.262736 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:31.262721 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 16:47:31.262783 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:31.262742 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 16:47:31.262783 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:31.262754 2579 projected.go:196] Error preparing data for projected volume kube-api-access-5vdxd for pod openshift-network-diagnostics/network-check-target-hp28s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 16:47:31.262893 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:31.262816 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f09988e-c137-49af-8f80-a100a01cc2c0-kube-api-access-5vdxd podName:7f09988e-c137-49af-8f80-a100a01cc2c0 nodeName:}" failed. No retries permitted until 2026-06-08 16:47:32.26279885 +0000 UTC m=+4.159576309 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5vdxd" (UniqueName: "kubernetes.io/projected/7f09988e-c137-49af-8f80-a100a01cc2c0-kube-api-access-5vdxd") pod "network-check-target-hp28s" (UID: "7f09988e-c137-49af-8f80-a100a01cc2c0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 16:47:31.282005 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:31.281973 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f8cc15b_8e39_4661_ba32_9298034d36d4.slice/crio-7fba468d958b57b3e2b1958b799a91b55d09c5eff26c7c193436b85c5c42bb1f WatchSource:0}: Error finding container 7fba468d958b57b3e2b1958b799a91b55d09c5eff26c7c193436b85c5c42bb1f: Status 404 returned error can't find the container with id 7fba468d958b57b3e2b1958b799a91b55d09c5eff26c7c193436b85c5c42bb1f Jun 08 16:47:31.305723 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:31.305685 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ebab24f_4a53_4e31_bff3_c20586cf3da6.slice/crio-7cac59dabf1c7e1a3d89ebd0f0696d9fe790a61a09b06a2f8eaae13fba95d11b WatchSource:0}: Error finding container 7cac59dabf1c7e1a3d89ebd0f0696d9fe790a61a09b06a2f8eaae13fba95d11b: Status 404 returned error can't find the container with id 7cac59dabf1c7e1a3d89ebd0f0696d9fe790a61a09b06a2f8eaae13fba95d11b Jun 08 16:47:31.309071 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:31.309047 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda00cfd6c_ccf8_4a08_94d8_1d08c4233bef.slice/crio-9a839e42656c1f09885179f242c22e13cea4a8e24b3bd42e77b2e95c3e7b6134 WatchSource:0}: Error finding container 9a839e42656c1f09885179f242c22e13cea4a8e24b3bd42e77b2e95c3e7b6134: Status 404 returned error can't find the container with id 9a839e42656c1f09885179f242c22e13cea4a8e24b3bd42e77b2e95c3e7b6134 Jun 08 16:47:31.310505 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:31.310440 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod559d75ed_52d7_4430_8f9f_09a01958d3f4.slice/crio-20efe8bf0dc5e8b373d018addc8693749a73965e9f3b08c47bc2256fc8b3c279 WatchSource:0}: Error finding container 20efe8bf0dc5e8b373d018addc8693749a73965e9f3b08c47bc2256fc8b3c279: Status 404 returned error can't find the container with id 20efe8bf0dc5e8b373d018addc8693749a73965e9f3b08c47bc2256fc8b3c279 Jun 08 16:47:31.313987 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:31.313574 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb99c500_61a5_432d_93dc_24d07ebd5c1a.slice/crio-f04429325a34abe649b325dd53cd023fdeb34b592bd3fbf79a5e21bda56dca0f WatchSource:0}: Error finding container f04429325a34abe649b325dd53cd023fdeb34b592bd3fbf79a5e21bda56dca0f: Status 404 returned error can't find the container with id f04429325a34abe649b325dd53cd023fdeb34b592bd3fbf79a5e21bda56dca0f Jun 08 16:47:31.315664 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:47:31.315337 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2559512_11a8_49bb_8c55_66f746104f95.slice/crio-20a5fa099c5dc545a870e2fb49a9998260211faf017e0ca1c5e295b81a790114 WatchSource:0}: Error finding container 20a5fa099c5dc545a870e2fb49a9998260211faf017e0ca1c5e295b81a790114: Status 404 returned error can't find the container with id 20a5fa099c5dc545a870e2fb49a9998260211faf017e0ca1c5e295b81a790114 Jun 08 16:47:31.488680 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:31.488619 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 16:42:30 +0000 UTC" deadline="2028-02-11 14:19:38.665315585 +0000 UTC" Jun 08 16:47:31.488680 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:31.488675 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14709h32m7.176645082s" Jun 08 16:47:31.527655 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:31.527623 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tf49l" event={"ID":"8e0b775b-0b05-45f0-a071-d8ffc91e8b50","Type":"ContainerStarted","Data":"aab4b2b6c429f26da1233fbec5e98fdcfe90520d1df64ff70c65bd772971684f"} Jun 08 16:47:31.528998 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:31.528969 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jvrlj" event={"ID":"5690029c-2d74-407e-9f78-f55d7a9d216b","Type":"ContainerStarted","Data":"813c557b493b8a86b06192211b90442c94b915e2852869ec0e1f32f7572daf22"} Jun 08 16:47:31.530048 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:31.530028 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m8296" event={"ID":"1f8cc15b-8e39-4661-ba32-9298034d36d4","Type":"ContainerStarted","Data":"7fba468d958b57b3e2b1958b799a91b55d09c5eff26c7c193436b85c5c42bb1f"} Jun 08 16:47:31.531207 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:31.531188 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9bmtp" event={"ID":"2d4b91d7-69b6-4cb8-821c-6313ccdae4fe","Type":"ContainerStarted","Data":"6110e44a9bee4d6ff1469de392d751794cda6f30053baf99ea464df91bc239d4"} Jun 08 16:47:31.532750 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:31.532730 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tpm7n" event={"ID":"a00cfd6c-ccf8-4a08-94d8-1d08c4233bef","Type":"ContainerStarted","Data":"9a839e42656c1f09885179f242c22e13cea4a8e24b3bd42e77b2e95c3e7b6134"} Jun 08 16:47:31.535037 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:31.534992 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-92hf8" event={"ID":"7ebab24f-4a53-4e31-bff3-c20586cf3da6","Type":"ContainerStarted","Data":"7cac59dabf1c7e1a3d89ebd0f0696d9fe790a61a09b06a2f8eaae13fba95d11b"} Jun 08 16:47:31.539280 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:31.539255 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-83.ec2.internal" event={"ID":"9aa4eed84fc7574a1d3167c11c94bf11","Type":"ContainerStarted","Data":"2656164d40e37d32f1b851c6c19077783529a67874e57d50f26259c4b56962c7"} Jun 08 16:47:31.540282 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:31.540259 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmkwf" event={"ID":"e2559512-11a8-49bb-8c55-66f746104f95","Type":"ContainerStarted","Data":"20a5fa099c5dc545a870e2fb49a9998260211faf017e0ca1c5e295b81a790114"} Jun 08 16:47:31.541466 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:31.541442 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4lzgx" event={"ID":"cb99c500-61a5-432d-93dc-24d07ebd5c1a","Type":"ContainerStarted","Data":"f04429325a34abe649b325dd53cd023fdeb34b592bd3fbf79a5e21bda56dca0f"} Jun 08 16:47:31.542451 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:31.542430 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" event={"ID":"559d75ed-52d7-4430-8f9f-09a01958d3f4","Type":"ContainerStarted","Data":"20efe8bf0dc5e8b373d018addc8693749a73965e9f3b08c47bc2256fc8b3c279"} Jun 08 16:47:31.554279 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:31.554209 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-83.ec2.internal" podStartSLOduration=1.554192525 podStartE2EDuration="1.554192525s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 16:47:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:47:31.553742488 +0000 UTC m=+3.450519964" watchObservedRunningTime="2026-06-08 16:47:31.554192525 +0000 UTC m=+3.450970001" Jun 08 16:47:32.069361 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:32.068676 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ee7062a-14dc-4eba-8adb-3c93000940f1-original-pull-secret\") pod \"global-pull-secret-syncer-8d9t8\" (UID: \"5ee7062a-14dc-4eba-8adb-3c93000940f1\") " pod="kube-system/global-pull-secret-syncer-8d9t8" Jun 08 16:47:32.069361 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:32.068888 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 16:47:32.069361 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:32.068956 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ee7062a-14dc-4eba-8adb-3c93000940f1-original-pull-secret podName:5ee7062a-14dc-4eba-8adb-3c93000940f1 nodeName:}" failed. No retries permitted until 2026-06-08 16:47:34.068937846 +0000 UTC m=+5.965715304 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ee7062a-14dc-4eba-8adb-3c93000940f1-original-pull-secret") pod "global-pull-secret-syncer-8d9t8" (UID: "5ee7062a-14dc-4eba-8adb-3c93000940f1") : object "kube-system"/"original-pull-secret" not registered Jun 08 16:47:32.170433 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:32.169885 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc8ed935-c565-44cd-93bf-b2699dd09b1b-metrics-certs\") pod \"network-metrics-daemon-52225\" (UID: \"cc8ed935-c565-44cd-93bf-b2699dd09b1b\") " pod="openshift-multus/network-metrics-daemon-52225" Jun 08 16:47:32.170433 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:32.170026 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 16:47:32.170433 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:32.170097 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc8ed935-c565-44cd-93bf-b2699dd09b1b-metrics-certs podName:cc8ed935-c565-44cd-93bf-b2699dd09b1b nodeName:}" failed. No retries permitted until 2026-06-08 16:47:34.170074987 +0000 UTC m=+6.066852442 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cc8ed935-c565-44cd-93bf-b2699dd09b1b-metrics-certs") pod "network-metrics-daemon-52225" (UID: "cc8ed935-c565-44cd-93bf-b2699dd09b1b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 16:47:32.271563 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:32.270907 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vdxd\" (UniqueName: \"kubernetes.io/projected/7f09988e-c137-49af-8f80-a100a01cc2c0-kube-api-access-5vdxd\") pod \"network-check-target-hp28s\" (UID: \"7f09988e-c137-49af-8f80-a100a01cc2c0\") " pod="openshift-network-diagnostics/network-check-target-hp28s" Jun 08 16:47:32.271563 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:32.271116 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 16:47:32.271563 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:32.271137 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 16:47:32.271563 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:32.271151 2579 projected.go:196] Error preparing data for projected volume kube-api-access-5vdxd for pod openshift-network-diagnostics/network-check-target-hp28s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 16:47:32.271563 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:32.271210 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f09988e-c137-49af-8f80-a100a01cc2c0-kube-api-access-5vdxd podName:7f09988e-c137-49af-8f80-a100a01cc2c0 nodeName:}" failed. No retries permitted until 2026-06-08 16:47:34.271191958 +0000 UTC m=+6.167969413 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5vdxd" (UniqueName: "kubernetes.io/projected/7f09988e-c137-49af-8f80-a100a01cc2c0-kube-api-access-5vdxd") pod "network-check-target-hp28s" (UID: "7f09988e-c137-49af-8f80-a100a01cc2c0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 16:47:32.488961 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:32.488846 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 16:42:30 +0000 UTC" deadline="2027-12-17 08:47:37.80231505 +0000 UTC" Jun 08 16:47:32.488961 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:32.488913 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13360h0m5.313406035s" Jun 08 16:47:32.521058 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:32.520634 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hp28s" Jun 08 16:47:32.521058 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:32.520758 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hp28s" podUID="7f09988e-c137-49af-8f80-a100a01cc2c0" Jun 08 16:47:32.521471 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:32.521431 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-52225" Jun 08 16:47:32.521571 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:32.521537 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-52225" podUID="cc8ed935-c565-44cd-93bf-b2699dd09b1b" Jun 08 16:47:32.521638 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:32.521603 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8d9t8" Jun 08 16:47:32.521684 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:32.521672 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8d9t8" podUID="5ee7062a-14dc-4eba-8adb-3c93000940f1" Jun 08 16:47:32.563041 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:32.563006 2579 generic.go:356] "Generic (PLEG): container finished" podID="33189211f39fbdf362fe0672528406c3" containerID="bb0af64c9a310f5bdf532d8a76c916c85a78570ad897d7ea6d0bea4c49c5d945" exitCode=0 Jun 08 16:47:32.563566 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:32.563543 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-83.ec2.internal" event={"ID":"33189211f39fbdf362fe0672528406c3","Type":"ContainerDied","Data":"bb0af64c9a310f5bdf532d8a76c916c85a78570ad897d7ea6d0bea4c49c5d945"} Jun 08 16:47:33.578807 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:33.578147 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-83.ec2.internal" event={"ID":"33189211f39fbdf362fe0672528406c3","Type":"ContainerStarted","Data":"c726dce1465357da2812ab999bab41f5e534321518fee8cc30d79ff7f91e4e84"} Jun 08 16:47:34.085004 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:34.084967 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ee7062a-14dc-4eba-8adb-3c93000940f1-original-pull-secret\") pod \"global-pull-secret-syncer-8d9t8\" (UID: \"5ee7062a-14dc-4eba-8adb-3c93000940f1\") " pod="kube-system/global-pull-secret-syncer-8d9t8" Jun 08 16:47:34.085177 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:34.085156 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 16:47:34.085264 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:34.085221 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ee7062a-14dc-4eba-8adb-3c93000940f1-original-pull-secret podName:5ee7062a-14dc-4eba-8adb-3c93000940f1 nodeName:}" failed. No retries permitted until 2026-06-08 16:47:38.085203004 +0000 UTC m=+9.981980458 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ee7062a-14dc-4eba-8adb-3c93000940f1-original-pull-secret") pod "global-pull-secret-syncer-8d9t8" (UID: "5ee7062a-14dc-4eba-8adb-3c93000940f1") : object "kube-system"/"original-pull-secret" not registered Jun 08 16:47:34.185800 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:34.185765 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc8ed935-c565-44cd-93bf-b2699dd09b1b-metrics-certs\") pod \"network-metrics-daemon-52225\" (UID: \"cc8ed935-c565-44cd-93bf-b2699dd09b1b\") " pod="openshift-multus/network-metrics-daemon-52225" Jun 08 16:47:34.185980 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:34.185912 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 16:47:34.185980 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:34.185972 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc8ed935-c565-44cd-93bf-b2699dd09b1b-metrics-certs podName:cc8ed935-c565-44cd-93bf-b2699dd09b1b nodeName:}" failed. No retries permitted until 2026-06-08 16:47:38.185957386 +0000 UTC m=+10.082734839 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cc8ed935-c565-44cd-93bf-b2699dd09b1b-metrics-certs") pod "network-metrics-daemon-52225" (UID: "cc8ed935-c565-44cd-93bf-b2699dd09b1b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 16:47:34.286710 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:34.286672 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vdxd\" (UniqueName: \"kubernetes.io/projected/7f09988e-c137-49af-8f80-a100a01cc2c0-kube-api-access-5vdxd\") pod \"network-check-target-hp28s\" (UID: \"7f09988e-c137-49af-8f80-a100a01cc2c0\") " pod="openshift-network-diagnostics/network-check-target-hp28s" Jun 08 16:47:34.286874 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:34.286855 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 16:47:34.286874 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:34.286872 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 16:47:34.287011 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:34.286885 2579 projected.go:196] Error preparing data for projected volume kube-api-access-5vdxd for pod openshift-network-diagnostics/network-check-target-hp28s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 16:47:34.287011 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:34.286989 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f09988e-c137-49af-8f80-a100a01cc2c0-kube-api-access-5vdxd podName:7f09988e-c137-49af-8f80-a100a01cc2c0 nodeName:}" failed. No retries permitted until 2026-06-08 16:47:38.286926532 +0000 UTC m=+10.183704007 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5vdxd" (UniqueName: "kubernetes.io/projected/7f09988e-c137-49af-8f80-a100a01cc2c0-kube-api-access-5vdxd") pod "network-check-target-hp28s" (UID: "7f09988e-c137-49af-8f80-a100a01cc2c0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 16:47:34.521481 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:34.521337 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hp28s" Jun 08 16:47:34.521636 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:34.521465 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hp28s" podUID="7f09988e-c137-49af-8f80-a100a01cc2c0" Jun 08 16:47:34.522148 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:34.521846 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-52225" Jun 08 16:47:34.522148 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:34.521961 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-52225" podUID="cc8ed935-c565-44cd-93bf-b2699dd09b1b" Jun 08 16:47:34.523494 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:34.523472 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8d9t8" Jun 08 16:47:34.523591 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:34.523572 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8d9t8" podUID="5ee7062a-14dc-4eba-8adb-3c93000940f1" Jun 08 16:47:36.520638 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:36.520603 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hp28s" Jun 08 16:47:36.521090 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:36.520744 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hp28s" podUID="7f09988e-c137-49af-8f80-a100a01cc2c0" Jun 08 16:47:36.521215 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:36.521185 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-52225" Jun 08 16:47:36.521362 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:36.521320 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-52225" podUID="cc8ed935-c565-44cd-93bf-b2699dd09b1b" Jun 08 16:47:36.521513 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:36.521494 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8d9t8" Jun 08 16:47:36.521569 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:36.521558 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8d9t8" podUID="5ee7062a-14dc-4eba-8adb-3c93000940f1" Jun 08 16:47:38.119970 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:38.119931 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ee7062a-14dc-4eba-8adb-3c93000940f1-original-pull-secret\") pod \"global-pull-secret-syncer-8d9t8\" (UID: \"5ee7062a-14dc-4eba-8adb-3c93000940f1\") " pod="kube-system/global-pull-secret-syncer-8d9t8" Jun 08 16:47:38.120411 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:38.120110 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 16:47:38.120411 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:38.120168 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ee7062a-14dc-4eba-8adb-3c93000940f1-original-pull-secret podName:5ee7062a-14dc-4eba-8adb-3c93000940f1 nodeName:}" failed. No retries permitted until 2026-06-08 16:47:46.120148786 +0000 UTC m=+18.016926241 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ee7062a-14dc-4eba-8adb-3c93000940f1-original-pull-secret") pod "global-pull-secret-syncer-8d9t8" (UID: "5ee7062a-14dc-4eba-8adb-3c93000940f1") : object "kube-system"/"original-pull-secret" not registered Jun 08 16:47:38.221305 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:38.221265 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc8ed935-c565-44cd-93bf-b2699dd09b1b-metrics-certs\") pod \"network-metrics-daemon-52225\" (UID: \"cc8ed935-c565-44cd-93bf-b2699dd09b1b\") " pod="openshift-multus/network-metrics-daemon-52225" Jun 08 16:47:38.221452 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:38.221424 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 16:47:38.221540 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:38.221484 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc8ed935-c565-44cd-93bf-b2699dd09b1b-metrics-certs podName:cc8ed935-c565-44cd-93bf-b2699dd09b1b nodeName:}" failed. No retries permitted until 2026-06-08 16:47:46.221463666 +0000 UTC m=+18.118241122 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cc8ed935-c565-44cd-93bf-b2699dd09b1b-metrics-certs") pod "network-metrics-daemon-52225" (UID: "cc8ed935-c565-44cd-93bf-b2699dd09b1b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 16:47:38.321858 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:38.321821 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vdxd\" (UniqueName: \"kubernetes.io/projected/7f09988e-c137-49af-8f80-a100a01cc2c0-kube-api-access-5vdxd\") pod \"network-check-target-hp28s\" (UID: \"7f09988e-c137-49af-8f80-a100a01cc2c0\") " pod="openshift-network-diagnostics/network-check-target-hp28s" Jun 08 16:47:38.322037 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:38.322002 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 16:47:38.322037 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:38.322022 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 16:47:38.322037 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:38.322033 2579 projected.go:196] Error preparing data for projected volume kube-api-access-5vdxd for pod openshift-network-diagnostics/network-check-target-hp28s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 16:47:38.322152 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:38.322082 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f09988e-c137-49af-8f80-a100a01cc2c0-kube-api-access-5vdxd podName:7f09988e-c137-49af-8f80-a100a01cc2c0 nodeName:}" failed. No retries permitted until 2026-06-08 16:47:46.322068327 +0000 UTC m=+18.218845780 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5vdxd" (UniqueName: "kubernetes.io/projected/7f09988e-c137-49af-8f80-a100a01cc2c0-kube-api-access-5vdxd") pod "network-check-target-hp28s" (UID: "7f09988e-c137-49af-8f80-a100a01cc2c0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 16:47:38.521145 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:38.521071 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hp28s" Jun 08 16:47:38.521352 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:38.521175 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hp28s" podUID="7f09988e-c137-49af-8f80-a100a01cc2c0" Jun 08 16:47:38.521589 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:38.521570 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-52225" Jun 08 16:47:38.521698 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:38.521680 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-52225" podUID="cc8ed935-c565-44cd-93bf-b2699dd09b1b" Jun 08 16:47:38.522015 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:38.521850 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8d9t8" Jun 08 16:47:38.522015 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:38.521957 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8d9t8" podUID="5ee7062a-14dc-4eba-8adb-3c93000940f1" Jun 08 16:47:40.520478 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:40.520446 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8d9t8" Jun 08 16:47:40.520948 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:40.520592 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8d9t8" podUID="5ee7062a-14dc-4eba-8adb-3c93000940f1" Jun 08 16:47:40.520948 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:40.520455 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-52225" Jun 08 16:47:40.520948 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:40.520703 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-52225" podUID="cc8ed935-c565-44cd-93bf-b2699dd09b1b" Jun 08 16:47:40.520948 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:40.520446 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hp28s" Jun 08 16:47:40.521302 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:40.521168 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hp28s" podUID="7f09988e-c137-49af-8f80-a100a01cc2c0" Jun 08 16:47:42.520887 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:42.520810 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8d9t8" Jun 08 16:47:42.521311 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:42.520810 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-52225" Jun 08 16:47:42.521311 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:42.520938 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8d9t8" podUID="5ee7062a-14dc-4eba-8adb-3c93000940f1" Jun 08 16:47:42.521311 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:42.520817 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hp28s" Jun 08 16:47:42.521311 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:42.521001 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-52225" podUID="cc8ed935-c565-44cd-93bf-b2699dd09b1b" Jun 08 16:47:42.521311 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:42.521071 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hp28s" podUID="7f09988e-c137-49af-8f80-a100a01cc2c0" Jun 08 16:47:44.520747 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:44.520707 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-52225" Jun 08 16:47:44.521127 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:44.520707 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8d9t8" Jun 08 16:47:44.521127 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:44.520846 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-52225" podUID="cc8ed935-c565-44cd-93bf-b2699dd09b1b" Jun 08 16:47:44.521127 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:44.520707 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hp28s" Jun 08 16:47:44.521127 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:44.520917 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8d9t8" podUID="5ee7062a-14dc-4eba-8adb-3c93000940f1" Jun 08 16:47:44.521127 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:44.521026 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hp28s" podUID="7f09988e-c137-49af-8f80-a100a01cc2c0" Jun 08 16:47:46.180821 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:46.180779 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ee7062a-14dc-4eba-8adb-3c93000940f1-original-pull-secret\") pod \"global-pull-secret-syncer-8d9t8\" (UID: \"5ee7062a-14dc-4eba-8adb-3c93000940f1\") " pod="kube-system/global-pull-secret-syncer-8d9t8" Jun 08 16:47:46.181228 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:46.180934 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 16:47:46.181228 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:46.181015 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ee7062a-14dc-4eba-8adb-3c93000940f1-original-pull-secret podName:5ee7062a-14dc-4eba-8adb-3c93000940f1 nodeName:}" failed. No retries permitted until 2026-06-08 16:48:02.180995395 +0000 UTC m=+34.077772847 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ee7062a-14dc-4eba-8adb-3c93000940f1-original-pull-secret") pod "global-pull-secret-syncer-8d9t8" (UID: "5ee7062a-14dc-4eba-8adb-3c93000940f1") : object "kube-system"/"original-pull-secret" not registered Jun 08 16:47:46.281927 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:46.281890 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc8ed935-c565-44cd-93bf-b2699dd09b1b-metrics-certs\") pod \"network-metrics-daemon-52225\" (UID: \"cc8ed935-c565-44cd-93bf-b2699dd09b1b\") " pod="openshift-multus/network-metrics-daemon-52225" Jun 08 16:47:46.282084 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:46.282013 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 16:47:46.282084 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:46.282078 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc8ed935-c565-44cd-93bf-b2699dd09b1b-metrics-certs podName:cc8ed935-c565-44cd-93bf-b2699dd09b1b nodeName:}" failed. No retries permitted until 2026-06-08 16:48:02.282058997 +0000 UTC m=+34.178836452 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cc8ed935-c565-44cd-93bf-b2699dd09b1b-metrics-certs") pod "network-metrics-daemon-52225" (UID: "cc8ed935-c565-44cd-93bf-b2699dd09b1b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 16:47:46.382342 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:46.382314 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vdxd\" (UniqueName: \"kubernetes.io/projected/7f09988e-c137-49af-8f80-a100a01cc2c0-kube-api-access-5vdxd\") pod \"network-check-target-hp28s\" (UID: \"7f09988e-c137-49af-8f80-a100a01cc2c0\") " pod="openshift-network-diagnostics/network-check-target-hp28s" Jun 08 16:47:46.382493 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:46.382468 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 16:47:46.382493 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:46.382488 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 16:47:46.382562 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:46.382497 2579 projected.go:196] Error preparing data for projected volume kube-api-access-5vdxd for pod openshift-network-diagnostics/network-check-target-hp28s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 16:47:46.382562 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:46.382544 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f09988e-c137-49af-8f80-a100a01cc2c0-kube-api-access-5vdxd podName:7f09988e-c137-49af-8f80-a100a01cc2c0 nodeName:}" failed. No retries permitted until 2026-06-08 16:48:02.382531289 +0000 UTC m=+34.279308742 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5vdxd" (UniqueName: "kubernetes.io/projected/7f09988e-c137-49af-8f80-a100a01cc2c0-kube-api-access-5vdxd") pod "network-check-target-hp28s" (UID: "7f09988e-c137-49af-8f80-a100a01cc2c0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 16:47:46.520902 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:46.520828 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hp28s" Jun 08 16:47:46.521042 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:46.520828 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-52225" Jun 08 16:47:46.521042 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:46.520948 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hp28s" podUID="7f09988e-c137-49af-8f80-a100a01cc2c0" Jun 08 16:47:46.521110 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:46.521045 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-52225" podUID="cc8ed935-c565-44cd-93bf-b2699dd09b1b" Jun 08 16:47:46.521110 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:46.520835 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8d9t8" Jun 08 16:47:46.521182 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:46.521158 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8d9t8" podUID="5ee7062a-14dc-4eba-8adb-3c93000940f1" Jun 08 16:47:48.520790 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:48.520761 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-52225" Jun 08 16:47:48.521333 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:48.520874 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-52225" podUID="cc8ed935-c565-44cd-93bf-b2699dd09b1b" Jun 08 16:47:48.521333 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:48.520962 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hp28s" Jun 08 16:47:48.521333 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:48.521061 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hp28s" podUID="7f09988e-c137-49af-8f80-a100a01cc2c0" Jun 08 16:47:48.521333 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:48.521097 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8d9t8" Jun 08 16:47:48.521333 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:48.521146 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8d9t8" podUID="5ee7062a-14dc-4eba-8adb-3c93000940f1" Jun 08 16:47:50.520596 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:50.520374 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hp28s" Jun 08 16:47:50.521384 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:50.520453 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-52225" Jun 08 16:47:50.521384 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:50.520698 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hp28s" podUID="7f09988e-c137-49af-8f80-a100a01cc2c0" Jun 08 16:47:50.521384 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:50.520790 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-52225" podUID="cc8ed935-c565-44cd-93bf-b2699dd09b1b" Jun 08 16:47:50.521384 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:50.520561 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8d9t8" Jun 08 16:47:50.521384 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:50.520888 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8d9t8" podUID="5ee7062a-14dc-4eba-8adb-3c93000940f1" Jun 08 16:47:50.611786 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:50.611760 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" event={"ID":"559d75ed-52d7-4430-8f9f-09a01958d3f4","Type":"ContainerStarted","Data":"a0aef8b49b8cd5a10bb40a29dc1962c04a8aecea44f5a9bb925cc8b23055561c"} Jun 08 16:47:50.611904 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:50.611825 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" event={"ID":"559d75ed-52d7-4430-8f9f-09a01958d3f4","Type":"ContainerStarted","Data":"55fb266ea8e7bf7fe8e1fe6248be0c5b16cc967b1c4d5447eaf64e9de509f7ef"} Jun 08 16:47:50.612922 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:50.612899 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jvrlj" event={"ID":"5690029c-2d74-407e-9f78-f55d7a9d216b","Type":"ContainerStarted","Data":"86bd2b0570c4e09822d30ee7c220b224462ca45fdcb1a5fdea1997b609ff5b05"} Jun 08 16:47:50.614163 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:50.614142 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m8296" event={"ID":"1f8cc15b-8e39-4661-ba32-9298034d36d4","Type":"ContainerStarted","Data":"46b9e0b9d0736e7b83ec495d47ddf69329b217800c752c084552c11da818a618"} Jun 08 16:47:50.615541 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:50.615518 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9bmtp" event={"ID":"2d4b91d7-69b6-4cb8-821c-6313ccdae4fe","Type":"ContainerStarted","Data":"b15bf22fd0a3c61c786eb941668979f48a9350af32e5c8cef1e52ae72fe2c4e9"} Jun 08 16:47:50.616820 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:50.616799 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tpm7n" event={"ID":"a00cfd6c-ccf8-4a08-94d8-1d08c4233bef","Type":"ContainerStarted","Data":"2443d4278a387178929dfa3772d94f58059b23942eda1435a3f0dfa46489a972"} Jun 08 16:47:50.620330 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:50.618801 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-92hf8" event={"ID":"7ebab24f-4a53-4e31-bff3-c20586cf3da6","Type":"ContainerStarted","Data":"0ef3c62bbc99a14c133b1f8ee02a770f3af3b07567179fcc8a4cf1a0c2d067fc"} Jun 08 16:47:50.623465 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:50.623442 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmkwf" event={"ID":"e2559512-11a8-49bb-8c55-66f746104f95","Type":"ContainerStarted","Data":"a4b9ed21474840d76dce158dd69fd15d506351d702b7dd5284737fe1ec84e3e3"} Jun 08 16:47:50.624887 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:50.624865 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4lzgx" event={"ID":"cb99c500-61a5-432d-93dc-24d07ebd5c1a","Type":"ContainerStarted","Data":"06c15efba75fa89f41b941496c53aa485e9ceafad68eff49b95b7386a638e5f8"} Jun 08 16:47:50.631419 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:50.630274 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jvrlj" podStartSLOduration=3.665184001 podStartE2EDuration="22.630254998s" totalImagesPullingTime="18.965070997s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 16:47:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:47:50.628688514 +0000 UTC m=+22.525465992" watchObservedRunningTime="2026-06-08 16:47:50.630254998 +0000 UTC m=+22.527032481" Jun 08 16:47:50.631419 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:50.630403 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-83.ec2.internal" podStartSLOduration=20.630395794000002 podStartE2EDuration="20.630395794s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 16:47:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:47:33.595762614 +0000 UTC m=+5.492540091" watchObservedRunningTime="2026-06-08 16:47:50.630395794 +0000 UTC m=+22.527173271" Jun 08 16:47:50.648357 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:50.648055 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-m8296" podStartSLOduration=3.681355822 podStartE2EDuration="22.648033906s" totalImagesPullingTime="18.966678084s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 16:47:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:47:50.64704455 +0000 UTC m=+22.543822024" watchObservedRunningTime="2026-06-08 16:47:50.648033906 +0000 UTC m=+22.544811386" Jun 08 16:47:50.662985 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:50.662946 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-92hf8" podStartSLOduration=7.561849646 podStartE2EDuration="22.662923311s" totalImagesPullingTime="15.101073665s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:47:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:47:50.662108963 +0000 UTC m=+22.558886434" watchObservedRunningTime="2026-06-08 16:47:50.662923311 +0000 UTC m=+22.559700787" Jun 08 16:47:50.680868 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:50.680825 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4lzgx" podStartSLOduration=3.670574744 podStartE2EDuration="22.680810488s" totalImagesPullingTime="19.010235744s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 16:47:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:47:50.680798243 +0000 UTC m=+22.577575774" watchObservedRunningTime="2026-06-08 16:47:50.680810488 +0000 UTC m=+22.577587962" Jun 08 16:47:50.717422 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:50.717371 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9bmtp" podStartSLOduration=7.62465322 podStartE2EDuration="22.717350011s" totalImagesPullingTime="15.092696791s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 16:47:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:47:50.71656204 +0000 UTC m=+22.613339515" watchObservedRunningTime="2026-06-08 16:47:50.717350011 +0000 UTC m=+22.614127486" Jun 08 16:47:50.818979 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:50.818944 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:47:50.902507 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:50.902454 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:47:51.457171 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:51.457136 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-92hf8" Jun 08 16:47:51.457818 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:51.457797 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-92hf8" Jun 08 16:47:51.629884 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:51.629856 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vkrbj_559d75ed-52d7-4430-8f9f-09a01958d3f4/ovn-acl-logging/0.log" Jun 08 16:47:51.630281 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:51.630191 2579 generic.go:356] "Generic (PLEG): container finished" podID="559d75ed-52d7-4430-8f9f-09a01958d3f4" containerID="a0aef8b49b8cd5a10bb40a29dc1962c04a8aecea44f5a9bb925cc8b23055561c" exitCode=1 Jun 08 16:47:51.630351 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:51.630278 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" event={"ID":"559d75ed-52d7-4430-8f9f-09a01958d3f4","Type":"ContainerDied","Data":"a0aef8b49b8cd5a10bb40a29dc1962c04a8aecea44f5a9bb925cc8b23055561c"} Jun 08 16:47:51.630405 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:51.630370 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" event={"ID":"559d75ed-52d7-4430-8f9f-09a01958d3f4","Type":"ContainerStarted","Data":"97fd7660ce18fc8e14c497f23645487cfe3eaedfcbef2970aad3a7c589270801"} Jun 08 16:47:51.630460 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:51.630425 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" event={"ID":"559d75ed-52d7-4430-8f9f-09a01958d3f4","Type":"ContainerStarted","Data":"35bc1f15b3db0b9444f1098ccdbb66393b3b472199ebc6513e18c279a3032b89"} Jun 08 16:47:51.630510 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:51.630476 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" event={"ID":"559d75ed-52d7-4430-8f9f-09a01958d3f4","Type":"ContainerStarted","Data":"be8f7170c2e479c049a7d6bba8db899edcf86e1dc44695582e30bf07b082c484"} Jun 08 16:47:51.630565 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:51.630525 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" event={"ID":"559d75ed-52d7-4430-8f9f-09a01958d3f4","Type":"ContainerStarted","Data":"447588b595f65f6517a5f47ace715608de53ddcefe4cb6d01e5e192d8a829546"} Jun 08 16:47:51.631571 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:51.631546 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tf49l" event={"ID":"8e0b775b-0b05-45f0-a071-d8ffc91e8b50","Type":"ContainerStarted","Data":"a2358daa754cd067c4c5b510dfaa3554563de91831449aa60eb67ff31a8d3e2e"} Jun 08 16:47:51.633044 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:51.633024 2579 generic.go:356] "Generic (PLEG): container finished" podID="a00cfd6c-ccf8-4a08-94d8-1d08c4233bef" containerID="2443d4278a387178929dfa3772d94f58059b23942eda1435a3f0dfa46489a972" exitCode=0 Jun 08 16:47:51.633218 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:51.633123 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tpm7n" event={"ID":"a00cfd6c-ccf8-4a08-94d8-1d08c4233bef","Type":"ContainerDied","Data":"2443d4278a387178929dfa3772d94f58059b23942eda1435a3f0dfa46489a972"} Jun 08 16:47:51.633372 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:51.633358 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-92hf8" Jun 08 16:47:51.634014 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:51.633997 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-92hf8" Jun 08 16:47:51.648641 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:51.648600 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-tf49l" podStartSLOduration=4.683459082 podStartE2EDuration="23.648585686s" totalImagesPullingTime="18.965126604s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 16:47:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:47:51.648338314 +0000 UTC m=+23.545115789" watchObservedRunningTime="2026-06-08 16:47:51.648585686 +0000 UTC m=+23.545363166" Jun 08 16:47:51.703968 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:51.703934 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:47:51.766511 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:51.766474 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:47:51.867301 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:51.867128 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:47:51.912878 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:51.912860 2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 08 16:47:52.520656 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:52.520625 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-52225" Jun 08 16:47:52.520872 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:52.520761 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8d9t8" Jun 08 16:47:52.520923 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:52.520865 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8d9t8" podUID="5ee7062a-14dc-4eba-8adb-3c93000940f1" Jun 08 16:47:52.520923 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:52.520759 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-52225" podUID="cc8ed935-c565-44cd-93bf-b2699dd09b1b" Jun 08 16:47:52.520923 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:52.520625 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hp28s" Jun 08 16:47:52.521022 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:52.520958 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hp28s" podUID="7f09988e-c137-49af-8f80-a100a01cc2c0" Jun 08 16:47:52.526965 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:52.526870 2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-08T16:47:51.912874393Z","UUID":"521ec4c1-5bdb-4774-9b0c-d9d36b91feef","Handler":null,"Name":"","Endpoint":""} Jun 08 16:47:52.528425 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:52.528404 2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 08 16:47:52.528554 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:52.528447 2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 08 16:47:52.638419 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:52.638384 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmkwf" event={"ID":"e2559512-11a8-49bb-8c55-66f746104f95","Type":"ContainerStarted","Data":"8a0f95308561f07ff27071264ee51ee585516474e4acc9dda394c8501b952564"} Jun 08 16:47:53.322122 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:53.322089 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:47:53.422254 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:53.422205 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:47:53.642982 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:53.642883 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmkwf" event={"ID":"e2559512-11a8-49bb-8c55-66f746104f95","Type":"ContainerStarted","Data":"7ff5c207450e643417a3679731c8f40baea9247d1c07338be7b21255e7eaf73e"} Jun 08 16:47:53.646581 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:53.646549 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vkrbj_559d75ed-52d7-4430-8f9f-09a01958d3f4/ovn-acl-logging/0.log" Jun 08 16:47:53.647047 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:53.647023 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" event={"ID":"559d75ed-52d7-4430-8f9f-09a01958d3f4","Type":"ContainerStarted","Data":"93a4ed654bffe618a712e6b76163b5583acf7ecf129c0e6b70f1bdde0f32387b"} Jun 08 16:47:53.661846 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:53.661799 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmkwf" podStartSLOduration=4.271738536 podStartE2EDuration="25.661781818s" totalImagesPullingTime="21.390043282s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 16:47:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:47:53.661523542 +0000 UTC m=+25.558301016" watchObservedRunningTime="2026-06-08 16:47:53.661781818 +0000 UTC m=+25.558559295" Jun 08 16:47:53.875874 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:53.875839 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:47:53.937229 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:53.937158 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:47:54.520058 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:54.520025 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hp28s" Jun 08 16:47:54.520255 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:54.520034 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-52225" Jun 08 16:47:54.520255 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:54.520141 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hp28s" podUID="7f09988e-c137-49af-8f80-a100a01cc2c0" Jun 08 16:47:54.520255 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:54.520034 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8d9t8" Jun 08 16:47:54.520406 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:54.520269 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-52225" podUID="cc8ed935-c565-44cd-93bf-b2699dd09b1b" Jun 08 16:47:54.520406 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:54.520364 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8d9t8" podUID="5ee7062a-14dc-4eba-8adb-3c93000940f1" Jun 08 16:47:56.520724 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:56.520642 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-52225" Jun 08 16:47:56.521390 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:56.520649 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8d9t8" Jun 08 16:47:56.521390 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:56.520751 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-52225" podUID="cc8ed935-c565-44cd-93bf-b2699dd09b1b" Jun 08 16:47:56.521390 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:56.520848 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8d9t8" podUID="5ee7062a-14dc-4eba-8adb-3c93000940f1" Jun 08 16:47:56.521390 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:56.520897 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hp28s" Jun 08 16:47:56.521390 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:56.520962 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hp28s" podUID="7f09988e-c137-49af-8f80-a100a01cc2c0" Jun 08 16:47:56.655168 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:56.655135 2579 generic.go:356] "Generic (PLEG): container finished" podID="a00cfd6c-ccf8-4a08-94d8-1d08c4233bef" containerID="9dcdf5f83193c22fb273c8238048c6b72dcfd992f6fb2a4df8a925217dd988d9" exitCode=0 Jun 08 16:47:56.655362 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:56.655222 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tpm7n" event={"ID":"a00cfd6c-ccf8-4a08-94d8-1d08c4233bef","Type":"ContainerDied","Data":"9dcdf5f83193c22fb273c8238048c6b72dcfd992f6fb2a4df8a925217dd988d9"} Jun 08 16:47:56.660361 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:56.660333 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vkrbj_559d75ed-52d7-4430-8f9f-09a01958d3f4/ovn-acl-logging/0.log" Jun 08 16:47:56.660752 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:56.660729 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" event={"ID":"559d75ed-52d7-4430-8f9f-09a01958d3f4","Type":"ContainerStarted","Data":"d23c829363e8a59e5c85a18f063350b62fb16b175fc3355b7f520e434da08766"} Jun 08 16:47:56.661036 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:56.661018 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:56.661126 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:56.661069 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:56.661126 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:56.661106 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:56.661251 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:56.661148 2579 scope.go:117] "RemoveContainer" containerID="a0aef8b49b8cd5a10bb40a29dc1962c04a8aecea44f5a9bb925cc8b23055561c" Jun 08 16:47:56.677683 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:56.677616 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:56.677747 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:56.677711 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:47:57.668862 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:57.668645 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vkrbj_559d75ed-52d7-4430-8f9f-09a01958d3f4/ovn-acl-logging/0.log" Jun 08 16:47:57.669769 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:57.669736 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" event={"ID":"559d75ed-52d7-4430-8f9f-09a01958d3f4","Type":"ContainerStarted","Data":"1be719713ea3ebe8b621053cf104d49e311634fb5507675fa9303cfec257bcfa"} Jun 08 16:47:57.697730 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:57.697689 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" podStartSLOduration=10.67751745 podStartE2EDuration="29.697673544s" totalImagesPullingTime="19.020156094s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 16:47:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:47:57.696318954 +0000 UTC m=+29.593096429" watchObservedRunningTime="2026-06-08 16:47:57.697673544 +0000 UTC m=+29.594451012" Jun 08 16:47:57.775833 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:57.775809 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-52225"] Jun 08 16:47:57.775930 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:57.775919 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-52225" Jun 08 16:47:57.776022 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:57.776005 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-52225" podUID="cc8ed935-c565-44cd-93bf-b2699dd09b1b" Jun 08 16:47:57.778555 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:57.778517 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hp28s"] Jun 08 16:47:57.778659 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:57.778636 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hp28s" Jun 08 16:47:57.778761 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:57.778721 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hp28s" podUID="7f09988e-c137-49af-8f80-a100a01cc2c0" Jun 08 16:47:57.787671 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:57.787647 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8d9t8"] Jun 08 16:47:57.787773 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:57.787747 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8d9t8" Jun 08 16:47:57.787868 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:57.787844 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8d9t8" podUID="5ee7062a-14dc-4eba-8adb-3c93000940f1" Jun 08 16:47:57.956458 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:57.956396 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:47:58.015552 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:58.015518 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:47:58.673867 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:58.673829 2579 generic.go:356] "Generic (PLEG): container finished" podID="a00cfd6c-ccf8-4a08-94d8-1d08c4233bef" containerID="f087eac81f874eb11d86b9d0533bd06407bff4c7dffc79c83d2d55430d3468d0" exitCode=0 Jun 08 16:47:58.674373 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:58.673907 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tpm7n" event={"ID":"a00cfd6c-ccf8-4a08-94d8-1d08c4233bef","Type":"ContainerDied","Data":"f087eac81f874eb11d86b9d0533bd06407bff4c7dffc79c83d2d55430d3468d0"} Jun 08 16:47:59.431686 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:59.431651 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:47:59.492459 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:59.492422 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:47:59.520579 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:59.520553 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-52225" Jun 08 16:47:59.520719 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:59.520586 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hp28s" Jun 08 16:47:59.520719 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:59.520669 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-52225" podUID="cc8ed935-c565-44cd-93bf-b2699dd09b1b" Jun 08 16:47:59.520719 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:47:59.520566 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8d9t8" Jun 08 16:47:59.520828 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:59.520753 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hp28s" podUID="7f09988e-c137-49af-8f80-a100a01cc2c0" Jun 08 16:47:59.520828 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:47:59.520822 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8d9t8" podUID="5ee7062a-14dc-4eba-8adb-3c93000940f1" Jun 08 16:48:00.385254 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:00.385194 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:00.681453 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:00.681382 2579 generic.go:356] "Generic (PLEG): container finished" podID="a00cfd6c-ccf8-4a08-94d8-1d08c4233bef" containerID="d69b6130ac9aa20f010b356aa3e1fe90bf2b19a58550feaa586e7879cdf5781a" exitCode=0 Jun 08 16:48:00.681453 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:00.681418 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tpm7n" event={"ID":"a00cfd6c-ccf8-4a08-94d8-1d08c4233bef","Type":"ContainerDied","Data":"d69b6130ac9aa20f010b356aa3e1fe90bf2b19a58550feaa586e7879cdf5781a"} Jun 08 16:48:01.485530 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:01.485488 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:01.521029 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:01.520559 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8d9t8" Jun 08 16:48:01.521029 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:01.520593 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-52225" Jun 08 16:48:01.521029 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:48:01.520697 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8d9t8" podUID="5ee7062a-14dc-4eba-8adb-3c93000940f1" Jun 08 16:48:01.521029 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:01.520719 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hp28s" Jun 08 16:48:01.521029 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:48:01.520826 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-52225" podUID="cc8ed935-c565-44cd-93bf-b2699dd09b1b" Jun 08 16:48:01.521029 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:48:01.520893 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hp28s" podUID="7f09988e-c137-49af-8f80-a100a01cc2c0" Jun 08 16:48:02.203997 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:02.203960 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ee7062a-14dc-4eba-8adb-3c93000940f1-original-pull-secret\") pod \"global-pull-secret-syncer-8d9t8\" (UID: \"5ee7062a-14dc-4eba-8adb-3c93000940f1\") " pod="kube-system/global-pull-secret-syncer-8d9t8" Jun 08 16:48:02.204297 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:48:02.204129 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 16:48:02.204297 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:48:02.204206 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ee7062a-14dc-4eba-8adb-3c93000940f1-original-pull-secret podName:5ee7062a-14dc-4eba-8adb-3c93000940f1 nodeName:}" failed. No retries permitted until 2026-06-08 16:48:34.204187032 +0000 UTC m=+66.100964488 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ee7062a-14dc-4eba-8adb-3c93000940f1-original-pull-secret") pod "global-pull-secret-syncer-8d9t8" (UID: "5ee7062a-14dc-4eba-8adb-3c93000940f1") : object "kube-system"/"original-pull-secret" not registered Jun 08 16:48:02.304512 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:02.304481 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc8ed935-c565-44cd-93bf-b2699dd09b1b-metrics-certs\") pod \"network-metrics-daemon-52225\" (UID: \"cc8ed935-c565-44cd-93bf-b2699dd09b1b\") " pod="openshift-multus/network-metrics-daemon-52225" Jun 08 16:48:02.304673 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:48:02.304634 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 16:48:02.304727 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:48:02.304711 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc8ed935-c565-44cd-93bf-b2699dd09b1b-metrics-certs podName:cc8ed935-c565-44cd-93bf-b2699dd09b1b nodeName:}" failed. No retries permitted until 2026-06-08 16:48:34.304681567 +0000 UTC m=+66.201459021 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cc8ed935-c565-44cd-93bf-b2699dd09b1b-metrics-certs") pod "network-metrics-daemon-52225" (UID: "cc8ed935-c565-44cd-93bf-b2699dd09b1b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 16:48:02.405128 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:02.405087 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vdxd\" (UniqueName: \"kubernetes.io/projected/7f09988e-c137-49af-8f80-a100a01cc2c0-kube-api-access-5vdxd\") pod \"network-check-target-hp28s\" (UID: \"7f09988e-c137-49af-8f80-a100a01cc2c0\") " pod="openshift-network-diagnostics/network-check-target-hp28s" Jun 08 16:48:02.405291 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:48:02.405262 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 16:48:02.405291 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:48:02.405290 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 16:48:02.405385 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:48:02.405303 2579 projected.go:196] Error preparing data for projected volume kube-api-access-5vdxd for pod openshift-network-diagnostics/network-check-target-hp28s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 16:48:02.405385 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:48:02.405366 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f09988e-c137-49af-8f80-a100a01cc2c0-kube-api-access-5vdxd podName:7f09988e-c137-49af-8f80-a100a01cc2c0 nodeName:}" failed. No retries permitted until 2026-06-08 16:48:34.405348199 +0000 UTC m=+66.302125655 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5vdxd" (UniqueName: "kubernetes.io/projected/7f09988e-c137-49af-8f80-a100a01cc2c0-kube-api-access-5vdxd") pod "network-check-target-hp28s" (UID: "7f09988e-c137-49af-8f80-a100a01cc2c0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 16:48:03.406257 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:03.406203 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-83.ec2.internal" event="NodeReady" Jun 08 16:48:03.406666 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:03.406380 2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 08 16:48:03.458448 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:03.458411 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pjgts"] Jun 08 16:48:03.460710 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:03.460683 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-k75p9"] Jun 08 16:48:03.460846 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:03.460759 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pjgts" Jun 08 16:48:03.463656 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:03.463628 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dpvks\"" Jun 08 16:48:03.463928 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:03.463862 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 08 16:48:03.463928 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:03.463912 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 08 16:48:03.464205 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:03.464186 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 08 16:48:03.464483 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:03.464465 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-k75p9" Jun 08 16:48:03.468671 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:03.468646 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 08 16:48:03.468761 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:03.468682 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-m9sqz\"" Jun 08 16:48:03.468761 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:03.468691 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 08 16:48:03.468924 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:03.468906 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pjgts"] Jun 08 16:48:03.472087 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:03.471881 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-k75p9"] Jun 08 16:48:03.520862 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:03.520840 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8d9t8" Jun 08 16:48:03.520982 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:03.520938 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hp28s" Jun 08 16:48:03.520982 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:03.520968 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-52225" Jun 08 16:48:03.523960 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:03.523771 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 16:48:03.523960 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:03.523781 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rh7q7\"" Jun 08 16:48:03.523960 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:03.523772 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 16:48:03.523960 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:03.523827 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 16:48:03.523960 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:03.523881 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 16:48:03.523960 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:03.523945 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9mcb6\"" Jun 08 16:48:03.578802 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:03.578775 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:03.612200 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:03.612173 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5588\" (UniqueName: \"kubernetes.io/projected/0015697c-c802-48e9-8fba-511d0f7be4e7-kube-api-access-f5588\") pod \"ingress-canary-pjgts\" (UID: \"0015697c-c802-48e9-8fba-511d0f7be4e7\") " pod="openshift-ingress-canary/ingress-canary-pjgts" Jun 08 16:48:03.612323 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:03.612201 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/39f5a916-a88c-4539-a49d-ac446548636f-config-volume\") pod \"dns-default-k75p9\" (UID: \"39f5a916-a88c-4539-a49d-ac446548636f\") " pod="openshift-dns/dns-default-k75p9" Jun 08 16:48:03.612323 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:03.612248 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfqdg\" (UniqueName: \"kubernetes.io/projected/39f5a916-a88c-4539-a49d-ac446548636f-kube-api-access-xfqdg\") pod \"dns-default-k75p9\" (UID: \"39f5a916-a88c-4539-a49d-ac446548636f\") " pod="openshift-dns/dns-default-k75p9" Jun 08 16:48:03.612323 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:03.612278 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39f5a916-a88c-4539-a49d-ac446548636f-tmp-dir\") pod \"dns-default-k75p9\" (UID: \"39f5a916-a88c-4539-a49d-ac446548636f\") " pod="openshift-dns/dns-default-k75p9" Jun 08 16:48:03.612471 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:03.612326 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0015697c-c802-48e9-8fba-511d0f7be4e7-cert\") pod \"ingress-canary-pjgts\" (UID: \"0015697c-c802-48e9-8fba-511d0f7be4e7\") " pod="openshift-ingress-canary/ingress-canary-pjgts" Jun 08 16:48:03.612471 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:03.612350 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39f5a916-a88c-4539-a49d-ac446548636f-metrics-tls\") pod \"dns-default-k75p9\" (UID: \"39f5a916-a88c-4539-a49d-ac446548636f\") " pod="openshift-dns/dns-default-k75p9" Jun 08 16:48:03.679408 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:03.679325 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:03.713378 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:03.713345 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5588\" (UniqueName: \"kubernetes.io/projected/0015697c-c802-48e9-8fba-511d0f7be4e7-kube-api-access-f5588\") pod \"ingress-canary-pjgts\" (UID: \"0015697c-c802-48e9-8fba-511d0f7be4e7\") " pod="openshift-ingress-canary/ingress-canary-pjgts" Jun 08 16:48:03.713378 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:03.713376 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/39f5a916-a88c-4539-a49d-ac446548636f-config-volume\") pod \"dns-default-k75p9\" (UID: \"39f5a916-a88c-4539-a49d-ac446548636f\") " pod="openshift-dns/dns-default-k75p9" Jun 08 16:48:03.713568 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:03.713412 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfqdg\" (UniqueName: \"kubernetes.io/projected/39f5a916-a88c-4539-a49d-ac446548636f-kube-api-access-xfqdg\") pod \"dns-default-k75p9\" (UID: \"39f5a916-a88c-4539-a49d-ac446548636f\") " pod="openshift-dns/dns-default-k75p9" Jun 08 16:48:03.713568 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:03.713444 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39f5a916-a88c-4539-a49d-ac446548636f-tmp-dir\") pod \"dns-default-k75p9\" (UID: \"39f5a916-a88c-4539-a49d-ac446548636f\") " pod="openshift-dns/dns-default-k75p9" Jun 08 16:48:03.713568 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:03.713468 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0015697c-c802-48e9-8fba-511d0f7be4e7-cert\") pod \"ingress-canary-pjgts\" (UID: \"0015697c-c802-48e9-8fba-511d0f7be4e7\") " pod="openshift-ingress-canary/ingress-canary-pjgts" Jun 08 16:48:03.713568 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:03.713496 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39f5a916-a88c-4539-a49d-ac446548636f-metrics-tls\") pod \"dns-default-k75p9\" (UID: \"39f5a916-a88c-4539-a49d-ac446548636f\") " pod="openshift-dns/dns-default-k75p9" Jun 08 16:48:03.713763 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:48:03.713581 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 16:48:03.713763 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:48:03.713624 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39f5a916-a88c-4539-a49d-ac446548636f-metrics-tls podName:39f5a916-a88c-4539-a49d-ac446548636f nodeName:}" failed. No retries permitted until 2026-06-08 16:48:04.213609368 +0000 UTC m=+36.110386820 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/39f5a916-a88c-4539-a49d-ac446548636f-metrics-tls") pod "dns-default-k75p9" (UID: "39f5a916-a88c-4539-a49d-ac446548636f") : secret "dns-default-metrics-tls" not found Jun 08 16:48:03.713882 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:03.713863 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39f5a916-a88c-4539-a49d-ac446548636f-tmp-dir\") pod \"dns-default-k75p9\" (UID: \"39f5a916-a88c-4539-a49d-ac446548636f\") " pod="openshift-dns/dns-default-k75p9" Jun 08 16:48:03.714046 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:03.714023 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/39f5a916-a88c-4539-a49d-ac446548636f-config-volume\") pod \"dns-default-k75p9\" (UID: \"39f5a916-a88c-4539-a49d-ac446548636f\") " pod="openshift-dns/dns-default-k75p9" Jun 08 16:48:03.718393 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:03.718374 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0015697c-c802-48e9-8fba-511d0f7be4e7-cert\") pod \"ingress-canary-pjgts\" (UID: \"0015697c-c802-48e9-8fba-511d0f7be4e7\") " pod="openshift-ingress-canary/ingress-canary-pjgts" Jun 08 16:48:03.723804 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:03.723773 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfqdg\" (UniqueName: \"kubernetes.io/projected/39f5a916-a88c-4539-a49d-ac446548636f-kube-api-access-xfqdg\") pod \"dns-default-k75p9\" (UID: \"39f5a916-a88c-4539-a49d-ac446548636f\") " pod="openshift-dns/dns-default-k75p9" Jun 08 16:48:03.723902 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:03.723884 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5588\" (UniqueName: \"kubernetes.io/projected/0015697c-c802-48e9-8fba-511d0f7be4e7-kube-api-access-f5588\") pod \"ingress-canary-pjgts\" (UID: \"0015697c-c802-48e9-8fba-511d0f7be4e7\") " pod="openshift-ingress-canary/ingress-canary-pjgts" Jun 08 16:48:03.778857 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:03.778823 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pjgts" Jun 08 16:48:03.795136 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:03.795096 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:04.218374 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:04.218329 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39f5a916-a88c-4539-a49d-ac446548636f-metrics-tls\") pod \"dns-default-k75p9\" (UID: \"39f5a916-a88c-4539-a49d-ac446548636f\") " pod="openshift-dns/dns-default-k75p9" Jun 08 16:48:04.218571 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:48:04.218493 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 16:48:04.218635 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:48:04.218574 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39f5a916-a88c-4539-a49d-ac446548636f-metrics-tls podName:39f5a916-a88c-4539-a49d-ac446548636f nodeName:}" failed. No retries permitted until 2026-06-08 16:48:05.218552866 +0000 UTC m=+37.115330325 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/39f5a916-a88c-4539-a49d-ac446548636f-metrics-tls") pod "dns-default-k75p9" (UID: "39f5a916-a88c-4539-a49d-ac446548636f") : secret "dns-default-metrics-tls" not found Jun 08 16:48:04.775695 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:04.775669 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pjgts"] Jun 08 16:48:04.779852 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:48:04.779823 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0015697c_c802_48e9_8fba_511d0f7be4e7.slice/crio-026253c202665fb7c46ab074f5a744e2e7cfc90ae8d4e8e9aa352cb588bda05d WatchSource:0}: Error finding container 026253c202665fb7c46ab074f5a744e2e7cfc90ae8d4e8e9aa352cb588bda05d: Status 404 returned error can't find the container with id 026253c202665fb7c46ab074f5a744e2e7cfc90ae8d4e8e9aa352cb588bda05d Jun 08 16:48:05.225149 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:05.225108 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39f5a916-a88c-4539-a49d-ac446548636f-metrics-tls\") pod \"dns-default-k75p9\" (UID: \"39f5a916-a88c-4539-a49d-ac446548636f\") " pod="openshift-dns/dns-default-k75p9" Jun 08 16:48:05.225345 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:48:05.225273 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 16:48:05.225345 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:48:05.225340 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39f5a916-a88c-4539-a49d-ac446548636f-metrics-tls podName:39f5a916-a88c-4539-a49d-ac446548636f nodeName:}" failed. No retries permitted until 2026-06-08 16:48:07.225322982 +0000 UTC m=+39.122100434 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/39f5a916-a88c-4539-a49d-ac446548636f-metrics-tls") pod "dns-default-k75p9" (UID: "39f5a916-a88c-4539-a49d-ac446548636f") : secret "dns-default-metrics-tls" not found Jun 08 16:48:05.697640 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:05.697606 2579 generic.go:356] "Generic (PLEG): container finished" podID="a00cfd6c-ccf8-4a08-94d8-1d08c4233bef" containerID="a9c76f057e31c26dcf6197579addbf7e2003576ef68f0b6d175c517a9e39e72a" exitCode=0 Jun 08 16:48:05.697815 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:05.697689 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tpm7n" event={"ID":"a00cfd6c-ccf8-4a08-94d8-1d08c4233bef","Type":"ContainerDied","Data":"a9c76f057e31c26dcf6197579addbf7e2003576ef68f0b6d175c517a9e39e72a"} Jun 08 16:48:05.699079 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:05.699055 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pjgts" event={"ID":"0015697c-c802-48e9-8fba-511d0f7be4e7","Type":"ContainerStarted","Data":"026253c202665fb7c46ab074f5a744e2e7cfc90ae8d4e8e9aa352cb588bda05d"} Jun 08 16:48:05.939140 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:05.938939 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:05.992438 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:05.992409 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:06.705546 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:06.705504 2579 generic.go:356] "Generic (PLEG): container finished" podID="a00cfd6c-ccf8-4a08-94d8-1d08c4233bef" containerID="2504c1a05c516f3314c037f9f0ec3e1bdb4530b27a5123280908b293dd4fbc79" exitCode=0 Jun 08 16:48:06.705546 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:06.705551 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tpm7n" event={"ID":"a00cfd6c-ccf8-4a08-94d8-1d08c4233bef","Type":"ContainerDied","Data":"2504c1a05c516f3314c037f9f0ec3e1bdb4530b27a5123280908b293dd4fbc79"} Jun 08 16:48:07.241338 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:07.241293 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39f5a916-a88c-4539-a49d-ac446548636f-metrics-tls\") pod \"dns-default-k75p9\" (UID: \"39f5a916-a88c-4539-a49d-ac446548636f\") " pod="openshift-dns/dns-default-k75p9" Jun 08 16:48:07.242162 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:48:07.241464 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 16:48:07.242162 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:48:07.241539 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39f5a916-a88c-4539-a49d-ac446548636f-metrics-tls podName:39f5a916-a88c-4539-a49d-ac446548636f nodeName:}" failed. No retries permitted until 2026-06-08 16:48:11.241521048 +0000 UTC m=+43.138298514 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/39f5a916-a88c-4539-a49d-ac446548636f-metrics-tls") pod "dns-default-k75p9" (UID: "39f5a916-a88c-4539-a49d-ac446548636f") : secret "dns-default-metrics-tls" not found Jun 08 16:48:07.519906 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:07.519802 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:07.619589 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:07.619551 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:07.710757 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:07.710727 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tpm7n" event={"ID":"a00cfd6c-ccf8-4a08-94d8-1d08c4233bef","Type":"ContainerStarted","Data":"50a6e9b0650af344615806e85183d79895137a39c17282721b96788337cc5a7f"} Jun 08 16:48:07.712102 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:07.712081 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pjgts" event={"ID":"0015697c-c802-48e9-8fba-511d0f7be4e7","Type":"ContainerStarted","Data":"8eb16b74d98295b282348df08fa29d4182f0285f7ff14efb401f610a68f377f3"} Jun 08 16:48:07.735022 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:07.734981 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tpm7n" podStartSLOduration=10.651324843 podStartE2EDuration="39.734969107s" totalImagesPullingTime="29.083644264s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 16:47:28 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:48:07.734297455 +0000 UTC m=+39.631074930" watchObservedRunningTime="2026-06-08 16:48:07.734969107 +0000 UTC m=+39.631746603" Jun 08 16:48:07.751352 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:07.751314 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pjgts" podStartSLOduration=2.680184771 podStartE2EDuration="4.751301017s" totalImagesPullingTime="2.071116246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:48:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:48:07.750904213 +0000 UTC m=+39.647681688" watchObservedRunningTime="2026-06-08 16:48:07.751301017 +0000 UTC m=+39.648078495" Jun 08 16:48:07.860407 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:07.860374 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:07.921490 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:07.921458 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:11.268943 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:11.268911 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39f5a916-a88c-4539-a49d-ac446548636f-metrics-tls\") pod \"dns-default-k75p9\" (UID: \"39f5a916-a88c-4539-a49d-ac446548636f\") " pod="openshift-dns/dns-default-k75p9" Jun 08 16:48:11.269399 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:48:11.269032 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 16:48:11.269399 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:48:11.269086 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39f5a916-a88c-4539-a49d-ac446548636f-metrics-tls podName:39f5a916-a88c-4539-a49d-ac446548636f nodeName:}" failed. No retries permitted until 2026-06-08 16:48:19.269072844 +0000 UTC m=+51.165850297 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/39f5a916-a88c-4539-a49d-ac446548636f-metrics-tls") pod "dns-default-k75p9" (UID: "39f5a916-a88c-4539-a49d-ac446548636f") : secret "dns-default-metrics-tls" not found Jun 08 16:48:11.599408 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:11.599378 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:15.188505 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:15.188459 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:15.289059 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:15.289028 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:15.437896 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:15.437863 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:15.497545 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:15.497434 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:16.064680 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:16.064641 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:16.165197 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:16.165156 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:19.324151 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:19.324110 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39f5a916-a88c-4539-a49d-ac446548636f-metrics-tls\") pod \"dns-default-k75p9\" (UID: \"39f5a916-a88c-4539-a49d-ac446548636f\") " pod="openshift-dns/dns-default-k75p9" Jun 08 16:48:19.324619 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:48:19.324284 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 16:48:19.324619 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:48:19.324361 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39f5a916-a88c-4539-a49d-ac446548636f-metrics-tls podName:39f5a916-a88c-4539-a49d-ac446548636f nodeName:}" failed. No retries permitted until 2026-06-08 16:48:35.324345397 +0000 UTC m=+67.221122849 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/39f5a916-a88c-4539-a49d-ac446548636f-metrics-tls") pod "dns-default-k75p9" (UID: "39f5a916-a88c-4539-a49d-ac446548636f") : secret "dns-default-metrics-tls" not found Jun 08 16:48:28.688766 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:28.688738 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vkrbj" Jun 08 16:48:28.847337 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:28.847300 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:28.907438 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:28.907397 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:34.220601 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:34.220562 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ee7062a-14dc-4eba-8adb-3c93000940f1-original-pull-secret\") pod \"global-pull-secret-syncer-8d9t8\" (UID: \"5ee7062a-14dc-4eba-8adb-3c93000940f1\") " pod="kube-system/global-pull-secret-syncer-8d9t8" Jun 08 16:48:34.223759 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:34.223742 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 16:48:34.234004 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:34.233982 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ee7062a-14dc-4eba-8adb-3c93000940f1-original-pull-secret\") pod \"global-pull-secret-syncer-8d9t8\" (UID: \"5ee7062a-14dc-4eba-8adb-3c93000940f1\") " pod="kube-system/global-pull-secret-syncer-8d9t8" Jun 08 16:48:34.321294 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:34.321268 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc8ed935-c565-44cd-93bf-b2699dd09b1b-metrics-certs\") pod \"network-metrics-daemon-52225\" (UID: \"cc8ed935-c565-44cd-93bf-b2699dd09b1b\") " pod="openshift-multus/network-metrics-daemon-52225" Jun 08 16:48:34.323975 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:34.323957 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 16:48:34.332191 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:48:34.332175 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 16:48:34.332296 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:48:34.332268 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc8ed935-c565-44cd-93bf-b2699dd09b1b-metrics-certs podName:cc8ed935-c565-44cd-93bf-b2699dd09b1b nodeName:}" failed. No retries permitted until 2026-06-08 16:49:38.332228268 +0000 UTC m=+130.229005738 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cc8ed935-c565-44cd-93bf-b2699dd09b1b-metrics-certs") pod "network-metrics-daemon-52225" (UID: "cc8ed935-c565-44cd-93bf-b2699dd09b1b") : secret "metrics-daemon-secret" not found Jun 08 16:48:34.422521 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:34.422494 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vdxd\" (UniqueName: \"kubernetes.io/projected/7f09988e-c137-49af-8f80-a100a01cc2c0-kube-api-access-5vdxd\") pod \"network-check-target-hp28s\" (UID: \"7f09988e-c137-49af-8f80-a100a01cc2c0\") " pod="openshift-network-diagnostics/network-check-target-hp28s" Jun 08 16:48:34.425411 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:34.425395 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 16:48:34.431605 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:34.431591 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8d9t8" Jun 08 16:48:34.435081 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:34.435060 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 16:48:34.445754 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:34.445736 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vdxd\" (UniqueName: \"kubernetes.io/projected/7f09988e-c137-49af-8f80-a100a01cc2c0-kube-api-access-5vdxd\") pod \"network-check-target-hp28s\" (UID: \"7f09988e-c137-49af-8f80-a100a01cc2c0\") " pod="openshift-network-diagnostics/network-check-target-hp28s" Jun 08 16:48:34.551004 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:34.550976 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8d9t8"] Jun 08 16:48:34.554377 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:48:34.554346 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ee7062a_14dc_4eba_8adb_3c93000940f1.slice/crio-b0d5a6e3276737c8194767a7199d85f35bcd87fbb4a441dc1ea18e79788fc9e2 WatchSource:0}: Error finding container b0d5a6e3276737c8194767a7199d85f35bcd87fbb4a441dc1ea18e79788fc9e2: Status 404 returned error can't find the container with id b0d5a6e3276737c8194767a7199d85f35bcd87fbb4a441dc1ea18e79788fc9e2 Jun 08 16:48:34.740911 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:34.740832 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rh7q7\"" Jun 08 16:48:34.748156 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:34.748130 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hp28s" Jun 08 16:48:34.773560 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:34.773532 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8d9t8" event={"ID":"5ee7062a-14dc-4eba-8adb-3c93000940f1","Type":"ContainerStarted","Data":"b0d5a6e3276737c8194767a7199d85f35bcd87fbb4a441dc1ea18e79788fc9e2"} Jun 08 16:48:34.872920 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:34.872890 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hp28s"] Jun 08 16:48:34.875465 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:48:34.875433 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f09988e_c137_49af_8f80_a100a01cc2c0.slice/crio-a88fd146b0de56487ce9dc91caf417f4c57f493f0200eae8a19760f1a11be8d4 WatchSource:0}: Error finding container a88fd146b0de56487ce9dc91caf417f4c57f493f0200eae8a19760f1a11be8d4: Status 404 returned error can't find the container with id a88fd146b0de56487ce9dc91caf417f4c57f493f0200eae8a19760f1a11be8d4 Jun 08 16:48:35.327939 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:35.327901 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39f5a916-a88c-4539-a49d-ac446548636f-metrics-tls\") pod \"dns-default-k75p9\" (UID: \"39f5a916-a88c-4539-a49d-ac446548636f\") " pod="openshift-dns/dns-default-k75p9" Jun 08 16:48:35.328445 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:48:35.328037 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 16:48:35.328445 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:48:35.328097 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39f5a916-a88c-4539-a49d-ac446548636f-metrics-tls podName:39f5a916-a88c-4539-a49d-ac446548636f nodeName:}" failed. No retries permitted until 2026-06-08 16:49:07.328080751 +0000 UTC m=+99.224858211 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/39f5a916-a88c-4539-a49d-ac446548636f-metrics-tls") pod "dns-default-k75p9" (UID: "39f5a916-a88c-4539-a49d-ac446548636f") : secret "dns-default-metrics-tls" not found Jun 08 16:48:35.777692 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:35.777596 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hp28s" event={"ID":"7f09988e-c137-49af-8f80-a100a01cc2c0","Type":"ContainerStarted","Data":"a88fd146b0de56487ce9dc91caf417f4c57f493f0200eae8a19760f1a11be8d4"} Jun 08 16:48:37.419801 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:37.419768 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:37.524136 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:37.524096 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:37.995863 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:37.995834 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-6k567"] Jun 08 16:48:38.009348 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.009323 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-557dd576b7-t4q2j"] Jun 08 16:48:38.009513 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.009492 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-6k567" Jun 08 16:48:38.012277 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.012174 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 08 16:48:38.012627 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.012602 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 08 16:48:38.013452 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.013029 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 08 16:48:38.013452 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.013229 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 08 16:48:38.013452 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.013347 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-vvprt\"" Jun 08 16:48:38.018689 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.018644 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 08 16:48:38.037621 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.037597 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-6k567"] Jun 08 16:48:38.037621 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.037630 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-557dd576b7-t4q2j"] Jun 08 16:48:38.037846 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.037719 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-557dd576b7-t4q2j" Jun 08 16:48:38.040255 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.040218 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 08 16:48:38.040351 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.040275 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 08 16:48:38.040571 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.040547 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 08 16:48:38.040672 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.040547 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 08 16:48:38.040672 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.040559 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-tqftv\"" Jun 08 16:48:38.040672 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.040660 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 08 16:48:38.040815 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.040757 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 08 16:48:38.047594 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.047574 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d71f42f1-6fe5-4ee6-a40c-4f1095961288-tmp\") pod \"insights-operator-896549976-6k567\" (UID: \"d71f42f1-6fe5-4ee6-a40c-4f1095961288\") " pod="openshift-insights/insights-operator-896549976-6k567" Jun 08 16:48:38.047665 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.047598 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d71f42f1-6fe5-4ee6-a40c-4f1095961288-snapshots\") pod \"insights-operator-896549976-6k567\" (UID: \"d71f42f1-6fe5-4ee6-a40c-4f1095961288\") " pod="openshift-insights/insights-operator-896549976-6k567" Jun 08 16:48:38.047665 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.047618 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d71f42f1-6fe5-4ee6-a40c-4f1095961288-serving-cert\") pod \"insights-operator-896549976-6k567\" (UID: \"d71f42f1-6fe5-4ee6-a40c-4f1095961288\") " pod="openshift-insights/insights-operator-896549976-6k567" Jun 08 16:48:38.047665 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.047636 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f9358ada-e6bb-40f0-a5ce-b8e2ecce889f-stats-auth\") pod \"router-default-557dd576b7-t4q2j\" (UID: \"f9358ada-e6bb-40f0-a5ce-b8e2ecce889f\") " pod="openshift-ingress/router-default-557dd576b7-t4q2j" Jun 08 16:48:38.047780 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.047692 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9358ada-e6bb-40f0-a5ce-b8e2ecce889f-metrics-certs\") pod \"router-default-557dd576b7-t4q2j\" (UID: \"f9358ada-e6bb-40f0-a5ce-b8e2ecce889f\") " pod="openshift-ingress/router-default-557dd576b7-t4q2j" Jun 08 16:48:38.047780 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.047745 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9358ada-e6bb-40f0-a5ce-b8e2ecce889f-service-ca-bundle\") pod \"router-default-557dd576b7-t4q2j\" (UID: \"f9358ada-e6bb-40f0-a5ce-b8e2ecce889f\") " pod="openshift-ingress/router-default-557dd576b7-t4q2j" Jun 08 16:48:38.047780 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.047767 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d71f42f1-6fe5-4ee6-a40c-4f1095961288-trusted-ca-bundle\") pod \"insights-operator-896549976-6k567\" (UID: \"d71f42f1-6fe5-4ee6-a40c-4f1095961288\") " pod="openshift-insights/insights-operator-896549976-6k567" Jun 08 16:48:38.047876 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.047791 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f9358ada-e6bb-40f0-a5ce-b8e2ecce889f-default-certificate\") pod \"router-default-557dd576b7-t4q2j\" (UID: \"f9358ada-e6bb-40f0-a5ce-b8e2ecce889f\") " pod="openshift-ingress/router-default-557dd576b7-t4q2j" Jun 08 16:48:38.047876 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.047811 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8lz7\" (UniqueName: \"kubernetes.io/projected/d71f42f1-6fe5-4ee6-a40c-4f1095961288-kube-api-access-q8lz7\") pod \"insights-operator-896549976-6k567\" (UID: \"d71f42f1-6fe5-4ee6-a40c-4f1095961288\") " pod="openshift-insights/insights-operator-896549976-6k567" Jun 08 16:48:38.047876 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.047865 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t4sd\" (UniqueName: \"kubernetes.io/projected/f9358ada-e6bb-40f0-a5ce-b8e2ecce889f-kube-api-access-7t4sd\") pod \"router-default-557dd576b7-t4q2j\" (UID: \"f9358ada-e6bb-40f0-a5ce-b8e2ecce889f\") " pod="openshift-ingress/router-default-557dd576b7-t4q2j" Jun 08 16:48:38.047967 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.047890 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d71f42f1-6fe5-4ee6-a40c-4f1095961288-service-ca-bundle\") pod \"insights-operator-896549976-6k567\" (UID: \"d71f42f1-6fe5-4ee6-a40c-4f1095961288\") " pod="openshift-insights/insights-operator-896549976-6k567" Jun 08 16:48:38.103655 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.103616 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-j2knr"] Jun 08 16:48:38.121993 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.121965 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-j2knr"] Jun 08 16:48:38.122165 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.122108 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-j2knr" Jun 08 16:48:38.125697 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.125669 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 08 16:48:38.126029 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.125757 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 08 16:48:38.126029 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.125811 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 08 16:48:38.126146 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.126057 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-tckv7\"" Jun 08 16:48:38.148169 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.148143 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9358ada-e6bb-40f0-a5ce-b8e2ecce889f-service-ca-bundle\") pod \"router-default-557dd576b7-t4q2j\" (UID: \"f9358ada-e6bb-40f0-a5ce-b8e2ecce889f\") " pod="openshift-ingress/router-default-557dd576b7-t4q2j" Jun 08 16:48:38.148319 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.148178 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d71f42f1-6fe5-4ee6-a40c-4f1095961288-trusted-ca-bundle\") pod \"insights-operator-896549976-6k567\" (UID: \"d71f42f1-6fe5-4ee6-a40c-4f1095961288\") " pod="openshift-insights/insights-operator-896549976-6k567" Jun 08 16:48:38.148319 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.148204 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f9358ada-e6bb-40f0-a5ce-b8e2ecce889f-default-certificate\") pod \"router-default-557dd576b7-t4q2j\" (UID: \"f9358ada-e6bb-40f0-a5ce-b8e2ecce889f\") " pod="openshift-ingress/router-default-557dd576b7-t4q2j" Jun 08 16:48:38.148319 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.148223 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8lz7\" (UniqueName: \"kubernetes.io/projected/d71f42f1-6fe5-4ee6-a40c-4f1095961288-kube-api-access-q8lz7\") pod \"insights-operator-896549976-6k567\" (UID: \"d71f42f1-6fe5-4ee6-a40c-4f1095961288\") " pod="openshift-insights/insights-operator-896549976-6k567" Jun 08 16:48:38.148319 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.148269 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvpzj\" (UniqueName: \"kubernetes.io/projected/380b2769-36cd-4c5e-945b-9435096f31f2-kube-api-access-wvpzj\") pod \"cluster-samples-operator-854f8b96b6-j2knr\" (UID: \"380b2769-36cd-4c5e-945b-9435096f31f2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-j2knr" Jun 08 16:48:38.148319 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.148300 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t4sd\" (UniqueName: \"kubernetes.io/projected/f9358ada-e6bb-40f0-a5ce-b8e2ecce889f-kube-api-access-7t4sd\") pod \"router-default-557dd576b7-t4q2j\" (UID: \"f9358ada-e6bb-40f0-a5ce-b8e2ecce889f\") " pod="openshift-ingress/router-default-557dd576b7-t4q2j" Jun 08 16:48:38.148597 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.148325 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d71f42f1-6fe5-4ee6-a40c-4f1095961288-service-ca-bundle\") pod \"insights-operator-896549976-6k567\" (UID: \"d71f42f1-6fe5-4ee6-a40c-4f1095961288\") " pod="openshift-insights/insights-operator-896549976-6k567" Jun 08 16:48:38.148597 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:48:38.148354 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f9358ada-e6bb-40f0-a5ce-b8e2ecce889f-service-ca-bundle podName:f9358ada-e6bb-40f0-a5ce-b8e2ecce889f nodeName:}" failed. No retries permitted until 2026-06-08 16:48:38.648332958 +0000 UTC m=+70.545110425 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f9358ada-e6bb-40f0-a5ce-b8e2ecce889f-service-ca-bundle") pod "router-default-557dd576b7-t4q2j" (UID: "f9358ada-e6bb-40f0-a5ce-b8e2ecce889f") : configmap references non-existent config key: service-ca.crt Jun 08 16:48:38.148597 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.148535 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d71f42f1-6fe5-4ee6-a40c-4f1095961288-tmp\") pod \"insights-operator-896549976-6k567\" (UID: \"d71f42f1-6fe5-4ee6-a40c-4f1095961288\") " pod="openshift-insights/insights-operator-896549976-6k567" Jun 08 16:48:38.148597 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.148566 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d71f42f1-6fe5-4ee6-a40c-4f1095961288-snapshots\") pod \"insights-operator-896549976-6k567\" (UID: \"d71f42f1-6fe5-4ee6-a40c-4f1095961288\") " pod="openshift-insights/insights-operator-896549976-6k567" Jun 08 16:48:38.148597 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.148595 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/380b2769-36cd-4c5e-945b-9435096f31f2-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-j2knr\" (UID: \"380b2769-36cd-4c5e-945b-9435096f31f2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-j2knr" Jun 08 16:48:38.148838 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.148626 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d71f42f1-6fe5-4ee6-a40c-4f1095961288-serving-cert\") pod \"insights-operator-896549976-6k567\" (UID: \"d71f42f1-6fe5-4ee6-a40c-4f1095961288\") " pod="openshift-insights/insights-operator-896549976-6k567" Jun 08 16:48:38.148838 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.148656 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f9358ada-e6bb-40f0-a5ce-b8e2ecce889f-stats-auth\") pod \"router-default-557dd576b7-t4q2j\" (UID: \"f9358ada-e6bb-40f0-a5ce-b8e2ecce889f\") " pod="openshift-ingress/router-default-557dd576b7-t4q2j" Jun 08 16:48:38.148838 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.148689 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9358ada-e6bb-40f0-a5ce-b8e2ecce889f-metrics-certs\") pod \"router-default-557dd576b7-t4q2j\" (UID: \"f9358ada-e6bb-40f0-a5ce-b8e2ecce889f\") " pod="openshift-ingress/router-default-557dd576b7-t4q2j" Jun 08 16:48:38.148959 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.148889 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d71f42f1-6fe5-4ee6-a40c-4f1095961288-tmp\") pod \"insights-operator-896549976-6k567\" (UID: \"d71f42f1-6fe5-4ee6-a40c-4f1095961288\") " pod="openshift-insights/insights-operator-896549976-6k567" Jun 08 16:48:38.148959 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:48:38.148934 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 16:48:38.149046 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:48:38.148996 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9358ada-e6bb-40f0-a5ce-b8e2ecce889f-metrics-certs podName:f9358ada-e6bb-40f0-a5ce-b8e2ecce889f nodeName:}" failed. No retries permitted until 2026-06-08 16:48:38.648979452 +0000 UTC m=+70.545756911 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f9358ada-e6bb-40f0-a5ce-b8e2ecce889f-metrics-certs") pod "router-default-557dd576b7-t4q2j" (UID: "f9358ada-e6bb-40f0-a5ce-b8e2ecce889f") : secret "router-metrics-certs-default" not found Jun 08 16:48:38.149305 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.149282 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d71f42f1-6fe5-4ee6-a40c-4f1095961288-snapshots\") pod \"insights-operator-896549976-6k567\" (UID: \"d71f42f1-6fe5-4ee6-a40c-4f1095961288\") " pod="openshift-insights/insights-operator-896549976-6k567" Jun 08 16:48:38.149305 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.149302 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d71f42f1-6fe5-4ee6-a40c-4f1095961288-trusted-ca-bundle\") pod \"insights-operator-896549976-6k567\" (UID: \"d71f42f1-6fe5-4ee6-a40c-4f1095961288\") " pod="openshift-insights/insights-operator-896549976-6k567" Jun 08 16:48:38.149788 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.149766 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d71f42f1-6fe5-4ee6-a40c-4f1095961288-service-ca-bundle\") pod \"insights-operator-896549976-6k567\" (UID: \"d71f42f1-6fe5-4ee6-a40c-4f1095961288\") " pod="openshift-insights/insights-operator-896549976-6k567" Jun 08 16:48:38.149992 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.149822 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:38.151174 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.151152 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f9358ada-e6bb-40f0-a5ce-b8e2ecce889f-default-certificate\") pod \"router-default-557dd576b7-t4q2j\" (UID: \"f9358ada-e6bb-40f0-a5ce-b8e2ecce889f\") " pod="openshift-ingress/router-default-557dd576b7-t4q2j" Jun 08 16:48:38.151393 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.151377 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d71f42f1-6fe5-4ee6-a40c-4f1095961288-serving-cert\") pod \"insights-operator-896549976-6k567\" (UID: \"d71f42f1-6fe5-4ee6-a40c-4f1095961288\") " pod="openshift-insights/insights-operator-896549976-6k567" Jun 08 16:48:38.151563 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.151535 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f9358ada-e6bb-40f0-a5ce-b8e2ecce889f-stats-auth\") pod \"router-default-557dd576b7-t4q2j\" (UID: \"f9358ada-e6bb-40f0-a5ce-b8e2ecce889f\") " pod="openshift-ingress/router-default-557dd576b7-t4q2j" Jun 08 16:48:38.160134 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.160111 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t4sd\" (UniqueName: \"kubernetes.io/projected/f9358ada-e6bb-40f0-a5ce-b8e2ecce889f-kube-api-access-7t4sd\") pod \"router-default-557dd576b7-t4q2j\" (UID: \"f9358ada-e6bb-40f0-a5ce-b8e2ecce889f\") " pod="openshift-ingress/router-default-557dd576b7-t4q2j" Jun 08 16:48:38.160906 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.160884 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8lz7\" (UniqueName: \"kubernetes.io/projected/d71f42f1-6fe5-4ee6-a40c-4f1095961288-kube-api-access-q8lz7\") pod \"insights-operator-896549976-6k567\" (UID: \"d71f42f1-6fe5-4ee6-a40c-4f1095961288\") " pod="openshift-insights/insights-operator-896549976-6k567" Jun 08 16:48:38.225686 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.225642 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:38.249123 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.249088 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/380b2769-36cd-4c5e-945b-9435096f31f2-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-j2knr\" (UID: \"380b2769-36cd-4c5e-945b-9435096f31f2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-j2knr" Jun 08 16:48:38.249223 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.249205 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvpzj\" (UniqueName: \"kubernetes.io/projected/380b2769-36cd-4c5e-945b-9435096f31f2-kube-api-access-wvpzj\") pod \"cluster-samples-operator-854f8b96b6-j2knr\" (UID: \"380b2769-36cd-4c5e-945b-9435096f31f2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-j2knr" Jun 08 16:48:38.249622 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:48:38.249580 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 16:48:38.249722 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:48:38.249688 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/380b2769-36cd-4c5e-945b-9435096f31f2-samples-operator-tls podName:380b2769-36cd-4c5e-945b-9435096f31f2 nodeName:}" failed. No retries permitted until 2026-06-08 16:48:38.74966604 +0000 UTC m=+70.646443495 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/380b2769-36cd-4c5e-945b-9435096f31f2-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-j2knr" (UID: "380b2769-36cd-4c5e-945b-9435096f31f2") : secret "samples-operator-tls" not found Jun 08 16:48:38.263379 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.263357 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvpzj\" (UniqueName: \"kubernetes.io/projected/380b2769-36cd-4c5e-945b-9435096f31f2-kube-api-access-wvpzj\") pod \"cluster-samples-operator-854f8b96b6-j2knr\" (UID: \"380b2769-36cd-4c5e-945b-9435096f31f2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-j2knr" Jun 08 16:48:38.320704 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.320675 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-6k567" Jun 08 16:48:38.462361 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.462326 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-6k567"] Jun 08 16:48:38.467195 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:48:38.467173 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd71f42f1_6fe5_4ee6_a40c_4f1095961288.slice/crio-cced0580b7acc6504e6636086805463b70896b528830b7e6b8e392cb44e908fb WatchSource:0}: Error finding container cced0580b7acc6504e6636086805463b70896b528830b7e6b8e392cb44e908fb: Status 404 returned error can't find the container with id cced0580b7acc6504e6636086805463b70896b528830b7e6b8e392cb44e908fb Jun 08 16:48:38.652739 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.652703 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9358ada-e6bb-40f0-a5ce-b8e2ecce889f-metrics-certs\") pod \"router-default-557dd576b7-t4q2j\" (UID: \"f9358ada-e6bb-40f0-a5ce-b8e2ecce889f\") " pod="openshift-ingress/router-default-557dd576b7-t4q2j" Jun 08 16:48:38.652927 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.652757 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9358ada-e6bb-40f0-a5ce-b8e2ecce889f-service-ca-bundle\") pod \"router-default-557dd576b7-t4q2j\" (UID: \"f9358ada-e6bb-40f0-a5ce-b8e2ecce889f\") " pod="openshift-ingress/router-default-557dd576b7-t4q2j" Jun 08 16:48:38.652927 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:48:38.652880 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 16:48:38.652927 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:48:38.652897 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f9358ada-e6bb-40f0-a5ce-b8e2ecce889f-service-ca-bundle podName:f9358ada-e6bb-40f0-a5ce-b8e2ecce889f nodeName:}" failed. No retries permitted until 2026-06-08 16:48:39.652877992 +0000 UTC m=+71.549655462 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f9358ada-e6bb-40f0-a5ce-b8e2ecce889f-service-ca-bundle") pod "router-default-557dd576b7-t4q2j" (UID: "f9358ada-e6bb-40f0-a5ce-b8e2ecce889f") : configmap references non-existent config key: service-ca.crt Jun 08 16:48:38.653078 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:48:38.652942 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9358ada-e6bb-40f0-a5ce-b8e2ecce889f-metrics-certs podName:f9358ada-e6bb-40f0-a5ce-b8e2ecce889f nodeName:}" failed. No retries permitted until 2026-06-08 16:48:39.652924917 +0000 UTC m=+71.549702370 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f9358ada-e6bb-40f0-a5ce-b8e2ecce889f-metrics-certs") pod "router-default-557dd576b7-t4q2j" (UID: "f9358ada-e6bb-40f0-a5ce-b8e2ecce889f") : secret "router-metrics-certs-default" not found Jun 08 16:48:38.753877 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.753844 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/380b2769-36cd-4c5e-945b-9435096f31f2-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-j2knr\" (UID: \"380b2769-36cd-4c5e-945b-9435096f31f2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-j2knr" Jun 08 16:48:38.754033 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:48:38.753989 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 16:48:38.754079 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:48:38.754055 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/380b2769-36cd-4c5e-945b-9435096f31f2-samples-operator-tls podName:380b2769-36cd-4c5e-945b-9435096f31f2 nodeName:}" failed. No retries permitted until 2026-06-08 16:48:39.754040319 +0000 UTC m=+71.650817772 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/380b2769-36cd-4c5e-945b-9435096f31f2-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-j2knr" (UID: "380b2769-36cd-4c5e-945b-9435096f31f2") : secret "samples-operator-tls" not found Jun 08 16:48:38.785895 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.785853 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-6k567" event={"ID":"d71f42f1-6fe5-4ee6-a40c-4f1095961288","Type":"ContainerStarted","Data":"cced0580b7acc6504e6636086805463b70896b528830b7e6b8e392cb44e908fb"} Jun 08 16:48:38.787213 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.787189 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hp28s" event={"ID":"7f09988e-c137-49af-8f80-a100a01cc2c0","Type":"ContainerStarted","Data":"5a1da2fb05073aa1c896f51fdbe5b748b8bad38dc0e8569e9c6e7c72c55b18f0"} Jun 08 16:48:38.787389 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.787371 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hp28s" Jun 08 16:48:38.805038 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:38.804992 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hp28s" podStartSLOduration=67.481014395 podStartE2EDuration="1m10.804979557s" totalImagesPullingTime="3.323965162s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:47:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:48:38.804339999 +0000 UTC m=+70.701117475" watchObservedRunningTime="2026-06-08 16:48:38.804979557 +0000 UTC m=+70.701757032" Jun 08 16:48:39.660743 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:39.660699 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9358ada-e6bb-40f0-a5ce-b8e2ecce889f-metrics-certs\") pod \"router-default-557dd576b7-t4q2j\" (UID: \"f9358ada-e6bb-40f0-a5ce-b8e2ecce889f\") " pod="openshift-ingress/router-default-557dd576b7-t4q2j" Jun 08 16:48:39.661215 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:39.660752 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9358ada-e6bb-40f0-a5ce-b8e2ecce889f-service-ca-bundle\") pod \"router-default-557dd576b7-t4q2j\" (UID: \"f9358ada-e6bb-40f0-a5ce-b8e2ecce889f\") " pod="openshift-ingress/router-default-557dd576b7-t4q2j" Jun 08 16:48:39.661215 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:48:39.660873 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 16:48:39.661215 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:48:39.660906 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f9358ada-e6bb-40f0-a5ce-b8e2ecce889f-service-ca-bundle podName:f9358ada-e6bb-40f0-a5ce-b8e2ecce889f nodeName:}" failed. No retries permitted until 2026-06-08 16:48:41.660889216 +0000 UTC m=+73.557666683 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f9358ada-e6bb-40f0-a5ce-b8e2ecce889f-service-ca-bundle") pod "router-default-557dd576b7-t4q2j" (UID: "f9358ada-e6bb-40f0-a5ce-b8e2ecce889f") : configmap references non-existent config key: service-ca.crt Jun 08 16:48:39.661215 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:48:39.660958 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9358ada-e6bb-40f0-a5ce-b8e2ecce889f-metrics-certs podName:f9358ada-e6bb-40f0-a5ce-b8e2ecce889f nodeName:}" failed. No retries permitted until 2026-06-08 16:48:41.660937374 +0000 UTC m=+73.557714848 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f9358ada-e6bb-40f0-a5ce-b8e2ecce889f-metrics-certs") pod "router-default-557dd576b7-t4q2j" (UID: "f9358ada-e6bb-40f0-a5ce-b8e2ecce889f") : secret "router-metrics-certs-default" not found Jun 08 16:48:39.761900 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:39.761867 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/380b2769-36cd-4c5e-945b-9435096f31f2-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-j2knr\" (UID: \"380b2769-36cd-4c5e-945b-9435096f31f2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-j2knr" Jun 08 16:48:39.762071 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:48:39.762051 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 16:48:39.762145 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:48:39.762133 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/380b2769-36cd-4c5e-945b-9435096f31f2-samples-operator-tls podName:380b2769-36cd-4c5e-945b-9435096f31f2 nodeName:}" failed. No retries permitted until 2026-06-08 16:48:41.762112641 +0000 UTC m=+73.658890096 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/380b2769-36cd-4c5e-945b-9435096f31f2-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-j2knr" (UID: "380b2769-36cd-4c5e-945b-9435096f31f2") : secret "samples-operator-tls" not found Jun 08 16:48:40.286365 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:40.286309 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:40.341507 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:40.341464 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:41.678785 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:41.678737 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9358ada-e6bb-40f0-a5ce-b8e2ecce889f-metrics-certs\") pod \"router-default-557dd576b7-t4q2j\" (UID: \"f9358ada-e6bb-40f0-a5ce-b8e2ecce889f\") " pod="openshift-ingress/router-default-557dd576b7-t4q2j" Jun 08 16:48:41.678785 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:41.678781 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9358ada-e6bb-40f0-a5ce-b8e2ecce889f-service-ca-bundle\") pod \"router-default-557dd576b7-t4q2j\" (UID: \"f9358ada-e6bb-40f0-a5ce-b8e2ecce889f\") " pod="openshift-ingress/router-default-557dd576b7-t4q2j" Jun 08 16:48:41.679301 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:48:41.678916 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f9358ada-e6bb-40f0-a5ce-b8e2ecce889f-service-ca-bundle podName:f9358ada-e6bb-40f0-a5ce-b8e2ecce889f nodeName:}" failed. No retries permitted until 2026-06-08 16:48:45.678901291 +0000 UTC m=+77.575678745 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f9358ada-e6bb-40f0-a5ce-b8e2ecce889f-service-ca-bundle") pod "router-default-557dd576b7-t4q2j" (UID: "f9358ada-e6bb-40f0-a5ce-b8e2ecce889f") : configmap references non-existent config key: service-ca.crt Jun 08 16:48:41.679301 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:48:41.678937 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 16:48:41.679301 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:48:41.679015 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9358ada-e6bb-40f0-a5ce-b8e2ecce889f-metrics-certs podName:f9358ada-e6bb-40f0-a5ce-b8e2ecce889f nodeName:}" failed. No retries permitted until 2026-06-08 16:48:45.678997984 +0000 UTC m=+77.575775445 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f9358ada-e6bb-40f0-a5ce-b8e2ecce889f-metrics-certs") pod "router-default-557dd576b7-t4q2j" (UID: "f9358ada-e6bb-40f0-a5ce-b8e2ecce889f") : secret "router-metrics-certs-default" not found Jun 08 16:48:41.779971 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:41.779937 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/380b2769-36cd-4c5e-945b-9435096f31f2-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-j2knr\" (UID: \"380b2769-36cd-4c5e-945b-9435096f31f2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-j2knr" Jun 08 16:48:41.780116 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:48:41.780092 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 16:48:41.780170 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:48:41.780160 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/380b2769-36cd-4c5e-945b-9435096f31f2-samples-operator-tls podName:380b2769-36cd-4c5e-945b-9435096f31f2 nodeName:}" failed. No retries permitted until 2026-06-08 16:48:45.780146478 +0000 UTC m=+77.676923930 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/380b2769-36cd-4c5e-945b-9435096f31f2-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-j2knr" (UID: "380b2769-36cd-4c5e-945b-9435096f31f2") : secret "samples-operator-tls" not found Jun 08 16:48:41.797749 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:41.797720 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-6k567" event={"ID":"d71f42f1-6fe5-4ee6-a40c-4f1095961288","Type":"ContainerStarted","Data":"c014dc1d14cff10b875ce5466c5cdf607328af58c481f4c3401b084037eda802"} Jun 08 16:48:41.799216 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:41.799193 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8d9t8" event={"ID":"5ee7062a-14dc-4eba-8adb-3c93000940f1","Type":"ContainerStarted","Data":"ff469584fbc17e7d35827bce234c4610e1af33b67137cb72008329015f2cd0f7"} Jun 08 16:48:41.815190 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:41.815149 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-6k567" podStartSLOduration=2.145852461 podStartE2EDuration="4.815136277s" totalImagesPullingTime="2.669283816s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:48:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:48:41.814336272 +0000 UTC m=+73.711113748" watchObservedRunningTime="2026-06-08 16:48:41.815136277 +0000 UTC m=+73.711913751" Jun 08 16:48:41.829276 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:41.829207 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8d9t8" podStartSLOduration=67.241603413 podStartE2EDuration="1m13.829193697s" totalImagesPullingTime="6.587590284s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 16:47:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:48:41.828720662 +0000 UTC m=+73.725498135" watchObservedRunningTime="2026-06-08 16:48:41.829193697 +0000 UTC m=+73.725971171" Jun 08 16:48:42.241683 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:42.241649 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:42.296282 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:42.296229 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:42.471965 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:42.471919 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:42.527709 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:42.527616 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:42.628351 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:42.628320 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:44.000866 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:44.000843 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9bmtp_2d4b91d7-69b6-4cb8-821c-6313ccdae4fe/dns-node-resolver/0.log" Jun 08 16:48:44.513857 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:44.513816 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:44.614455 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:44.614405 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:45.000317 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:45.000290 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jvrlj_5690029c-2d74-407e-9f78-f55d7a9d216b/node-ca/0.log" Jun 08 16:48:45.275773 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:45.275679 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:45.710100 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:45.710065 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9358ada-e6bb-40f0-a5ce-b8e2ecce889f-metrics-certs\") pod \"router-default-557dd576b7-t4q2j\" (UID: \"f9358ada-e6bb-40f0-a5ce-b8e2ecce889f\") " pod="openshift-ingress/router-default-557dd576b7-t4q2j" Jun 08 16:48:45.710100 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:45.710105 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9358ada-e6bb-40f0-a5ce-b8e2ecce889f-service-ca-bundle\") pod \"router-default-557dd576b7-t4q2j\" (UID: \"f9358ada-e6bb-40f0-a5ce-b8e2ecce889f\") " pod="openshift-ingress/router-default-557dd576b7-t4q2j" Jun 08 16:48:45.710347 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:48:45.710224 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 16:48:45.710347 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:48:45.710268 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f9358ada-e6bb-40f0-a5ce-b8e2ecce889f-service-ca-bundle podName:f9358ada-e6bb-40f0-a5ce-b8e2ecce889f nodeName:}" failed. No retries permitted until 2026-06-08 16:48:53.710233128 +0000 UTC m=+85.607010580 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f9358ada-e6bb-40f0-a5ce-b8e2ecce889f-service-ca-bundle") pod "router-default-557dd576b7-t4q2j" (UID: "f9358ada-e6bb-40f0-a5ce-b8e2ecce889f") : configmap references non-existent config key: service-ca.crt Jun 08 16:48:45.710347 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:48:45.710327 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9358ada-e6bb-40f0-a5ce-b8e2ecce889f-metrics-certs podName:f9358ada-e6bb-40f0-a5ce-b8e2ecce889f nodeName:}" failed. No retries permitted until 2026-06-08 16:48:53.71030859 +0000 UTC m=+85.607086059 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f9358ada-e6bb-40f0-a5ce-b8e2ecce889f-metrics-certs") pod "router-default-557dd576b7-t4q2j" (UID: "f9358ada-e6bb-40f0-a5ce-b8e2ecce889f") : secret "router-metrics-certs-default" not found Jun 08 16:48:45.714230 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:45.714193 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:45.800092 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:45.800063 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pjgts_0015697c-c802-48e9-8fba-511d0f7be4e7/serve-healthcheck-canary/0.log" Jun 08 16:48:45.810732 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:45.810710 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/380b2769-36cd-4c5e-945b-9435096f31f2-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-j2knr\" (UID: \"380b2769-36cd-4c5e-945b-9435096f31f2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-j2knr" Jun 08 16:48:45.810857 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:48:45.810844 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 16:48:45.810916 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:48:45.810907 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/380b2769-36cd-4c5e-945b-9435096f31f2-samples-operator-tls podName:380b2769-36cd-4c5e-945b-9435096f31f2 nodeName:}" failed. No retries permitted until 2026-06-08 16:48:53.810893657 +0000 UTC m=+85.707671113 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/380b2769-36cd-4c5e-945b-9435096f31f2-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-j2knr" (UID: "380b2769-36cd-4c5e-945b-9435096f31f2") : secret "samples-operator-tls" not found Jun 08 16:48:45.977881 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:45.977806 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:46.078469 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:46.078420 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:47.614462 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:47.614427 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:47.671613 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:47.671583 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:48.501907 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:48.501856 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:48.848932 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:48.848899 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:48.949225 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:48.949198 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:49.050027 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:49.050000 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:49.155922 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:49.155828 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:49.218473 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:49.218439 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:49.351962 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:49.351933 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:49.749195 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:49.749157 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:50.155657 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:50.155624 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:50.944721 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:50.944682 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:51.154918 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:51.154880 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:51.272832 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:51.272746 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:51.557309 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:51.557207 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:51.623722 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:51.623691 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:51.744783 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:51.744751 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:52.350412 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:52.350380 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:52.541903 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:52.541870 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:52.661519 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:52.661453 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:52.962891 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:52.962828 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:53.148862 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:53.148834 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:53.548970 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:53.548935 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:53.649824 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:53.649795 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:53.749946 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:53.749914 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:53.765908 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:53.765880 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9358ada-e6bb-40f0-a5ce-b8e2ecce889f-metrics-certs\") pod \"router-default-557dd576b7-t4q2j\" (UID: \"f9358ada-e6bb-40f0-a5ce-b8e2ecce889f\") " pod="openshift-ingress/router-default-557dd576b7-t4q2j" Jun 08 16:48:53.765984 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:53.765916 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9358ada-e6bb-40f0-a5ce-b8e2ecce889f-service-ca-bundle\") pod \"router-default-557dd576b7-t4q2j\" (UID: \"f9358ada-e6bb-40f0-a5ce-b8e2ecce889f\") " pod="openshift-ingress/router-default-557dd576b7-t4q2j" Jun 08 16:48:53.766038 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:48:53.766027 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f9358ada-e6bb-40f0-a5ce-b8e2ecce889f-service-ca-bundle podName:f9358ada-e6bb-40f0-a5ce-b8e2ecce889f nodeName:}" failed. No retries permitted until 2026-06-08 16:49:09.766012969 +0000 UTC m=+101.662790423 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f9358ada-e6bb-40f0-a5ce-b8e2ecce889f-service-ca-bundle") pod "router-default-557dd576b7-t4q2j" (UID: "f9358ada-e6bb-40f0-a5ce-b8e2ecce889f") : configmap references non-existent config key: service-ca.crt Jun 08 16:48:53.768332 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:53.768312 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9358ada-e6bb-40f0-a5ce-b8e2ecce889f-metrics-certs\") pod \"router-default-557dd576b7-t4q2j\" (UID: \"f9358ada-e6bb-40f0-a5ce-b8e2ecce889f\") " pod="openshift-ingress/router-default-557dd576b7-t4q2j" Jun 08 16:48:53.866925 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:53.866890 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/380b2769-36cd-4c5e-945b-9435096f31f2-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-j2knr\" (UID: \"380b2769-36cd-4c5e-945b-9435096f31f2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-j2knr" Jun 08 16:48:53.869385 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:53.869364 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/380b2769-36cd-4c5e-945b-9435096f31f2-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-j2knr\" (UID: \"380b2769-36cd-4c5e-945b-9435096f31f2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-j2knr" Jun 08 16:48:54.032488 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:54.032449 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-j2knr" Jun 08 16:48:54.159023 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:54.158995 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-j2knr"] Jun 08 16:48:54.349042 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:54.349007 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:54.724933 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:54.724899 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:54.777022 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:54.776986 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:54.833578 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:54.833545 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-j2knr" event={"ID":"380b2769-36cd-4c5e-945b-9435096f31f2","Type":"ContainerStarted","Data":"2e1c222c003728847c75597943d444656e8a8ae1a1d40c556d9149dcde8a4f7f"} Jun 08 16:48:54.956116 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:54.955987 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:55.290669 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:55.290634 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:55.390159 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:55.390080 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:55.749503 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:55.749453 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:55.838771 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:55.838740 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-j2knr" event={"ID":"380b2769-36cd-4c5e-945b-9435096f31f2","Type":"ContainerStarted","Data":"e364667ca195f740d6597e50372f057a076ce810f78a8895e0c04897acfe90e7"} Jun 08 16:48:56.142936 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:56.142905 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:56.253891 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:56.253855 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:56.753879 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:56.753838 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:56.843701 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:56.843663 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-j2knr" event={"ID":"380b2769-36cd-4c5e-945b-9435096f31f2","Type":"ContainerStarted","Data":"73d6e2c60128d6064e19784eaa586f856a5024dc0f9ed833c5469941fe9b44d2"} Jun 08 16:48:56.862210 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:56.862158 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-j2knr" podStartSLOduration=17.309201619 podStartE2EDuration="18.862141692s" totalImagesPullingTime="1.552940073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:48:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:48:56.860528549 +0000 UTC m=+88.757306051" watchObservedRunningTime="2026-06-08 16:48:56.862141692 +0000 UTC m=+88.758919145" Jun 08 16:48:56.948254 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:56.948215 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:57.349651 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:57.349607 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:57.941020 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:57.940981 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:58.003350 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:58.003317 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:58.357457 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:58.357423 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:58.748020 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:58.747937 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:59.142805 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:59.142773 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:59.347981 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:59.347947 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:48:59.552513 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:48:59.552418 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:07.370103 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:07.370070 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39f5a916-a88c-4539-a49d-ac446548636f-metrics-tls\") pod \"dns-default-k75p9\" (UID: \"39f5a916-a88c-4539-a49d-ac446548636f\") " pod="openshift-dns/dns-default-k75p9" Jun 08 16:49:07.372466 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:07.372444 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39f5a916-a88c-4539-a49d-ac446548636f-metrics-tls\") pod \"dns-default-k75p9\" (UID: \"39f5a916-a88c-4539-a49d-ac446548636f\") " pod="openshift-dns/dns-default-k75p9" Jun 08 16:49:07.388771 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:07.388748 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-m9sqz\"" Jun 08 16:49:07.396314 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:07.396296 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-k75p9" Jun 08 16:49:07.521373 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:07.521343 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-k75p9"] Jun 08 16:49:07.524180 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:49:07.524159 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39f5a916_a88c_4539_a49d_ac446548636f.slice/crio-1e365a0638592412d7d75a09fa2ffcf92e51ee5cd351a29ca947b32a62292945 WatchSource:0}: Error finding container 1e365a0638592412d7d75a09fa2ffcf92e51ee5cd351a29ca947b32a62292945: Status 404 returned error can't find the container with id 1e365a0638592412d7d75a09fa2ffcf92e51ee5cd351a29ca947b32a62292945 Jun 08 16:49:07.877612 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:07.877576 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-k75p9" event={"ID":"39f5a916-a88c-4539-a49d-ac446548636f","Type":"ContainerStarted","Data":"1e365a0638592412d7d75a09fa2ffcf92e51ee5cd351a29ca947b32a62292945"} Jun 08 16:49:09.326145 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.326087 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7f959567c7-ctsqs"] Jun 08 16:49:09.329821 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.329805 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f959567c7-ctsqs" Jun 08 16:49:09.332391 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.332340 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 08 16:49:09.332492 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.332417 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 08 16:49:09.332492 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.332450 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cmbff\"" Jun 08 16:49:09.333463 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.333400 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 08 16:49:09.338708 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.338691 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 08 16:49:09.343695 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.343676 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7f959567c7-ctsqs"] Jun 08 16:49:09.386711 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.386681 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7f959567c7-ctsqs"] Jun 08 16:49:09.386863 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.386727 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94mvp\" (UniqueName: \"kubernetes.io/projected/4f64b910-1d06-42c0-a217-596c9aa07eb5-kube-api-access-94mvp\") pod \"image-registry-7f959567c7-ctsqs\" (UID: \"4f64b910-1d06-42c0-a217-596c9aa07eb5\") " pod="openshift-image-registry/image-registry-7f959567c7-ctsqs" Jun 08 16:49:09.386863 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.386757 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4f64b910-1d06-42c0-a217-596c9aa07eb5-trusted-ca\") pod \"image-registry-7f959567c7-ctsqs\" (UID: \"4f64b910-1d06-42c0-a217-596c9aa07eb5\") " pod="openshift-image-registry/image-registry-7f959567c7-ctsqs" Jun 08 16:49:09.386863 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.386788 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f64b910-1d06-42c0-a217-596c9aa07eb5-registry-tls\") pod \"image-registry-7f959567c7-ctsqs\" (UID: \"4f64b910-1d06-42c0-a217-596c9aa07eb5\") " pod="openshift-image-registry/image-registry-7f959567c7-ctsqs" Jun 08 16:49:09.386863 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.386847 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4f64b910-1d06-42c0-a217-596c9aa07eb5-image-registry-private-configuration\") pod \"image-registry-7f959567c7-ctsqs\" (UID: \"4f64b910-1d06-42c0-a217-596c9aa07eb5\") " pod="openshift-image-registry/image-registry-7f959567c7-ctsqs" Jun 08 16:49:09.387032 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:49:09.386870 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-94mvp registry-certificates registry-tls trusted-ca], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-7f959567c7-ctsqs" podUID="4f64b910-1d06-42c0-a217-596c9aa07eb5" Jun 08 16:49:09.387032 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.386878 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4f64b910-1d06-42c0-a217-596c9aa07eb5-registry-certificates\") pod \"image-registry-7f959567c7-ctsqs\" (UID: \"4f64b910-1d06-42c0-a217-596c9aa07eb5\") " pod="openshift-image-registry/image-registry-7f959567c7-ctsqs" Jun 08 16:49:09.387032 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.386923 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4f64b910-1d06-42c0-a217-596c9aa07eb5-ca-trust-extracted\") pod \"image-registry-7f959567c7-ctsqs\" (UID: \"4f64b910-1d06-42c0-a217-596c9aa07eb5\") " pod="openshift-image-registry/image-registry-7f959567c7-ctsqs" Jun 08 16:49:09.387032 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.386963 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4f64b910-1d06-42c0-a217-596c9aa07eb5-installation-pull-secrets\") pod \"image-registry-7f959567c7-ctsqs\" (UID: \"4f64b910-1d06-42c0-a217-596c9aa07eb5\") " pod="openshift-image-registry/image-registry-7f959567c7-ctsqs" Jun 08 16:49:09.387032 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.386990 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f64b910-1d06-42c0-a217-596c9aa07eb5-bound-sa-token\") pod \"image-registry-7f959567c7-ctsqs\" (UID: \"4f64b910-1d06-42c0-a217-596c9aa07eb5\") " pod="openshift-image-registry/image-registry-7f959567c7-ctsqs" Jun 08 16:49:09.424439 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.424402 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-qndcr"] Jun 08 16:49:09.427640 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.427618 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5ddbb49fbf-qjj6g"] Jun 08 16:49:09.427785 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.427731 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qndcr" Jun 08 16:49:09.430426 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.430406 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5ddbb49fbf-qjj6g" Jun 08 16:49:09.430941 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.430926 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-r4xgg\"" Jun 08 16:49:09.431168 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.431155 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 08 16:49:09.431537 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.431522 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 08 16:49:09.441203 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.441181 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-qndcr"] Jun 08 16:49:09.448674 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.448650 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-x5q95"] Jun 08 16:49:09.451766 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.451748 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5ddbb49fbf-qjj6g"] Jun 08 16:49:09.451872 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.451848 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x5q95" Jun 08 16:49:09.455772 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.455754 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4k45p\"" Jun 08 16:49:09.456357 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.456339 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 08 16:49:09.456624 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.456610 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 08 16:49:09.464339 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.464318 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x5q95"] Jun 08 16:49:09.487909 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.487875 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/11a6db22-9ea7-42cd-87c6-f990e78a244f-installation-pull-secrets\") pod \"image-registry-5ddbb49fbf-qjj6g\" (UID: \"11a6db22-9ea7-42cd-87c6-f990e78a244f\") " pod="openshift-image-registry/image-registry-5ddbb49fbf-qjj6g" Jun 08 16:49:09.488030 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.487926 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f64b910-1d06-42c0-a217-596c9aa07eb5-registry-tls\") pod \"image-registry-7f959567c7-ctsqs\" (UID: \"4f64b910-1d06-42c0-a217-596c9aa07eb5\") " pod="openshift-image-registry/image-registry-7f959567c7-ctsqs" Jun 08 16:49:09.488030 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.487977 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/11a6db22-9ea7-42cd-87c6-f990e78a244f-registry-certificates\") pod \"image-registry-5ddbb49fbf-qjj6g\" (UID: \"11a6db22-9ea7-42cd-87c6-f990e78a244f\") " pod="openshift-image-registry/image-registry-5ddbb49fbf-qjj6g" Jun 08 16:49:09.488030 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.488016 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/11a6db22-9ea7-42cd-87c6-f990e78a244f-ca-trust-extracted\") pod \"image-registry-5ddbb49fbf-qjj6g\" (UID: \"11a6db22-9ea7-42cd-87c6-f990e78a244f\") " pod="openshift-image-registry/image-registry-5ddbb49fbf-qjj6g" Jun 08 16:49:09.488193 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.488041 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/11a6db22-9ea7-42cd-87c6-f990e78a244f-trusted-ca\") pod \"image-registry-5ddbb49fbf-qjj6g\" (UID: \"11a6db22-9ea7-42cd-87c6-f990e78a244f\") " pod="openshift-image-registry/image-registry-5ddbb49fbf-qjj6g" Jun 08 16:49:09.488193 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.488062 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4f64b910-1d06-42c0-a217-596c9aa07eb5-image-registry-private-configuration\") pod \"image-registry-7f959567c7-ctsqs\" (UID: \"4f64b910-1d06-42c0-a217-596c9aa07eb5\") " pod="openshift-image-registry/image-registry-7f959567c7-ctsqs" Jun 08 16:49:09.488193 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.488095 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/afe50c9a-e17c-4e7c-9426-50e526b0aedc-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-qndcr\" (UID: \"afe50c9a-e17c-4e7c-9426-50e526b0aedc\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qndcr" Jun 08 16:49:09.488193 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.488124 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4f64b910-1d06-42c0-a217-596c9aa07eb5-registry-certificates\") pod \"image-registry-7f959567c7-ctsqs\" (UID: \"4f64b910-1d06-42c0-a217-596c9aa07eb5\") " pod="openshift-image-registry/image-registry-7f959567c7-ctsqs" Jun 08 16:49:09.488193 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.488186 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4f64b910-1d06-42c0-a217-596c9aa07eb5-ca-trust-extracted\") pod \"image-registry-7f959567c7-ctsqs\" (UID: \"4f64b910-1d06-42c0-a217-596c9aa07eb5\") " pod="openshift-image-registry/image-registry-7f959567c7-ctsqs" Jun 08 16:49:09.488532 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.488283 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4f64b910-1d06-42c0-a217-596c9aa07eb5-installation-pull-secrets\") pod \"image-registry-7f959567c7-ctsqs\" (UID: \"4f64b910-1d06-42c0-a217-596c9aa07eb5\") " pod="openshift-image-registry/image-registry-7f959567c7-ctsqs" Jun 08 16:49:09.488532 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.488313 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f64b910-1d06-42c0-a217-596c9aa07eb5-bound-sa-token\") pod \"image-registry-7f959567c7-ctsqs\" (UID: \"4f64b910-1d06-42c0-a217-596c9aa07eb5\") " pod="openshift-image-registry/image-registry-7f959567c7-ctsqs" Jun 08 16:49:09.488532 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.488356 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/11a6db22-9ea7-42cd-87c6-f990e78a244f-bound-sa-token\") pod \"image-registry-5ddbb49fbf-qjj6g\" (UID: \"11a6db22-9ea7-42cd-87c6-f990e78a244f\") " pod="openshift-image-registry/image-registry-5ddbb49fbf-qjj6g" Jun 08 16:49:09.488532 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.488467 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vrzs\" (UniqueName: \"kubernetes.io/projected/11a6db22-9ea7-42cd-87c6-f990e78a244f-kube-api-access-9vrzs\") pod \"image-registry-5ddbb49fbf-qjj6g\" (UID: \"11a6db22-9ea7-42cd-87c6-f990e78a244f\") " pod="openshift-image-registry/image-registry-5ddbb49fbf-qjj6g" Jun 08 16:49:09.488532 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.488491 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/afe50c9a-e17c-4e7c-9426-50e526b0aedc-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-qndcr\" (UID: \"afe50c9a-e17c-4e7c-9426-50e526b0aedc\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qndcr" Jun 08 16:49:09.488532 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.488521 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/11a6db22-9ea7-42cd-87c6-f990e78a244f-registry-tls\") pod \"image-registry-5ddbb49fbf-qjj6g\" (UID: \"11a6db22-9ea7-42cd-87c6-f990e78a244f\") " pod="openshift-image-registry/image-registry-5ddbb49fbf-qjj6g" Jun 08 16:49:09.488831 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.488555 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94mvp\" (UniqueName: \"kubernetes.io/projected/4f64b910-1d06-42c0-a217-596c9aa07eb5-kube-api-access-94mvp\") pod \"image-registry-7f959567c7-ctsqs\" (UID: \"4f64b910-1d06-42c0-a217-596c9aa07eb5\") " pod="openshift-image-registry/image-registry-7f959567c7-ctsqs" Jun 08 16:49:09.488831 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.488584 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4f64b910-1d06-42c0-a217-596c9aa07eb5-trusted-ca\") pod \"image-registry-7f959567c7-ctsqs\" (UID: \"4f64b910-1d06-42c0-a217-596c9aa07eb5\") " pod="openshift-image-registry/image-registry-7f959567c7-ctsqs" Jun 08 16:49:09.488831 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.488608 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/11a6db22-9ea7-42cd-87c6-f990e78a244f-image-registry-private-configuration\") pod \"image-registry-5ddbb49fbf-qjj6g\" (UID: \"11a6db22-9ea7-42cd-87c6-f990e78a244f\") " pod="openshift-image-registry/image-registry-5ddbb49fbf-qjj6g" Jun 08 16:49:09.488831 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.488696 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4f64b910-1d06-42c0-a217-596c9aa07eb5-ca-trust-extracted\") pod \"image-registry-7f959567c7-ctsqs\" (UID: \"4f64b910-1d06-42c0-a217-596c9aa07eb5\") " pod="openshift-image-registry/image-registry-7f959567c7-ctsqs" Jun 08 16:49:09.489445 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.489420 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4f64b910-1d06-42c0-a217-596c9aa07eb5-registry-certificates\") pod \"image-registry-7f959567c7-ctsqs\" (UID: \"4f64b910-1d06-42c0-a217-596c9aa07eb5\") " pod="openshift-image-registry/image-registry-7f959567c7-ctsqs" Jun 08 16:49:09.489641 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.489619 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4f64b910-1d06-42c0-a217-596c9aa07eb5-trusted-ca\") pod \"image-registry-7f959567c7-ctsqs\" (UID: \"4f64b910-1d06-42c0-a217-596c9aa07eb5\") " pod="openshift-image-registry/image-registry-7f959567c7-ctsqs" Jun 08 16:49:09.491117 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.491094 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4f64b910-1d06-42c0-a217-596c9aa07eb5-image-registry-private-configuration\") pod \"image-registry-7f959567c7-ctsqs\" (UID: \"4f64b910-1d06-42c0-a217-596c9aa07eb5\") " pod="openshift-image-registry/image-registry-7f959567c7-ctsqs" Jun 08 16:49:09.491224 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.491175 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:09.491674 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.491652 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f64b910-1d06-42c0-a217-596c9aa07eb5-registry-tls\") pod \"image-registry-7f959567c7-ctsqs\" (UID: \"4f64b910-1d06-42c0-a217-596c9aa07eb5\") " pod="openshift-image-registry/image-registry-7f959567c7-ctsqs" Jun 08 16:49:09.491880 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.491862 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4f64b910-1d06-42c0-a217-596c9aa07eb5-installation-pull-secrets\") pod \"image-registry-7f959567c7-ctsqs\" (UID: \"4f64b910-1d06-42c0-a217-596c9aa07eb5\") " pod="openshift-image-registry/image-registry-7f959567c7-ctsqs" Jun 08 16:49:09.498588 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.498561 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f64b910-1d06-42c0-a217-596c9aa07eb5-bound-sa-token\") pod \"image-registry-7f959567c7-ctsqs\" (UID: \"4f64b910-1d06-42c0-a217-596c9aa07eb5\") " pod="openshift-image-registry/image-registry-7f959567c7-ctsqs" Jun 08 16:49:09.499067 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.499051 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94mvp\" (UniqueName: \"kubernetes.io/projected/4f64b910-1d06-42c0-a217-596c9aa07eb5-kube-api-access-94mvp\") pod \"image-registry-7f959567c7-ctsqs\" (UID: \"4f64b910-1d06-42c0-a217-596c9aa07eb5\") " pod="openshift-image-registry/image-registry-7f959567c7-ctsqs" Jun 08 16:49:09.580176 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.580081 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:09.589138 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.589115 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/11a6db22-9ea7-42cd-87c6-f990e78a244f-bound-sa-token\") pod \"image-registry-5ddbb49fbf-qjj6g\" (UID: \"11a6db22-9ea7-42cd-87c6-f990e78a244f\") " pod="openshift-image-registry/image-registry-5ddbb49fbf-qjj6g" Jun 08 16:49:09.589270 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.589144 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vrzs\" (UniqueName: \"kubernetes.io/projected/11a6db22-9ea7-42cd-87c6-f990e78a244f-kube-api-access-9vrzs\") pod \"image-registry-5ddbb49fbf-qjj6g\" (UID: \"11a6db22-9ea7-42cd-87c6-f990e78a244f\") " pod="openshift-image-registry/image-registry-5ddbb49fbf-qjj6g" Jun 08 16:49:09.589270 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.589163 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/afe50c9a-e17c-4e7c-9426-50e526b0aedc-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-qndcr\" (UID: \"afe50c9a-e17c-4e7c-9426-50e526b0aedc\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qndcr" Jun 08 16:49:09.589270 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.589189 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/11a6db22-9ea7-42cd-87c6-f990e78a244f-registry-tls\") pod \"image-registry-5ddbb49fbf-qjj6g\" (UID: \"11a6db22-9ea7-42cd-87c6-f990e78a244f\") " pod="openshift-image-registry/image-registry-5ddbb49fbf-qjj6g" Jun 08 16:49:09.589270 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.589212 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/11a6db22-9ea7-42cd-87c6-f990e78a244f-image-registry-private-configuration\") pod \"image-registry-5ddbb49fbf-qjj6g\" (UID: \"11a6db22-9ea7-42cd-87c6-f990e78a244f\") " pod="openshift-image-registry/image-registry-5ddbb49fbf-qjj6g" Jun 08 16:49:09.589270 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.589265 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b15be71f-f411-4891-93a4-60fcd2a2422d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x5q95\" (UID: \"b15be71f-f411-4891-93a4-60fcd2a2422d\") " pod="openshift-insights/insights-runtime-extractor-x5q95" Jun 08 16:49:09.589516 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.589296 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/11a6db22-9ea7-42cd-87c6-f990e78a244f-installation-pull-secrets\") pod \"image-registry-5ddbb49fbf-qjj6g\" (UID: \"11a6db22-9ea7-42cd-87c6-f990e78a244f\") " pod="openshift-image-registry/image-registry-5ddbb49fbf-qjj6g" Jun 08 16:49:09.589516 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.589313 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b15be71f-f411-4891-93a4-60fcd2a2422d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x5q95\" (UID: \"b15be71f-f411-4891-93a4-60fcd2a2422d\") " pod="openshift-insights/insights-runtime-extractor-x5q95" Jun 08 16:49:09.589516 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.589335 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b15be71f-f411-4891-93a4-60fcd2a2422d-data-volume\") pod \"insights-runtime-extractor-x5q95\" (UID: \"b15be71f-f411-4891-93a4-60fcd2a2422d\") " pod="openshift-insights/insights-runtime-extractor-x5q95" Jun 08 16:49:09.589516 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.589363 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/11a6db22-9ea7-42cd-87c6-f990e78a244f-registry-certificates\") pod \"image-registry-5ddbb49fbf-qjj6g\" (UID: \"11a6db22-9ea7-42cd-87c6-f990e78a244f\") " pod="openshift-image-registry/image-registry-5ddbb49fbf-qjj6g" Jun 08 16:49:09.589516 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.589387 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b15be71f-f411-4891-93a4-60fcd2a2422d-crio-socket\") pod \"insights-runtime-extractor-x5q95\" (UID: \"b15be71f-f411-4891-93a4-60fcd2a2422d\") " pod="openshift-insights/insights-runtime-extractor-x5q95" Jun 08 16:49:09.589516 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.589476 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/11a6db22-9ea7-42cd-87c6-f990e78a244f-ca-trust-extracted\") pod \"image-registry-5ddbb49fbf-qjj6g\" (UID: \"11a6db22-9ea7-42cd-87c6-f990e78a244f\") " pod="openshift-image-registry/image-registry-5ddbb49fbf-qjj6g" Jun 08 16:49:09.589516 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.589516 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/11a6db22-9ea7-42cd-87c6-f990e78a244f-trusted-ca\") pod \"image-registry-5ddbb49fbf-qjj6g\" (UID: \"11a6db22-9ea7-42cd-87c6-f990e78a244f\") " pod="openshift-image-registry/image-registry-5ddbb49fbf-qjj6g" Jun 08 16:49:09.589913 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.589556 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22r6k\" (UniqueName: \"kubernetes.io/projected/b15be71f-f411-4891-93a4-60fcd2a2422d-kube-api-access-22r6k\") pod \"insights-runtime-extractor-x5q95\" (UID: \"b15be71f-f411-4891-93a4-60fcd2a2422d\") " pod="openshift-insights/insights-runtime-extractor-x5q95" Jun 08 16:49:09.589913 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.589588 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/afe50c9a-e17c-4e7c-9426-50e526b0aedc-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-qndcr\" (UID: \"afe50c9a-e17c-4e7c-9426-50e526b0aedc\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qndcr" Jun 08 16:49:09.589913 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.589876 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/11a6db22-9ea7-42cd-87c6-f990e78a244f-ca-trust-extracted\") pod \"image-registry-5ddbb49fbf-qjj6g\" (UID: \"11a6db22-9ea7-42cd-87c6-f990e78a244f\") " pod="openshift-image-registry/image-registry-5ddbb49fbf-qjj6g" Jun 08 16:49:09.590318 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.590296 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/afe50c9a-e17c-4e7c-9426-50e526b0aedc-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-qndcr\" (UID: \"afe50c9a-e17c-4e7c-9426-50e526b0aedc\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qndcr" Jun 08 16:49:09.590476 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.590450 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/11a6db22-9ea7-42cd-87c6-f990e78a244f-registry-certificates\") pod \"image-registry-5ddbb49fbf-qjj6g\" (UID: \"11a6db22-9ea7-42cd-87c6-f990e78a244f\") " pod="openshift-image-registry/image-registry-5ddbb49fbf-qjj6g" Jun 08 16:49:09.591008 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.590984 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/11a6db22-9ea7-42cd-87c6-f990e78a244f-trusted-ca\") pod \"image-registry-5ddbb49fbf-qjj6g\" (UID: \"11a6db22-9ea7-42cd-87c6-f990e78a244f\") " pod="openshift-image-registry/image-registry-5ddbb49fbf-qjj6g" Jun 08 16:49:09.591909 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.591890 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/11a6db22-9ea7-42cd-87c6-f990e78a244f-image-registry-private-configuration\") pod \"image-registry-5ddbb49fbf-qjj6g\" (UID: \"11a6db22-9ea7-42cd-87c6-f990e78a244f\") " pod="openshift-image-registry/image-registry-5ddbb49fbf-qjj6g" Jun 08 16:49:09.592001 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.591946 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/11a6db22-9ea7-42cd-87c6-f990e78a244f-installation-pull-secrets\") pod \"image-registry-5ddbb49fbf-qjj6g\" (UID: \"11a6db22-9ea7-42cd-87c6-f990e78a244f\") " pod="openshift-image-registry/image-registry-5ddbb49fbf-qjj6g" Jun 08 16:49:09.592001 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.591957 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/11a6db22-9ea7-42cd-87c6-f990e78a244f-registry-tls\") pod \"image-registry-5ddbb49fbf-qjj6g\" (UID: \"11a6db22-9ea7-42cd-87c6-f990e78a244f\") " pod="openshift-image-registry/image-registry-5ddbb49fbf-qjj6g" Jun 08 16:49:09.592343 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.592323 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/afe50c9a-e17c-4e7c-9426-50e526b0aedc-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-qndcr\" (UID: \"afe50c9a-e17c-4e7c-9426-50e526b0aedc\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qndcr" Jun 08 16:49:09.600039 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.600017 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/11a6db22-9ea7-42cd-87c6-f990e78a244f-bound-sa-token\") pod \"image-registry-5ddbb49fbf-qjj6g\" (UID: \"11a6db22-9ea7-42cd-87c6-f990e78a244f\") " pod="openshift-image-registry/image-registry-5ddbb49fbf-qjj6g" Jun 08 16:49:09.600470 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.600454 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vrzs\" (UniqueName: \"kubernetes.io/projected/11a6db22-9ea7-42cd-87c6-f990e78a244f-kube-api-access-9vrzs\") pod \"image-registry-5ddbb49fbf-qjj6g\" (UID: \"11a6db22-9ea7-42cd-87c6-f990e78a244f\") " pod="openshift-image-registry/image-registry-5ddbb49fbf-qjj6g" Jun 08 16:49:09.690561 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.690526 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b15be71f-f411-4891-93a4-60fcd2a2422d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x5q95\" (UID: \"b15be71f-f411-4891-93a4-60fcd2a2422d\") " pod="openshift-insights/insights-runtime-extractor-x5q95" Jun 08 16:49:09.690561 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.690563 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b15be71f-f411-4891-93a4-60fcd2a2422d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x5q95\" (UID: \"b15be71f-f411-4891-93a4-60fcd2a2422d\") " pod="openshift-insights/insights-runtime-extractor-x5q95" Jun 08 16:49:09.690743 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.690586 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b15be71f-f411-4891-93a4-60fcd2a2422d-data-volume\") pod \"insights-runtime-extractor-x5q95\" (UID: \"b15be71f-f411-4891-93a4-60fcd2a2422d\") " pod="openshift-insights/insights-runtime-extractor-x5q95" Jun 08 16:49:09.690743 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.690602 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b15be71f-f411-4891-93a4-60fcd2a2422d-crio-socket\") pod \"insights-runtime-extractor-x5q95\" (UID: \"b15be71f-f411-4891-93a4-60fcd2a2422d\") " pod="openshift-insights/insights-runtime-extractor-x5q95" Jun 08 16:49:09.690743 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.690661 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b15be71f-f411-4891-93a4-60fcd2a2422d-crio-socket\") pod \"insights-runtime-extractor-x5q95\" (UID: \"b15be71f-f411-4891-93a4-60fcd2a2422d\") " pod="openshift-insights/insights-runtime-extractor-x5q95" Jun 08 16:49:09.690865 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.690743 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22r6k\" (UniqueName: \"kubernetes.io/projected/b15be71f-f411-4891-93a4-60fcd2a2422d-kube-api-access-22r6k\") pod \"insights-runtime-extractor-x5q95\" (UID: \"b15be71f-f411-4891-93a4-60fcd2a2422d\") " pod="openshift-insights/insights-runtime-extractor-x5q95" Jun 08 16:49:09.690941 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.690919 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b15be71f-f411-4891-93a4-60fcd2a2422d-data-volume\") pod \"insights-runtime-extractor-x5q95\" (UID: \"b15be71f-f411-4891-93a4-60fcd2a2422d\") " pod="openshift-insights/insights-runtime-extractor-x5q95" Jun 08 16:49:09.691198 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.691178 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b15be71f-f411-4891-93a4-60fcd2a2422d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x5q95\" (UID: \"b15be71f-f411-4891-93a4-60fcd2a2422d\") " pod="openshift-insights/insights-runtime-extractor-x5q95" Jun 08 16:49:09.692980 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.692962 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b15be71f-f411-4891-93a4-60fcd2a2422d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x5q95\" (UID: \"b15be71f-f411-4891-93a4-60fcd2a2422d\") " pod="openshift-insights/insights-runtime-extractor-x5q95" Jun 08 16:49:09.704773 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.704746 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22r6k\" (UniqueName: \"kubernetes.io/projected/b15be71f-f411-4891-93a4-60fcd2a2422d-kube-api-access-22r6k\") pod \"insights-runtime-extractor-x5q95\" (UID: \"b15be71f-f411-4891-93a4-60fcd2a2422d\") " pod="openshift-insights/insights-runtime-extractor-x5q95" Jun 08 16:49:09.737243 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.737221 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qndcr" Jun 08 16:49:09.742712 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.742694 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5ddbb49fbf-qjj6g" Jun 08 16:49:09.760855 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.760837 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x5q95" Jun 08 16:49:09.792299 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.792268 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9358ada-e6bb-40f0-a5ce-b8e2ecce889f-service-ca-bundle\") pod \"router-default-557dd576b7-t4q2j\" (UID: \"f9358ada-e6bb-40f0-a5ce-b8e2ecce889f\") " pod="openshift-ingress/router-default-557dd576b7-t4q2j" Jun 08 16:49:09.792737 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.792707 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hp28s" Jun 08 16:49:09.793067 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.793044 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9358ada-e6bb-40f0-a5ce-b8e2ecce889f-service-ca-bundle\") pod \"router-default-557dd576b7-t4q2j\" (UID: \"f9358ada-e6bb-40f0-a5ce-b8e2ecce889f\") " pod="openshift-ingress/router-default-557dd576b7-t4q2j" Jun 08 16:49:09.848009 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.847135 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-557dd576b7-t4q2j" Jun 08 16:49:09.903275 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.903168 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-k75p9" event={"ID":"39f5a916-a88c-4539-a49d-ac446548636f","Type":"ContainerStarted","Data":"61f85dcacbf11d56c8d732dc98225bb5fff78b4f95254a801fa39e940e1bdd35"} Jun 08 16:49:09.903440 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.903326 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-k75p9" event={"ID":"39f5a916-a88c-4539-a49d-ac446548636f","Type":"ContainerStarted","Data":"0ca059c5fee28be92a2680de2f956907063f0580176ea8e6f60dda996bc5b839"} Jun 08 16:49:09.903440 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.903350 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f959567c7-ctsqs" Jun 08 16:49:09.917102 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.916667 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-qndcr"] Jun 08 16:49:09.920026 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:49:09.919979 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafe50c9a_e17c_4e7c_9426_50e526b0aedc.slice/crio-a2d15c2c1b86b9e4fe09449ed41f154653cfd1bace5d38ad855aad2a993f48f1 WatchSource:0}: Error finding container a2d15c2c1b86b9e4fe09449ed41f154653cfd1bace5d38ad855aad2a993f48f1: Status 404 returned error can't find the container with id a2d15c2c1b86b9e4fe09449ed41f154653cfd1bace5d38ad855aad2a993f48f1 Jun 08 16:49:09.931189 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.931089 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f959567c7-ctsqs" Jun 08 16:49:09.946517 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.946471 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-k75p9" podStartSLOduration=65.49572004 podStartE2EDuration="1m6.946453733s" totalImagesPullingTime="1.450733693s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:48:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:49:09.944575758 +0000 UTC m=+101.841353235" watchObservedRunningTime="2026-06-08 16:49:09.946453733 +0000 UTC m=+101.843231208" Jun 08 16:49:09.960673 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.960586 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5ddbb49fbf-qjj6g"] Jun 08 16:49:09.964424 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:49:09.964401 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11a6db22_9ea7_42cd_87c6_f990e78a244f.slice/crio-5d3ff34aedcbd50893aa94fac9c62945a763df5520685f318feba9c379e308fa WatchSource:0}: Error finding container 5d3ff34aedcbd50893aa94fac9c62945a763df5520685f318feba9c379e308fa: Status 404 returned error can't find the container with id 5d3ff34aedcbd50893aa94fac9c62945a763df5520685f318feba9c379e308fa Jun 08 16:49:09.979117 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.978536 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x5q95"] Jun 08 16:49:09.998653 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.997289 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4f64b910-1d06-42c0-a217-596c9aa07eb5-installation-pull-secrets\") pod \"4f64b910-1d06-42c0-a217-596c9aa07eb5\" (UID: \"4f64b910-1d06-42c0-a217-596c9aa07eb5\") " Jun 08 16:49:09.998653 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.997335 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4f64b910-1d06-42c0-a217-596c9aa07eb5-image-registry-private-configuration\") pod \"4f64b910-1d06-42c0-a217-596c9aa07eb5\" (UID: \"4f64b910-1d06-42c0-a217-596c9aa07eb5\") " Jun 08 16:49:09.998653 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.997372 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4f64b910-1d06-42c0-a217-596c9aa07eb5-ca-trust-extracted\") pod \"4f64b910-1d06-42c0-a217-596c9aa07eb5\" (UID: \"4f64b910-1d06-42c0-a217-596c9aa07eb5\") " Jun 08 16:49:09.998653 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.997413 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f64b910-1d06-42c0-a217-596c9aa07eb5-registry-tls\") pod \"4f64b910-1d06-42c0-a217-596c9aa07eb5\" (UID: \"4f64b910-1d06-42c0-a217-596c9aa07eb5\") " Jun 08 16:49:09.998653 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.997444 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4f64b910-1d06-42c0-a217-596c9aa07eb5-trusted-ca\") pod \"4f64b910-1d06-42c0-a217-596c9aa07eb5\" (UID: \"4f64b910-1d06-42c0-a217-596c9aa07eb5\") " Jun 08 16:49:09.998653 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.997476 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-94mvp\" (UniqueName: \"kubernetes.io/projected/4f64b910-1d06-42c0-a217-596c9aa07eb5-kube-api-access-94mvp\") pod \"4f64b910-1d06-42c0-a217-596c9aa07eb5\" (UID: \"4f64b910-1d06-42c0-a217-596c9aa07eb5\") " Jun 08 16:49:09.998653 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.997522 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f64b910-1d06-42c0-a217-596c9aa07eb5-bound-sa-token\") pod \"4f64b910-1d06-42c0-a217-596c9aa07eb5\" (UID: \"4f64b910-1d06-42c0-a217-596c9aa07eb5\") " Jun 08 16:49:09.998653 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.997548 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4f64b910-1d06-42c0-a217-596c9aa07eb5-registry-certificates\") pod \"4f64b910-1d06-42c0-a217-596c9aa07eb5\" (UID: \"4f64b910-1d06-42c0-a217-596c9aa07eb5\") " Jun 08 16:49:10.000324 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:09.999703 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f64b910-1d06-42c0-a217-596c9aa07eb5-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4f64b910-1d06-42c0-a217-596c9aa07eb5" (UID: "4f64b910-1d06-42c0-a217-596c9aa07eb5"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 16:49:10.004985 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:10.002746 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f64b910-1d06-42c0-a217-596c9aa07eb5-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4f64b910-1d06-42c0-a217-596c9aa07eb5" (UID: "4f64b910-1d06-42c0-a217-596c9aa07eb5"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 16:49:10.004985 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:10.003348 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f64b910-1d06-42c0-a217-596c9aa07eb5-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4f64b910-1d06-42c0-a217-596c9aa07eb5" (UID: "4f64b910-1d06-42c0-a217-596c9aa07eb5"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 16:49:10.004985 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:10.004819 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f64b910-1d06-42c0-a217-596c9aa07eb5-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4f64b910-1d06-42c0-a217-596c9aa07eb5" (UID: "4f64b910-1d06-42c0-a217-596c9aa07eb5"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 16:49:10.015607 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:10.015564 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f64b910-1d06-42c0-a217-596c9aa07eb5-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4f64b910-1d06-42c0-a217-596c9aa07eb5" (UID: "4f64b910-1d06-42c0-a217-596c9aa07eb5"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 16:49:10.015914 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:10.015878 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f64b910-1d06-42c0-a217-596c9aa07eb5-kube-api-access-94mvp" (OuterVolumeSpecName: "kube-api-access-94mvp") pod "4f64b910-1d06-42c0-a217-596c9aa07eb5" (UID: "4f64b910-1d06-42c0-a217-596c9aa07eb5"). InnerVolumeSpecName "kube-api-access-94mvp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 16:49:10.016015 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:10.015906 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f64b910-1d06-42c0-a217-596c9aa07eb5-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4f64b910-1d06-42c0-a217-596c9aa07eb5" (UID: "4f64b910-1d06-42c0-a217-596c9aa07eb5"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 16:49:10.017210 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:10.017188 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f64b910-1d06-42c0-a217-596c9aa07eb5-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4f64b910-1d06-42c0-a217-596c9aa07eb5" (UID: "4f64b910-1d06-42c0-a217-596c9aa07eb5"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 16:49:10.052289 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:10.052205 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-557dd576b7-t4q2j"] Jun 08 16:49:10.055426 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:49:10.055403 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9358ada_e6bb_40f0_a5ce_b8e2ecce889f.slice/crio-6797a98d1e0d32ee7b081e691398c73deecb474fa1eb0ea802d146608ecd55e6 WatchSource:0}: Error finding container 6797a98d1e0d32ee7b081e691398c73deecb474fa1eb0ea802d146608ecd55e6: Status 404 returned error can't find the container with id 6797a98d1e0d32ee7b081e691398c73deecb474fa1eb0ea802d146608ecd55e6 Jun 08 16:49:10.098813 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:10.098747 2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4f64b910-1d06-42c0-a217-596c9aa07eb5-image-registry-private-configuration\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 16:49:10.098813 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:10.098779 2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4f64b910-1d06-42c0-a217-596c9aa07eb5-ca-trust-extracted\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 16:49:10.098813 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:10.098794 2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f64b910-1d06-42c0-a217-596c9aa07eb5-registry-tls\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 16:49:10.098813 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:10.098808 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4f64b910-1d06-42c0-a217-596c9aa07eb5-trusted-ca\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 16:49:10.099047 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:10.098820 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-94mvp\" (UniqueName: \"kubernetes.io/projected/4f64b910-1d06-42c0-a217-596c9aa07eb5-kube-api-access-94mvp\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 16:49:10.099047 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:10.098834 2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f64b910-1d06-42c0-a217-596c9aa07eb5-bound-sa-token\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 16:49:10.099047 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:10.098848 2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4f64b910-1d06-42c0-a217-596c9aa07eb5-registry-certificates\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 16:49:10.099047 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:10.098861 2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4f64b910-1d06-42c0-a217-596c9aa07eb5-installation-pull-secrets\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 16:49:10.908316 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:10.908276 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x5q95" event={"ID":"b15be71f-f411-4891-93a4-60fcd2a2422d","Type":"ContainerStarted","Data":"6eb3e6857cc2916801058a2fd5b8afb193153a718d64e4efaa7a9c92f1a3c3bb"} Jun 08 16:49:10.908691 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:10.908343 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x5q95" event={"ID":"b15be71f-f411-4891-93a4-60fcd2a2422d","Type":"ContainerStarted","Data":"acfa4c1242d5f8f9aecfdfb77c58ea2c9dd0322bbe739f62b616c76b907dcc9b"} Jun 08 16:49:10.909702 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:10.909673 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-557dd576b7-t4q2j" event={"ID":"f9358ada-e6bb-40f0-a5ce-b8e2ecce889f","Type":"ContainerStarted","Data":"b03b9c49a531ed0baf8ee370af2f5e3c134bc63d86791ee4f4e5918389a409c8"} Jun 08 16:49:10.909843 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:10.909725 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-557dd576b7-t4q2j" event={"ID":"f9358ada-e6bb-40f0-a5ce-b8e2ecce889f","Type":"ContainerStarted","Data":"6797a98d1e0d32ee7b081e691398c73deecb474fa1eb0ea802d146608ecd55e6"} Jun 08 16:49:10.911037 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:10.911017 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5ddbb49fbf-qjj6g" event={"ID":"11a6db22-9ea7-42cd-87c6-f990e78a244f","Type":"ContainerStarted","Data":"a6c0eb4be93f4714ef9f02e4bf269e38607751599dcf993094aceea04a81f007"} Jun 08 16:49:10.911121 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:10.911051 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5ddbb49fbf-qjj6g" event={"ID":"11a6db22-9ea7-42cd-87c6-f990e78a244f","Type":"ContainerStarted","Data":"5d3ff34aedcbd50893aa94fac9c62945a763df5520685f318feba9c379e308fa"} Jun 08 16:49:10.911121 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:10.911084 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5ddbb49fbf-qjj6g" Jun 08 16:49:10.912186 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:10.912155 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qndcr" event={"ID":"afe50c9a-e17c-4e7c-9426-50e526b0aedc","Type":"ContainerStarted","Data":"a2d15c2c1b86b9e4fe09449ed41f154653cfd1bace5d38ad855aad2a993f48f1"} Jun 08 16:49:10.912300 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:10.912172 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f959567c7-ctsqs" Jun 08 16:49:10.912370 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:10.912355 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-k75p9" Jun 08 16:49:10.930500 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:10.930461 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-557dd576b7-t4q2j" podStartSLOduration=33.930450766 podStartE2EDuration="33.930450766s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:48:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:49:10.930159035 +0000 UTC m=+102.826936511" watchObservedRunningTime="2026-06-08 16:49:10.930450766 +0000 UTC m=+102.827228241" Jun 08 16:49:10.959447 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:10.959422 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7f959567c7-ctsqs"] Jun 08 16:49:10.963488 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:10.963457 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7f959567c7-ctsqs"] Jun 08 16:49:10.982614 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:10.982574 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5ddbb49fbf-qjj6g" podStartSLOduration=1.98256096 podStartE2EDuration="1.98256096s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:49:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:49:10.981761818 +0000 UTC m=+102.878539295" watchObservedRunningTime="2026-06-08 16:49:10.98256096 +0000 UTC m=+102.879338426" Jun 08 16:49:11.847720 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:11.847695 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-557dd576b7-t4q2j" Jun 08 16:49:11.851128 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:11.851049 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-557dd576b7-t4q2j" Jun 08 16:49:11.917618 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:11.917584 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qndcr" event={"ID":"afe50c9a-e17c-4e7c-9426-50e526b0aedc","Type":"ContainerStarted","Data":"83ffd3a9f997d976d2dbe4678be35b212b1d1f0a5a0febd02709820b0db5eefb"} Jun 08 16:49:11.919659 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:11.919630 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x5q95" event={"ID":"b15be71f-f411-4891-93a4-60fcd2a2422d","Type":"ContainerStarted","Data":"841468d2ede901c4956ae7b004830a742af22db56da3c535ef1139a9101faa49"} Jun 08 16:49:11.920303 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:11.920278 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-557dd576b7-t4q2j" Jun 08 16:49:11.921361 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:11.921342 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-557dd576b7-t4q2j" Jun 08 16:49:11.933687 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:11.933602 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qndcr" podStartSLOduration=1.182454792 podStartE2EDuration="2.933584749s" totalImagesPullingTime="1.751129957s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:49:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:49:11.932796178 +0000 UTC m=+103.829573654" watchObservedRunningTime="2026-06-08 16:49:11.933584749 +0000 UTC m=+103.830362225" Jun 08 16:49:12.042685 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:12.042649 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:12.099921 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:12.099888 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:12.154625 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:12.154579 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:12.525232 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:12.525192 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f64b910-1d06-42c0-a217-596c9aa07eb5" path="/var/lib/kubelet/pods/4f64b910-1d06-42c0-a217-596c9aa07eb5/volumes" Jun 08 16:49:13.931023 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:13.930988 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x5q95" event={"ID":"b15be71f-f411-4891-93a4-60fcd2a2422d","Type":"ContainerStarted","Data":"9fd59a5b321720cb0e5e7a093edd17ff6cd2568812a50b94b26e2b2b76754fc8"} Jun 08 16:49:13.951252 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:13.951201 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-x5q95" podStartSLOduration=1.87716767 podStartE2EDuration="4.951189948s" totalImagesPullingTime="3.074022278s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 16:49:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:49:13.950545785 +0000 UTC m=+105.847323259" watchObservedRunningTime="2026-06-08 16:49:13.951189948 +0000 UTC m=+105.847967422" Jun 08 16:49:15.547950 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:15.547905 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:15.648902 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:15.648868 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:15.866607 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:15.866580 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:15.973248 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:15.973214 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:16.073067 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:16.073031 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:16.131113 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:16.131045 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-bbvrx"] Jun 08 16:49:16.133783 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:16.133768 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-bbvrx" Jun 08 16:49:16.136140 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:16.136120 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 08 16:49:16.136285 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:16.136258 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-7fcqs\"" Jun 08 16:49:16.141989 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:16.141965 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-bbvrx"] Jun 08 16:49:16.157285 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:16.157262 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:16.247581 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:16.247557 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/59c46146-5fe0-4d6e-a29e-1a007d518010-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-bbvrx\" (UID: \"59c46146-5fe0-4d6e-a29e-1a007d518010\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-bbvrx" Jun 08 16:49:16.347817 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:16.347792 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/59c46146-5fe0-4d6e-a29e-1a007d518010-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-bbvrx\" (UID: \"59c46146-5fe0-4d6e-a29e-1a007d518010\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-bbvrx" Jun 08 16:49:16.347934 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:49:16.347917 2579 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 08 16:49:16.348000 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:49:16.347985 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59c46146-5fe0-4d6e-a29e-1a007d518010-tls-certificates podName:59c46146-5fe0-4d6e-a29e-1a007d518010 nodeName:}" failed. No retries permitted until 2026-06-08 16:49:16.847966256 +0000 UTC m=+108.744743726 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/59c46146-5fe0-4d6e-a29e-1a007d518010-tls-certificates") pod "prometheus-operator-admission-webhook-5b6b8f594-bbvrx" (UID: "59c46146-5fe0-4d6e-a29e-1a007d518010") : secret "prometheus-operator-admission-webhook-tls" not found Jun 08 16:49:16.505902 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:16.505839 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:16.851309 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:16.851282 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/59c46146-5fe0-4d6e-a29e-1a007d518010-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-bbvrx\" (UID: \"59c46146-5fe0-4d6e-a29e-1a007d518010\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-bbvrx" Jun 08 16:49:16.853700 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:16.853681 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/59c46146-5fe0-4d6e-a29e-1a007d518010-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-bbvrx\" (UID: \"59c46146-5fe0-4d6e-a29e-1a007d518010\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-bbvrx" Jun 08 16:49:17.043592 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:17.043550 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-bbvrx" Jun 08 16:49:17.163234 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:17.163212 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-bbvrx"] Jun 08 16:49:17.165663 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:49:17.165635 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59c46146_5fe0_4d6e_a29e_1a007d518010.slice/crio-2c83e5ec73aeebd2e6dc188b5eec4df07fee55c1f2e3ca24ddfba34bac7fd141 WatchSource:0}: Error finding container 2c83e5ec73aeebd2e6dc188b5eec4df07fee55c1f2e3ca24ddfba34bac7fd141: Status 404 returned error can't find the container with id 2c83e5ec73aeebd2e6dc188b5eec4df07fee55c1f2e3ca24ddfba34bac7fd141 Jun 08 16:49:17.946170 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:17.946127 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-bbvrx" event={"ID":"59c46146-5fe0-4d6e-a29e-1a007d518010","Type":"ContainerStarted","Data":"2c83e5ec73aeebd2e6dc188b5eec4df07fee55c1f2e3ca24ddfba34bac7fd141"} Jun 08 16:49:18.950381 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:18.950344 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-bbvrx" event={"ID":"59c46146-5fe0-4d6e-a29e-1a007d518010","Type":"ContainerStarted","Data":"e01f0602ed6c719c140b92b21b1e07eed4c90086c7dbe41747b8e8dc4109b008"} Jun 08 16:49:18.950836 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:18.950567 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-bbvrx" Jun 08 16:49:18.955440 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:18.955422 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-bbvrx" Jun 08 16:49:18.965575 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:18.965532 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-bbvrx" podStartSLOduration=1.8970216720000002 podStartE2EDuration="2.965518527s" totalImagesPullingTime="1.068496855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:49:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:49:18.964534098 +0000 UTC m=+110.861311574" watchObservedRunningTime="2026-06-08 16:49:18.965518527 +0000 UTC m=+110.862296002" Jun 08 16:49:19.150302 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:19.150269 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:19.224290 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:19.224211 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-7cfcr"] Jun 08 16:49:19.226153 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:19.226138 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-7cfcr" Jun 08 16:49:19.230527 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:19.230506 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 08 16:49:19.230638 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:19.230600 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 08 16:49:19.230638 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:19.230606 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-v8g2q\"" Jun 08 16:49:19.232458 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:19.232381 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 08 16:49:19.232784 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:19.232763 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 08 16:49:19.237847 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:19.237827 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 08 16:49:19.243358 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:19.243331 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-7cfcr"] Jun 08 16:49:19.246516 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:19.246494 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:19.305047 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:19.305021 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:19.367678 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:19.367651 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/82d39be1-b24a-4012-9f6a-4af36f8ac4c5-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-7cfcr\" (UID: \"82d39be1-b24a-4012-9f6a-4af36f8ac4c5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7cfcr" Jun 08 16:49:19.367798 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:19.367699 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/82d39be1-b24a-4012-9f6a-4af36f8ac4c5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-7cfcr\" (UID: \"82d39be1-b24a-4012-9f6a-4af36f8ac4c5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7cfcr" Jun 08 16:49:19.367798 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:19.367762 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82d39be1-b24a-4012-9f6a-4af36f8ac4c5-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-7cfcr\" (UID: \"82d39be1-b24a-4012-9f6a-4af36f8ac4c5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7cfcr" Jun 08 16:49:19.367882 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:19.367809 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnl7s\" (UniqueName: \"kubernetes.io/projected/82d39be1-b24a-4012-9f6a-4af36f8ac4c5-kube-api-access-gnl7s\") pod \"prometheus-operator-7f7d445d84-7cfcr\" (UID: \"82d39be1-b24a-4012-9f6a-4af36f8ac4c5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7cfcr" Jun 08 16:49:19.397460 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:19.397432 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:19.468117 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:19.468094 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/82d39be1-b24a-4012-9f6a-4af36f8ac4c5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-7cfcr\" (UID: \"82d39be1-b24a-4012-9f6a-4af36f8ac4c5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7cfcr" Jun 08 16:49:19.468222 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:19.468124 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82d39be1-b24a-4012-9f6a-4af36f8ac4c5-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-7cfcr\" (UID: \"82d39be1-b24a-4012-9f6a-4af36f8ac4c5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7cfcr" Jun 08 16:49:19.468222 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:19.468151 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnl7s\" (UniqueName: \"kubernetes.io/projected/82d39be1-b24a-4012-9f6a-4af36f8ac4c5-kube-api-access-gnl7s\") pod \"prometheus-operator-7f7d445d84-7cfcr\" (UID: \"82d39be1-b24a-4012-9f6a-4af36f8ac4c5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7cfcr" Jun 08 16:49:19.468368 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:19.468226 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/82d39be1-b24a-4012-9f6a-4af36f8ac4c5-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-7cfcr\" (UID: \"82d39be1-b24a-4012-9f6a-4af36f8ac4c5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7cfcr" Jun 08 16:49:19.468745 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:19.468727 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82d39be1-b24a-4012-9f6a-4af36f8ac4c5-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-7cfcr\" (UID: \"82d39be1-b24a-4012-9f6a-4af36f8ac4c5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7cfcr" Jun 08 16:49:19.470714 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:19.470694 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/82d39be1-b24a-4012-9f6a-4af36f8ac4c5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-7cfcr\" (UID: \"82d39be1-b24a-4012-9f6a-4af36f8ac4c5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7cfcr" Jun 08 16:49:19.470824 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:19.470803 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/82d39be1-b24a-4012-9f6a-4af36f8ac4c5-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-7cfcr\" (UID: \"82d39be1-b24a-4012-9f6a-4af36f8ac4c5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7cfcr" Jun 08 16:49:19.479992 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:19.479944 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnl7s\" (UniqueName: \"kubernetes.io/projected/82d39be1-b24a-4012-9f6a-4af36f8ac4c5-kube-api-access-gnl7s\") pod \"prometheus-operator-7f7d445d84-7cfcr\" (UID: \"82d39be1-b24a-4012-9f6a-4af36f8ac4c5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7cfcr" Jun 08 16:49:19.535096 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:19.535076 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-7cfcr" Jun 08 16:49:19.657041 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:19.657015 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-7cfcr"] Jun 08 16:49:19.659516 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:49:19.659495 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82d39be1_b24a_4012_9f6a_4af36f8ac4c5.slice/crio-ddc337247ac9c71db69f1a37a115f59aaba1a10c673f6e2c7de0a75f00b5399a WatchSource:0}: Error finding container ddc337247ac9c71db69f1a37a115f59aaba1a10c673f6e2c7de0a75f00b5399a: Status 404 returned error can't find the container with id ddc337247ac9c71db69f1a37a115f59aaba1a10c673f6e2c7de0a75f00b5399a Jun 08 16:49:19.954458 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:19.954427 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-7cfcr" event={"ID":"82d39be1-b24a-4012-9f6a-4af36f8ac4c5","Type":"ContainerStarted","Data":"ddc337247ac9c71db69f1a37a115f59aaba1a10c673f6e2c7de0a75f00b5399a"} Jun 08 16:49:20.922524 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:20.922487 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-k75p9" Jun 08 16:49:21.231720 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:21.231640 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:21.962808 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:21.962770 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-7cfcr" event={"ID":"82d39be1-b24a-4012-9f6a-4af36f8ac4c5","Type":"ContainerStarted","Data":"246ab5b6875246dab792655a9c36ac92d1624291e12f5ba7b31faf8e501df20a"} Jun 08 16:49:21.962960 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:21.962832 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-7cfcr" event={"ID":"82d39be1-b24a-4012-9f6a-4af36f8ac4c5","Type":"ContainerStarted","Data":"f6f0e2ae935656feecbb182a1be9b4707568a2a0dc6a01e5e4057bc1d69ba575"} Jun 08 16:49:21.981276 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:21.981211 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-7cfcr" podStartSLOduration=1.670237423 podStartE2EDuration="2.981197371s" totalImagesPullingTime="1.310959948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:49:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:49:21.979315075 +0000 UTC m=+113.876092549" watchObservedRunningTime="2026-06-08 16:49:21.981197371 +0000 UTC m=+113.877974845" Jun 08 16:49:23.312098 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.312057 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:23.548437 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.548393 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:23.597897 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.597867 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-d956z"] Jun 08 16:49:23.600046 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.600027 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d956z" Jun 08 16:49:23.605021 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.604998 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 08 16:49:23.605511 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.605492 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-48gxv\"" Jun 08 16:49:23.605983 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.605960 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 08 16:49:23.606304 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.606286 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 08 16:49:23.613857 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.613837 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-d956z"] Jun 08 16:49:23.615139 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.615122 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vcsbd"] Jun 08 16:49:23.617473 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.617455 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vcsbd" Jun 08 16:49:23.620020 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.619998 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 08 16:49:23.620135 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.620024 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 08 16:49:23.620135 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.620061 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 08 16:49:23.620317 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.620304 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-kvzhg\"" Jun 08 16:49:23.654162 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.654131 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:23.701259 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.701208 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5fff9157-6f59-44bd-bb68-d83f5fb56328-sys\") pod \"node-exporter-vcsbd\" (UID: \"5fff9157-6f59-44bd-bb68-d83f5fb56328\") " pod="openshift-monitoring/node-exporter-vcsbd" Jun 08 16:49:23.701412 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.701318 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5fff9157-6f59-44bd-bb68-d83f5fb56328-metrics-client-ca\") pod \"node-exporter-vcsbd\" (UID: \"5fff9157-6f59-44bd-bb68-d83f5fb56328\") " pod="openshift-monitoring/node-exporter-vcsbd" Jun 08 16:49:23.701412 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.701339 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kc9x\" (UniqueName: \"kubernetes.io/projected/5fff9157-6f59-44bd-bb68-d83f5fb56328-kube-api-access-9kc9x\") pod \"node-exporter-vcsbd\" (UID: \"5fff9157-6f59-44bd-bb68-d83f5fb56328\") " pod="openshift-monitoring/node-exporter-vcsbd" Jun 08 16:49:23.701412 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.701362 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5fff9157-6f59-44bd-bb68-d83f5fb56328-root\") pod \"node-exporter-vcsbd\" (UID: \"5fff9157-6f59-44bd-bb68-d83f5fb56328\") " pod="openshift-monitoring/node-exporter-vcsbd" Jun 08 16:49:23.701412 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.701400 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37610212-ce3b-459a-9d75-2a949e72aab5-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-d956z\" (UID: \"37610212-ce3b-459a-9d75-2a949e72aab5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d956z" Jun 08 16:49:23.701565 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.701416 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/37610212-ce3b-459a-9d75-2a949e72aab5-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-d956z\" (UID: \"37610212-ce3b-459a-9d75-2a949e72aab5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d956z" Jun 08 16:49:23.701565 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.701453 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/37610212-ce3b-459a-9d75-2a949e72aab5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-d956z\" (UID: \"37610212-ce3b-459a-9d75-2a949e72aab5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d956z" Jun 08 16:49:23.701565 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.701476 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5fff9157-6f59-44bd-bb68-d83f5fb56328-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vcsbd\" (UID: \"5fff9157-6f59-44bd-bb68-d83f5fb56328\") " pod="openshift-monitoring/node-exporter-vcsbd" Jun 08 16:49:23.701565 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.701497 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl4g4\" (UniqueName: \"kubernetes.io/projected/37610212-ce3b-459a-9d75-2a949e72aab5-kube-api-access-pl4g4\") pod \"kube-state-metrics-57bbf8bfb5-d956z\" (UID: \"37610212-ce3b-459a-9d75-2a949e72aab5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d956z" Jun 08 16:49:23.701565 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.701516 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5fff9157-6f59-44bd-bb68-d83f5fb56328-node-exporter-tls\") pod \"node-exporter-vcsbd\" (UID: \"5fff9157-6f59-44bd-bb68-d83f5fb56328\") " pod="openshift-monitoring/node-exporter-vcsbd" Jun 08 16:49:23.701565 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.701534 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5fff9157-6f59-44bd-bb68-d83f5fb56328-node-exporter-accelerators-collector-config\") pod \"node-exporter-vcsbd\" (UID: \"5fff9157-6f59-44bd-bb68-d83f5fb56328\") " pod="openshift-monitoring/node-exporter-vcsbd" Jun 08 16:49:23.701779 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.701611 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/37610212-ce3b-459a-9d75-2a949e72aab5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-d956z\" (UID: \"37610212-ce3b-459a-9d75-2a949e72aab5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d956z" Jun 08 16:49:23.701779 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.701663 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5fff9157-6f59-44bd-bb68-d83f5fb56328-node-exporter-textfile\") pod \"node-exporter-vcsbd\" (UID: \"5fff9157-6f59-44bd-bb68-d83f5fb56328\") " pod="openshift-monitoring/node-exporter-vcsbd" Jun 08 16:49:23.701779 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.701691 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5fff9157-6f59-44bd-bb68-d83f5fb56328-node-exporter-wtmp\") pod \"node-exporter-vcsbd\" (UID: \"5fff9157-6f59-44bd-bb68-d83f5fb56328\") " pod="openshift-monitoring/node-exporter-vcsbd" Jun 08 16:49:23.701779 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.701734 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/37610212-ce3b-459a-9d75-2a949e72aab5-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-d956z\" (UID: \"37610212-ce3b-459a-9d75-2a949e72aab5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d956z" Jun 08 16:49:23.742548 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.742512 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:23.803200 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.803157 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5fff9157-6f59-44bd-bb68-d83f5fb56328-metrics-client-ca\") pod \"node-exporter-vcsbd\" (UID: \"5fff9157-6f59-44bd-bb68-d83f5fb56328\") " pod="openshift-monitoring/node-exporter-vcsbd" Jun 08 16:49:23.803200 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.803201 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kc9x\" (UniqueName: \"kubernetes.io/projected/5fff9157-6f59-44bd-bb68-d83f5fb56328-kube-api-access-9kc9x\") pod \"node-exporter-vcsbd\" (UID: \"5fff9157-6f59-44bd-bb68-d83f5fb56328\") " pod="openshift-monitoring/node-exporter-vcsbd" Jun 08 16:49:23.803479 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.803258 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5fff9157-6f59-44bd-bb68-d83f5fb56328-root\") pod \"node-exporter-vcsbd\" (UID: \"5fff9157-6f59-44bd-bb68-d83f5fb56328\") " pod="openshift-monitoring/node-exporter-vcsbd" Jun 08 16:49:23.803479 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.803294 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37610212-ce3b-459a-9d75-2a949e72aab5-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-d956z\" (UID: \"37610212-ce3b-459a-9d75-2a949e72aab5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d956z" Jun 08 16:49:23.803479 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.803322 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/37610212-ce3b-459a-9d75-2a949e72aab5-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-d956z\" (UID: \"37610212-ce3b-459a-9d75-2a949e72aab5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d956z" Jun 08 16:49:23.803479 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.803353 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/37610212-ce3b-459a-9d75-2a949e72aab5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-d956z\" (UID: \"37610212-ce3b-459a-9d75-2a949e72aab5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d956z" Jun 08 16:49:23.803479 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.803382 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5fff9157-6f59-44bd-bb68-d83f5fb56328-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vcsbd\" (UID: \"5fff9157-6f59-44bd-bb68-d83f5fb56328\") " pod="openshift-monitoring/node-exporter-vcsbd" Jun 08 16:49:23.803479 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.803414 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl4g4\" (UniqueName: \"kubernetes.io/projected/37610212-ce3b-459a-9d75-2a949e72aab5-kube-api-access-pl4g4\") pod \"kube-state-metrics-57bbf8bfb5-d956z\" (UID: \"37610212-ce3b-459a-9d75-2a949e72aab5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d956z" Jun 08 16:49:23.803479 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.803450 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5fff9157-6f59-44bd-bb68-d83f5fb56328-node-exporter-tls\") pod \"node-exporter-vcsbd\" (UID: \"5fff9157-6f59-44bd-bb68-d83f5fb56328\") " pod="openshift-monitoring/node-exporter-vcsbd" Jun 08 16:49:23.803479 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.803480 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5fff9157-6f59-44bd-bb68-d83f5fb56328-node-exporter-accelerators-collector-config\") pod \"node-exporter-vcsbd\" (UID: \"5fff9157-6f59-44bd-bb68-d83f5fb56328\") " pod="openshift-monitoring/node-exporter-vcsbd" Jun 08 16:49:23.803865 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.803516 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/37610212-ce3b-459a-9d75-2a949e72aab5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-d956z\" (UID: \"37610212-ce3b-459a-9d75-2a949e72aab5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d956z" Jun 08 16:49:23.803865 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.803546 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5fff9157-6f59-44bd-bb68-d83f5fb56328-node-exporter-textfile\") pod \"node-exporter-vcsbd\" (UID: \"5fff9157-6f59-44bd-bb68-d83f5fb56328\") " pod="openshift-monitoring/node-exporter-vcsbd" Jun 08 16:49:23.803865 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.803578 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5fff9157-6f59-44bd-bb68-d83f5fb56328-root\") pod \"node-exporter-vcsbd\" (UID: \"5fff9157-6f59-44bd-bb68-d83f5fb56328\") " pod="openshift-monitoring/node-exporter-vcsbd" Jun 08 16:49:23.803865 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:49:23.803675 2579 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 08 16:49:23.803865 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:49:23.803744 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37610212-ce3b-459a-9d75-2a949e72aab5-kube-state-metrics-tls podName:37610212-ce3b-459a-9d75-2a949e72aab5 nodeName:}" failed. No retries permitted until 2026-06-08 16:49:24.303724231 +0000 UTC m=+116.200501684 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/37610212-ce3b-459a-9d75-2a949e72aab5-kube-state-metrics-tls") pod "kube-state-metrics-57bbf8bfb5-d956z" (UID: "37610212-ce3b-459a-9d75-2a949e72aab5") : secret "kube-state-metrics-tls" not found Jun 08 16:49:23.803865 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.803762 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5fff9157-6f59-44bd-bb68-d83f5fb56328-metrics-client-ca\") pod \"node-exporter-vcsbd\" (UID: \"5fff9157-6f59-44bd-bb68-d83f5fb56328\") " pod="openshift-monitoring/node-exporter-vcsbd" Jun 08 16:49:23.804177 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.803868 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5fff9157-6f59-44bd-bb68-d83f5fb56328-node-exporter-textfile\") pod \"node-exporter-vcsbd\" (UID: \"5fff9157-6f59-44bd-bb68-d83f5fb56328\") " pod="openshift-monitoring/node-exporter-vcsbd" Jun 08 16:49:23.804177 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:49:23.804004 2579 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 08 16:49:23.804177 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:49:23.804052 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fff9157-6f59-44bd-bb68-d83f5fb56328-node-exporter-tls podName:5fff9157-6f59-44bd-bb68-d83f5fb56328 nodeName:}" failed. No retries permitted until 2026-06-08 16:49:24.304035771 +0000 UTC m=+116.200813224 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/5fff9157-6f59-44bd-bb68-d83f5fb56328-node-exporter-tls") pod "node-exporter-vcsbd" (UID: "5fff9157-6f59-44bd-bb68-d83f5fb56328") : secret "node-exporter-tls" not found Jun 08 16:49:23.804177 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.804100 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5fff9157-6f59-44bd-bb68-d83f5fb56328-node-exporter-wtmp\") pod \"node-exporter-vcsbd\" (UID: \"5fff9157-6f59-44bd-bb68-d83f5fb56328\") " pod="openshift-monitoring/node-exporter-vcsbd" Jun 08 16:49:23.804177 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.804141 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/37610212-ce3b-459a-9d75-2a949e72aab5-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-d956z\" (UID: \"37610212-ce3b-459a-9d75-2a949e72aab5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d956z" Jun 08 16:49:23.804444 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.804182 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5fff9157-6f59-44bd-bb68-d83f5fb56328-sys\") pod \"node-exporter-vcsbd\" (UID: \"5fff9157-6f59-44bd-bb68-d83f5fb56328\") " pod="openshift-monitoring/node-exporter-vcsbd" Jun 08 16:49:23.804444 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.804318 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5fff9157-6f59-44bd-bb68-d83f5fb56328-sys\") pod \"node-exporter-vcsbd\" (UID: \"5fff9157-6f59-44bd-bb68-d83f5fb56328\") " pod="openshift-monitoring/node-exporter-vcsbd" Jun 08 16:49:23.804444 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.804377 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5fff9157-6f59-44bd-bb68-d83f5fb56328-node-exporter-accelerators-collector-config\") pod \"node-exporter-vcsbd\" (UID: \"5fff9157-6f59-44bd-bb68-d83f5fb56328\") " pod="openshift-monitoring/node-exporter-vcsbd" Jun 08 16:49:23.804584 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.804494 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/37610212-ce3b-459a-9d75-2a949e72aab5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-d956z\" (UID: \"37610212-ce3b-459a-9d75-2a949e72aab5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d956z" Jun 08 16:49:23.804584 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.804541 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5fff9157-6f59-44bd-bb68-d83f5fb56328-node-exporter-wtmp\") pod \"node-exporter-vcsbd\" (UID: \"5fff9157-6f59-44bd-bb68-d83f5fb56328\") " pod="openshift-monitoring/node-exporter-vcsbd" Jun 08 16:49:23.804692 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.804593 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37610212-ce3b-459a-9d75-2a949e72aab5-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-d956z\" (UID: \"37610212-ce3b-459a-9d75-2a949e72aab5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d956z" Jun 08 16:49:23.804692 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.804673 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/37610212-ce3b-459a-9d75-2a949e72aab5-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-d956z\" (UID: \"37610212-ce3b-459a-9d75-2a949e72aab5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d956z" Jun 08 16:49:23.806665 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.806638 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5fff9157-6f59-44bd-bb68-d83f5fb56328-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vcsbd\" (UID: \"5fff9157-6f59-44bd-bb68-d83f5fb56328\") " pod="openshift-monitoring/node-exporter-vcsbd" Jun 08 16:49:23.806795 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.806775 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/37610212-ce3b-459a-9d75-2a949e72aab5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-d956z\" (UID: \"37610212-ce3b-459a-9d75-2a949e72aab5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d956z" Jun 08 16:49:23.817698 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.817677 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl4g4\" (UniqueName: \"kubernetes.io/projected/37610212-ce3b-459a-9d75-2a949e72aab5-kube-api-access-pl4g4\") pod \"kube-state-metrics-57bbf8bfb5-d956z\" (UID: \"37610212-ce3b-459a-9d75-2a949e72aab5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d956z" Jun 08 16:49:23.817853 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.817833 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kc9x\" (UniqueName: \"kubernetes.io/projected/5fff9157-6f59-44bd-bb68-d83f5fb56328-kube-api-access-9kc9x\") pod \"node-exporter-vcsbd\" (UID: \"5fff9157-6f59-44bd-bb68-d83f5fb56328\") " pod="openshift-monitoring/node-exporter-vcsbd" Jun 08 16:49:23.843070 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.843027 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:23.955965 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:23.955881 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:24.039257 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.039174 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:24.308543 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.308469 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/37610212-ce3b-459a-9d75-2a949e72aab5-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-d956z\" (UID: \"37610212-ce3b-459a-9d75-2a949e72aab5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d956z" Jun 08 16:49:24.308543 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.308513 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5fff9157-6f59-44bd-bb68-d83f5fb56328-node-exporter-tls\") pod \"node-exporter-vcsbd\" (UID: \"5fff9157-6f59-44bd-bb68-d83f5fb56328\") " pod="openshift-monitoring/node-exporter-vcsbd" Jun 08 16:49:24.311223 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.311196 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5fff9157-6f59-44bd-bb68-d83f5fb56328-node-exporter-tls\") pod \"node-exporter-vcsbd\" (UID: \"5fff9157-6f59-44bd-bb68-d83f5fb56328\") " pod="openshift-monitoring/node-exporter-vcsbd" Jun 08 16:49:24.311367 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.311300 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/37610212-ce3b-459a-9d75-2a949e72aab5-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-d956z\" (UID: \"37610212-ce3b-459a-9d75-2a949e72aab5\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d956z" Jun 08 16:49:24.358108 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.358076 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:24.510034 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.510000 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d956z" Jun 08 16:49:24.525845 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.525818 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vcsbd" Jun 08 16:49:24.537705 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:49:24.537680 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fff9157_6f59_44bd_bb68_d83f5fb56328.slice/crio-824a4e6a871cfbac8968ec2ec3682b40de62e08a0b9ca1c2da46a4816eb1a87d WatchSource:0}: Error finding container 824a4e6a871cfbac8968ec2ec3682b40de62e08a0b9ca1c2da46a4816eb1a87d: Status 404 returned error can't find the container with id 824a4e6a871cfbac8968ec2ec3682b40de62e08a0b9ca1c2da46a4816eb1a87d Jun 08 16:49:24.561881 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.561812 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:24.645965 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.645932 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:24.651264 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.651225 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 16:49:24.656170 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.656124 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-d956z"] Jun 08 16:49:24.656292 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.656275 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:49:24.658861 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:49:24.658839 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37610212_ce3b_459a_9d75_2a949e72aab5.slice/crio-ee482a1d55cb1e7d2242e820964b870d62bac3fedf7f066297a7c836099aed5f WatchSource:0}: Error finding container ee482a1d55cb1e7d2242e820964b870d62bac3fedf7f066297a7c836099aed5f: Status 404 returned error can't find the container with id ee482a1d55cb1e7d2242e820964b870d62bac3fedf7f066297a7c836099aed5f Jun 08 16:49:24.659093 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.659072 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 08 16:49:24.659093 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.659097 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 08 16:49:24.659383 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.659347 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 08 16:49:24.659383 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.659347 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 08 16:49:24.659555 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.659402 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 08 16:49:24.659555 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.659534 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 08 16:49:24.659765 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.659534 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 08 16:49:24.659765 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.659642 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 08 16:49:24.659899 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.659882 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 08 16:49:24.659961 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.659908 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-z2448\"" Jun 08 16:49:24.674088 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.674066 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 16:49:24.759636 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.759602 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:24.812758 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.812686 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-web-config\") pod \"alertmanager-main-0\" (UID: \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:49:24.812758 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.812732 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:49:24.812928 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.812802 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:49:24.812928 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.812857 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:49:24.812928 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.812885 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:49:24.813054 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.812946 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:49:24.813054 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.812977 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:49:24.813054 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.813015 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:49:24.813054 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.813047 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-config-volume\") pod \"alertmanager-main-0\" (UID: \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:49:24.813181 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.813080 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-config-out\") pod \"alertmanager-main-0\" (UID: \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:49:24.813181 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.813098 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:49:24.813181 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.813114 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-629hk\" (UniqueName: \"kubernetes.io/projected/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-kube-api-access-629hk\") pod \"alertmanager-main-0\" (UID: \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:49:24.813181 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.813142 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:49:24.913680 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.913645 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:49:24.913680 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.913683 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:49:24.913911 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.913712 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:49:24.913911 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.913733 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-config-volume\") pod \"alertmanager-main-0\" (UID: \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:49:24.913911 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.913752 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-config-out\") pod \"alertmanager-main-0\" (UID: \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:49:24.913911 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.913778 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:49:24.913911 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.913797 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-629hk\" (UniqueName: \"kubernetes.io/projected/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-kube-api-access-629hk\") pod \"alertmanager-main-0\" (UID: \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:49:24.913911 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.913814 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:49:24.913911 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.913850 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-web-config\") pod \"alertmanager-main-0\" (UID: \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:49:24.913911 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.913874 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:49:24.913911 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.913902 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:49:24.914369 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.913958 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:49:24.914369 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.913998 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:49:24.914529 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.914512 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:49:24.915035 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.914979 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:49:24.915549 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.915525 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:49:24.917298 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.917227 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:49:24.917814 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.917771 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:49:24.918163 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.917952 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:49:24.918163 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.918105 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:49:24.918163 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.918125 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-config-out\") pod \"alertmanager-main-0\" (UID: \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:49:24.918656 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.918634 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-config-volume\") pod \"alertmanager-main-0\" (UID: \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:49:24.918749 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.918733 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-web-config\") pod \"alertmanager-main-0\" (UID: \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:49:24.918836 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.918810 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:49:24.919015 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.918993 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:49:24.923122 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.923104 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-629hk\" (UniqueName: \"kubernetes.io/projected/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-kube-api-access-629hk\") pod \"alertmanager-main-0\" (UID: \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:49:24.970844 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.970785 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:49:24.974855 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.974825 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d956z" event={"ID":"37610212-ce3b-459a-9d75-2a949e72aab5","Type":"ContainerStarted","Data":"ee482a1d55cb1e7d2242e820964b870d62bac3fedf7f066297a7c836099aed5f"} Jun 08 16:49:24.976277 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:24.976255 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vcsbd" event={"ID":"5fff9157-6f59-44bd-bb68-d83f5fb56328","Type":"ContainerStarted","Data":"824a4e6a871cfbac8968ec2ec3682b40de62e08a0b9ca1c2da46a4816eb1a87d"} Jun 08 16:49:25.128798 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:25.128775 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 16:49:25.131192 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:49:25.131154 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6f7a42a_49b9_49c9_a7ef_0abcc44fbc33.slice/crio-99b50c11d7f64fe71401720fb93be273bc08c7d108de55b5f90d6445eed0c267 WatchSource:0}: Error finding container 99b50c11d7f64fe71401720fb93be273bc08c7d108de55b5f90d6445eed0c267: Status 404 returned error can't find the container with id 99b50c11d7f64fe71401720fb93be273bc08c7d108de55b5f90d6445eed0c267 Jun 08 16:49:25.566444 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:25.566378 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6685bf9566-m6m5j"] Jun 08 16:49:25.572268 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:25.571899 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6685bf9566-m6m5j" Jun 08 16:49:25.575665 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:25.575636 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 08 16:49:25.575915 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:25.575893 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 08 16:49:25.576165 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:25.576147 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-b8ilqqc2v4o1\"" Jun 08 16:49:25.576496 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:25.576478 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 08 16:49:25.576845 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:25.576822 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 08 16:49:25.576947 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:25.576900 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 08 16:49:25.577261 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:25.577128 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-2gsct\"" Jun 08 16:49:25.585761 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:25.585681 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6685bf9566-m6m5j"] Jun 08 16:49:25.720114 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:25.720037 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5e80641a-da35-4c3e-b8d1-5823cb3c2969-secret-grpc-tls\") pod \"thanos-querier-6685bf9566-m6m5j\" (UID: \"5e80641a-da35-4c3e-b8d1-5823cb3c2969\") " pod="openshift-monitoring/thanos-querier-6685bf9566-m6m5j" Jun 08 16:49:25.720114 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:25.720071 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5e80641a-da35-4c3e-b8d1-5823cb3c2969-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6685bf9566-m6m5j\" (UID: \"5e80641a-da35-4c3e-b8d1-5823cb3c2969\") " pod="openshift-monitoring/thanos-querier-6685bf9566-m6m5j" Jun 08 16:49:25.720114 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:25.720108 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e80641a-da35-4c3e-b8d1-5823cb3c2969-metrics-client-ca\") pod \"thanos-querier-6685bf9566-m6m5j\" (UID: \"5e80641a-da35-4c3e-b8d1-5823cb3c2969\") " pod="openshift-monitoring/thanos-querier-6685bf9566-m6m5j" Jun 08 16:49:25.720407 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:25.720133 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5e80641a-da35-4c3e-b8d1-5823cb3c2969-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6685bf9566-m6m5j\" (UID: \"5e80641a-da35-4c3e-b8d1-5823cb3c2969\") " pod="openshift-monitoring/thanos-querier-6685bf9566-m6m5j" Jun 08 16:49:25.720407 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:25.720186 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5e80641a-da35-4c3e-b8d1-5823cb3c2969-secret-thanos-querier-tls\") pod \"thanos-querier-6685bf9566-m6m5j\" (UID: \"5e80641a-da35-4c3e-b8d1-5823cb3c2969\") " pod="openshift-monitoring/thanos-querier-6685bf9566-m6m5j" Jun 08 16:49:25.720407 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:25.720309 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5e80641a-da35-4c3e-b8d1-5823cb3c2969-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6685bf9566-m6m5j\" (UID: \"5e80641a-da35-4c3e-b8d1-5823cb3c2969\") " pod="openshift-monitoring/thanos-querier-6685bf9566-m6m5j" Jun 08 16:49:25.720407 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:25.720342 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rzwg\" (UniqueName: \"kubernetes.io/projected/5e80641a-da35-4c3e-b8d1-5823cb3c2969-kube-api-access-2rzwg\") pod \"thanos-querier-6685bf9566-m6m5j\" (UID: \"5e80641a-da35-4c3e-b8d1-5823cb3c2969\") " pod="openshift-monitoring/thanos-querier-6685bf9566-m6m5j" Jun 08 16:49:25.720614 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:25.720418 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5e80641a-da35-4c3e-b8d1-5823cb3c2969-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6685bf9566-m6m5j\" (UID: \"5e80641a-da35-4c3e-b8d1-5823cb3c2969\") " pod="openshift-monitoring/thanos-querier-6685bf9566-m6m5j" Jun 08 16:49:25.821651 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:25.821610 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5e80641a-da35-4c3e-b8d1-5823cb3c2969-secret-grpc-tls\") pod \"thanos-querier-6685bf9566-m6m5j\" (UID: \"5e80641a-da35-4c3e-b8d1-5823cb3c2969\") " pod="openshift-monitoring/thanos-querier-6685bf9566-m6m5j" Jun 08 16:49:25.821812 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:25.821669 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5e80641a-da35-4c3e-b8d1-5823cb3c2969-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6685bf9566-m6m5j\" (UID: \"5e80641a-da35-4c3e-b8d1-5823cb3c2969\") " pod="openshift-monitoring/thanos-querier-6685bf9566-m6m5j" Jun 08 16:49:25.821812 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:25.821728 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e80641a-da35-4c3e-b8d1-5823cb3c2969-metrics-client-ca\") pod \"thanos-querier-6685bf9566-m6m5j\" (UID: \"5e80641a-da35-4c3e-b8d1-5823cb3c2969\") " pod="openshift-monitoring/thanos-querier-6685bf9566-m6m5j" Jun 08 16:49:25.821894 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:25.821851 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5e80641a-da35-4c3e-b8d1-5823cb3c2969-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6685bf9566-m6m5j\" (UID: \"5e80641a-da35-4c3e-b8d1-5823cb3c2969\") " pod="openshift-monitoring/thanos-querier-6685bf9566-m6m5j" Jun 08 16:49:25.821925 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:25.821890 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5e80641a-da35-4c3e-b8d1-5823cb3c2969-secret-thanos-querier-tls\") pod \"thanos-querier-6685bf9566-m6m5j\" (UID: \"5e80641a-da35-4c3e-b8d1-5823cb3c2969\") " pod="openshift-monitoring/thanos-querier-6685bf9566-m6m5j" Jun 08 16:49:25.821970 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:25.821923 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5e80641a-da35-4c3e-b8d1-5823cb3c2969-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6685bf9566-m6m5j\" (UID: \"5e80641a-da35-4c3e-b8d1-5823cb3c2969\") " pod="openshift-monitoring/thanos-querier-6685bf9566-m6m5j" Jun 08 16:49:25.821970 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:25.821955 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rzwg\" (UniqueName: \"kubernetes.io/projected/5e80641a-da35-4c3e-b8d1-5823cb3c2969-kube-api-access-2rzwg\") pod \"thanos-querier-6685bf9566-m6m5j\" (UID: \"5e80641a-da35-4c3e-b8d1-5823cb3c2969\") " pod="openshift-monitoring/thanos-querier-6685bf9566-m6m5j" Jun 08 16:49:25.822059 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:25.822014 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5e80641a-da35-4c3e-b8d1-5823cb3c2969-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6685bf9566-m6m5j\" (UID: \"5e80641a-da35-4c3e-b8d1-5823cb3c2969\") " pod="openshift-monitoring/thanos-querier-6685bf9566-m6m5j" Jun 08 16:49:25.822621 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:25.822595 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e80641a-da35-4c3e-b8d1-5823cb3c2969-metrics-client-ca\") pod \"thanos-querier-6685bf9566-m6m5j\" (UID: \"5e80641a-da35-4c3e-b8d1-5823cb3c2969\") " pod="openshift-monitoring/thanos-querier-6685bf9566-m6m5j" Jun 08 16:49:25.824989 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:25.824961 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5e80641a-da35-4c3e-b8d1-5823cb3c2969-secret-thanos-querier-tls\") pod \"thanos-querier-6685bf9566-m6m5j\" (UID: \"5e80641a-da35-4c3e-b8d1-5823cb3c2969\") " pod="openshift-monitoring/thanos-querier-6685bf9566-m6m5j" Jun 08 16:49:25.825299 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:25.825274 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5e80641a-da35-4c3e-b8d1-5823cb3c2969-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6685bf9566-m6m5j\" (UID: \"5e80641a-da35-4c3e-b8d1-5823cb3c2969\") " pod="openshift-monitoring/thanos-querier-6685bf9566-m6m5j" Jun 08 16:49:25.825470 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:25.825444 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5e80641a-da35-4c3e-b8d1-5823cb3c2969-secret-grpc-tls\") pod \"thanos-querier-6685bf9566-m6m5j\" (UID: \"5e80641a-da35-4c3e-b8d1-5823cb3c2969\") " pod="openshift-monitoring/thanos-querier-6685bf9566-m6m5j" Jun 08 16:49:25.826390 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:25.826350 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5e80641a-da35-4c3e-b8d1-5823cb3c2969-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6685bf9566-m6m5j\" (UID: \"5e80641a-da35-4c3e-b8d1-5823cb3c2969\") " pod="openshift-monitoring/thanos-querier-6685bf9566-m6m5j" Jun 08 16:49:25.826849 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:25.826812 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5e80641a-da35-4c3e-b8d1-5823cb3c2969-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6685bf9566-m6m5j\" (UID: \"5e80641a-da35-4c3e-b8d1-5823cb3c2969\") " pod="openshift-monitoring/thanos-querier-6685bf9566-m6m5j" Jun 08 16:49:25.827404 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:25.827366 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5e80641a-da35-4c3e-b8d1-5823cb3c2969-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6685bf9566-m6m5j\" (UID: \"5e80641a-da35-4c3e-b8d1-5823cb3c2969\") " pod="openshift-monitoring/thanos-querier-6685bf9566-m6m5j" Jun 08 16:49:25.830191 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:25.830148 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rzwg\" (UniqueName: \"kubernetes.io/projected/5e80641a-da35-4c3e-b8d1-5823cb3c2969-kube-api-access-2rzwg\") pod \"thanos-querier-6685bf9566-m6m5j\" (UID: \"5e80641a-da35-4c3e-b8d1-5823cb3c2969\") " pod="openshift-monitoring/thanos-querier-6685bf9566-m6m5j" Jun 08 16:49:25.932363 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:25.932322 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6685bf9566-m6m5j" Jun 08 16:49:25.982097 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:25.982018 2579 generic.go:356] "Generic (PLEG): container finished" podID="5fff9157-6f59-44bd-bb68-d83f5fb56328" containerID="d0a64883aebab0d4aef4c3c138de5c114ab2e3f108a8d0d28014b8c0da6ce48c" exitCode=0 Jun 08 16:49:25.982359 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:25.982328 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vcsbd" event={"ID":"5fff9157-6f59-44bd-bb68-d83f5fb56328","Type":"ContainerDied","Data":"d0a64883aebab0d4aef4c3c138de5c114ab2e3f108a8d0d28014b8c0da6ce48c"} Jun 08 16:49:25.984009 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:25.983985 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33","Type":"ContainerStarted","Data":"99b50c11d7f64fe71401720fb93be273bc08c7d108de55b5f90d6445eed0c267"} Jun 08 16:49:26.493859 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:26.493835 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6685bf9566-m6m5j"] Jun 08 16:49:26.496498 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:49:26.496460 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e80641a_da35_4c3e_b8d1_5823cb3c2969.slice/crio-e09a99952c242b0d0280611a0a8feb1b151408bb82701f25c11af7bc2794adc0 WatchSource:0}: Error finding container e09a99952c242b0d0280611a0a8feb1b151408bb82701f25c11af7bc2794adc0: Status 404 returned error can't find the container with id e09a99952c242b0d0280611a0a8feb1b151408bb82701f25c11af7bc2794adc0 Jun 08 16:49:26.543014 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:26.542958 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:26.642889 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:26.642844 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:26.701197 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:26.701170 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:26.768630 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:26.768594 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:26.990099 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:26.990003 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d956z" event={"ID":"37610212-ce3b-459a-9d75-2a949e72aab5","Type":"ContainerStarted","Data":"94f1f8096551eea76adbec5c4e7796194c6b558af9e15f60e980cf7c7cfb95d6"} Jun 08 16:49:26.990099 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:26.990071 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d956z" event={"ID":"37610212-ce3b-459a-9d75-2a949e72aab5","Type":"ContainerStarted","Data":"1997214a5edc9b4da0e7149aef634df8995c697181747642643ca946794ebebd"} Jun 08 16:49:26.990099 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:26.990097 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d956z" event={"ID":"37610212-ce3b-459a-9d75-2a949e72aab5","Type":"ContainerStarted","Data":"88fcc1c6cbe0ef74a59a75fad69e5fe14e6dbe874bc50cd4661d6be828e2de6b"} Jun 08 16:49:26.991961 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:26.991938 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vcsbd" event={"ID":"5fff9157-6f59-44bd-bb68-d83f5fb56328","Type":"ContainerStarted","Data":"731fe09fa267f8e69284130e11c5eb419c5f5270c0a25cdbbafc2fc8d3605639"} Jun 08 16:49:26.992099 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:26.992007 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vcsbd" event={"ID":"5fff9157-6f59-44bd-bb68-d83f5fb56328","Type":"ContainerStarted","Data":"9e082b7c2e3b13ed9c9f71986c85fc9e6c18159cc6d9fc112ef5843d9b9bbd30"} Jun 08 16:49:26.993367 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:26.993344 2579 generic.go:356] "Generic (PLEG): container finished" podID="f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33" containerID="31e780dde1cda5929a461cb9318c6146cc69419b134ec80ef21668c3020001cf" exitCode=0 Jun 08 16:49:26.993459 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:26.993381 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33","Type":"ContainerDied","Data":"31e780dde1cda5929a461cb9318c6146cc69419b134ec80ef21668c3020001cf"} Jun 08 16:49:26.994633 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:26.994613 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6685bf9566-m6m5j" event={"ID":"5e80641a-da35-4c3e-b8d1-5823cb3c2969","Type":"ContainerStarted","Data":"e09a99952c242b0d0280611a0a8feb1b151408bb82701f25c11af7bc2794adc0"} Jun 08 16:49:27.010162 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:27.010090 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d956z" podStartSLOduration=2.354998737 podStartE2EDuration="4.010073961s" totalImagesPullingTime="1.655075224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:49:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:49:27.0096384 +0000 UTC m=+118.906415876" watchObservedRunningTime="2026-06-08 16:49:27.010073961 +0000 UTC m=+118.906851436" Jun 08 16:49:27.030316 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:27.030277 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vcsbd" podStartSLOduration=3.0604670880000002 podStartE2EDuration="4.030265286s" totalImagesPullingTime="880.850013ms" totalInitContainerRuntime="88.948185ms" isStatefulPod=true podCreationTimestamp="2026-06-08 16:49:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:49:27.029117005 +0000 UTC m=+118.925894481" watchObservedRunningTime="2026-06-08 16:49:27.030265286 +0000 UTC m=+118.927042755" Jun 08 16:49:27.943777 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:27.943730 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:28.008082 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:28.008033 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:28.331000 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:28.330961 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-rf6jk"] Jun 08 16:49:28.331318 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:28.331175 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:28.336096 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:28.335583 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-rf6jk" Jun 08 16:49:28.338488 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:28.338466 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 08 16:49:28.338606 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:28.338567 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-wnqrv\"" Jun 08 16:49:28.350203 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:28.350112 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-rf6jk"] Jun 08 16:49:28.404624 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:28.404581 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:28.448620 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:28.448579 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prmtn\" (UniqueName: \"kubernetes.io/projected/9c94da77-3591-40a6-90f1-ab02631e4cec-kube-api-access-prmtn\") pod \"monitoring-plugin-76b68cc874-rf6jk\" (UID: \"9c94da77-3591-40a6-90f1-ab02631e4cec\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-rf6jk" Jun 08 16:49:28.448620 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:28.448623 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9c94da77-3591-40a6-90f1-ab02631e4cec-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-rf6jk\" (UID: \"9c94da77-3591-40a6-90f1-ab02631e4cec\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-rf6jk" Jun 08 16:49:28.549397 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:28.549371 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prmtn\" (UniqueName: \"kubernetes.io/projected/9c94da77-3591-40a6-90f1-ab02631e4cec-kube-api-access-prmtn\") pod \"monitoring-plugin-76b68cc874-rf6jk\" (UID: \"9c94da77-3591-40a6-90f1-ab02631e4cec\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-rf6jk" Jun 08 16:49:28.549555 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:28.549424 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9c94da77-3591-40a6-90f1-ab02631e4cec-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-rf6jk\" (UID: \"9c94da77-3591-40a6-90f1-ab02631e4cec\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-rf6jk" Jun 08 16:49:28.552143 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:28.552123 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 08 16:49:28.557560 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:28.557540 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prmtn\" (UniqueName: \"kubernetes.io/projected/9c94da77-3591-40a6-90f1-ab02631e4cec-kube-api-access-prmtn\") pod \"monitoring-plugin-76b68cc874-rf6jk\" (UID: \"9c94da77-3591-40a6-90f1-ab02631e4cec\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-rf6jk" Jun 08 16:49:28.560204 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:49:28.560182 2579 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 08 16:49:28.560298 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:49:28.560271 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c94da77-3591-40a6-90f1-ab02631e4cec-monitoring-plugin-cert podName:9c94da77-3591-40a6-90f1-ab02631e4cec nodeName:}" failed. No retries permitted until 2026-06-08 16:49:29.06023205 +0000 UTC m=+120.957009507 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/9c94da77-3591-40a6-90f1-ab02631e4cec-monitoring-plugin-cert") pod "monitoring-plugin-76b68cc874-rf6jk" (UID: "9c94da77-3591-40a6-90f1-ab02631e4cec") : secret "monitoring-plugin-cert" not found Jun 08 16:49:28.673969 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:28.673887 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:29.155084 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:29.155056 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9c94da77-3591-40a6-90f1-ab02631e4cec-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-rf6jk\" (UID: \"9c94da77-3591-40a6-90f1-ab02631e4cec\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-rf6jk" Jun 08 16:49:29.157427 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:29.157401 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9c94da77-3591-40a6-90f1-ab02631e4cec-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-rf6jk\" (UID: \"9c94da77-3591-40a6-90f1-ab02631e4cec\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-rf6jk" Jun 08 16:49:29.252743 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:29.252716 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-wnqrv\"" Jun 08 16:49:29.261121 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:29.261099 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-rf6jk" Jun 08 16:49:29.395867 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:29.395797 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-rf6jk"] Jun 08 16:49:29.399089 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:49:29.399059 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c94da77_3591_40a6_90f1_ab02631e4cec.slice/crio-b59fffe40d8439040b9b01a028b0ab80f92a686b4747470da722dfdb3e0f72f4 WatchSource:0}: Error finding container b59fffe40d8439040b9b01a028b0ab80f92a686b4747470da722dfdb3e0f72f4: Status 404 returned error can't find the container with id b59fffe40d8439040b9b01a028b0ab80f92a686b4747470da722dfdb3e0f72f4 Jun 08 16:49:29.824984 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:29.824941 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:30.019976 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:30.019938 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33","Type":"ContainerStarted","Data":"2c257748a547fd2163023bc728e8c2a7a0865c47dbae1b5743d5c209ad50b05a"} Jun 08 16:49:30.020157 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:30.020028 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33","Type":"ContainerStarted","Data":"cb29f6fe8c8cafd50fa451e586602228ae69a07150f50ce53d84d73a8c4dcd13"} Jun 08 16:49:30.020157 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:30.020072 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33","Type":"ContainerStarted","Data":"54105098d28ab81478cdca552a107ed49d176220e46806df00ba45e001a453e0"} Jun 08 16:49:30.020157 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:30.020114 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33","Type":"ContainerStarted","Data":"53c8ae1f9e1ccf4d3e5a28d18bae4b1dbb4a686ccbe609e313cebc13817664ef"} Jun 08 16:49:30.020157 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:30.020155 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33","Type":"ContainerStarted","Data":"2c69dbfd1081f27b3b47216bb0133faff4c008cd7b72e5eba06a3f85d34985b3"} Jun 08 16:49:30.023082 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:30.022894 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6685bf9566-m6m5j" event={"ID":"5e80641a-da35-4c3e-b8d1-5823cb3c2969","Type":"ContainerStarted","Data":"00307b15360bb74050c52119fb177c1e664182ddb0815a84ca6a344652bffd99"} Jun 08 16:49:30.023082 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:30.022974 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6685bf9566-m6m5j" event={"ID":"5e80641a-da35-4c3e-b8d1-5823cb3c2969","Type":"ContainerStarted","Data":"1b76aa212b4ecfde324349a8591dc64967c81657698d496203551a992eb12857"} Jun 08 16:49:30.023082 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:30.023023 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6685bf9566-m6m5j" event={"ID":"5e80641a-da35-4c3e-b8d1-5823cb3c2969","Type":"ContainerStarted","Data":"6a4ca10f8a1107a09b9b58a2e24bb3676723a91dd69f4daae17f5aef19fd0555"} Jun 08 16:49:30.024831 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:30.024778 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-rf6jk" event={"ID":"9c94da77-3591-40a6-90f1-ab02631e4cec","Type":"ContainerStarted","Data":"b59fffe40d8439040b9b01a028b0ab80f92a686b4747470da722dfdb3e0f72f4"} Jun 08 16:49:30.082227 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:30.082133 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:31.032571 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:31.032490 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33","Type":"ContainerStarted","Data":"31d0f7f4c17ae03cf567538164e1866a8108af4da3041503a9ed57e433e42528"} Jun 08 16:49:31.035308 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:31.035264 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6685bf9566-m6m5j" event={"ID":"5e80641a-da35-4c3e-b8d1-5823cb3c2969","Type":"ContainerStarted","Data":"83af037d4adf4563f2cdb8d8cb613651dec7206efd2aa794ed1bbcee8a012f52"} Jun 08 16:49:31.035429 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:31.035344 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6685bf9566-m6m5j" event={"ID":"5e80641a-da35-4c3e-b8d1-5823cb3c2969","Type":"ContainerStarted","Data":"96df60a770203f0394e7246d4ea868adda7ff616577608d614a8999138cc76b0"} Jun 08 16:49:31.035429 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:31.035383 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6685bf9566-m6m5j" event={"ID":"5e80641a-da35-4c3e-b8d1-5823cb3c2969","Type":"ContainerStarted","Data":"394d4c70e652348dbd20d9ee8aa1c6cbe265e0774c013ae4452836862d860718"} Jun 08 16:49:31.035530 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:31.035464 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6685bf9566-m6m5j" Jun 08 16:49:31.036745 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:31.036722 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-rf6jk" event={"ID":"9c94da77-3591-40a6-90f1-ab02631e4cec","Type":"ContainerStarted","Data":"5cc76cd533e99992e22d11144ae628705ce71695f11b4f4684051770eae15ad7"} Jun 08 16:49:31.036855 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:31.036757 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-rf6jk" Jun 08 16:49:31.043354 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:31.043332 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-rf6jk" Jun 08 16:49:31.058715 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:31.058671 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.874347257 podStartE2EDuration="7.05865867s" totalImagesPullingTime="4.158901258s" totalInitContainerRuntime="25.410155ms" isStatefulPod=false podCreationTimestamp="2026-06-08 16:49:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:49:31.057160219 +0000 UTC m=+122.953937695" watchObservedRunningTime="2026-06-08 16:49:31.05865867 +0000 UTC m=+122.955436145" Jun 08 16:49:31.078320 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:31.078269 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6685bf9566-m6m5j" podStartSLOduration=2.471990658 podStartE2EDuration="6.078231175s" totalImagesPullingTime="3.606240517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:49:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:49:31.076414166 +0000 UTC m=+122.973191643" watchObservedRunningTime="2026-06-08 16:49:31.078231175 +0000 UTC m=+122.975008652" Jun 08 16:49:31.091854 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:31.091816 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-rf6jk" podStartSLOduration=1.694889695 podStartE2EDuration="3.091805503s" totalImagesPullingTime="1.396915808s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:49:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:49:31.090948087 +0000 UTC m=+122.987725563" watchObservedRunningTime="2026-06-08 16:49:31.091805503 +0000 UTC m=+122.988582977" Jun 08 16:49:31.924378 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:31.924346 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5ddbb49fbf-qjj6g" Jun 08 16:49:32.061964 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:32.061926 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:32.121985 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:32.121954 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:32.645086 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:32.645049 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-nhlg6"] Jun 08 16:49:32.648495 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:32.648477 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-nhlg6" Jun 08 16:49:32.651024 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:32.651005 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 08 16:49:32.651480 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:32.651465 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-qzr4p\"" Jun 08 16:49:32.651563 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:32.651538 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 08 16:49:32.659984 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:32.659961 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-nhlg6"] Jun 08 16:49:32.662000 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:32.661971 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:32.689116 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:32.689081 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vpgg\" (UniqueName: \"kubernetes.io/projected/f81b9a94-06d5-40af-9188-bc24b482e22a-kube-api-access-7vpgg\") pod \"downloads-6657875f97-nhlg6\" (UID: \"f81b9a94-06d5-40af-9188-bc24b482e22a\") " pod="openshift-console/downloads-6657875f97-nhlg6" Jun 08 16:49:32.756220 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:32.756186 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:32.790624 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:32.790585 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vpgg\" (UniqueName: \"kubernetes.io/projected/f81b9a94-06d5-40af-9188-bc24b482e22a-kube-api-access-7vpgg\") pod \"downloads-6657875f97-nhlg6\" (UID: \"f81b9a94-06d5-40af-9188-bc24b482e22a\") " pod="openshift-console/downloads-6657875f97-nhlg6" Jun 08 16:49:32.799317 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:32.799280 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vpgg\" (UniqueName: \"kubernetes.io/projected/f81b9a94-06d5-40af-9188-bc24b482e22a-kube-api-access-7vpgg\") pod \"downloads-6657875f97-nhlg6\" (UID: \"f81b9a94-06d5-40af-9188-bc24b482e22a\") " pod="openshift-console/downloads-6657875f97-nhlg6" Jun 08 16:49:32.855635 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:32.855605 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:32.956493 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:32.956402 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:32.957149 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:32.957131 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-nhlg6" Jun 08 16:49:33.111464 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:33.111435 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-nhlg6"] Jun 08 16:49:33.115158 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:49:33.115129 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf81b9a94_06d5_40af_9188_bc24b482e22a.slice/crio-8c7dd2762c5555a13202ae71bf215f5bee1d82c988220a035354989ae11d7809 WatchSource:0}: Error finding container 8c7dd2762c5555a13202ae71bf215f5bee1d82c988220a035354989ae11d7809: Status 404 returned error can't find the container with id 8c7dd2762c5555a13202ae71bf215f5bee1d82c988220a035354989ae11d7809 Jun 08 16:49:33.380373 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:33.380340 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:33.443918 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:33.443883 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:33.516139 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:33.516099 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:33.577163 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:33.577131 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:33.928731 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:33.928688 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:34.029250 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:34.029203 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:34.053886 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:34.053843 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-nhlg6" event={"ID":"f81b9a94-06d5-40af-9188-bc24b482e22a","Type":"ContainerStarted","Data":"8c7dd2762c5555a13202ae71bf215f5bee1d82c988220a035354989ae11d7809"} Jun 08 16:49:34.523642 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:34.523610 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:34.730954 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:34.730918 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:35.129091 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:35.128958 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:35.352380 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:35.352341 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:37.050336 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:37.050306 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6685bf9566-m6m5j" Jun 08 16:49:38.344317 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:38.344270 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc8ed935-c565-44cd-93bf-b2699dd09b1b-metrics-certs\") pod \"network-metrics-daemon-52225\" (UID: \"cc8ed935-c565-44cd-93bf-b2699dd09b1b\") " pod="openshift-multus/network-metrics-daemon-52225" Jun 08 16:49:38.347077 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:38.347041 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc8ed935-c565-44cd-93bf-b2699dd09b1b-metrics-certs\") pod \"network-metrics-daemon-52225\" (UID: \"cc8ed935-c565-44cd-93bf-b2699dd09b1b\") " pod="openshift-multus/network-metrics-daemon-52225" Jun 08 16:49:38.646664 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:38.646577 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9mcb6\"" Jun 08 16:49:38.654808 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:38.654777 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-52225" Jun 08 16:49:38.785653 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:38.785621 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-52225"] Jun 08 16:49:38.789374 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:49:38.789303 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc8ed935_c565_44cd_93bf_b2699dd09b1b.slice/crio-9bc707ba9503a3d89bb018f717db5ede996dad1599cd1fc462ad166a425ff4f7 WatchSource:0}: Error finding container 9bc707ba9503a3d89bb018f717db5ede996dad1599cd1fc462ad166a425ff4f7: Status 404 returned error can't find the container with id 9bc707ba9503a3d89bb018f717db5ede996dad1599cd1fc462ad166a425ff4f7 Jun 08 16:49:39.057548 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:39.057436 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:39.076949 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:39.076910 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-52225" event={"ID":"cc8ed935-c565-44cd-93bf-b2699dd09b1b","Type":"ContainerStarted","Data":"9bc707ba9503a3d89bb018f717db5ede996dad1599cd1fc462ad166a425ff4f7"} Jun 08 16:49:39.159131 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:39.159079 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:40.084019 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:40.083985 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-52225" event={"ID":"cc8ed935-c565-44cd-93bf-b2699dd09b1b","Type":"ContainerStarted","Data":"c16f0677cff28828536f9a7cf7a7f5eb684ad978b3e2ea5c98a0c89314ba5fde"} Jun 08 16:49:40.084472 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:40.084038 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-52225" event={"ID":"cc8ed935-c565-44cd-93bf-b2699dd09b1b","Type":"ContainerStarted","Data":"cb5e917717e1b40a1cee5bfd9d61604b1663ee09dd8f51cdc9a48566dca4e84a"} Jun 08 16:49:40.105221 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:40.105159 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-52225" podStartSLOduration=131.19289186 podStartE2EDuration="2m12.105144709s" totalImagesPullingTime="912.252849ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:47:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:49:40.103863874 +0000 UTC m=+132.000641360" watchObservedRunningTime="2026-06-08 16:49:40.105144709 +0000 UTC m=+132.001922183" Jun 08 16:49:40.198870 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:40.198825 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:40.256218 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:40.256182 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:41.118305 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:41.118273 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:41.177535 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:41.177505 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:42.684711 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:42.684677 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54cb67944f-bf2fk"] Jun 08 16:49:42.689376 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:42.689354 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54cb67944f-bf2fk" Jun 08 16:49:42.692259 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:42.692216 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-xhdc5\"" Jun 08 16:49:42.692366 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:42.692327 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 08 16:49:42.693492 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:42.693224 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 08 16:49:42.693492 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:42.693340 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 08 16:49:42.693492 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:42.693372 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 08 16:49:42.693492 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:42.693435 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 08 16:49:42.701738 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:42.701717 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54cb67944f-bf2fk"] Jun 08 16:49:42.781275 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:42.781231 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78425613-8e75-4220-8b0f-f67a5a870a28-service-ca\") pod \"console-54cb67944f-bf2fk\" (UID: \"78425613-8e75-4220-8b0f-f67a5a870a28\") " pod="openshift-console/console-54cb67944f-bf2fk" Jun 08 16:49:42.781381 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:42.781284 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78425613-8e75-4220-8b0f-f67a5a870a28-console-serving-cert\") pod \"console-54cb67944f-bf2fk\" (UID: \"78425613-8e75-4220-8b0f-f67a5a870a28\") " pod="openshift-console/console-54cb67944f-bf2fk" Jun 08 16:49:42.781381 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:42.781368 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h98v2\" (UniqueName: \"kubernetes.io/projected/78425613-8e75-4220-8b0f-f67a5a870a28-kube-api-access-h98v2\") pod \"console-54cb67944f-bf2fk\" (UID: \"78425613-8e75-4220-8b0f-f67a5a870a28\") " pod="openshift-console/console-54cb67944f-bf2fk" Jun 08 16:49:42.781448 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:42.781398 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78425613-8e75-4220-8b0f-f67a5a870a28-console-oauth-config\") pod \"console-54cb67944f-bf2fk\" (UID: \"78425613-8e75-4220-8b0f-f67a5a870a28\") " pod="openshift-console/console-54cb67944f-bf2fk" Jun 08 16:49:42.781448 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:42.781422 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78425613-8e75-4220-8b0f-f67a5a870a28-console-config\") pod \"console-54cb67944f-bf2fk\" (UID: \"78425613-8e75-4220-8b0f-f67a5a870a28\") " pod="openshift-console/console-54cb67944f-bf2fk" Jun 08 16:49:42.781511 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:42.781452 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78425613-8e75-4220-8b0f-f67a5a870a28-oauth-serving-cert\") pod \"console-54cb67944f-bf2fk\" (UID: \"78425613-8e75-4220-8b0f-f67a5a870a28\") " pod="openshift-console/console-54cb67944f-bf2fk" Jun 08 16:49:42.882453 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:42.882419 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78425613-8e75-4220-8b0f-f67a5a870a28-console-serving-cert\") pod \"console-54cb67944f-bf2fk\" (UID: \"78425613-8e75-4220-8b0f-f67a5a870a28\") " pod="openshift-console/console-54cb67944f-bf2fk" Jun 08 16:49:42.882569 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:42.882500 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h98v2\" (UniqueName: \"kubernetes.io/projected/78425613-8e75-4220-8b0f-f67a5a870a28-kube-api-access-h98v2\") pod \"console-54cb67944f-bf2fk\" (UID: \"78425613-8e75-4220-8b0f-f67a5a870a28\") " pod="openshift-console/console-54cb67944f-bf2fk" Jun 08 16:49:42.882569 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:42.882536 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78425613-8e75-4220-8b0f-f67a5a870a28-console-oauth-config\") pod \"console-54cb67944f-bf2fk\" (UID: \"78425613-8e75-4220-8b0f-f67a5a870a28\") " pod="openshift-console/console-54cb67944f-bf2fk" Jun 08 16:49:42.882677 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:42.882576 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78425613-8e75-4220-8b0f-f67a5a870a28-console-config\") pod \"console-54cb67944f-bf2fk\" (UID: \"78425613-8e75-4220-8b0f-f67a5a870a28\") " pod="openshift-console/console-54cb67944f-bf2fk" Jun 08 16:49:42.882677 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:42.882604 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78425613-8e75-4220-8b0f-f67a5a870a28-oauth-serving-cert\") pod \"console-54cb67944f-bf2fk\" (UID: \"78425613-8e75-4220-8b0f-f67a5a870a28\") " pod="openshift-console/console-54cb67944f-bf2fk" Jun 08 16:49:42.882677 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:42.882643 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78425613-8e75-4220-8b0f-f67a5a870a28-service-ca\") pod \"console-54cb67944f-bf2fk\" (UID: \"78425613-8e75-4220-8b0f-f67a5a870a28\") " pod="openshift-console/console-54cb67944f-bf2fk" Jun 08 16:49:42.883368 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:42.883344 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78425613-8e75-4220-8b0f-f67a5a870a28-console-config\") pod \"console-54cb67944f-bf2fk\" (UID: \"78425613-8e75-4220-8b0f-f67a5a870a28\") " pod="openshift-console/console-54cb67944f-bf2fk" Jun 08 16:49:42.883613 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:42.883593 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78425613-8e75-4220-8b0f-f67a5a870a28-service-ca\") pod \"console-54cb67944f-bf2fk\" (UID: \"78425613-8e75-4220-8b0f-f67a5a870a28\") " pod="openshift-console/console-54cb67944f-bf2fk" Jun 08 16:49:42.883696 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:42.883671 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78425613-8e75-4220-8b0f-f67a5a870a28-oauth-serving-cert\") pod \"console-54cb67944f-bf2fk\" (UID: \"78425613-8e75-4220-8b0f-f67a5a870a28\") " pod="openshift-console/console-54cb67944f-bf2fk" Jun 08 16:49:42.885253 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:42.885220 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78425613-8e75-4220-8b0f-f67a5a870a28-console-serving-cert\") pod \"console-54cb67944f-bf2fk\" (UID: \"78425613-8e75-4220-8b0f-f67a5a870a28\") " pod="openshift-console/console-54cb67944f-bf2fk" Jun 08 16:49:42.885354 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:42.885329 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78425613-8e75-4220-8b0f-f67a5a870a28-console-oauth-config\") pod \"console-54cb67944f-bf2fk\" (UID: \"78425613-8e75-4220-8b0f-f67a5a870a28\") " pod="openshift-console/console-54cb67944f-bf2fk" Jun 08 16:49:42.892147 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:42.892124 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h98v2\" (UniqueName: \"kubernetes.io/projected/78425613-8e75-4220-8b0f-f67a5a870a28-kube-api-access-h98v2\") pod \"console-54cb67944f-bf2fk\" (UID: \"78425613-8e75-4220-8b0f-f67a5a870a28\") " pod="openshift-console/console-54cb67944f-bf2fk" Jun 08 16:49:42.942140 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:42.942069 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:43.000783 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:43.000759 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54cb67944f-bf2fk" Jun 08 16:49:43.043375 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:43.043297 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:43.145441 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:43.145416 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54cb67944f-bf2fk"] Jun 08 16:49:43.147678 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:49:43.147647 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78425613_8e75_4220_8b0f_f67a5a870a28.slice/crio-49922b074ff8eb32426e364d66d5799649cf7a323949636d562b0070a2f89588 WatchSource:0}: Error finding container 49922b074ff8eb32426e364d66d5799649cf7a323949636d562b0070a2f89588: Status 404 returned error can't find the container with id 49922b074ff8eb32426e364d66d5799649cf7a323949636d562b0070a2f89588 Jun 08 16:49:44.104448 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:44.104403 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54cb67944f-bf2fk" event={"ID":"78425613-8e75-4220-8b0f-f67a5a870a28","Type":"ContainerStarted","Data":"49922b074ff8eb32426e364d66d5799649cf7a323949636d562b0070a2f89588"} Jun 08 16:49:46.555452 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:46.555404 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:46.654103 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:46.654022 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:49.757945 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:49.757888 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:49.814800 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:49.814764 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:49.950806 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:49.950749 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:50.010893 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:50.010802 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:50.547517 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:50.547483 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-689c455565-xf5dr"] Jun 08 16:49:50.557682 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:50.557658 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-689c455565-xf5dr" Jun 08 16:49:50.566212 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:50.566182 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 08 16:49:50.567465 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:50.567343 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-689c455565-xf5dr"] Jun 08 16:49:50.655188 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:50.655148 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0864113e-05ab-4ca4-b633-f88be80c84e7-service-ca\") pod \"console-689c455565-xf5dr\" (UID: \"0864113e-05ab-4ca4-b633-f88be80c84e7\") " pod="openshift-console/console-689c455565-xf5dr" Jun 08 16:49:50.655390 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:50.655204 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0864113e-05ab-4ca4-b633-f88be80c84e7-console-oauth-config\") pod \"console-689c455565-xf5dr\" (UID: \"0864113e-05ab-4ca4-b633-f88be80c84e7\") " pod="openshift-console/console-689c455565-xf5dr" Jun 08 16:49:50.655390 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:50.655340 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0864113e-05ab-4ca4-b633-f88be80c84e7-trusted-ca-bundle\") pod \"console-689c455565-xf5dr\" (UID: \"0864113e-05ab-4ca4-b633-f88be80c84e7\") " pod="openshift-console/console-689c455565-xf5dr" Jun 08 16:49:50.655390 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:50.655377 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0864113e-05ab-4ca4-b633-f88be80c84e7-console-config\") pod \"console-689c455565-xf5dr\" (UID: \"0864113e-05ab-4ca4-b633-f88be80c84e7\") " pod="openshift-console/console-689c455565-xf5dr" Jun 08 16:49:50.655541 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:50.655403 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0864113e-05ab-4ca4-b633-f88be80c84e7-oauth-serving-cert\") pod \"console-689c455565-xf5dr\" (UID: \"0864113e-05ab-4ca4-b633-f88be80c84e7\") " pod="openshift-console/console-689c455565-xf5dr" Jun 08 16:49:50.655541 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:50.655445 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0864113e-05ab-4ca4-b633-f88be80c84e7-console-serving-cert\") pod \"console-689c455565-xf5dr\" (UID: \"0864113e-05ab-4ca4-b633-f88be80c84e7\") " pod="openshift-console/console-689c455565-xf5dr" Jun 08 16:49:50.655541 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:50.655476 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mckhb\" (UniqueName: \"kubernetes.io/projected/0864113e-05ab-4ca4-b633-f88be80c84e7-kube-api-access-mckhb\") pod \"console-689c455565-xf5dr\" (UID: \"0864113e-05ab-4ca4-b633-f88be80c84e7\") " pod="openshift-console/console-689c455565-xf5dr" Jun 08 16:49:50.756211 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:50.756166 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0864113e-05ab-4ca4-b633-f88be80c84e7-trusted-ca-bundle\") pod \"console-689c455565-xf5dr\" (UID: \"0864113e-05ab-4ca4-b633-f88be80c84e7\") " pod="openshift-console/console-689c455565-xf5dr" Jun 08 16:49:50.756211 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:50.756213 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0864113e-05ab-4ca4-b633-f88be80c84e7-console-config\") pod \"console-689c455565-xf5dr\" (UID: \"0864113e-05ab-4ca4-b633-f88be80c84e7\") " pod="openshift-console/console-689c455565-xf5dr" Jun 08 16:49:50.756484 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:50.756259 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0864113e-05ab-4ca4-b633-f88be80c84e7-oauth-serving-cert\") pod \"console-689c455565-xf5dr\" (UID: \"0864113e-05ab-4ca4-b633-f88be80c84e7\") " pod="openshift-console/console-689c455565-xf5dr" Jun 08 16:49:50.756484 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:50.756305 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0864113e-05ab-4ca4-b633-f88be80c84e7-console-serving-cert\") pod \"console-689c455565-xf5dr\" (UID: \"0864113e-05ab-4ca4-b633-f88be80c84e7\") " pod="openshift-console/console-689c455565-xf5dr" Jun 08 16:49:50.756484 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:50.756362 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mckhb\" (UniqueName: \"kubernetes.io/projected/0864113e-05ab-4ca4-b633-f88be80c84e7-kube-api-access-mckhb\") pod \"console-689c455565-xf5dr\" (UID: \"0864113e-05ab-4ca4-b633-f88be80c84e7\") " pod="openshift-console/console-689c455565-xf5dr" Jun 08 16:49:50.756484 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:50.756408 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0864113e-05ab-4ca4-b633-f88be80c84e7-service-ca\") pod \"console-689c455565-xf5dr\" (UID: \"0864113e-05ab-4ca4-b633-f88be80c84e7\") " pod="openshift-console/console-689c455565-xf5dr" Jun 08 16:49:50.756484 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:50.756448 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0864113e-05ab-4ca4-b633-f88be80c84e7-console-oauth-config\") pod \"console-689c455565-xf5dr\" (UID: \"0864113e-05ab-4ca4-b633-f88be80c84e7\") " pod="openshift-console/console-689c455565-xf5dr" Jun 08 16:49:50.757265 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:50.757022 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0864113e-05ab-4ca4-b633-f88be80c84e7-console-config\") pod \"console-689c455565-xf5dr\" (UID: \"0864113e-05ab-4ca4-b633-f88be80c84e7\") " pod="openshift-console/console-689c455565-xf5dr" Jun 08 16:49:50.757265 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:50.757022 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0864113e-05ab-4ca4-b633-f88be80c84e7-oauth-serving-cert\") pod \"console-689c455565-xf5dr\" (UID: \"0864113e-05ab-4ca4-b633-f88be80c84e7\") " pod="openshift-console/console-689c455565-xf5dr" Jun 08 16:49:50.757265 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:50.757201 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0864113e-05ab-4ca4-b633-f88be80c84e7-trusted-ca-bundle\") pod \"console-689c455565-xf5dr\" (UID: \"0864113e-05ab-4ca4-b633-f88be80c84e7\") " pod="openshift-console/console-689c455565-xf5dr" Jun 08 16:49:50.757594 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:50.757570 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0864113e-05ab-4ca4-b633-f88be80c84e7-service-ca\") pod \"console-689c455565-xf5dr\" (UID: \"0864113e-05ab-4ca4-b633-f88be80c84e7\") " pod="openshift-console/console-689c455565-xf5dr" Jun 08 16:49:50.759099 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:50.759078 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0864113e-05ab-4ca4-b633-f88be80c84e7-console-serving-cert\") pod \"console-689c455565-xf5dr\" (UID: \"0864113e-05ab-4ca4-b633-f88be80c84e7\") " pod="openshift-console/console-689c455565-xf5dr" Jun 08 16:49:50.759437 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:50.759357 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0864113e-05ab-4ca4-b633-f88be80c84e7-console-oauth-config\") pod \"console-689c455565-xf5dr\" (UID: \"0864113e-05ab-4ca4-b633-f88be80c84e7\") " pod="openshift-console/console-689c455565-xf5dr" Jun 08 16:49:50.765646 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:50.765618 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mckhb\" (UniqueName: \"kubernetes.io/projected/0864113e-05ab-4ca4-b633-f88be80c84e7-kube-api-access-mckhb\") pod \"console-689c455565-xf5dr\" (UID: \"0864113e-05ab-4ca4-b633-f88be80c84e7\") " pod="openshift-console/console-689c455565-xf5dr" Jun 08 16:49:50.869551 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:50.869512 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-689c455565-xf5dr" Jun 08 16:49:52.662746 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:52.662230 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-689c455565-xf5dr"] Jun 08 16:49:53.149696 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:53.149657 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-689c455565-xf5dr" event={"ID":"0864113e-05ab-4ca4-b633-f88be80c84e7","Type":"ContainerStarted","Data":"79a9b328542f951005f2359e3d80e794a1b9e3edd7d9afcc62cd2b471aff03d8"} Jun 08 16:49:53.149885 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:53.149717 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-689c455565-xf5dr" event={"ID":"0864113e-05ab-4ca4-b633-f88be80c84e7","Type":"ContainerStarted","Data":"4f02ac481a6597477b48ca482157a2d3cbb6dd7ec59564930fde8be69e6d161a"} Jun 08 16:49:53.151592 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:53.151561 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-nhlg6" event={"ID":"f81b9a94-06d5-40af-9188-bc24b482e22a","Type":"ContainerStarted","Data":"4f6f92fd888672870f89a4ace9ff21c8a4d7d21e1e5af352f3e3f01d19c17cfd"} Jun 08 16:49:53.151810 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:53.151764 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-nhlg6" Jun 08 16:49:53.153810 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:53.153783 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54cb67944f-bf2fk" event={"ID":"78425613-8e75-4220-8b0f-f67a5a870a28","Type":"ContainerStarted","Data":"2c8a3c1571225e76947488cf0d8eda08b44ce04e02423baf76a1224377851334"} Jun 08 16:49:53.167780 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:53.167730 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-689c455565-xf5dr" podStartSLOduration=3.167711733 podStartE2EDuration="3.167711733s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:49:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:49:53.16732221 +0000 UTC m=+145.064099686" watchObservedRunningTime="2026-06-08 16:49:53.167711733 +0000 UTC m=+145.064489211" Jun 08 16:49:53.169627 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:53.169605 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-nhlg6" Jun 08 16:49:53.183937 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:53.183893 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-nhlg6" podStartSLOduration=1.728307499 podStartE2EDuration="21.183876208s" totalImagesPullingTime="19.455568709s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:49:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:49:53.181765648 +0000 UTC m=+145.078543125" watchObservedRunningTime="2026-06-08 16:49:53.183876208 +0000 UTC m=+145.080653684" Jun 08 16:49:53.199731 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:53.199683 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54cb67944f-bf2fk" podStartSLOduration=1.81635183 podStartE2EDuration="11.199668182s" totalImagesPullingTime="9.383316352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:49:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:49:53.198587926 +0000 UTC m=+145.095365401" watchObservedRunningTime="2026-06-08 16:49:53.199668182 +0000 UTC m=+145.096445657" Jun 08 16:49:53.954125 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:53.954087 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:54.008778 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:54.008734 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:57.174118 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:57.174043 2579 generic.go:356] "Generic (PLEG): container finished" podID="d71f42f1-6fe5-4ee6-a40c-4f1095961288" containerID="c014dc1d14cff10b875ce5466c5cdf607328af58c481f4c3401b084037eda802" exitCode=0 Jun 08 16:49:57.174118 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:57.174104 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-6k567" event={"ID":"d71f42f1-6fe5-4ee6-a40c-4f1095961288","Type":"ContainerDied","Data":"c014dc1d14cff10b875ce5466c5cdf607328af58c481f4c3401b084037eda802"} Jun 08 16:49:57.174604 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:57.174494 2579 scope.go:117] "RemoveContainer" containerID="c014dc1d14cff10b875ce5466c5cdf607328af58c481f4c3401b084037eda802" Jun 08 16:49:58.182136 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:58.182095 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-6k567" event={"ID":"d71f42f1-6fe5-4ee6-a40c-4f1095961288","Type":"ContainerStarted","Data":"d0a0d42fea5745c55eb9431f52a2ebc1946617ffbbf02c1119a72631653e1f41"} Jun 08 16:49:58.950748 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:58.950710 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:58.963139 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:58.963105 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33/init-config-reloader/0.log" Jun 08 16:49:59.050282 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:59.050228 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:49:59.160611 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:59.160580 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33/alertmanager/0.log" Jun 08 16:49:59.360702 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:59.360671 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33/config-reloader/0.log" Jun 08 16:49:59.560361 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:59.560336 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33/kube-rbac-proxy-web/0.log" Jun 08 16:49:59.761200 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:59.761135 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33/kube-rbac-proxy/0.log" Jun 08 16:49:59.963418 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:49:59.963387 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33/kube-rbac-proxy-metric/0.log" Jun 08 16:50:00.162146 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:00.162113 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33/prom-label-proxy/0.log" Jun 08 16:50:00.569501 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:00.569474 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-d956z_37610212-ce3b-459a-9d75-2a949e72aab5/kube-state-metrics/0.log" Jun 08 16:50:00.761533 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:00.761502 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-d956z_37610212-ce3b-459a-9d75-2a949e72aab5/kube-rbac-proxy-main/0.log" Jun 08 16:50:00.870168 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:00.870099 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-689c455565-xf5dr" Jun 08 16:50:00.870168 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:00.870153 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-689c455565-xf5dr" Jun 08 16:50:00.875558 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:00.875533 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-689c455565-xf5dr" Jun 08 16:50:00.961204 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:00.961168 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-d956z_37610212-ce3b-459a-9d75-2a949e72aab5/kube-rbac-proxy-self/0.log" Jun 08 16:50:01.200645 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:01.200575 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-689c455565-xf5dr" Jun 08 16:50:01.249781 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:01.249749 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54cb67944f-bf2fk"] Jun 08 16:50:01.362787 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:01.362754 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-rf6jk_9c94da77-3591-40a6-90f1-ab02631e4cec/monitoring-plugin/0.log" Jun 08 16:50:01.374221 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:01.374185 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:50:01.474792 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:01.474728 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:50:01.565698 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:01.565669 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:50:02.188731 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:02.188694 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:50:02.262690 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:02.262668 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:50:02.759448 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:02.759413 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vcsbd_5fff9157-6f59-44bd-bb68-d83f5fb56328/init-textfile/0.log" Jun 08 16:50:02.961226 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:02.961199 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vcsbd_5fff9157-6f59-44bd-bb68-d83f5fb56328/node-exporter/0.log" Jun 08 16:50:03.001596 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:03.001573 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54cb67944f-bf2fk" Jun 08 16:50:03.160884 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:03.160866 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vcsbd_5fff9157-6f59-44bd-bb68-d83f5fb56328/kube-rbac-proxy/0.log" Jun 08 16:50:05.364071 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:05.364033 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-7cfcr_82d39be1-b24a-4012-9f6a-4af36f8ac4c5/prometheus-operator/0.log" Jun 08 16:50:05.560521 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:05.560499 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-7cfcr_82d39be1-b24a-4012-9f6a-4af36f8ac4c5/kube-rbac-proxy/0.log" Jun 08 16:50:05.759690 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:05.759624 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-bbvrx_59c46146-5fe0-4d6e-a29e-1a007d518010/prometheus-operator-admission-webhook/0.log" Jun 08 16:50:06.561251 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:06.561203 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6685bf9566-m6m5j_5e80641a-da35-4c3e-b8d1-5823cb3c2969/thanos-query/0.log" Jun 08 16:50:06.760689 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:06.760660 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6685bf9566-m6m5j_5e80641a-da35-4c3e-b8d1-5823cb3c2969/kube-rbac-proxy-web/0.log" Jun 08 16:50:06.960686 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:06.960654 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6685bf9566-m6m5j_5e80641a-da35-4c3e-b8d1-5823cb3c2969/kube-rbac-proxy/0.log" Jun 08 16:50:07.161044 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:07.161014 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6685bf9566-m6m5j_5e80641a-da35-4c3e-b8d1-5823cb3c2969/prom-label-proxy/0.log" Jun 08 16:50:07.362145 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:07.362119 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6685bf9566-m6m5j_5e80641a-da35-4c3e-b8d1-5823cb3c2969/kube-rbac-proxy-rules/0.log" Jun 08 16:50:07.561799 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:07.561766 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6685bf9566-m6m5j_5e80641a-da35-4c3e-b8d1-5823cb3c2969/kube-rbac-proxy-metrics/0.log" Jun 08 16:50:07.764342 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:07.764259 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-qndcr_afe50c9a-e17c-4e7c-9426-50e526b0aedc/networking-console-plugin/0.log" Jun 08 16:50:08.361782 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:08.361748 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-54cb67944f-bf2fk_78425613-8e75-4220-8b0f-f67a5a870a28/console/0.log" Jun 08 16:50:08.559987 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:08.559954 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-689c455565-xf5dr_0864113e-05ab-4ca4-b633-f88be80c84e7/console/0.log" Jun 08 16:50:08.765013 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:08.764933 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-nhlg6_f81b9a94-06d5-40af-9188-bc24b482e22a/download-server/0.log" Jun 08 16:50:08.855433 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:08.855401 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:50:08.966678 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:08.966644 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:50:08.967033 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:08.967010 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-557dd576b7-t4q2j_f9358ada-e6bb-40f0-a5ce-b8e2ecce889f/router/0.log" Jun 08 16:50:09.055461 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:09.055372 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:50:09.359748 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:09.359722 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pjgts_0015697c-c802-48e9-8fba-511d0f7be4e7/serve-healthcheck-canary/0.log" Jun 08 16:50:12.958571 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:12.958529 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:50:13.054530 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:13.054498 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:50:18.698449 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:18.698353 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:50:24.949702 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:24.949658 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:50:26.278566 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:26.278525 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-54cb67944f-bf2fk" podUID="78425613-8e75-4220-8b0f-f67a5a870a28" containerName="console" containerID="cri-o://2c8a3c1571225e76947488cf0d8eda08b44ce04e02423baf76a1224377851334" gracePeriod=15 Jun 08 16:50:26.569665 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:26.569625 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54cb67944f-bf2fk" Jun 08 16:50:26.658613 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:26.658588 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78425613-8e75-4220-8b0f-f67a5a870a28-service-ca\") pod \"78425613-8e75-4220-8b0f-f67a5a870a28\" (UID: \"78425613-8e75-4220-8b0f-f67a5a870a28\") " Jun 08 16:50:26.658740 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:26.658620 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78425613-8e75-4220-8b0f-f67a5a870a28-console-config\") pod \"78425613-8e75-4220-8b0f-f67a5a870a28\" (UID: \"78425613-8e75-4220-8b0f-f67a5a870a28\") " Jun 08 16:50:26.658740 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:26.658645 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78425613-8e75-4220-8b0f-f67a5a870a28-console-oauth-config\") pod \"78425613-8e75-4220-8b0f-f67a5a870a28\" (UID: \"78425613-8e75-4220-8b0f-f67a5a870a28\") " Jun 08 16:50:26.658740 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:26.658666 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78425613-8e75-4220-8b0f-f67a5a870a28-oauth-serving-cert\") pod \"78425613-8e75-4220-8b0f-f67a5a870a28\" (UID: \"78425613-8e75-4220-8b0f-f67a5a870a28\") " Jun 08 16:50:26.658740 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:26.658693 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h98v2\" (UniqueName: \"kubernetes.io/projected/78425613-8e75-4220-8b0f-f67a5a870a28-kube-api-access-h98v2\") pod \"78425613-8e75-4220-8b0f-f67a5a870a28\" (UID: \"78425613-8e75-4220-8b0f-f67a5a870a28\") " Jun 08 16:50:26.658740 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:26.658731 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78425613-8e75-4220-8b0f-f67a5a870a28-console-serving-cert\") pod \"78425613-8e75-4220-8b0f-f67a5a870a28\" (UID: \"78425613-8e75-4220-8b0f-f67a5a870a28\") " Jun 08 16:50:26.659075 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:26.659053 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78425613-8e75-4220-8b0f-f67a5a870a28-console-config" (OuterVolumeSpecName: "console-config") pod "78425613-8e75-4220-8b0f-f67a5a870a28" (UID: "78425613-8e75-4220-8b0f-f67a5a870a28"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 16:50:26.659075 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:26.659049 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78425613-8e75-4220-8b0f-f67a5a870a28-service-ca" (OuterVolumeSpecName: "service-ca") pod "78425613-8e75-4220-8b0f-f67a5a870a28" (UID: "78425613-8e75-4220-8b0f-f67a5a870a28"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 16:50:26.659202 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:26.659060 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78425613-8e75-4220-8b0f-f67a5a870a28-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "78425613-8e75-4220-8b0f-f67a5a870a28" (UID: "78425613-8e75-4220-8b0f-f67a5a870a28"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 16:50:26.661060 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:26.661030 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78425613-8e75-4220-8b0f-f67a5a870a28-kube-api-access-h98v2" (OuterVolumeSpecName: "kube-api-access-h98v2") pod "78425613-8e75-4220-8b0f-f67a5a870a28" (UID: "78425613-8e75-4220-8b0f-f67a5a870a28"). InnerVolumeSpecName "kube-api-access-h98v2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 16:50:26.661174 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:26.661066 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78425613-8e75-4220-8b0f-f67a5a870a28-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "78425613-8e75-4220-8b0f-f67a5a870a28" (UID: "78425613-8e75-4220-8b0f-f67a5a870a28"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 16:50:26.661174 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:26.661135 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78425613-8e75-4220-8b0f-f67a5a870a28-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "78425613-8e75-4220-8b0f-f67a5a870a28" (UID: "78425613-8e75-4220-8b0f-f67a5a870a28"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 16:50:26.759596 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:26.759564 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78425613-8e75-4220-8b0f-f67a5a870a28-service-ca\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 16:50:26.759596 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:26.759594 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78425613-8e75-4220-8b0f-f67a5a870a28-console-config\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 16:50:26.759739 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:26.759605 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78425613-8e75-4220-8b0f-f67a5a870a28-console-oauth-config\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 16:50:26.759739 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:26.759616 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78425613-8e75-4220-8b0f-f67a5a870a28-oauth-serving-cert\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 16:50:26.759739 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:26.759625 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h98v2\" (UniqueName: \"kubernetes.io/projected/78425613-8e75-4220-8b0f-f67a5a870a28-kube-api-access-h98v2\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 16:50:26.759739 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:26.759648 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78425613-8e75-4220-8b0f-f67a5a870a28-console-serving-cert\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 16:50:27.064448 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:27.064409 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:50:27.132928 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:27.132891 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:50:27.302408 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:27.302378 2579 generic.go:356] "Generic (PLEG): container finished" podID="78425613-8e75-4220-8b0f-f67a5a870a28" containerID="2c8a3c1571225e76947488cf0d8eda08b44ce04e02423baf76a1224377851334" exitCode=0 Jun 08 16:50:27.302777 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:27.302422 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54cb67944f-bf2fk" Jun 08 16:50:27.302777 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:27.302451 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54cb67944f-bf2fk" event={"ID":"78425613-8e75-4220-8b0f-f67a5a870a28","Type":"ContainerDied","Data":"2c8a3c1571225e76947488cf0d8eda08b44ce04e02423baf76a1224377851334"} Jun 08 16:50:27.302777 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:27.302491 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54cb67944f-bf2fk" event={"ID":"78425613-8e75-4220-8b0f-f67a5a870a28","Type":"ContainerDied","Data":"49922b074ff8eb32426e364d66d5799649cf7a323949636d562b0070a2f89588"} Jun 08 16:50:27.302777 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:27.302520 2579 scope.go:117] "RemoveContainer" containerID="2c8a3c1571225e76947488cf0d8eda08b44ce04e02423baf76a1224377851334" Jun 08 16:50:27.324023 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:27.324003 2579 scope.go:117] "RemoveContainer" containerID="2c8a3c1571225e76947488cf0d8eda08b44ce04e02423baf76a1224377851334" Jun 08 16:50:27.324427 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:50:27.324402 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c8a3c1571225e76947488cf0d8eda08b44ce04e02423baf76a1224377851334\": container with ID starting with 2c8a3c1571225e76947488cf0d8eda08b44ce04e02423baf76a1224377851334 not found: ID does not exist" containerID="2c8a3c1571225e76947488cf0d8eda08b44ce04e02423baf76a1224377851334" Jun 08 16:50:27.324544 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:27.324436 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c8a3c1571225e76947488cf0d8eda08b44ce04e02423baf76a1224377851334"} err="failed to get container status \"2c8a3c1571225e76947488cf0d8eda08b44ce04e02423baf76a1224377851334\": rpc error: code = NotFound desc = could not find container \"2c8a3c1571225e76947488cf0d8eda08b44ce04e02423baf76a1224377851334\": container with ID starting with 2c8a3c1571225e76947488cf0d8eda08b44ce04e02423baf76a1224377851334 not found: ID does not exist" Jun 08 16:50:27.336091 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:27.336070 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54cb67944f-bf2fk"] Jun 08 16:50:27.341044 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:27.341027 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54cb67944f-bf2fk"] Jun 08 16:50:28.525063 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:28.525028 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78425613-8e75-4220-8b0f-f67a5a870a28" path="/var/lib/kubelet/pods/78425613-8e75-4220-8b0f-f67a5a870a28/volumes" Jun 08 16:50:39.723475 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:39.723432 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:50:39.824301 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:39.824263 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:50:43.972155 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:43.972115 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 16:50:43.972634 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:43.972538 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33" containerName="alertmanager" containerID="cri-o://2c69dbfd1081f27b3b47216bb0133faff4c008cd7b72e5eba06a3f85d34985b3" gracePeriod=120 Jun 08 16:50:43.972634 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:43.972578 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33" containerName="kube-rbac-proxy-web" containerID="cri-o://54105098d28ab81478cdca552a107ed49d176220e46806df00ba45e001a453e0" gracePeriod=120 Jun 08 16:50:43.972744 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:43.972652 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33" containerName="prom-label-proxy" containerID="cri-o://31d0f7f4c17ae03cf567538164e1866a8108af4da3041503a9ed57e433e42528" gracePeriod=120 Jun 08 16:50:43.972744 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:43.972623 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33" containerName="config-reloader" containerID="cri-o://53c8ae1f9e1ccf4d3e5a28d18bae4b1dbb4a686ccbe609e313cebc13817664ef" gracePeriod=120 Jun 08 16:50:43.972845 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:43.972591 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33" containerName="kube-rbac-proxy-metric" containerID="cri-o://2c257748a547fd2163023bc728e8c2a7a0865c47dbae1b5743d5c209ad50b05a" gracePeriod=120 Jun 08 16:50:43.972898 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:43.972854 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33" containerName="kube-rbac-proxy" containerID="cri-o://cb29f6fe8c8cafd50fa451e586602228ae69a07150f50ce53d84d73a8c4dcd13" gracePeriod=120 Jun 08 16:50:44.373099 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:44.373065 2579 generic.go:356] "Generic (PLEG): container finished" podID="f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33" containerID="31d0f7f4c17ae03cf567538164e1866a8108af4da3041503a9ed57e433e42528" exitCode=0 Jun 08 16:50:44.373099 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:44.373093 2579 generic.go:356] "Generic (PLEG): container finished" podID="f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33" containerID="2c257748a547fd2163023bc728e8c2a7a0865c47dbae1b5743d5c209ad50b05a" exitCode=0 Jun 08 16:50:44.373099 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:44.373099 2579 generic.go:356] "Generic (PLEG): container finished" podID="f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33" containerID="cb29f6fe8c8cafd50fa451e586602228ae69a07150f50ce53d84d73a8c4dcd13" exitCode=0 Jun 08 16:50:44.373099 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:44.373104 2579 generic.go:356] "Generic (PLEG): container finished" podID="f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33" containerID="53c8ae1f9e1ccf4d3e5a28d18bae4b1dbb4a686ccbe609e313cebc13817664ef" exitCode=0 Jun 08 16:50:44.373099 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:44.373109 2579 generic.go:356] "Generic (PLEG): container finished" podID="f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33" containerID="2c69dbfd1081f27b3b47216bb0133faff4c008cd7b72e5eba06a3f85d34985b3" exitCode=0 Jun 08 16:50:44.373528 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:44.373143 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33","Type":"ContainerDied","Data":"31d0f7f4c17ae03cf567538164e1866a8108af4da3041503a9ed57e433e42528"} Jun 08 16:50:44.373528 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:44.373272 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33","Type":"ContainerDied","Data":"2c257748a547fd2163023bc728e8c2a7a0865c47dbae1b5743d5c209ad50b05a"} Jun 08 16:50:44.373528 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:44.373316 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33","Type":"ContainerDied","Data":"cb29f6fe8c8cafd50fa451e586602228ae69a07150f50ce53d84d73a8c4dcd13"} Jun 08 16:50:44.373528 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:44.373356 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33","Type":"ContainerDied","Data":"53c8ae1f9e1ccf4d3e5a28d18bae4b1dbb4a686ccbe609e313cebc13817664ef"} Jun 08 16:50:44.373528 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:44.373393 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33","Type":"ContainerDied","Data":"2c69dbfd1081f27b3b47216bb0133faff4c008cd7b72e5eba06a3f85d34985b3"} Jun 08 16:50:45.223213 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.223190 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:50:45.313873 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.313793 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-alertmanager-trusted-ca-bundle\") pod \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\" (UID: \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\") " Jun 08 16:50:45.313873 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.313843 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-cluster-tls-config\") pod \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\" (UID: \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\") " Jun 08 16:50:45.314071 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.313876 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-config-out\") pod \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\" (UID: \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\") " Jun 08 16:50:45.314071 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.313893 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-secret-alertmanager-main-tls\") pod \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\" (UID: \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\") " Jun 08 16:50:45.314071 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.313913 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-tls-assets\") pod \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\" (UID: \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\") " Jun 08 16:50:45.314071 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.313938 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-secret-alertmanager-kube-rbac-proxy\") pod \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\" (UID: \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\") " Jun 08 16:50:45.314071 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.313971 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-web-config\") pod \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\" (UID: \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\") " Jun 08 16:50:45.314071 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.313997 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-alertmanager-main-db\") pod \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\" (UID: \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\") " Jun 08 16:50:45.314071 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.314035 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-metrics-client-ca\") pod \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\" (UID: \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\") " Jun 08 16:50:45.314455 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.314076 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-629hk\" (UniqueName: \"kubernetes.io/projected/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-kube-api-access-629hk\") pod \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\" (UID: \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\") " Jun 08 16:50:45.314455 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.314108 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-config-volume\") pod \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\" (UID: \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\") " Jun 08 16:50:45.314455 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.314144 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-secret-alertmanager-kube-rbac-proxy-web\") pod \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\" (UID: \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\") " Jun 08 16:50:45.314455 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.314172 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-secret-alertmanager-kube-rbac-proxy-metric\") pod \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\" (UID: \"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33\") " Jun 08 16:50:45.314455 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.314270 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33" (UID: "f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 16:50:45.314724 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.314489 2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 16:50:45.315003 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.314942 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33" (UID: "f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 16:50:45.315348 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.315305 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33" (UID: "f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 16:50:45.317613 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.317459 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33" (UID: "f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 16:50:45.317613 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.317552 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33" (UID: "f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 16:50:45.317613 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.317600 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33" (UID: "f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 16:50:45.317830 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.317729 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-config-out" (OuterVolumeSpecName: "config-out") pod "f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33" (UID: "f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 16:50:45.317884 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.317830 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-config-volume" (OuterVolumeSpecName: "config-volume") pod "f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33" (UID: "f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 16:50:45.318398 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.318376 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33" (UID: "f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 16:50:45.318824 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.318806 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33" (UID: "f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 16:50:45.319472 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.319453 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-kube-api-access-629hk" (OuterVolumeSpecName: "kube-api-access-629hk") pod "f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33" (UID: "f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33"). InnerVolumeSpecName "kube-api-access-629hk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 16:50:45.321790 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.321758 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33" (UID: "f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 16:50:45.328969 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.328948 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-web-config" (OuterVolumeSpecName: "web-config") pod "f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33" (UID: "f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 16:50:45.379757 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.379726 2579 generic.go:356] "Generic (PLEG): container finished" podID="f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33" containerID="54105098d28ab81478cdca552a107ed49d176220e46806df00ba45e001a453e0" exitCode=0 Jun 08 16:50:45.379877 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.379803 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:50:45.379877 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.379806 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33","Type":"ContainerDied","Data":"54105098d28ab81478cdca552a107ed49d176220e46806df00ba45e001a453e0"} Jun 08 16:50:45.379877 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.379872 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33","Type":"ContainerDied","Data":"99b50c11d7f64fe71401720fb93be273bc08c7d108de55b5f90d6445eed0c267"} Jun 08 16:50:45.379988 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.379907 2579 scope.go:117] "RemoveContainer" containerID="31d0f7f4c17ae03cf567538164e1866a8108af4da3041503a9ed57e433e42528" Jun 08 16:50:45.388039 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.387939 2579 scope.go:117] "RemoveContainer" containerID="2c257748a547fd2163023bc728e8c2a7a0865c47dbae1b5743d5c209ad50b05a" Jun 08 16:50:45.396774 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.396750 2579 scope.go:117] "RemoveContainer" containerID="cb29f6fe8c8cafd50fa451e586602228ae69a07150f50ce53d84d73a8c4dcd13" Jun 08 16:50:45.403456 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.403438 2579 scope.go:117] "RemoveContainer" containerID="54105098d28ab81478cdca552a107ed49d176220e46806df00ba45e001a453e0" Jun 08 16:50:45.406204 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.406183 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 16:50:45.410996 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.410976 2579 scope.go:117] "RemoveContainer" containerID="53c8ae1f9e1ccf4d3e5a28d18bae4b1dbb4a686ccbe609e313cebc13817664ef" Jun 08 16:50:45.412023 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.412003 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 16:50:45.415315 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.415295 2579 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-config-volume\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 16:50:45.415392 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.415334 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 16:50:45.415392 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.415345 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 16:50:45.415392 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.415356 2579 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-cluster-tls-config\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 16:50:45.415392 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.415364 2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-config-out\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 16:50:45.415392 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.415373 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-secret-alertmanager-main-tls\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 16:50:45.415392 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.415382 2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-tls-assets\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 16:50:45.415392 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.415390 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 16:50:45.415642 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.415398 2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-web-config\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 16:50:45.415642 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.415406 2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-alertmanager-main-db\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 16:50:45.415642 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.415413 2579 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-metrics-client-ca\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 16:50:45.415642 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.415422 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-629hk\" (UniqueName: \"kubernetes.io/projected/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33-kube-api-access-629hk\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 16:50:45.417520 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.417498 2579 scope.go:117] "RemoveContainer" containerID="2c69dbfd1081f27b3b47216bb0133faff4c008cd7b72e5eba06a3f85d34985b3" Jun 08 16:50:45.424079 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.424063 2579 scope.go:117] "RemoveContainer" containerID="31e780dde1cda5929a461cb9318c6146cc69419b134ec80ef21668c3020001cf" Jun 08 16:50:45.430852 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.430836 2579 scope.go:117] "RemoveContainer" containerID="31d0f7f4c17ae03cf567538164e1866a8108af4da3041503a9ed57e433e42528" Jun 08 16:50:45.431080 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:50:45.431063 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31d0f7f4c17ae03cf567538164e1866a8108af4da3041503a9ed57e433e42528\": container with ID starting with 31d0f7f4c17ae03cf567538164e1866a8108af4da3041503a9ed57e433e42528 not found: ID does not exist" containerID="31d0f7f4c17ae03cf567538164e1866a8108af4da3041503a9ed57e433e42528" Jun 08 16:50:45.431125 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.431088 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31d0f7f4c17ae03cf567538164e1866a8108af4da3041503a9ed57e433e42528"} err="failed to get container status \"31d0f7f4c17ae03cf567538164e1866a8108af4da3041503a9ed57e433e42528\": rpc error: code = NotFound desc = could not find container \"31d0f7f4c17ae03cf567538164e1866a8108af4da3041503a9ed57e433e42528\": container with ID starting with 31d0f7f4c17ae03cf567538164e1866a8108af4da3041503a9ed57e433e42528 not found: ID does not exist" Jun 08 16:50:45.431125 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.431105 2579 scope.go:117] "RemoveContainer" containerID="2c257748a547fd2163023bc728e8c2a7a0865c47dbae1b5743d5c209ad50b05a" Jun 08 16:50:45.431422 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:50:45.431404 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c257748a547fd2163023bc728e8c2a7a0865c47dbae1b5743d5c209ad50b05a\": container with ID starting with 2c257748a547fd2163023bc728e8c2a7a0865c47dbae1b5743d5c209ad50b05a not found: ID does not exist" containerID="2c257748a547fd2163023bc728e8c2a7a0865c47dbae1b5743d5c209ad50b05a" Jun 08 16:50:45.431489 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.431426 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c257748a547fd2163023bc728e8c2a7a0865c47dbae1b5743d5c209ad50b05a"} err="failed to get container status \"2c257748a547fd2163023bc728e8c2a7a0865c47dbae1b5743d5c209ad50b05a\": rpc error: code = NotFound desc = could not find container \"2c257748a547fd2163023bc728e8c2a7a0865c47dbae1b5743d5c209ad50b05a\": container with ID starting with 2c257748a547fd2163023bc728e8c2a7a0865c47dbae1b5743d5c209ad50b05a not found: ID does not exist" Jun 08 16:50:45.431489 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.431444 2579 scope.go:117] "RemoveContainer" containerID="cb29f6fe8c8cafd50fa451e586602228ae69a07150f50ce53d84d73a8c4dcd13" Jun 08 16:50:45.431699 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:50:45.431681 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb29f6fe8c8cafd50fa451e586602228ae69a07150f50ce53d84d73a8c4dcd13\": container with ID starting with cb29f6fe8c8cafd50fa451e586602228ae69a07150f50ce53d84d73a8c4dcd13 not found: ID does not exist" containerID="cb29f6fe8c8cafd50fa451e586602228ae69a07150f50ce53d84d73a8c4dcd13" Jun 08 16:50:45.431742 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.431705 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb29f6fe8c8cafd50fa451e586602228ae69a07150f50ce53d84d73a8c4dcd13"} err="failed to get container status \"cb29f6fe8c8cafd50fa451e586602228ae69a07150f50ce53d84d73a8c4dcd13\": rpc error: code = NotFound desc = could not find container \"cb29f6fe8c8cafd50fa451e586602228ae69a07150f50ce53d84d73a8c4dcd13\": container with ID starting with cb29f6fe8c8cafd50fa451e586602228ae69a07150f50ce53d84d73a8c4dcd13 not found: ID does not exist" Jun 08 16:50:45.431742 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.431719 2579 scope.go:117] "RemoveContainer" containerID="54105098d28ab81478cdca552a107ed49d176220e46806df00ba45e001a453e0" Jun 08 16:50:45.431935 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:50:45.431920 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54105098d28ab81478cdca552a107ed49d176220e46806df00ba45e001a453e0\": container with ID starting with 54105098d28ab81478cdca552a107ed49d176220e46806df00ba45e001a453e0 not found: ID does not exist" containerID="54105098d28ab81478cdca552a107ed49d176220e46806df00ba45e001a453e0" Jun 08 16:50:45.431974 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.431939 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54105098d28ab81478cdca552a107ed49d176220e46806df00ba45e001a453e0"} err="failed to get container status \"54105098d28ab81478cdca552a107ed49d176220e46806df00ba45e001a453e0\": rpc error: code = NotFound desc = could not find container \"54105098d28ab81478cdca552a107ed49d176220e46806df00ba45e001a453e0\": container with ID starting with 54105098d28ab81478cdca552a107ed49d176220e46806df00ba45e001a453e0 not found: ID does not exist" Jun 08 16:50:45.431974 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.431953 2579 scope.go:117] "RemoveContainer" containerID="53c8ae1f9e1ccf4d3e5a28d18bae4b1dbb4a686ccbe609e313cebc13817664ef" Jun 08 16:50:45.432136 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:50:45.432121 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53c8ae1f9e1ccf4d3e5a28d18bae4b1dbb4a686ccbe609e313cebc13817664ef\": container with ID starting with 53c8ae1f9e1ccf4d3e5a28d18bae4b1dbb4a686ccbe609e313cebc13817664ef not found: ID does not exist" containerID="53c8ae1f9e1ccf4d3e5a28d18bae4b1dbb4a686ccbe609e313cebc13817664ef" Jun 08 16:50:45.432177 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.432140 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53c8ae1f9e1ccf4d3e5a28d18bae4b1dbb4a686ccbe609e313cebc13817664ef"} err="failed to get container status \"53c8ae1f9e1ccf4d3e5a28d18bae4b1dbb4a686ccbe609e313cebc13817664ef\": rpc error: code = NotFound desc = could not find container \"53c8ae1f9e1ccf4d3e5a28d18bae4b1dbb4a686ccbe609e313cebc13817664ef\": container with ID starting with 53c8ae1f9e1ccf4d3e5a28d18bae4b1dbb4a686ccbe609e313cebc13817664ef not found: ID does not exist" Jun 08 16:50:45.432177 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.432153 2579 scope.go:117] "RemoveContainer" containerID="2c69dbfd1081f27b3b47216bb0133faff4c008cd7b72e5eba06a3f85d34985b3" Jun 08 16:50:45.432388 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:50:45.432374 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c69dbfd1081f27b3b47216bb0133faff4c008cd7b72e5eba06a3f85d34985b3\": container with ID starting with 2c69dbfd1081f27b3b47216bb0133faff4c008cd7b72e5eba06a3f85d34985b3 not found: ID does not exist" containerID="2c69dbfd1081f27b3b47216bb0133faff4c008cd7b72e5eba06a3f85d34985b3" Jun 08 16:50:45.432440 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.432390 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c69dbfd1081f27b3b47216bb0133faff4c008cd7b72e5eba06a3f85d34985b3"} err="failed to get container status \"2c69dbfd1081f27b3b47216bb0133faff4c008cd7b72e5eba06a3f85d34985b3\": rpc error: code = NotFound desc = could not find container \"2c69dbfd1081f27b3b47216bb0133faff4c008cd7b72e5eba06a3f85d34985b3\": container with ID starting with 2c69dbfd1081f27b3b47216bb0133faff4c008cd7b72e5eba06a3f85d34985b3 not found: ID does not exist" Jun 08 16:50:45.432440 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.432401 2579 scope.go:117] "RemoveContainer" containerID="31e780dde1cda5929a461cb9318c6146cc69419b134ec80ef21668c3020001cf" Jun 08 16:50:45.432609 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:50:45.432594 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31e780dde1cda5929a461cb9318c6146cc69419b134ec80ef21668c3020001cf\": container with ID starting with 31e780dde1cda5929a461cb9318c6146cc69419b134ec80ef21668c3020001cf not found: ID does not exist" containerID="31e780dde1cda5929a461cb9318c6146cc69419b134ec80ef21668c3020001cf" Jun 08 16:50:45.432650 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.432613 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31e780dde1cda5929a461cb9318c6146cc69419b134ec80ef21668c3020001cf"} err="failed to get container status \"31e780dde1cda5929a461cb9318c6146cc69419b134ec80ef21668c3020001cf\": rpc error: code = NotFound desc = could not find container \"31e780dde1cda5929a461cb9318c6146cc69419b134ec80ef21668c3020001cf\": container with ID starting with 31e780dde1cda5929a461cb9318c6146cc69419b134ec80ef21668c3020001cf not found: ID does not exist" Jun 08 16:50:45.440982 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.440961 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 16:50:45.441280 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.441266 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33" containerName="kube-rbac-proxy" Jun 08 16:50:45.441328 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.441282 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33" containerName="kube-rbac-proxy" Jun 08 16:50:45.441328 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.441292 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78425613-8e75-4220-8b0f-f67a5a870a28" containerName="console" Jun 08 16:50:45.441328 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.441298 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="78425613-8e75-4220-8b0f-f67a5a870a28" containerName="console" Jun 08 16:50:45.441328 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.441305 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33" containerName="init-config-reloader" Jun 08 16:50:45.441328 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.441310 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33" containerName="init-config-reloader" Jun 08 16:50:45.441328 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.441323 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33" containerName="alertmanager" Jun 08 16:50:45.441328 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.441328 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33" containerName="alertmanager" Jun 08 16:50:45.441525 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.441333 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33" containerName="config-reloader" Jun 08 16:50:45.441525 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.441338 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33" containerName="config-reloader" Jun 08 16:50:45.441525 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.441345 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33" containerName="kube-rbac-proxy-metric" Jun 08 16:50:45.441525 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.441350 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33" containerName="kube-rbac-proxy-metric" Jun 08 16:50:45.441525 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.441361 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33" containerName="kube-rbac-proxy-web" Jun 08 16:50:45.441525 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.441365 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33" containerName="kube-rbac-proxy-web" Jun 08 16:50:45.441525 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.441372 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33" containerName="prom-label-proxy" Jun 08 16:50:45.441525 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.441377 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33" containerName="prom-label-proxy" Jun 08 16:50:45.441525 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.441429 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33" containerName="alertmanager" Jun 08 16:50:45.441525 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.441438 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33" containerName="kube-rbac-proxy-metric" Jun 08 16:50:45.441525 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.441444 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="78425613-8e75-4220-8b0f-f67a5a870a28" containerName="console" Jun 08 16:50:45.441525 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.441450 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33" containerName="config-reloader" Jun 08 16:50:45.441525 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.441455 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33" containerName="prom-label-proxy" Jun 08 16:50:45.441525 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.441460 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33" containerName="kube-rbac-proxy-web" Jun 08 16:50:45.441525 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.441466 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33" containerName="kube-rbac-proxy" Jun 08 16:50:45.445080 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.445063 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:50:45.447981 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.447965 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-z2448\"" Jun 08 16:50:45.448229 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.448213 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 08 16:50:45.448803 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.448786 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 08 16:50:45.449156 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.449138 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 08 16:50:45.449312 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.449174 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 08 16:50:45.449312 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.449229 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 08 16:50:45.449425 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.449381 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 08 16:50:45.449632 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.449616 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 08 16:50:45.449851 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.449838 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 08 16:50:45.455783 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.455767 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 08 16:50:45.459738 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.459717 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 16:50:45.515890 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.515856 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/992c5885-aa97-4d83-89ee-1e4c35e5602c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"992c5885-aa97-4d83-89ee-1e4c35e5602c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:50:45.515890 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.515887 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfmfk\" (UniqueName: \"kubernetes.io/projected/992c5885-aa97-4d83-89ee-1e4c35e5602c-kube-api-access-jfmfk\") pod \"alertmanager-main-0\" (UID: \"992c5885-aa97-4d83-89ee-1e4c35e5602c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:50:45.516069 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.515906 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/992c5885-aa97-4d83-89ee-1e4c35e5602c-config-out\") pod \"alertmanager-main-0\" (UID: \"992c5885-aa97-4d83-89ee-1e4c35e5602c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:50:45.516069 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.515955 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/992c5885-aa97-4d83-89ee-1e4c35e5602c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"992c5885-aa97-4d83-89ee-1e4c35e5602c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:50:45.516069 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.515998 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/992c5885-aa97-4d83-89ee-1e4c35e5602c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"992c5885-aa97-4d83-89ee-1e4c35e5602c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:50:45.516069 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.516027 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/992c5885-aa97-4d83-89ee-1e4c35e5602c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"992c5885-aa97-4d83-89ee-1e4c35e5602c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:50:45.516069 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.516062 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/992c5885-aa97-4d83-89ee-1e4c35e5602c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"992c5885-aa97-4d83-89ee-1e4c35e5602c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:50:45.516226 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.516080 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/992c5885-aa97-4d83-89ee-1e4c35e5602c-web-config\") pod \"alertmanager-main-0\" (UID: \"992c5885-aa97-4d83-89ee-1e4c35e5602c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:50:45.516226 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.516100 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/992c5885-aa97-4d83-89ee-1e4c35e5602c-config-volume\") pod \"alertmanager-main-0\" (UID: \"992c5885-aa97-4d83-89ee-1e4c35e5602c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:50:45.516226 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.516130 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/992c5885-aa97-4d83-89ee-1e4c35e5602c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"992c5885-aa97-4d83-89ee-1e4c35e5602c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:50:45.516226 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.516145 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/992c5885-aa97-4d83-89ee-1e4c35e5602c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"992c5885-aa97-4d83-89ee-1e4c35e5602c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:50:45.516226 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.516160 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/992c5885-aa97-4d83-89ee-1e4c35e5602c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"992c5885-aa97-4d83-89ee-1e4c35e5602c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:50:45.516226 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.516201 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/992c5885-aa97-4d83-89ee-1e4c35e5602c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"992c5885-aa97-4d83-89ee-1e4c35e5602c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:50:45.617182 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.617152 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/992c5885-aa97-4d83-89ee-1e4c35e5602c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"992c5885-aa97-4d83-89ee-1e4c35e5602c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:50:45.617327 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.617187 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfmfk\" (UniqueName: \"kubernetes.io/projected/992c5885-aa97-4d83-89ee-1e4c35e5602c-kube-api-access-jfmfk\") pod \"alertmanager-main-0\" (UID: \"992c5885-aa97-4d83-89ee-1e4c35e5602c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:50:45.617327 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.617208 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/992c5885-aa97-4d83-89ee-1e4c35e5602c-config-out\") pod \"alertmanager-main-0\" (UID: \"992c5885-aa97-4d83-89ee-1e4c35e5602c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:50:45.617406 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.617357 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/992c5885-aa97-4d83-89ee-1e4c35e5602c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"992c5885-aa97-4d83-89ee-1e4c35e5602c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:50:45.617406 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.617390 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/992c5885-aa97-4d83-89ee-1e4c35e5602c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"992c5885-aa97-4d83-89ee-1e4c35e5602c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:50:45.617482 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.617425 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/992c5885-aa97-4d83-89ee-1e4c35e5602c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"992c5885-aa97-4d83-89ee-1e4c35e5602c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:50:45.617482 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.617471 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/992c5885-aa97-4d83-89ee-1e4c35e5602c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"992c5885-aa97-4d83-89ee-1e4c35e5602c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:50:45.617569 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.617496 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/992c5885-aa97-4d83-89ee-1e4c35e5602c-web-config\") pod \"alertmanager-main-0\" (UID: \"992c5885-aa97-4d83-89ee-1e4c35e5602c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:50:45.617569 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.617526 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/992c5885-aa97-4d83-89ee-1e4c35e5602c-config-volume\") pod \"alertmanager-main-0\" (UID: \"992c5885-aa97-4d83-89ee-1e4c35e5602c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:50:45.617569 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.617557 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/992c5885-aa97-4d83-89ee-1e4c35e5602c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"992c5885-aa97-4d83-89ee-1e4c35e5602c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:50:45.617709 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.617583 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/992c5885-aa97-4d83-89ee-1e4c35e5602c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"992c5885-aa97-4d83-89ee-1e4c35e5602c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:50:45.617709 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.617607 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/992c5885-aa97-4d83-89ee-1e4c35e5602c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"992c5885-aa97-4d83-89ee-1e4c35e5602c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:50:45.617709 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.617659 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/992c5885-aa97-4d83-89ee-1e4c35e5602c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"992c5885-aa97-4d83-89ee-1e4c35e5602c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:50:45.618709 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.618346 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/992c5885-aa97-4d83-89ee-1e4c35e5602c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"992c5885-aa97-4d83-89ee-1e4c35e5602c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:50:45.618842 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.618777 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/992c5885-aa97-4d83-89ee-1e4c35e5602c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"992c5885-aa97-4d83-89ee-1e4c35e5602c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:50:45.619045 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.619017 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/992c5885-aa97-4d83-89ee-1e4c35e5602c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"992c5885-aa97-4d83-89ee-1e4c35e5602c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:50:45.620417 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.620394 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/992c5885-aa97-4d83-89ee-1e4c35e5602c-config-out\") pod \"alertmanager-main-0\" (UID: \"992c5885-aa97-4d83-89ee-1e4c35e5602c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:50:45.620533 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.620451 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/992c5885-aa97-4d83-89ee-1e4c35e5602c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"992c5885-aa97-4d83-89ee-1e4c35e5602c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:50:45.620672 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.620650 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/992c5885-aa97-4d83-89ee-1e4c35e5602c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"992c5885-aa97-4d83-89ee-1e4c35e5602c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:50:45.620770 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.620748 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/992c5885-aa97-4d83-89ee-1e4c35e5602c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"992c5885-aa97-4d83-89ee-1e4c35e5602c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:50:45.621022 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.620996 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/992c5885-aa97-4d83-89ee-1e4c35e5602c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"992c5885-aa97-4d83-89ee-1e4c35e5602c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:50:45.621292 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.621229 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/992c5885-aa97-4d83-89ee-1e4c35e5602c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"992c5885-aa97-4d83-89ee-1e4c35e5602c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:50:45.621380 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.621361 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/992c5885-aa97-4d83-89ee-1e4c35e5602c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"992c5885-aa97-4d83-89ee-1e4c35e5602c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:50:45.621422 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.621375 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/992c5885-aa97-4d83-89ee-1e4c35e5602c-web-config\") pod \"alertmanager-main-0\" (UID: \"992c5885-aa97-4d83-89ee-1e4c35e5602c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:50:45.622504 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.622483 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/992c5885-aa97-4d83-89ee-1e4c35e5602c-config-volume\") pod \"alertmanager-main-0\" (UID: \"992c5885-aa97-4d83-89ee-1e4c35e5602c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:50:45.626556 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.626538 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfmfk\" (UniqueName: \"kubernetes.io/projected/992c5885-aa97-4d83-89ee-1e4c35e5602c-kube-api-access-jfmfk\") pod \"alertmanager-main-0\" (UID: \"992c5885-aa97-4d83-89ee-1e4c35e5602c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:50:45.754781 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.754730 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:50:45.891625 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:45.891598 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 16:50:45.893498 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:50:45.893471 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod992c5885_aa97_4d83_89ee_1e4c35e5602c.slice/crio-2b7e97c3e1bc3e7d14bc4b16bdd85c5bc121d213cafb180a4a6f478c225f6aaf WatchSource:0}: Error finding container 2b7e97c3e1bc3e7d14bc4b16bdd85c5bc121d213cafb180a4a6f478c225f6aaf: Status 404 returned error can't find the container with id 2b7e97c3e1bc3e7d14bc4b16bdd85c5bc121d213cafb180a4a6f478c225f6aaf Jun 08 16:50:46.386437 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:46.386407 2579 generic.go:356] "Generic (PLEG): container finished" podID="992c5885-aa97-4d83-89ee-1e4c35e5602c" containerID="ee7fb0492b0cf660023c643f186328f9c45889bf8cc6c161e0aefd27ade99342" exitCode=0 Jun 08 16:50:46.386835 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:46.386457 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"992c5885-aa97-4d83-89ee-1e4c35e5602c","Type":"ContainerDied","Data":"ee7fb0492b0cf660023c643f186328f9c45889bf8cc6c161e0aefd27ade99342"} Jun 08 16:50:46.386835 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:46.386529 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"992c5885-aa97-4d83-89ee-1e4c35e5602c","Type":"ContainerStarted","Data":"2b7e97c3e1bc3e7d14bc4b16bdd85c5bc121d213cafb180a4a6f478c225f6aaf"} Jun 08 16:50:46.524998 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:46.524969 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33" path="/var/lib/kubelet/pods/f6f7a42a-49b9-49c9-a7ef-0abcc44fbc33/volumes" Jun 08 16:50:47.393733 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:47.393699 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"992c5885-aa97-4d83-89ee-1e4c35e5602c","Type":"ContainerStarted","Data":"78b79229ae0869da713d19b9bf14441d9db9d557b5095efd9ec590f53119c733"} Jun 08 16:50:47.394081 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:47.393760 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"992c5885-aa97-4d83-89ee-1e4c35e5602c","Type":"ContainerStarted","Data":"a82166580177bb6526381e244880f9d1ae2a966fdf2c5800f616088bf1dfe78c"} Jun 08 16:50:47.394081 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:47.393789 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"992c5885-aa97-4d83-89ee-1e4c35e5602c","Type":"ContainerStarted","Data":"1e5b811c30e7fabd66c82804026571f7d5b46b368e72fd4578b10dd1ff551749"} Jun 08 16:50:47.394081 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:47.393813 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"992c5885-aa97-4d83-89ee-1e4c35e5602c","Type":"ContainerStarted","Data":"c54cda98ba1934bcf6eff58afe7d52b2cab627b71667bba88088c1d6a80f897e"} Jun 08 16:50:47.394081 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:47.393839 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"992c5885-aa97-4d83-89ee-1e4c35e5602c","Type":"ContainerStarted","Data":"4a32a0b7b3f95a2d989a92ac13e66db71b6274875cde34b24fa58390b6a21e50"} Jun 08 16:50:47.394081 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:47.393862 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"992c5885-aa97-4d83-89ee-1e4c35e5602c","Type":"ContainerStarted","Data":"35d43581ed511ff0fbddc5f11bfa42c6ba9645ecf84fb5c9cb062b77cc2dc6c6"} Jun 08 16:50:47.423761 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:47.423699 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.406274294 podStartE2EDuration="2.423682508s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.408214ms" isStatefulPod=false podCreationTimestamp="2026-06-08 16:50:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:50:47.421908155 +0000 UTC m=+199.318685631" watchObservedRunningTime="2026-06-08 16:50:47.423682508 +0000 UTC m=+199.320459984" Jun 08 16:50:51.621332 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:51.621287 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:50:51.695760 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:51.695717 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:50:57.950323 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:57.950285 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:50:58.050061 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:50:58.050024 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:51:10.429118 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:10.429084 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-75cf68bd55-cxgv8"] Jun 08 16:51:10.432361 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:10.432340 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75cf68bd55-cxgv8" Jun 08 16:51:10.439819 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:10.439795 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/75f11dfa-0be5-4eab-99ec-d3fd6c866f34-console-oauth-config\") pod \"console-75cf68bd55-cxgv8\" (UID: \"75f11dfa-0be5-4eab-99ec-d3fd6c866f34\") " pod="openshift-console/console-75cf68bd55-cxgv8" Jun 08 16:51:10.439940 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:10.439826 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75f11dfa-0be5-4eab-99ec-d3fd6c866f34-trusted-ca-bundle\") pod \"console-75cf68bd55-cxgv8\" (UID: \"75f11dfa-0be5-4eab-99ec-d3fd6c866f34\") " pod="openshift-console/console-75cf68bd55-cxgv8" Jun 08 16:51:10.439940 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:10.439847 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/75f11dfa-0be5-4eab-99ec-d3fd6c866f34-console-config\") pod \"console-75cf68bd55-cxgv8\" (UID: \"75f11dfa-0be5-4eab-99ec-d3fd6c866f34\") " pod="openshift-console/console-75cf68bd55-cxgv8" Jun 08 16:51:10.439940 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:10.439907 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/75f11dfa-0be5-4eab-99ec-d3fd6c866f34-console-serving-cert\") pod \"console-75cf68bd55-cxgv8\" (UID: \"75f11dfa-0be5-4eab-99ec-d3fd6c866f34\") " pod="openshift-console/console-75cf68bd55-cxgv8" Jun 08 16:51:10.439940 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:10.439931 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/75f11dfa-0be5-4eab-99ec-d3fd6c866f34-oauth-serving-cert\") pod \"console-75cf68bd55-cxgv8\" (UID: \"75f11dfa-0be5-4eab-99ec-d3fd6c866f34\") " pod="openshift-console/console-75cf68bd55-cxgv8" Jun 08 16:51:10.440146 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:10.439965 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkxkk\" (UniqueName: \"kubernetes.io/projected/75f11dfa-0be5-4eab-99ec-d3fd6c866f34-kube-api-access-wkxkk\") pod \"console-75cf68bd55-cxgv8\" (UID: \"75f11dfa-0be5-4eab-99ec-d3fd6c866f34\") " pod="openshift-console/console-75cf68bd55-cxgv8" Jun 08 16:51:10.440146 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:10.439987 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/75f11dfa-0be5-4eab-99ec-d3fd6c866f34-service-ca\") pod \"console-75cf68bd55-cxgv8\" (UID: \"75f11dfa-0be5-4eab-99ec-d3fd6c866f34\") " pod="openshift-console/console-75cf68bd55-cxgv8" Jun 08 16:51:10.448296 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:10.448269 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75cf68bd55-cxgv8"] Jun 08 16:51:10.497051 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:10.497013 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:51:10.541292 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:10.541256 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/75f11dfa-0be5-4eab-99ec-d3fd6c866f34-console-serving-cert\") pod \"console-75cf68bd55-cxgv8\" (UID: \"75f11dfa-0be5-4eab-99ec-d3fd6c866f34\") " pod="openshift-console/console-75cf68bd55-cxgv8" Jun 08 16:51:10.541467 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:10.541299 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/75f11dfa-0be5-4eab-99ec-d3fd6c866f34-oauth-serving-cert\") pod \"console-75cf68bd55-cxgv8\" (UID: \"75f11dfa-0be5-4eab-99ec-d3fd6c866f34\") " pod="openshift-console/console-75cf68bd55-cxgv8" Jun 08 16:51:10.541467 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:10.541342 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkxkk\" (UniqueName: \"kubernetes.io/projected/75f11dfa-0be5-4eab-99ec-d3fd6c866f34-kube-api-access-wkxkk\") pod \"console-75cf68bd55-cxgv8\" (UID: \"75f11dfa-0be5-4eab-99ec-d3fd6c866f34\") " pod="openshift-console/console-75cf68bd55-cxgv8" Jun 08 16:51:10.541467 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:10.541364 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/75f11dfa-0be5-4eab-99ec-d3fd6c866f34-service-ca\") pod \"console-75cf68bd55-cxgv8\" (UID: \"75f11dfa-0be5-4eab-99ec-d3fd6c866f34\") " pod="openshift-console/console-75cf68bd55-cxgv8" Jun 08 16:51:10.541467 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:10.541408 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/75f11dfa-0be5-4eab-99ec-d3fd6c866f34-console-oauth-config\") pod \"console-75cf68bd55-cxgv8\" (UID: \"75f11dfa-0be5-4eab-99ec-d3fd6c866f34\") " pod="openshift-console/console-75cf68bd55-cxgv8" Jun 08 16:51:10.541467 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:10.541456 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75f11dfa-0be5-4eab-99ec-d3fd6c866f34-trusted-ca-bundle\") pod \"console-75cf68bd55-cxgv8\" (UID: \"75f11dfa-0be5-4eab-99ec-d3fd6c866f34\") " pod="openshift-console/console-75cf68bd55-cxgv8" Jun 08 16:51:10.541750 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:10.541491 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/75f11dfa-0be5-4eab-99ec-d3fd6c866f34-console-config\") pod \"console-75cf68bd55-cxgv8\" (UID: \"75f11dfa-0be5-4eab-99ec-d3fd6c866f34\") " pod="openshift-console/console-75cf68bd55-cxgv8" Jun 08 16:51:10.542284 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:10.542226 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/75f11dfa-0be5-4eab-99ec-d3fd6c866f34-console-config\") pod \"console-75cf68bd55-cxgv8\" (UID: \"75f11dfa-0be5-4eab-99ec-d3fd6c866f34\") " pod="openshift-console/console-75cf68bd55-cxgv8" Jun 08 16:51:10.542387 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:10.542296 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/75f11dfa-0be5-4eab-99ec-d3fd6c866f34-service-ca\") pod \"console-75cf68bd55-cxgv8\" (UID: \"75f11dfa-0be5-4eab-99ec-d3fd6c866f34\") " pod="openshift-console/console-75cf68bd55-cxgv8" Jun 08 16:51:10.542387 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:10.542307 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/75f11dfa-0be5-4eab-99ec-d3fd6c866f34-oauth-serving-cert\") pod \"console-75cf68bd55-cxgv8\" (UID: \"75f11dfa-0be5-4eab-99ec-d3fd6c866f34\") " pod="openshift-console/console-75cf68bd55-cxgv8" Jun 08 16:51:10.542556 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:10.542537 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75f11dfa-0be5-4eab-99ec-d3fd6c866f34-trusted-ca-bundle\") pod \"console-75cf68bd55-cxgv8\" (UID: \"75f11dfa-0be5-4eab-99ec-d3fd6c866f34\") " pod="openshift-console/console-75cf68bd55-cxgv8" Jun 08 16:51:10.543851 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:10.543823 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/75f11dfa-0be5-4eab-99ec-d3fd6c866f34-console-serving-cert\") pod \"console-75cf68bd55-cxgv8\" (UID: \"75f11dfa-0be5-4eab-99ec-d3fd6c866f34\") " pod="openshift-console/console-75cf68bd55-cxgv8" Jun 08 16:51:10.544003 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:10.543986 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/75f11dfa-0be5-4eab-99ec-d3fd6c866f34-console-oauth-config\") pod \"console-75cf68bd55-cxgv8\" (UID: \"75f11dfa-0be5-4eab-99ec-d3fd6c866f34\") " pod="openshift-console/console-75cf68bd55-cxgv8" Jun 08 16:51:10.555009 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:10.554988 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkxkk\" (UniqueName: \"kubernetes.io/projected/75f11dfa-0be5-4eab-99ec-d3fd6c866f34-kube-api-access-wkxkk\") pod \"console-75cf68bd55-cxgv8\" (UID: \"75f11dfa-0be5-4eab-99ec-d3fd6c866f34\") " pod="openshift-console/console-75cf68bd55-cxgv8" Jun 08 16:51:10.596481 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:10.596447 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:51:10.742397 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:10.742299 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75cf68bd55-cxgv8" Jun 08 16:51:10.878397 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:10.878371 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75cf68bd55-cxgv8"] Jun 08 16:51:10.880415 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:51:10.880386 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75f11dfa_0be5_4eab_99ec_d3fd6c866f34.slice/crio-4fa74d87e94bf758aa1386f63aa168e8e984bc77ae494e8bc2c42b79a04c4594 WatchSource:0}: Error finding container 4fa74d87e94bf758aa1386f63aa168e8e984bc77ae494e8bc2c42b79a04c4594: Status 404 returned error can't find the container with id 4fa74d87e94bf758aa1386f63aa168e8e984bc77ae494e8bc2c42b79a04c4594 Jun 08 16:51:11.494894 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:11.494860 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75cf68bd55-cxgv8" event={"ID":"75f11dfa-0be5-4eab-99ec-d3fd6c866f34","Type":"ContainerStarted","Data":"e2f272a7691e3235c7e9777ce279d9184d5f0361a6a4c6a164d1a7180c2d8ad5"} Jun 08 16:51:11.495274 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:11.494912 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75cf68bd55-cxgv8" event={"ID":"75f11dfa-0be5-4eab-99ec-d3fd6c866f34","Type":"ContainerStarted","Data":"4fa74d87e94bf758aa1386f63aa168e8e984bc77ae494e8bc2c42b79a04c4594"} Jun 08 16:51:11.522609 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:11.522557 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-75cf68bd55-cxgv8" podStartSLOduration=1.5225417060000002 podStartE2EDuration="1.522541706s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:51:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:51:11.521320227 +0000 UTC m=+223.418097701" watchObservedRunningTime="2026-06-08 16:51:11.522541706 +0000 UTC m=+223.419319181" Jun 08 16:51:20.742943 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:20.742901 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75cf68bd55-cxgv8" Jun 08 16:51:20.743476 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:20.742972 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75cf68bd55-cxgv8" Jun 08 16:51:20.747589 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:20.747568 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75cf68bd55-cxgv8" Jun 08 16:51:21.545058 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:21.545025 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75cf68bd55-cxgv8" Jun 08 16:51:21.620372 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:21.620342 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-689c455565-xf5dr"] Jun 08 16:51:21.796722 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:21.796635 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:51:21.910423 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:21.910380 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:51:26.001727 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:26.001688 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:51:26.107701 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:26.107667 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:51:28.194194 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:28.194158 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:51:46.641561 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:46.641472 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-689c455565-xf5dr" podUID="0864113e-05ab-4ca4-b633-f88be80c84e7" containerName="console" containerID="cri-o://79a9b328542f951005f2359e3d80e794a1b9e3edd7d9afcc62cd2b471aff03d8" gracePeriod=15 Jun 08 16:51:46.889097 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:46.889072 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-689c455565-xf5dr" Jun 08 16:51:47.047167 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:47.047086 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0864113e-05ab-4ca4-b633-f88be80c84e7-console-config\") pod \"0864113e-05ab-4ca4-b633-f88be80c84e7\" (UID: \"0864113e-05ab-4ca4-b633-f88be80c84e7\") " Jun 08 16:51:47.047167 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:47.047145 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0864113e-05ab-4ca4-b633-f88be80c84e7-oauth-serving-cert\") pod \"0864113e-05ab-4ca4-b633-f88be80c84e7\" (UID: \"0864113e-05ab-4ca4-b633-f88be80c84e7\") " Jun 08 16:51:47.047461 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:47.047173 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0864113e-05ab-4ca4-b633-f88be80c84e7-service-ca\") pod \"0864113e-05ab-4ca4-b633-f88be80c84e7\" (UID: \"0864113e-05ab-4ca4-b633-f88be80c84e7\") " Jun 08 16:51:47.047461 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:47.047199 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0864113e-05ab-4ca4-b633-f88be80c84e7-console-serving-cert\") pod \"0864113e-05ab-4ca4-b633-f88be80c84e7\" (UID: \"0864113e-05ab-4ca4-b633-f88be80c84e7\") " Jun 08 16:51:47.047461 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:47.047234 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0864113e-05ab-4ca4-b633-f88be80c84e7-console-oauth-config\") pod \"0864113e-05ab-4ca4-b633-f88be80c84e7\" (UID: \"0864113e-05ab-4ca4-b633-f88be80c84e7\") " Jun 08 16:51:47.047461 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:47.047298 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mckhb\" (UniqueName: \"kubernetes.io/projected/0864113e-05ab-4ca4-b633-f88be80c84e7-kube-api-access-mckhb\") pod \"0864113e-05ab-4ca4-b633-f88be80c84e7\" (UID: \"0864113e-05ab-4ca4-b633-f88be80c84e7\") " Jun 08 16:51:47.047461 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:47.047324 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0864113e-05ab-4ca4-b633-f88be80c84e7-trusted-ca-bundle\") pod \"0864113e-05ab-4ca4-b633-f88be80c84e7\" (UID: \"0864113e-05ab-4ca4-b633-f88be80c84e7\") " Jun 08 16:51:47.047748 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:47.047553 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0864113e-05ab-4ca4-b633-f88be80c84e7-console-config" (OuterVolumeSpecName: "console-config") pod "0864113e-05ab-4ca4-b633-f88be80c84e7" (UID: "0864113e-05ab-4ca4-b633-f88be80c84e7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 16:51:47.047748 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:47.047598 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0864113e-05ab-4ca4-b633-f88be80c84e7-service-ca" (OuterVolumeSpecName: "service-ca") pod "0864113e-05ab-4ca4-b633-f88be80c84e7" (UID: "0864113e-05ab-4ca4-b633-f88be80c84e7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 16:51:47.047907 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:47.047883 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0864113e-05ab-4ca4-b633-f88be80c84e7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0864113e-05ab-4ca4-b633-f88be80c84e7" (UID: "0864113e-05ab-4ca4-b633-f88be80c84e7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 16:51:47.048156 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:47.048133 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0864113e-05ab-4ca4-b633-f88be80c84e7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0864113e-05ab-4ca4-b633-f88be80c84e7" (UID: "0864113e-05ab-4ca4-b633-f88be80c84e7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 16:51:47.049616 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:47.049594 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0864113e-05ab-4ca4-b633-f88be80c84e7-kube-api-access-mckhb" (OuterVolumeSpecName: "kube-api-access-mckhb") pod "0864113e-05ab-4ca4-b633-f88be80c84e7" (UID: "0864113e-05ab-4ca4-b633-f88be80c84e7"). InnerVolumeSpecName "kube-api-access-mckhb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 16:51:47.050147 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:47.050118 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0864113e-05ab-4ca4-b633-f88be80c84e7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0864113e-05ab-4ca4-b633-f88be80c84e7" (UID: "0864113e-05ab-4ca4-b633-f88be80c84e7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 16:51:47.050226 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:47.050147 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0864113e-05ab-4ca4-b633-f88be80c84e7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0864113e-05ab-4ca4-b633-f88be80c84e7" (UID: "0864113e-05ab-4ca4-b633-f88be80c84e7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 16:51:47.148665 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:47.148638 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0864113e-05ab-4ca4-b633-f88be80c84e7-service-ca\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 16:51:47.148665 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:47.148659 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0864113e-05ab-4ca4-b633-f88be80c84e7-console-serving-cert\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 16:51:47.148665 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:47.148670 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0864113e-05ab-4ca4-b633-f88be80c84e7-console-oauth-config\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 16:51:47.148834 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:47.148679 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mckhb\" (UniqueName: \"kubernetes.io/projected/0864113e-05ab-4ca4-b633-f88be80c84e7-kube-api-access-mckhb\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 16:51:47.148834 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:47.148688 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0864113e-05ab-4ca4-b633-f88be80c84e7-trusted-ca-bundle\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 16:51:47.148834 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:47.148696 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0864113e-05ab-4ca4-b633-f88be80c84e7-console-config\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 16:51:47.148834 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:47.148704 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0864113e-05ab-4ca4-b633-f88be80c84e7-oauth-serving-cert\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 16:51:47.639399 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:47.639358 2579 generic.go:356] "Generic (PLEG): container finished" podID="0864113e-05ab-4ca4-b633-f88be80c84e7" containerID="79a9b328542f951005f2359e3d80e794a1b9e3edd7d9afcc62cd2b471aff03d8" exitCode=0 Jun 08 16:51:47.639580 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:47.639404 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-689c455565-xf5dr" Jun 08 16:51:47.639580 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:47.639444 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-689c455565-xf5dr" event={"ID":"0864113e-05ab-4ca4-b633-f88be80c84e7","Type":"ContainerDied","Data":"79a9b328542f951005f2359e3d80e794a1b9e3edd7d9afcc62cd2b471aff03d8"} Jun 08 16:51:47.639580 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:47.639497 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-689c455565-xf5dr" event={"ID":"0864113e-05ab-4ca4-b633-f88be80c84e7","Type":"ContainerDied","Data":"4f02ac481a6597477b48ca482157a2d3cbb6dd7ec59564930fde8be69e6d161a"} Jun 08 16:51:47.639580 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:47.639518 2579 scope.go:117] "RemoveContainer" containerID="79a9b328542f951005f2359e3d80e794a1b9e3edd7d9afcc62cd2b471aff03d8" Jun 08 16:51:47.648383 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:47.648176 2579 scope.go:117] "RemoveContainer" containerID="79a9b328542f951005f2359e3d80e794a1b9e3edd7d9afcc62cd2b471aff03d8" Jun 08 16:51:47.648607 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:51:47.648449 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79a9b328542f951005f2359e3d80e794a1b9e3edd7d9afcc62cd2b471aff03d8\": container with ID starting with 79a9b328542f951005f2359e3d80e794a1b9e3edd7d9afcc62cd2b471aff03d8 not found: ID does not exist" containerID="79a9b328542f951005f2359e3d80e794a1b9e3edd7d9afcc62cd2b471aff03d8" Jun 08 16:51:47.648607 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:47.648472 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79a9b328542f951005f2359e3d80e794a1b9e3edd7d9afcc62cd2b471aff03d8"} err="failed to get container status \"79a9b328542f951005f2359e3d80e794a1b9e3edd7d9afcc62cd2b471aff03d8\": rpc error: code = NotFound desc = could not find container \"79a9b328542f951005f2359e3d80e794a1b9e3edd7d9afcc62cd2b471aff03d8\": container with ID starting with 79a9b328542f951005f2359e3d80e794a1b9e3edd7d9afcc62cd2b471aff03d8 not found: ID does not exist" Jun 08 16:51:47.664971 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:47.664949 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-689c455565-xf5dr"] Jun 08 16:51:47.671514 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:47.671493 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-689c455565-xf5dr"] Jun 08 16:51:48.525379 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:48.525347 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0864113e-05ab-4ca4-b633-f88be80c84e7" path="/var/lib/kubelet/pods/0864113e-05ab-4ca4-b633-f88be80c84e7/volumes" Jun 08 16:51:58.117127 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:58.117088 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:51:58.454304 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:51:58.454210 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:52:00.403395 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:00.403364 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-8wm8z"] Jun 08 16:52:00.403797 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:00.403722 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0864113e-05ab-4ca4-b633-f88be80c84e7" containerName="console" Jun 08 16:52:00.403797 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:00.403733 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0864113e-05ab-4ca4-b633-f88be80c84e7" containerName="console" Jun 08 16:52:00.403797 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:00.403783 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0864113e-05ab-4ca4-b633-f88be80c84e7" containerName="console" Jun 08 16:52:00.406186 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:00.406168 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-8wm8z" Jun 08 16:52:00.410395 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:00.410369 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-fl4w5\"" Jun 08 16:52:00.410636 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:00.410616 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 08 16:52:00.410748 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:00.410713 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 08 16:52:00.422597 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:00.422577 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-8wm8z"] Jun 08 16:52:00.460231 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:00.460202 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/106a781e-5caf-433f-8489-178182bbcacd-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-8wm8z\" (UID: \"106a781e-5caf-433f-8489-178182bbcacd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-8wm8z" Jun 08 16:52:00.460400 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:00.460261 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7lbj\" (UniqueName: \"kubernetes.io/projected/106a781e-5caf-433f-8489-178182bbcacd-kube-api-access-h7lbj\") pod \"cert-manager-operator-controller-manager-57757f7cfc-8wm8z\" (UID: \"106a781e-5caf-433f-8489-178182bbcacd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-8wm8z" Jun 08 16:52:00.561539 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:00.561509 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/106a781e-5caf-433f-8489-178182bbcacd-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-8wm8z\" (UID: \"106a781e-5caf-433f-8489-178182bbcacd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-8wm8z" Jun 08 16:52:00.561700 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:00.561550 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7lbj\" (UniqueName: \"kubernetes.io/projected/106a781e-5caf-433f-8489-178182bbcacd-kube-api-access-h7lbj\") pod \"cert-manager-operator-controller-manager-57757f7cfc-8wm8z\" (UID: \"106a781e-5caf-433f-8489-178182bbcacd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-8wm8z" Jun 08 16:52:00.561879 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:00.561861 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/106a781e-5caf-433f-8489-178182bbcacd-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-8wm8z\" (UID: \"106a781e-5caf-433f-8489-178182bbcacd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-8wm8z" Jun 08 16:52:00.577553 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:00.577520 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7lbj\" (UniqueName: \"kubernetes.io/projected/106a781e-5caf-433f-8489-178182bbcacd-kube-api-access-h7lbj\") pod \"cert-manager-operator-controller-manager-57757f7cfc-8wm8z\" (UID: \"106a781e-5caf-433f-8489-178182bbcacd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-8wm8z" Jun 08 16:52:00.715625 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:00.715527 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-8wm8z" Jun 08 16:52:00.854726 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:00.854688 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-8wm8z"] Jun 08 16:52:00.859049 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:52:00.859023 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod106a781e_5caf_433f_8489_178182bbcacd.slice/crio-a8a2881a08385dd9b46fb10f22ba67510f1f12ea1177152590f0b66dbad9b023 WatchSource:0}: Error finding container a8a2881a08385dd9b46fb10f22ba67510f1f12ea1177152590f0b66dbad9b023: Status 404 returned error can't find the container with id a8a2881a08385dd9b46fb10f22ba67510f1f12ea1177152590f0b66dbad9b023 Jun 08 16:52:01.699272 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:01.699215 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-8wm8z" event={"ID":"106a781e-5caf-433f-8489-178182bbcacd","Type":"ContainerStarted","Data":"a8a2881a08385dd9b46fb10f22ba67510f1f12ea1177152590f0b66dbad9b023"} Jun 08 16:52:02.162738 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:02.162693 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:52:02.263642 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:02.263608 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:52:03.710252 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:03.710146 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-8wm8z" event={"ID":"106a781e-5caf-433f-8489-178182bbcacd","Type":"ContainerStarted","Data":"2b0a71b8cc4747c7e1ee7a4c9b0620949f65082494c1375e3e5be4891f538108"} Jun 08 16:52:03.741219 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:03.741171 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-8wm8z" podStartSLOduration=1.1845254490000001 podStartE2EDuration="3.741156315s" totalImagesPullingTime="2.556630866s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:52:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:52:03.737670975 +0000 UTC m=+275.634448451" watchObservedRunningTime="2026-06-08 16:52:03.741156315 +0000 UTC m=+275.637933789" Jun 08 16:52:04.163309 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:04.163261 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:52:04.337545 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:04.337508 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:52:07.639305 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:07.639199 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:52:07.773592 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:07.773558 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-btpl8"] Jun 08 16:52:07.775635 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:07.775618 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-btpl8" Jun 08 16:52:07.778392 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:07.778371 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 08 16:52:07.779425 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:07.779406 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-jp74s\"" Jun 08 16:52:07.779510 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:07.779406 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 08 16:52:07.787681 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:07.787660 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-btpl8"] Jun 08 16:52:07.831761 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:07.831728 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/525f63d0-29a3-4a5a-a344-6730b40e4344-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-btpl8\" (UID: \"525f63d0-29a3-4a5a-a344-6730b40e4344\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-btpl8" Jun 08 16:52:07.831928 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:07.831795 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nptrm\" (UniqueName: \"kubernetes.io/projected/525f63d0-29a3-4a5a-a344-6730b40e4344-kube-api-access-nptrm\") pod \"cert-manager-cainjector-5d99449ffd-btpl8\" (UID: \"525f63d0-29a3-4a5a-a344-6730b40e4344\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-btpl8" Jun 08 16:52:07.853351 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:07.853315 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:52:07.932447 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:07.932369 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/525f63d0-29a3-4a5a-a344-6730b40e4344-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-btpl8\" (UID: \"525f63d0-29a3-4a5a-a344-6730b40e4344\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-btpl8" Jun 08 16:52:07.932447 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:07.932425 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nptrm\" (UniqueName: \"kubernetes.io/projected/525f63d0-29a3-4a5a-a344-6730b40e4344-kube-api-access-nptrm\") pod \"cert-manager-cainjector-5d99449ffd-btpl8\" (UID: \"525f63d0-29a3-4a5a-a344-6730b40e4344\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-btpl8" Jun 08 16:52:07.949915 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:07.949887 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/525f63d0-29a3-4a5a-a344-6730b40e4344-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-btpl8\" (UID: \"525f63d0-29a3-4a5a-a344-6730b40e4344\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-btpl8" Jun 08 16:52:07.950172 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:07.950147 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nptrm\" (UniqueName: \"kubernetes.io/projected/525f63d0-29a3-4a5a-a344-6730b40e4344-kube-api-access-nptrm\") pod \"cert-manager-cainjector-5d99449ffd-btpl8\" (UID: \"525f63d0-29a3-4a5a-a344-6730b40e4344\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-btpl8" Jun 08 16:52:08.094794 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:08.094765 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-btpl8" Jun 08 16:52:08.228290 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:08.228194 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-btpl8"] Jun 08 16:52:08.231741 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:52:08.231714 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod525f63d0_29a3_4a5a_a344_6730b40e4344.slice/crio-fcef2cd2a29205c2ea29d8f14e3499c960a1f3235a39c2b929d5d10782e3a614 WatchSource:0}: Error finding container fcef2cd2a29205c2ea29d8f14e3499c960a1f3235a39c2b929d5d10782e3a614: Status 404 returned error can't find the container with id fcef2cd2a29205c2ea29d8f14e3499c960a1f3235a39c2b929d5d10782e3a614 Jun 08 16:52:08.723664 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:08.723632 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:52:08.731333 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:08.731293 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-btpl8" event={"ID":"525f63d0-29a3-4a5a-a344-6730b40e4344","Type":"ContainerStarted","Data":"fcef2cd2a29205c2ea29d8f14e3499c960a1f3235a39c2b929d5d10782e3a614"} Jun 08 16:52:08.818935 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:08.818898 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:52:10.743895 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:10.743860 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-btpl8" event={"ID":"525f63d0-29a3-4a5a-a344-6730b40e4344","Type":"ContainerStarted","Data":"2e783c985e9e28f2696f8ea1b5824915357f7840acd09a850dd0a6dc9744e813"} Jun 08 16:52:10.772228 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:10.772183 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-btpl8" podStartSLOduration=1.361961827 podStartE2EDuration="3.772166446s" totalImagesPullingTime="2.410204619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:52:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:52:10.772158851 +0000 UTC m=+282.668936328" watchObservedRunningTime="2026-06-08 16:52:10.772166446 +0000 UTC m=+282.668943923" Jun 08 16:52:15.220911 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:15.220870 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:52:15.438602 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:15.438564 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:52:15.536999 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:15.536919 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:52:20.892065 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:20.892024 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:52:20.998524 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:20.998480 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:52:22.311184 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:22.311144 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:52:22.637935 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:22.637900 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:52:27.543190 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:27.543149 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:52:27.620291 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:27.620259 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:52:28.457337 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:28.457306 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vkrbj_559d75ed-52d7-4430-8f9f-09a01958d3f4/ovn-acl-logging/0.log" Jun 08 16:52:28.459484 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:28.459462 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vkrbj_559d75ed-52d7-4430-8f9f-09a01958d3f4/ovn-acl-logging/0.log" Jun 08 16:52:28.463603 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:28.463581 2579 kubelet.go:1648] "Image garbage collection succeeded" Jun 08 16:52:34.575835 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:34.575805 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:52:34.674179 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:34.674133 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:52:35.190725 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:35.190688 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:52:35.425012 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:35.424972 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:52:35.569833 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:35.569791 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:52:35.638933 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:35.638902 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-558f5cf56d-ltdnl"] Jun 08 16:52:35.663170 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:35.663129 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-558f5cf56d-ltdnl" Jun 08 16:52:35.666305 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:35.666280 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 08 16:52:35.666591 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:35.666543 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 08 16:52:35.666591 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:35.666570 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 08 16:52:35.666771 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:35.666724 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lf54g\"" Jun 08 16:52:35.666840 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:35.666803 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 08 16:52:35.667853 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:35.667828 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-558f5cf56d-ltdnl"] Jun 08 16:52:35.770082 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:35.770048 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6hbs\" (UniqueName: \"kubernetes.io/projected/05c816cb-1aa9-4950-bbbd-1fd5bf2e0b19-kube-api-access-q6hbs\") pod \"opendatahub-operator-controller-manager-558f5cf56d-ltdnl\" (UID: \"05c816cb-1aa9-4950-bbbd-1fd5bf2e0b19\") " pod="opendatahub/opendatahub-operator-controller-manager-558f5cf56d-ltdnl" Jun 08 16:52:35.770275 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:35.770100 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05c816cb-1aa9-4950-bbbd-1fd5bf2e0b19-tmp\") pod \"opendatahub-operator-controller-manager-558f5cf56d-ltdnl\" (UID: \"05c816cb-1aa9-4950-bbbd-1fd5bf2e0b19\") " pod="opendatahub/opendatahub-operator-controller-manager-558f5cf56d-ltdnl" Jun 08 16:52:35.770275 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:35.770127 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/05c816cb-1aa9-4950-bbbd-1fd5bf2e0b19-webhook-cert\") pod \"opendatahub-operator-controller-manager-558f5cf56d-ltdnl\" (UID: \"05c816cb-1aa9-4950-bbbd-1fd5bf2e0b19\") " pod="opendatahub/opendatahub-operator-controller-manager-558f5cf56d-ltdnl" Jun 08 16:52:35.770275 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:35.770154 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/05c816cb-1aa9-4950-bbbd-1fd5bf2e0b19-apiservice-cert\") pod \"opendatahub-operator-controller-manager-558f5cf56d-ltdnl\" (UID: \"05c816cb-1aa9-4950-bbbd-1fd5bf2e0b19\") " pod="opendatahub/opendatahub-operator-controller-manager-558f5cf56d-ltdnl" Jun 08 16:52:35.770275 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:35.770182 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/05c816cb-1aa9-4950-bbbd-1fd5bf2e0b19-manifests\") pod \"opendatahub-operator-controller-manager-558f5cf56d-ltdnl\" (UID: \"05c816cb-1aa9-4950-bbbd-1fd5bf2e0b19\") " pod="opendatahub/opendatahub-operator-controller-manager-558f5cf56d-ltdnl" Jun 08 16:52:35.871492 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:35.871405 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6hbs\" (UniqueName: \"kubernetes.io/projected/05c816cb-1aa9-4950-bbbd-1fd5bf2e0b19-kube-api-access-q6hbs\") pod \"opendatahub-operator-controller-manager-558f5cf56d-ltdnl\" (UID: \"05c816cb-1aa9-4950-bbbd-1fd5bf2e0b19\") " pod="opendatahub/opendatahub-operator-controller-manager-558f5cf56d-ltdnl" Jun 08 16:52:35.871492 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:35.871448 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05c816cb-1aa9-4950-bbbd-1fd5bf2e0b19-tmp\") pod \"opendatahub-operator-controller-manager-558f5cf56d-ltdnl\" (UID: \"05c816cb-1aa9-4950-bbbd-1fd5bf2e0b19\") " pod="opendatahub/opendatahub-operator-controller-manager-558f5cf56d-ltdnl" Jun 08 16:52:35.871492 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:35.871469 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/05c816cb-1aa9-4950-bbbd-1fd5bf2e0b19-webhook-cert\") pod \"opendatahub-operator-controller-manager-558f5cf56d-ltdnl\" (UID: \"05c816cb-1aa9-4950-bbbd-1fd5bf2e0b19\") " pod="opendatahub/opendatahub-operator-controller-manager-558f5cf56d-ltdnl" Jun 08 16:52:35.871492 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:35.871493 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/05c816cb-1aa9-4950-bbbd-1fd5bf2e0b19-apiservice-cert\") pod \"opendatahub-operator-controller-manager-558f5cf56d-ltdnl\" (UID: \"05c816cb-1aa9-4950-bbbd-1fd5bf2e0b19\") " pod="opendatahub/opendatahub-operator-controller-manager-558f5cf56d-ltdnl" Jun 08 16:52:35.871819 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:35.871520 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/05c816cb-1aa9-4950-bbbd-1fd5bf2e0b19-manifests\") pod \"opendatahub-operator-controller-manager-558f5cf56d-ltdnl\" (UID: \"05c816cb-1aa9-4950-bbbd-1fd5bf2e0b19\") " pod="opendatahub/opendatahub-operator-controller-manager-558f5cf56d-ltdnl" Jun 08 16:52:35.871925 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:35.871906 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/05c816cb-1aa9-4950-bbbd-1fd5bf2e0b19-manifests\") pod \"opendatahub-operator-controller-manager-558f5cf56d-ltdnl\" (UID: \"05c816cb-1aa9-4950-bbbd-1fd5bf2e0b19\") " pod="opendatahub/opendatahub-operator-controller-manager-558f5cf56d-ltdnl" Jun 08 16:52:35.873865 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:35.873839 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05c816cb-1aa9-4950-bbbd-1fd5bf2e0b19-tmp\") pod \"opendatahub-operator-controller-manager-558f5cf56d-ltdnl\" (UID: \"05c816cb-1aa9-4950-bbbd-1fd5bf2e0b19\") " pod="opendatahub/opendatahub-operator-controller-manager-558f5cf56d-ltdnl" Jun 08 16:52:35.874033 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:35.874013 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/05c816cb-1aa9-4950-bbbd-1fd5bf2e0b19-webhook-cert\") pod \"opendatahub-operator-controller-manager-558f5cf56d-ltdnl\" (UID: \"05c816cb-1aa9-4950-bbbd-1fd5bf2e0b19\") " pod="opendatahub/opendatahub-operator-controller-manager-558f5cf56d-ltdnl" Jun 08 16:52:35.874169 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:35.874149 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/05c816cb-1aa9-4950-bbbd-1fd5bf2e0b19-apiservice-cert\") pod \"opendatahub-operator-controller-manager-558f5cf56d-ltdnl\" (UID: \"05c816cb-1aa9-4950-bbbd-1fd5bf2e0b19\") " pod="opendatahub/opendatahub-operator-controller-manager-558f5cf56d-ltdnl" Jun 08 16:52:35.882358 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:35.882326 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:52:35.898995 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:35.898965 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6hbs\" (UniqueName: \"kubernetes.io/projected/05c816cb-1aa9-4950-bbbd-1fd5bf2e0b19-kube-api-access-q6hbs\") pod \"opendatahub-operator-controller-manager-558f5cf56d-ltdnl\" (UID: \"05c816cb-1aa9-4950-bbbd-1fd5bf2e0b19\") " pod="opendatahub/opendatahub-operator-controller-manager-558f5cf56d-ltdnl" Jun 08 16:52:35.977089 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:35.977056 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-558f5cf56d-ltdnl" Jun 08 16:52:36.024355 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:36.024280 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:52:36.119331 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:36.119311 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-558f5cf56d-ltdnl"] Jun 08 16:52:36.121644 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:52:36.121580 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05c816cb_1aa9_4950_bbbd_1fd5bf2e0b19.slice/crio-ef9c90558946d0228f7444207e27eb4333b3a0a0a800ab3ff99a48027c04476e WatchSource:0}: Error finding container ef9c90558946d0228f7444207e27eb4333b3a0a0a800ab3ff99a48027c04476e: Status 404 returned error can't find the container with id ef9c90558946d0228f7444207e27eb4333b3a0a0a800ab3ff99a48027c04476e Jun 08 16:52:36.123451 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:36.123432 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 16:52:36.124604 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:36.124580 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:52:36.226984 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:36.226937 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:52:36.332406 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:36.332368 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:52:36.450114 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:36.450024 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:52:36.555290 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:36.555231 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:52:36.740397 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:36.740303 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:52:36.842655 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:36.842615 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:52:36.869450 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:36.869413 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-558f5cf56d-ltdnl" event={"ID":"05c816cb-1aa9-4950-bbbd-1fd5bf2e0b19","Type":"ContainerStarted","Data":"ef9c90558946d0228f7444207e27eb4333b3a0a0a800ab3ff99a48027c04476e"} Jun 08 16:52:39.886769 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:39.886730 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-558f5cf56d-ltdnl" event={"ID":"05c816cb-1aa9-4950-bbbd-1fd5bf2e0b19","Type":"ContainerStarted","Data":"5c5163e6c5583dd3d0214960e82d4dd1f8d150d81d0c2d1dce3cbdd11f7db205"} Jun 08 16:52:40.892935 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:40.892895 2579 generic.go:356] "Generic (PLEG): container finished" podID="05c816cb-1aa9-4950-bbbd-1fd5bf2e0b19" containerID="5c5163e6c5583dd3d0214960e82d4dd1f8d150d81d0c2d1dce3cbdd11f7db205" exitCode=0 Jun 08 16:52:40.893444 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:40.892987 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-558f5cf56d-ltdnl" event={"ID":"05c816cb-1aa9-4950-bbbd-1fd5bf2e0b19","Type":"ContainerDied","Data":"5c5163e6c5583dd3d0214960e82d4dd1f8d150d81d0c2d1dce3cbdd11f7db205"} Jun 08 16:52:41.899271 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:41.899223 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-558f5cf56d-ltdnl" event={"ID":"05c816cb-1aa9-4950-bbbd-1fd5bf2e0b19","Type":"ContainerStarted","Data":"5f7d0a6bfb9e32ef37ec3dca24e8e28c523cad47c3d72c336e10aa8a9cf72706"} Jun 08 16:52:41.899656 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:41.899329 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-558f5cf56d-ltdnl" Jun 08 16:52:41.929656 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:41.929610 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-558f5cf56d-ltdnl" podStartSLOduration=2.8226214069999997 podStartE2EDuration="6.929595002s" totalImagesPullingTime="3.19079059s" totalInitContainerRuntime="916.183005ms" isStatefulPod=false podCreationTimestamp="2026-06-08 16:52:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:52:41.926046028 +0000 UTC m=+313.822823504" watchObservedRunningTime="2026-06-08 16:52:41.929595002 +0000 UTC m=+313.826372551" Jun 08 16:52:48.971519 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:48.971486 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:52:49.061593 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:49.061565 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:52:52.905107 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:52.905078 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-558f5cf56d-ltdnl" Jun 08 16:52:54.693923 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:54.693885 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:52:54.893593 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:54.893557 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:52:55.223605 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:55.223569 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:52:55.345136 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:55.345091 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:52:55.436196 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:55.436163 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6687c84fb8-cmmw8"] Jun 08 16:52:55.439889 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:55.439867 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6687c84fb8-cmmw8" Jun 08 16:52:55.458533 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:55.458508 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 08 16:52:55.458840 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:55.458824 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 08 16:52:55.463551 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:55.463536 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 08 16:52:55.464208 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:55.464186 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-p8wxq\"" Jun 08 16:52:55.464636 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:55.464623 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 08 16:52:55.464918 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:55.464903 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 08 16:52:55.502315 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:55.498431 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6687c84fb8-cmmw8"] Jun 08 16:52:55.519055 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:55.519012 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:52:55.543473 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:55.543436 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5da85637-5118-444b-8b17-3909630af819-cert\") pod \"lws-controller-manager-6687c84fb8-cmmw8\" (UID: \"5da85637-5118-444b-8b17-3909630af819\") " pod="openshift-lws-operator/lws-controller-manager-6687c84fb8-cmmw8" Jun 08 16:52:55.543629 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:55.543497 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5da85637-5118-444b-8b17-3909630af819-manager-config\") pod \"lws-controller-manager-6687c84fb8-cmmw8\" (UID: \"5da85637-5118-444b-8b17-3909630af819\") " pod="openshift-lws-operator/lws-controller-manager-6687c84fb8-cmmw8" Jun 08 16:52:55.543629 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:55.543566 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58q5r\" (UniqueName: \"kubernetes.io/projected/5da85637-5118-444b-8b17-3909630af819-kube-api-access-58q5r\") pod \"lws-controller-manager-6687c84fb8-cmmw8\" (UID: \"5da85637-5118-444b-8b17-3909630af819\") " pod="openshift-lws-operator/lws-controller-manager-6687c84fb8-cmmw8" Jun 08 16:52:55.543629 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:55.543601 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5da85637-5118-444b-8b17-3909630af819-metrics-cert\") pod \"lws-controller-manager-6687c84fb8-cmmw8\" (UID: \"5da85637-5118-444b-8b17-3909630af819\") " pod="openshift-lws-operator/lws-controller-manager-6687c84fb8-cmmw8" Jun 08 16:52:55.644191 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:55.644157 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5da85637-5118-444b-8b17-3909630af819-manager-config\") pod \"lws-controller-manager-6687c84fb8-cmmw8\" (UID: \"5da85637-5118-444b-8b17-3909630af819\") " pod="openshift-lws-operator/lws-controller-manager-6687c84fb8-cmmw8" Jun 08 16:52:55.644418 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:55.644216 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58q5r\" (UniqueName: \"kubernetes.io/projected/5da85637-5118-444b-8b17-3909630af819-kube-api-access-58q5r\") pod \"lws-controller-manager-6687c84fb8-cmmw8\" (UID: \"5da85637-5118-444b-8b17-3909630af819\") " pod="openshift-lws-operator/lws-controller-manager-6687c84fb8-cmmw8" Jun 08 16:52:55.644418 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:55.644262 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5da85637-5118-444b-8b17-3909630af819-metrics-cert\") pod \"lws-controller-manager-6687c84fb8-cmmw8\" (UID: \"5da85637-5118-444b-8b17-3909630af819\") " pod="openshift-lws-operator/lws-controller-manager-6687c84fb8-cmmw8" Jun 08 16:52:55.644418 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:55.644312 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5da85637-5118-444b-8b17-3909630af819-cert\") pod \"lws-controller-manager-6687c84fb8-cmmw8\" (UID: \"5da85637-5118-444b-8b17-3909630af819\") " pod="openshift-lws-operator/lws-controller-manager-6687c84fb8-cmmw8" Jun 08 16:52:55.644976 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:55.644945 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5da85637-5118-444b-8b17-3909630af819-manager-config\") pod \"lws-controller-manager-6687c84fb8-cmmw8\" (UID: \"5da85637-5118-444b-8b17-3909630af819\") " pod="openshift-lws-operator/lws-controller-manager-6687c84fb8-cmmw8" Jun 08 16:52:55.646956 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:55.646932 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5da85637-5118-444b-8b17-3909630af819-cert\") pod \"lws-controller-manager-6687c84fb8-cmmw8\" (UID: \"5da85637-5118-444b-8b17-3909630af819\") " pod="openshift-lws-operator/lws-controller-manager-6687c84fb8-cmmw8" Jun 08 16:52:55.647053 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:55.646983 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5da85637-5118-444b-8b17-3909630af819-metrics-cert\") pod \"lws-controller-manager-6687c84fb8-cmmw8\" (UID: \"5da85637-5118-444b-8b17-3909630af819\") " pod="openshift-lws-operator/lws-controller-manager-6687c84fb8-cmmw8" Jun 08 16:52:55.668216 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:55.668187 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58q5r\" (UniqueName: \"kubernetes.io/projected/5da85637-5118-444b-8b17-3909630af819-kube-api-access-58q5r\") pod \"lws-controller-manager-6687c84fb8-cmmw8\" (UID: \"5da85637-5118-444b-8b17-3909630af819\") " pod="openshift-lws-operator/lws-controller-manager-6687c84fb8-cmmw8" Jun 08 16:52:55.748531 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:55.748493 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6687c84fb8-cmmw8" Jun 08 16:52:55.880365 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:55.880333 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:52:55.891156 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:55.891133 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6687c84fb8-cmmw8"] Jun 08 16:52:55.892031 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:52:55.892004 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5da85637_5118_444b_8b17_3909630af819.slice/crio-cfecd3e377f8bc8ba7c8263bbde8d069e0e8977a64deab2e1f4bf11e54fbb0c8 WatchSource:0}: Error finding container cfecd3e377f8bc8ba7c8263bbde8d069e0e8977a64deab2e1f4bf11e54fbb0c8: Status 404 returned error can't find the container with id cfecd3e377f8bc8ba7c8263bbde8d069e0e8977a64deab2e1f4bf11e54fbb0c8 Jun 08 16:52:55.962425 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:55.962386 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6687c84fb8-cmmw8" event={"ID":"5da85637-5118-444b-8b17-3909630af819","Type":"ContainerStarted","Data":"cfecd3e377f8bc8ba7c8263bbde8d069e0e8977a64deab2e1f4bf11e54fbb0c8"} Jun 08 16:52:55.987825 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:55.987774 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:52:56.118282 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:56.118225 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:52:56.383192 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:56.383106 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:52:56.645490 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:56.645335 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:52:56.946976 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:56.946780 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:52:58.979553 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:58.979520 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6687c84fb8-cmmw8" event={"ID":"5da85637-5118-444b-8b17-3909630af819","Type":"ContainerStarted","Data":"fc184b965d230d26521458d0aa71109048c7dbb7e62b05060550bf02639d250e"} Jun 08 16:52:58.979917 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:58.979580 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6687c84fb8-cmmw8" Jun 08 16:52:59.001935 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:52:59.001890 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6687c84fb8-cmmw8" podStartSLOduration=1.027795998 podStartE2EDuration="4.001874786s" totalImagesPullingTime="2.974078788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:52:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:52:58.99933742 +0000 UTC m=+330.896114923" watchObservedRunningTime="2026-06-08 16:52:59.001874786 +0000 UTC m=+330.898652260" Jun 08 16:53:07.506057 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:07.506016 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:53:08.683042 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:08.682996 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:53:08.855820 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:08.855770 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:53:09.010036 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:09.009942 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:53:09.123269 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:09.123221 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:53:09.985440 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:09.985410 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6687c84fb8-cmmw8" Jun 08 16:53:10.973175 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:10.973141 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:53:11.606193 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:11.606154 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:53:11.819525 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:11.819456 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:53:12.502304 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:12.502229 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:53:22.344199 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:22.344093 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:53:22.449890 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:22.449850 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:53:25.918577 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:25.918539 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:53:26.017300 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:26.017268 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-79f58678bc-nmb7b"] Jun 08 16:53:26.020667 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:26.020645 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-79f58678bc-nmb7b" Jun 08 16:53:26.023421 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:26.023392 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-p2ths\"" Jun 08 16:53:26.023655 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:26.023640 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 08 16:53:26.027092 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:26.027070 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/fc28443b-3645-4597-a075-ded4a47b7cdb-redirect-config\") pod \"dashboard-redirect-79f58678bc-nmb7b\" (UID: \"fc28443b-3645-4597-a075-ded4a47b7cdb\") " pod="opendatahub/dashboard-redirect-79f58678bc-nmb7b" Jun 08 16:53:26.027209 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:26.027120 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8dmr\" (UniqueName: \"kubernetes.io/projected/fc28443b-3645-4597-a075-ded4a47b7cdb-kube-api-access-h8dmr\") pod \"dashboard-redirect-79f58678bc-nmb7b\" (UID: \"fc28443b-3645-4597-a075-ded4a47b7cdb\") " pod="opendatahub/dashboard-redirect-79f58678bc-nmb7b" Jun 08 16:53:26.030733 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:26.030681 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-79f58678bc-nmb7b"] Jun 08 16:53:26.059164 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:26.059137 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:53:26.128134 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:26.128096 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8dmr\" (UniqueName: \"kubernetes.io/projected/fc28443b-3645-4597-a075-ded4a47b7cdb-kube-api-access-h8dmr\") pod \"dashboard-redirect-79f58678bc-nmb7b\" (UID: \"fc28443b-3645-4597-a075-ded4a47b7cdb\") " pod="opendatahub/dashboard-redirect-79f58678bc-nmb7b" Jun 08 16:53:26.128344 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:26.128170 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/fc28443b-3645-4597-a075-ded4a47b7cdb-redirect-config\") pod \"dashboard-redirect-79f58678bc-nmb7b\" (UID: \"fc28443b-3645-4597-a075-ded4a47b7cdb\") " pod="opendatahub/dashboard-redirect-79f58678bc-nmb7b" Jun 08 16:53:26.128857 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:26.128839 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/fc28443b-3645-4597-a075-ded4a47b7cdb-redirect-config\") pod \"dashboard-redirect-79f58678bc-nmb7b\" (UID: \"fc28443b-3645-4597-a075-ded4a47b7cdb\") " pod="opendatahub/dashboard-redirect-79f58678bc-nmb7b" Jun 08 16:53:26.137753 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:26.137732 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8dmr\" (UniqueName: \"kubernetes.io/projected/fc28443b-3645-4597-a075-ded4a47b7cdb-kube-api-access-h8dmr\") pod \"dashboard-redirect-79f58678bc-nmb7b\" (UID: \"fc28443b-3645-4597-a075-ded4a47b7cdb\") " pod="opendatahub/dashboard-redirect-79f58678bc-nmb7b" Jun 08 16:53:26.332388 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:26.332355 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-79f58678bc-nmb7b" Jun 08 16:53:26.474443 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:26.474419 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-79f58678bc-nmb7b"] Jun 08 16:53:26.476607 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:53:26.476578 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc28443b_3645_4597_a075_ded4a47b7cdb.slice/crio-18043667bc6e78bc701a37e96d2bec422a282d7b4022ba316f4784f7e55f3986 WatchSource:0}: Error finding container 18043667bc6e78bc701a37e96d2bec422a282d7b4022ba316f4784f7e55f3986: Status 404 returned error can't find the container with id 18043667bc6e78bc701a37e96d2bec422a282d7b4022ba316f4784f7e55f3986 Jun 08 16:53:27.105895 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:27.105827 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-79f58678bc-nmb7b" event={"ID":"fc28443b-3645-4597-a075-ded4a47b7cdb","Type":"ContainerStarted","Data":"18043667bc6e78bc701a37e96d2bec422a282d7b4022ba316f4784f7e55f3986"} Jun 08 16:53:28.112000 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:28.111969 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-79f58678bc-nmb7b" event={"ID":"fc28443b-3645-4597-a075-ded4a47b7cdb","Type":"ContainerStarted","Data":"aee07ee69c40f101be97d8fc66f9528cbd767982f31b5cb24d26598321c95a00"} Jun 08 16:53:28.131620 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:28.131576 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-79f58678bc-nmb7b" podStartSLOduration=1.578887946 podStartE2EDuration="3.131563211s" totalImagesPullingTime="1.552675265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:53:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:53:28.129583323 +0000 UTC m=+360.026360810" watchObservedRunningTime="2026-06-08 16:53:28.131563211 +0000 UTC m=+360.028340686" Jun 08 16:53:36.440922 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:36.440882 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:53:36.516335 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:36.516305 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:53:38.483405 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:38.483364 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:53:42.362926 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:42.362890 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:53:42.462475 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:42.462440 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:53:42.928126 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:42.928093 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:53:46.581509 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:46.581472 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:53:46.678552 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:46.678521 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:53:46.851976 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:46.851899 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795z7247"] Jun 08 16:53:46.854160 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:46.854145 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795z7247" Jun 08 16:53:46.859979 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:46.859951 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-44sb2\"" Jun 08 16:53:46.860458 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:46.860438 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 08 16:53:46.874722 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:46.874701 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795z7247"] Jun 08 16:53:46.897557 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:46.897533 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:53:46.911832 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:46.911807 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d55ef0d8-7737-4a48-886c-247bd9b4ba0f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795z7247\" (UID: \"d55ef0d8-7737-4a48-886c-247bd9b4ba0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795z7247" Jun 08 16:53:46.911940 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:46.911847 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d55ef0d8-7737-4a48-886c-247bd9b4ba0f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795z7247\" (UID: \"d55ef0d8-7737-4a48-886c-247bd9b4ba0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795z7247" Jun 08 16:53:46.911940 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:46.911883 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d55ef0d8-7737-4a48-886c-247bd9b4ba0f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795z7247\" (UID: \"d55ef0d8-7737-4a48-886c-247bd9b4ba0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795z7247" Jun 08 16:53:46.911940 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:46.911904 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d55ef0d8-7737-4a48-886c-247bd9b4ba0f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795z7247\" (UID: \"d55ef0d8-7737-4a48-886c-247bd9b4ba0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795z7247" Jun 08 16:53:46.911940 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:46.911927 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d55ef0d8-7737-4a48-886c-247bd9b4ba0f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795z7247\" (UID: \"d55ef0d8-7737-4a48-886c-247bd9b4ba0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795z7247" Jun 08 16:53:46.912101 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:46.911957 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w782n\" (UniqueName: \"kubernetes.io/projected/d55ef0d8-7737-4a48-886c-247bd9b4ba0f-kube-api-access-w782n\") pod \"data-science-gateway-data-science-gateway-class-74759f9795z7247\" (UID: \"d55ef0d8-7737-4a48-886c-247bd9b4ba0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795z7247" Jun 08 16:53:46.912101 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:46.911989 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d55ef0d8-7737-4a48-886c-247bd9b4ba0f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795z7247\" (UID: \"d55ef0d8-7737-4a48-886c-247bd9b4ba0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795z7247" Jun 08 16:53:46.912101 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:46.912006 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d55ef0d8-7737-4a48-886c-247bd9b4ba0f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795z7247\" (UID: \"d55ef0d8-7737-4a48-886c-247bd9b4ba0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795z7247" Jun 08 16:53:46.912101 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:46.912044 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d55ef0d8-7737-4a48-886c-247bd9b4ba0f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795z7247\" (UID: \"d55ef0d8-7737-4a48-886c-247bd9b4ba0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795z7247" Jun 08 16:53:47.012801 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:47.012777 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d55ef0d8-7737-4a48-886c-247bd9b4ba0f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795z7247\" (UID: \"d55ef0d8-7737-4a48-886c-247bd9b4ba0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795z7247" Jun 08 16:53:47.012898 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:47.012820 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d55ef0d8-7737-4a48-886c-247bd9b4ba0f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795z7247\" (UID: \"d55ef0d8-7737-4a48-886c-247bd9b4ba0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795z7247" Jun 08 16:53:47.012898 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:47.012871 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d55ef0d8-7737-4a48-886c-247bd9b4ba0f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795z7247\" (UID: \"d55ef0d8-7737-4a48-886c-247bd9b4ba0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795z7247" Jun 08 16:53:47.012898 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:47.012895 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d55ef0d8-7737-4a48-886c-247bd9b4ba0f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795z7247\" (UID: \"d55ef0d8-7737-4a48-886c-247bd9b4ba0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795z7247" Jun 08 16:53:47.013037 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:47.012913 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d55ef0d8-7737-4a48-886c-247bd9b4ba0f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795z7247\" (UID: \"d55ef0d8-7737-4a48-886c-247bd9b4ba0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795z7247" Jun 08 16:53:47.013037 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:47.012952 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d55ef0d8-7737-4a48-886c-247bd9b4ba0f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795z7247\" (UID: \"d55ef0d8-7737-4a48-886c-247bd9b4ba0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795z7247" Jun 08 16:53:47.013135 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:47.013089 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w782n\" (UniqueName: \"kubernetes.io/projected/d55ef0d8-7737-4a48-886c-247bd9b4ba0f-kube-api-access-w782n\") pod \"data-science-gateway-data-science-gateway-class-74759f9795z7247\" (UID: \"d55ef0d8-7737-4a48-886c-247bd9b4ba0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795z7247" Jun 08 16:53:47.013189 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:47.013135 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d55ef0d8-7737-4a48-886c-247bd9b4ba0f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795z7247\" (UID: \"d55ef0d8-7737-4a48-886c-247bd9b4ba0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795z7247" Jun 08 16:53:47.013189 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:47.013164 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d55ef0d8-7737-4a48-886c-247bd9b4ba0f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795z7247\" (UID: \"d55ef0d8-7737-4a48-886c-247bd9b4ba0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795z7247" Jun 08 16:53:47.013475 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:47.013435 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d55ef0d8-7737-4a48-886c-247bd9b4ba0f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795z7247\" (UID: \"d55ef0d8-7737-4a48-886c-247bd9b4ba0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795z7247" Jun 08 16:53:47.013576 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:47.013491 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d55ef0d8-7737-4a48-886c-247bd9b4ba0f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795z7247\" (UID: \"d55ef0d8-7737-4a48-886c-247bd9b4ba0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795z7247" Jun 08 16:53:47.013576 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:47.013536 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d55ef0d8-7737-4a48-886c-247bd9b4ba0f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795z7247\" (UID: \"d55ef0d8-7737-4a48-886c-247bd9b4ba0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795z7247" Jun 08 16:53:47.013707 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:47.013684 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d55ef0d8-7737-4a48-886c-247bd9b4ba0f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795z7247\" (UID: \"d55ef0d8-7737-4a48-886c-247bd9b4ba0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795z7247" Jun 08 16:53:47.013886 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:47.013869 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d55ef0d8-7737-4a48-886c-247bd9b4ba0f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795z7247\" (UID: \"d55ef0d8-7737-4a48-886c-247bd9b4ba0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795z7247" Jun 08 16:53:47.015408 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:47.015383 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d55ef0d8-7737-4a48-886c-247bd9b4ba0f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795z7247\" (UID: \"d55ef0d8-7737-4a48-886c-247bd9b4ba0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795z7247" Jun 08 16:53:47.015605 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:47.015585 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d55ef0d8-7737-4a48-886c-247bd9b4ba0f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795z7247\" (UID: \"d55ef0d8-7737-4a48-886c-247bd9b4ba0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795z7247" Jun 08 16:53:47.025141 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:47.025109 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d55ef0d8-7737-4a48-886c-247bd9b4ba0f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795z7247\" (UID: \"d55ef0d8-7737-4a48-886c-247bd9b4ba0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795z7247" Jun 08 16:53:47.025629 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:47.025608 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w782n\" (UniqueName: \"kubernetes.io/projected/d55ef0d8-7737-4a48-886c-247bd9b4ba0f-kube-api-access-w782n\") pod \"data-science-gateway-data-science-gateway-class-74759f9795z7247\" (UID: \"d55ef0d8-7737-4a48-886c-247bd9b4ba0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795z7247" Jun 08 16:53:47.057980 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:47.057949 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:53:47.161521 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:47.161415 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:53:47.164170 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:47.164149 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795z7247" Jun 08 16:53:47.300748 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:47.300723 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795z7247"] Jun 08 16:53:47.302563 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:53:47.302523 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd55ef0d8_7737_4a48_886c_247bd9b4ba0f.slice/crio-0097fa5a22331e93f37b22d8226850e704751a957dfe51bfafc5034bfee295e0 WatchSource:0}: Error finding container 0097fa5a22331e93f37b22d8226850e704751a957dfe51bfafc5034bfee295e0: Status 404 returned error can't find the container with id 0097fa5a22331e93f37b22d8226850e704751a957dfe51bfafc5034bfee295e0 Jun 08 16:53:48.212580 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:48.212534 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795z7247" event={"ID":"d55ef0d8-7737-4a48-886c-247bd9b4ba0f","Type":"ContainerStarted","Data":"0097fa5a22331e93f37b22d8226850e704751a957dfe51bfafc5034bfee295e0"} Jun 08 16:53:49.882649 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:49.882587 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 08 16:53:49.882958 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:49.882692 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 08 16:53:49.882958 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:49.882754 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 08 16:53:49.975010 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:49.974975 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:53:50.224396 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:50.224309 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795z7247" event={"ID":"d55ef0d8-7737-4a48-886c-247bd9b4ba0f","Type":"ContainerStarted","Data":"7b2e1690c0026df6b3b326e4db36efe8ca88d8ef813c0f5045f70ab17faf875b"} Jun 08 16:53:50.250428 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:50.250361 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795z7247" podStartSLOduration=1.672528667 podStartE2EDuration="4.25033572s" totalImagesPullingTime="2.577807053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:53:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:53:50.248591434 +0000 UTC m=+382.145368911" watchObservedRunningTime="2026-06-08 16:53:50.25033572 +0000 UTC m=+382.147113199" Jun 08 16:53:51.165041 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:51.164999 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795z7247" Jun 08 16:53:51.169574 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:51.169551 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795z7247" Jun 08 16:53:51.229118 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:51.229077 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795z7247" Jun 08 16:53:51.229982 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:51.229963 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795z7247" Jun 08 16:53:56.285113 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:56.285077 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:53:56.379530 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:56.379489 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:53:56.395348 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:56.395319 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-74pq7"] Jun 08 16:53:56.397918 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:56.397899 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-74pq7" Jun 08 16:53:56.401008 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:56.400989 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 08 16:53:56.402106 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:56.402090 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 08 16:53:56.402205 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:56.402126 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-4g6wd\"" Jun 08 16:53:56.414694 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:56.414673 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-74pq7"] Jun 08 16:53:56.453422 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:56.453383 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:53:56.500583 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:56.500556 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxb9d\" (UniqueName: \"kubernetes.io/projected/fb87ac63-ace3-4cb3-90d2-5f2d866c696d-kube-api-access-jxb9d\") pod \"kuadrant-operator-catalog-74pq7\" (UID: \"fb87ac63-ace3-4cb3-90d2-5f2d866c696d\") " pod="kuadrant-system/kuadrant-operator-catalog-74pq7" Jun 08 16:53:56.601551 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:56.601520 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxb9d\" (UniqueName: \"kubernetes.io/projected/fb87ac63-ace3-4cb3-90d2-5f2d866c696d-kube-api-access-jxb9d\") pod \"kuadrant-operator-catalog-74pq7\" (UID: \"fb87ac63-ace3-4cb3-90d2-5f2d866c696d\") " pod="kuadrant-system/kuadrant-operator-catalog-74pq7" Jun 08 16:53:56.610789 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:56.610756 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxb9d\" (UniqueName: \"kubernetes.io/projected/fb87ac63-ace3-4cb3-90d2-5f2d866c696d-kube-api-access-jxb9d\") pod \"kuadrant-operator-catalog-74pq7\" (UID: \"fb87ac63-ace3-4cb3-90d2-5f2d866c696d\") " pod="kuadrant-system/kuadrant-operator-catalog-74pq7" Jun 08 16:53:56.707319 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:56.707286 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-74pq7" Jun 08 16:53:56.753768 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:56.753731 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-74pq7"] Jun 08 16:53:56.845227 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:56.845193 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-74pq7"] Jun 08 16:53:56.848343 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:53:56.848314 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb87ac63_ace3_4cb3_90d2_5f2d866c696d.slice/crio-1b4084e1aefb25747ebfe96c1b6af735c744e6689aeb5e23597cac09368d0811 WatchSource:0}: Error finding container 1b4084e1aefb25747ebfe96c1b6af735c744e6689aeb5e23597cac09368d0811: Status 404 returned error can't find the container with id 1b4084e1aefb25747ebfe96c1b6af735c744e6689aeb5e23597cac09368d0811 Jun 08 16:53:56.966873 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:56.966837 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-x4d99"] Jun 08 16:53:56.969689 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:56.969671 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-x4d99" Jun 08 16:53:56.984105 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:56.984077 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-x4d99"] Jun 08 16:53:57.106082 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:57.105995 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dkll\" (UniqueName: \"kubernetes.io/projected/e90d64ac-7e00-4119-9b96-223ef1f3b443-kube-api-access-6dkll\") pod \"kuadrant-operator-catalog-x4d99\" (UID: \"e90d64ac-7e00-4119-9b96-223ef1f3b443\") " pod="kuadrant-system/kuadrant-operator-catalog-x4d99" Jun 08 16:53:57.192533 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:57.192500 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:53:57.207613 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:57.207590 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dkll\" (UniqueName: \"kubernetes.io/projected/e90d64ac-7e00-4119-9b96-223ef1f3b443-kube-api-access-6dkll\") pod \"kuadrant-operator-catalog-x4d99\" (UID: \"e90d64ac-7e00-4119-9b96-223ef1f3b443\") " pod="kuadrant-system/kuadrant-operator-catalog-x4d99" Jun 08 16:53:57.216707 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:57.216677 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dkll\" (UniqueName: \"kubernetes.io/projected/e90d64ac-7e00-4119-9b96-223ef1f3b443-kube-api-access-6dkll\") pod \"kuadrant-operator-catalog-x4d99\" (UID: \"e90d64ac-7e00-4119-9b96-223ef1f3b443\") " pod="kuadrant-system/kuadrant-operator-catalog-x4d99" Jun 08 16:53:57.258020 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:57.257982 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-74pq7" event={"ID":"fb87ac63-ace3-4cb3-90d2-5f2d866c696d","Type":"ContainerStarted","Data":"1b4084e1aefb25747ebfe96c1b6af735c744e6689aeb5e23597cac09368d0811"} Jun 08 16:53:57.279303 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:57.279271 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-x4d99" Jun 08 16:53:57.408662 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:57.408603 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:53:57.474400 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:57.474348 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-x4d99"] Jun 08 16:53:57.532882 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:53:57.532848 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode90d64ac_7e00_4119_9b96_223ef1f3b443.slice/crio-a8604d4e9894bbbdd0f4aa465c48aeb92539f747deb2d9e80e6daf0f8c9132b8 WatchSource:0}: Error finding container a8604d4e9894bbbdd0f4aa465c48aeb92539f747deb2d9e80e6daf0f8c9132b8: Status 404 returned error can't find the container with id a8604d4e9894bbbdd0f4aa465c48aeb92539f747deb2d9e80e6daf0f8c9132b8 Jun 08 16:53:58.263459 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:58.263427 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-x4d99" event={"ID":"e90d64ac-7e00-4119-9b96-223ef1f3b443","Type":"ContainerStarted","Data":"a8604d4e9894bbbdd0f4aa465c48aeb92539f747deb2d9e80e6daf0f8c9132b8"} Jun 08 16:53:59.270989 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:59.270947 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-74pq7" event={"ID":"fb87ac63-ace3-4cb3-90d2-5f2d866c696d","Type":"ContainerStarted","Data":"5436dd920ab363aebd801c5f612674f4dade19fa8487c1d32a800e22bd343600"} Jun 08 16:53:59.271521 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:59.271181 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-74pq7" podUID="fb87ac63-ace3-4cb3-90d2-5f2d866c696d" containerName="registry-server" containerID="cri-o://5436dd920ab363aebd801c5f612674f4dade19fa8487c1d32a800e22bd343600" gracePeriod=2 Jun 08 16:53:59.272905 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:59.272880 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-x4d99" event={"ID":"e90d64ac-7e00-4119-9b96-223ef1f3b443","Type":"ContainerStarted","Data":"610f47349c4b8f04519d5b2b8a9fcac70b84f8c31df7e32bb91213ac6b85594c"} Jun 08 16:53:59.290939 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:59.290884 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-74pq7" podStartSLOduration=0.984900592 podStartE2EDuration="3.290871067s" totalImagesPullingTime="2.305970475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:53:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:53:59.288644549 +0000 UTC m=+391.185422024" watchObservedRunningTime="2026-06-08 16:53:59.290871067 +0000 UTC m=+391.187648541" Jun 08 16:53:59.307464 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:59.307412 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-x4d99" podStartSLOduration=1.689412103 podStartE2EDuration="3.307397734s" totalImagesPullingTime="1.617985631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:53:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:53:59.306104458 +0000 UTC m=+391.202881934" watchObservedRunningTime="2026-06-08 16:53:59.307397734 +0000 UTC m=+391.204175208" Jun 08 16:53:59.627976 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:59.627954 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-74pq7" Jun 08 16:53:59.731024 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:59.730924 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxb9d\" (UniqueName: \"kubernetes.io/projected/fb87ac63-ace3-4cb3-90d2-5f2d866c696d-kube-api-access-jxb9d\") pod \"fb87ac63-ace3-4cb3-90d2-5f2d866c696d\" (UID: \"fb87ac63-ace3-4cb3-90d2-5f2d866c696d\") " Jun 08 16:53:59.733308 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:59.733281 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb87ac63-ace3-4cb3-90d2-5f2d866c696d-kube-api-access-jxb9d" (OuterVolumeSpecName: "kube-api-access-jxb9d") pod "fb87ac63-ace3-4cb3-90d2-5f2d866c696d" (UID: "fb87ac63-ace3-4cb3-90d2-5f2d866c696d"). InnerVolumeSpecName "kube-api-access-jxb9d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 16:53:59.831606 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:53:59.831567 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxb9d\" (UniqueName: \"kubernetes.io/projected/fb87ac63-ace3-4cb3-90d2-5f2d866c696d-kube-api-access-jxb9d\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 16:54:00.278586 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:00.278551 2579 generic.go:356] "Generic (PLEG): container finished" podID="fb87ac63-ace3-4cb3-90d2-5f2d866c696d" containerID="5436dd920ab363aebd801c5f612674f4dade19fa8487c1d32a800e22bd343600" exitCode=0 Jun 08 16:54:00.279044 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:00.278615 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-74pq7" Jun 08 16:54:00.279044 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:00.278637 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-74pq7" event={"ID":"fb87ac63-ace3-4cb3-90d2-5f2d866c696d","Type":"ContainerDied","Data":"5436dd920ab363aebd801c5f612674f4dade19fa8487c1d32a800e22bd343600"} Jun 08 16:54:00.279044 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:00.278711 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-74pq7" event={"ID":"fb87ac63-ace3-4cb3-90d2-5f2d866c696d","Type":"ContainerDied","Data":"1b4084e1aefb25747ebfe96c1b6af735c744e6689aeb5e23597cac09368d0811"} Jun 08 16:54:00.279044 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:00.278733 2579 scope.go:117] "RemoveContainer" containerID="5436dd920ab363aebd801c5f612674f4dade19fa8487c1d32a800e22bd343600" Jun 08 16:54:00.288001 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:00.287986 2579 scope.go:117] "RemoveContainer" containerID="5436dd920ab363aebd801c5f612674f4dade19fa8487c1d32a800e22bd343600" Jun 08 16:54:00.288258 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:54:00.288215 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5436dd920ab363aebd801c5f612674f4dade19fa8487c1d32a800e22bd343600\": container with ID starting with 5436dd920ab363aebd801c5f612674f4dade19fa8487c1d32a800e22bd343600 not found: ID does not exist" containerID="5436dd920ab363aebd801c5f612674f4dade19fa8487c1d32a800e22bd343600" Jun 08 16:54:00.288337 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:00.288265 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5436dd920ab363aebd801c5f612674f4dade19fa8487c1d32a800e22bd343600"} err="failed to get container status \"5436dd920ab363aebd801c5f612674f4dade19fa8487c1d32a800e22bd343600\": rpc error: code = NotFound desc = could not find container \"5436dd920ab363aebd801c5f612674f4dade19fa8487c1d32a800e22bd343600\": container with ID starting with 5436dd920ab363aebd801c5f612674f4dade19fa8487c1d32a800e22bd343600 not found: ID does not exist" Jun 08 16:54:00.300681 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:00.300652 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-74pq7"] Jun 08 16:54:00.307607 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:00.307584 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-74pq7"] Jun 08 16:54:00.525890 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:00.525808 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb87ac63-ace3-4cb3-90d2-5f2d866c696d" path="/var/lib/kubelet/pods/fb87ac63-ace3-4cb3-90d2-5f2d866c696d/volumes" Jun 08 16:54:07.279976 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:07.279948 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-x4d99" Jun 08 16:54:07.280435 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:07.280004 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-x4d99" Jun 08 16:54:07.302956 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:07.302925 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-x4d99" Jun 08 16:54:07.335357 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:07.335333 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-x4d99" Jun 08 16:54:22.916035 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:22.915963 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:54:25.142364 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:25.142331 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rtj6p"] Jun 08 16:54:25.142732 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:25.142698 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb87ac63-ace3-4cb3-90d2-5f2d866c696d" containerName="registry-server" Jun 08 16:54:25.142732 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:25.142709 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb87ac63-ace3-4cb3-90d2-5f2d866c696d" containerName="registry-server" Jun 08 16:54:25.142807 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:25.142776 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb87ac63-ace3-4cb3-90d2-5f2d866c696d" containerName="registry-server" Jun 08 16:54:25.152321 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:25.152298 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rtj6p" Jun 08 16:54:25.156294 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:25.156266 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-m224n\"" Jun 08 16:54:25.160916 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:25.160891 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rtj6p"] Jun 08 16:54:25.260671 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:25.260631 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xbk6\" (UniqueName: \"kubernetes.io/projected/879be250-b655-45e9-8161-52c7f1b3ee99-kube-api-access-4xbk6\") pod \"limitador-operator-controller-manager-859d7b78bd-rtj6p\" (UID: \"879be250-b655-45e9-8161-52c7f1b3ee99\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rtj6p" Jun 08 16:54:25.361113 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:25.361074 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xbk6\" (UniqueName: \"kubernetes.io/projected/879be250-b655-45e9-8161-52c7f1b3ee99-kube-api-access-4xbk6\") pod \"limitador-operator-controller-manager-859d7b78bd-rtj6p\" (UID: \"879be250-b655-45e9-8161-52c7f1b3ee99\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rtj6p" Jun 08 16:54:25.373991 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:25.373968 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xbk6\" (UniqueName: \"kubernetes.io/projected/879be250-b655-45e9-8161-52c7f1b3ee99-kube-api-access-4xbk6\") pod \"limitador-operator-controller-manager-859d7b78bd-rtj6p\" (UID: \"879be250-b655-45e9-8161-52c7f1b3ee99\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rtj6p" Jun 08 16:54:25.463429 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:25.463336 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rtj6p" Jun 08 16:54:25.600369 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:25.600294 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rtj6p"] Jun 08 16:54:25.602806 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:54:25.602778 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod879be250_b655_45e9_8161_52c7f1b3ee99.slice/crio-244456f886700dcd4e26c3b469f19107627bcf549ee8a85189f63d684f4230c7 WatchSource:0}: Error finding container 244456f886700dcd4e26c3b469f19107627bcf549ee8a85189f63d684f4230c7: Status 404 returned error can't find the container with id 244456f886700dcd4e26c3b469f19107627bcf549ee8a85189f63d684f4230c7 Jun 08 16:54:25.889808 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:25.889775 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:54:26.403124 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:26.403033 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rtj6p" event={"ID":"879be250-b655-45e9-8161-52c7f1b3ee99","Type":"ContainerStarted","Data":"244456f886700dcd4e26c3b469f19107627bcf549ee8a85189f63d684f4230c7"} Jun 08 16:54:26.679693 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:26.679504 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:54:27.409588 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:27.409543 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rtj6p" event={"ID":"879be250-b655-45e9-8161-52c7f1b3ee99","Type":"ContainerStarted","Data":"b3a8b20e670de4ae83a23ac5165aa9b58d4fccfced812603f20aea542a64914d"} Jun 08 16:54:27.410036 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:27.409636 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rtj6p" Jun 08 16:54:27.429798 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:27.429748 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rtj6p" podStartSLOduration=0.784131395 podStartE2EDuration="2.429734297s" totalImagesPullingTime="1.645602902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:54:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:54:27.429220467 +0000 UTC m=+419.325997942" watchObservedRunningTime="2026-06-08 16:54:27.429734297 +0000 UTC m=+419.326511771" Jun 08 16:54:29.432094 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:29.432060 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-v58v9"] Jun 08 16:54:29.437085 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:29.437060 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-v58v9" Jun 08 16:54:29.440466 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:29.440448 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-7dtss\"" Jun 08 16:54:29.449865 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:29.449843 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-v58v9"] Jun 08 16:54:29.500044 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:29.499999 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdzbs\" (UniqueName: \"kubernetes.io/projected/e2c2ec56-00f6-4565-8ffb-30f9ece43cb2-kube-api-access-kdzbs\") pod \"authorino-operator-75cc8d5cb7-v58v9\" (UID: \"e2c2ec56-00f6-4565-8ffb-30f9ece43cb2\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-v58v9" Jun 08 16:54:29.600601 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:29.600561 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdzbs\" (UniqueName: \"kubernetes.io/projected/e2c2ec56-00f6-4565-8ffb-30f9ece43cb2-kube-api-access-kdzbs\") pod \"authorino-operator-75cc8d5cb7-v58v9\" (UID: \"e2c2ec56-00f6-4565-8ffb-30f9ece43cb2\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-v58v9" Jun 08 16:54:29.621133 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:29.621106 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdzbs\" (UniqueName: \"kubernetes.io/projected/e2c2ec56-00f6-4565-8ffb-30f9ece43cb2-kube-api-access-kdzbs\") pod \"authorino-operator-75cc8d5cb7-v58v9\" (UID: \"e2c2ec56-00f6-4565-8ffb-30f9ece43cb2\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-v58v9" Jun 08 16:54:29.748011 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:29.747935 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-v58v9" Jun 08 16:54:29.895649 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:29.895611 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-v58v9"] Jun 08 16:54:29.899745 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:54:29.899718 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2c2ec56_00f6_4565_8ffb_30f9ece43cb2.slice/crio-39681bf77a60eef503f80a60b75892649472705ee48a69b93695c2b77212d0b7 WatchSource:0}: Error finding container 39681bf77a60eef503f80a60b75892649472705ee48a69b93695c2b77212d0b7: Status 404 returned error can't find the container with id 39681bf77a60eef503f80a60b75892649472705ee48a69b93695c2b77212d0b7 Jun 08 16:54:30.092622 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:30.092588 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:54:30.402615 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:30.402518 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:54:30.424178 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:30.424094 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-v58v9" event={"ID":"e2c2ec56-00f6-4565-8ffb-30f9ece43cb2","Type":"ContainerStarted","Data":"39681bf77a60eef503f80a60b75892649472705ee48a69b93695c2b77212d0b7"} Jun 08 16:54:30.614888 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:30.614838 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:54:32.439619 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:32.439584 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-v58v9" event={"ID":"e2c2ec56-00f6-4565-8ffb-30f9ece43cb2","Type":"ContainerStarted","Data":"09901090ddb7cfb604128e80fc8febac87dfb66984ca6f52da512f5ae95e8ae2"} Jun 08 16:54:32.439982 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:32.439724 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-v58v9" Jun 08 16:54:32.469076 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:32.469020 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-v58v9" podStartSLOduration=1.070843396 podStartE2EDuration="3.468997951s" totalImagesPullingTime="2.398154555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:54:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:54:32.467899157 +0000 UTC m=+424.364676631" watchObservedRunningTime="2026-06-08 16:54:32.468997951 +0000 UTC m=+424.365775427" Jun 08 16:54:32.890315 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:32.890219 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:54:34.573136 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:34.573104 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:54:35.488566 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:35.488527 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:54:37.747800 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:37.747767 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:54:38.416902 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:38.416874 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rtj6p" Jun 08 16:54:39.324651 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:39.324595 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:54:39.433511 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:39.433479 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:54:43.288860 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:43.288826 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:54:43.391610 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:43.391572 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:54:43.447604 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:43.447574 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-v58v9" Jun 08 16:54:43.701959 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:43.701929 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:54:43.797995 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:43.797964 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:54:45.248115 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:45.248082 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-ndhp7"] Jun 08 16:54:45.251598 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:45.251579 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ndhp7" Jun 08 16:54:45.254371 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:45.254346 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 08 16:54:45.254490 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:45.254408 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jhcb6\"" Jun 08 16:54:45.254490 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:45.254440 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 08 16:54:45.260447 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:45.260427 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-ndhp7"] Jun 08 16:54:45.262268 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:45.262222 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:54:45.345696 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:45.345665 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lvk7\" (UniqueName: \"kubernetes.io/projected/0721dcf8-5d3d-40c7-a3b0-6becfc02928e-kube-api-access-9lvk7\") pod \"kuadrant-console-plugin-66b5774985-ndhp7\" (UID: \"0721dcf8-5d3d-40c7-a3b0-6becfc02928e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ndhp7" Jun 08 16:54:45.345861 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:45.345712 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0721dcf8-5d3d-40c7-a3b0-6becfc02928e-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-ndhp7\" (UID: \"0721dcf8-5d3d-40c7-a3b0-6becfc02928e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ndhp7" Jun 08 16:54:45.345861 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:45.345785 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/0721dcf8-5d3d-40c7-a3b0-6becfc02928e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-ndhp7\" (UID: \"0721dcf8-5d3d-40c7-a3b0-6becfc02928e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ndhp7" Jun 08 16:54:45.446932 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:45.446894 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/0721dcf8-5d3d-40c7-a3b0-6becfc02928e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-ndhp7\" (UID: \"0721dcf8-5d3d-40c7-a3b0-6becfc02928e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ndhp7" Jun 08 16:54:45.447116 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:45.446961 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lvk7\" (UniqueName: \"kubernetes.io/projected/0721dcf8-5d3d-40c7-a3b0-6becfc02928e-kube-api-access-9lvk7\") pod \"kuadrant-console-plugin-66b5774985-ndhp7\" (UID: \"0721dcf8-5d3d-40c7-a3b0-6becfc02928e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ndhp7" Jun 08 16:54:45.447116 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:45.447012 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0721dcf8-5d3d-40c7-a3b0-6becfc02928e-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-ndhp7\" (UID: \"0721dcf8-5d3d-40c7-a3b0-6becfc02928e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ndhp7" Jun 08 16:54:45.447116 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:54:45.447061 2579 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 08 16:54:45.447222 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:54:45.447140 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0721dcf8-5d3d-40c7-a3b0-6becfc02928e-plugin-serving-cert podName:0721dcf8-5d3d-40c7-a3b0-6becfc02928e nodeName:}" failed. No retries permitted until 2026-06-08 16:54:45.947117854 +0000 UTC m=+437.843895309 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/0721dcf8-5d3d-40c7-a3b0-6becfc02928e-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-ndhp7" (UID: "0721dcf8-5d3d-40c7-a3b0-6becfc02928e") : secret "plugin-serving-cert" not found Jun 08 16:54:45.447716 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:45.447697 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0721dcf8-5d3d-40c7-a3b0-6becfc02928e-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-ndhp7\" (UID: \"0721dcf8-5d3d-40c7-a3b0-6becfc02928e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ndhp7" Jun 08 16:54:45.457164 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:45.457135 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lvk7\" (UniqueName: \"kubernetes.io/projected/0721dcf8-5d3d-40c7-a3b0-6becfc02928e-kube-api-access-9lvk7\") pod \"kuadrant-console-plugin-66b5774985-ndhp7\" (UID: \"0721dcf8-5d3d-40c7-a3b0-6becfc02928e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ndhp7" Jun 08 16:54:45.641430 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:45.641400 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d96d8d54c-lgmtf"] Jun 08 16:54:45.645154 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:45.645137 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d96d8d54c-lgmtf" Jun 08 16:54:45.657616 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:45.657588 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d96d8d54c-lgmtf"] Jun 08 16:54:45.687608 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:45.687570 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:54:45.749415 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:45.749372 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15336702-cb9e-4cd9-b595-e70a19398b9c-trusted-ca-bundle\") pod \"console-d96d8d54c-lgmtf\" (UID: \"15336702-cb9e-4cd9-b595-e70a19398b9c\") " pod="openshift-console/console-d96d8d54c-lgmtf" Jun 08 16:54:45.749415 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:45.749419 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15336702-cb9e-4cd9-b595-e70a19398b9c-console-oauth-config\") pod \"console-d96d8d54c-lgmtf\" (UID: \"15336702-cb9e-4cd9-b595-e70a19398b9c\") " pod="openshift-console/console-d96d8d54c-lgmtf" Jun 08 16:54:45.749651 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:45.749436 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15336702-cb9e-4cd9-b595-e70a19398b9c-console-config\") pod \"console-d96d8d54c-lgmtf\" (UID: \"15336702-cb9e-4cd9-b595-e70a19398b9c\") " pod="openshift-console/console-d96d8d54c-lgmtf" Jun 08 16:54:45.749651 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:45.749476 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15336702-cb9e-4cd9-b595-e70a19398b9c-oauth-serving-cert\") pod \"console-d96d8d54c-lgmtf\" (UID: \"15336702-cb9e-4cd9-b595-e70a19398b9c\") " pod="openshift-console/console-d96d8d54c-lgmtf" Jun 08 16:54:45.749651 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:45.749568 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxvbw\" (UniqueName: \"kubernetes.io/projected/15336702-cb9e-4cd9-b595-e70a19398b9c-kube-api-access-rxvbw\") pod \"console-d96d8d54c-lgmtf\" (UID: \"15336702-cb9e-4cd9-b595-e70a19398b9c\") " pod="openshift-console/console-d96d8d54c-lgmtf" Jun 08 16:54:45.749651 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:45.749620 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15336702-cb9e-4cd9-b595-e70a19398b9c-service-ca\") pod \"console-d96d8d54c-lgmtf\" (UID: \"15336702-cb9e-4cd9-b595-e70a19398b9c\") " pod="openshift-console/console-d96d8d54c-lgmtf" Jun 08 16:54:45.749806 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:45.749682 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15336702-cb9e-4cd9-b595-e70a19398b9c-console-serving-cert\") pod \"console-d96d8d54c-lgmtf\" (UID: \"15336702-cb9e-4cd9-b595-e70a19398b9c\") " pod="openshift-console/console-d96d8d54c-lgmtf" Jun 08 16:54:45.782823 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:45.782790 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:54:45.850146 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:45.850113 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15336702-cb9e-4cd9-b595-e70a19398b9c-trusted-ca-bundle\") pod \"console-d96d8d54c-lgmtf\" (UID: \"15336702-cb9e-4cd9-b595-e70a19398b9c\") " pod="openshift-console/console-d96d8d54c-lgmtf" Jun 08 16:54:45.850325 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:45.850163 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15336702-cb9e-4cd9-b595-e70a19398b9c-console-oauth-config\") pod \"console-d96d8d54c-lgmtf\" (UID: \"15336702-cb9e-4cd9-b595-e70a19398b9c\") " pod="openshift-console/console-d96d8d54c-lgmtf" Jun 08 16:54:45.850325 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:45.850196 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15336702-cb9e-4cd9-b595-e70a19398b9c-console-config\") pod \"console-d96d8d54c-lgmtf\" (UID: \"15336702-cb9e-4cd9-b595-e70a19398b9c\") " pod="openshift-console/console-d96d8d54c-lgmtf" Jun 08 16:54:45.850325 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:45.850219 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15336702-cb9e-4cd9-b595-e70a19398b9c-oauth-serving-cert\") pod \"console-d96d8d54c-lgmtf\" (UID: \"15336702-cb9e-4cd9-b595-e70a19398b9c\") " pod="openshift-console/console-d96d8d54c-lgmtf" Jun 08 16:54:45.850458 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:45.850398 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxvbw\" (UniqueName: \"kubernetes.io/projected/15336702-cb9e-4cd9-b595-e70a19398b9c-kube-api-access-rxvbw\") pod \"console-d96d8d54c-lgmtf\" (UID: \"15336702-cb9e-4cd9-b595-e70a19398b9c\") " pod="openshift-console/console-d96d8d54c-lgmtf" Jun 08 16:54:45.850512 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:45.850466 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15336702-cb9e-4cd9-b595-e70a19398b9c-service-ca\") pod \"console-d96d8d54c-lgmtf\" (UID: \"15336702-cb9e-4cd9-b595-e70a19398b9c\") " pod="openshift-console/console-d96d8d54c-lgmtf" Jun 08 16:54:45.850610 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:45.850591 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15336702-cb9e-4cd9-b595-e70a19398b9c-console-serving-cert\") pod \"console-d96d8d54c-lgmtf\" (UID: \"15336702-cb9e-4cd9-b595-e70a19398b9c\") " pod="openshift-console/console-d96d8d54c-lgmtf" Jun 08 16:54:45.851158 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:45.851074 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15336702-cb9e-4cd9-b595-e70a19398b9c-console-config\") pod \"console-d96d8d54c-lgmtf\" (UID: \"15336702-cb9e-4cd9-b595-e70a19398b9c\") " pod="openshift-console/console-d96d8d54c-lgmtf" Jun 08 16:54:45.851158 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:45.851088 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15336702-cb9e-4cd9-b595-e70a19398b9c-oauth-serving-cert\") pod \"console-d96d8d54c-lgmtf\" (UID: \"15336702-cb9e-4cd9-b595-e70a19398b9c\") " pod="openshift-console/console-d96d8d54c-lgmtf" Jun 08 16:54:45.851158 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:45.851149 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15336702-cb9e-4cd9-b595-e70a19398b9c-service-ca\") pod \"console-d96d8d54c-lgmtf\" (UID: \"15336702-cb9e-4cd9-b595-e70a19398b9c\") " pod="openshift-console/console-d96d8d54c-lgmtf" Jun 08 16:54:45.851158 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:45.851154 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15336702-cb9e-4cd9-b595-e70a19398b9c-trusted-ca-bundle\") pod \"console-d96d8d54c-lgmtf\" (UID: \"15336702-cb9e-4cd9-b595-e70a19398b9c\") " pod="openshift-console/console-d96d8d54c-lgmtf" Jun 08 16:54:45.853050 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:45.853019 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15336702-cb9e-4cd9-b595-e70a19398b9c-console-serving-cert\") pod \"console-d96d8d54c-lgmtf\" (UID: \"15336702-cb9e-4cd9-b595-e70a19398b9c\") " pod="openshift-console/console-d96d8d54c-lgmtf" Jun 08 16:54:45.853139 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:45.853080 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15336702-cb9e-4cd9-b595-e70a19398b9c-console-oauth-config\") pod \"console-d96d8d54c-lgmtf\" (UID: \"15336702-cb9e-4cd9-b595-e70a19398b9c\") " pod="openshift-console/console-d96d8d54c-lgmtf" Jun 08 16:54:45.859719 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:45.859697 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxvbw\" (UniqueName: \"kubernetes.io/projected/15336702-cb9e-4cd9-b595-e70a19398b9c-kube-api-access-rxvbw\") pod \"console-d96d8d54c-lgmtf\" (UID: \"15336702-cb9e-4cd9-b595-e70a19398b9c\") " pod="openshift-console/console-d96d8d54c-lgmtf" Jun 08 16:54:45.952179 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:45.952076 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/0721dcf8-5d3d-40c7-a3b0-6becfc02928e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-ndhp7\" (UID: \"0721dcf8-5d3d-40c7-a3b0-6becfc02928e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ndhp7" Jun 08 16:54:45.954677 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:45.954655 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/0721dcf8-5d3d-40c7-a3b0-6becfc02928e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-ndhp7\" (UID: \"0721dcf8-5d3d-40c7-a3b0-6becfc02928e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ndhp7" Jun 08 16:54:45.956600 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:45.956581 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d96d8d54c-lgmtf" Jun 08 16:54:46.095198 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:46.095169 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d96d8d54c-lgmtf"] Jun 08 16:54:46.097338 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:54:46.097308 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15336702_cb9e_4cd9_b595_e70a19398b9c.slice/crio-9842f30779bce8aae4fdd54b3ee8d28e70d7be8d0f84e4eb7fda18ac0ff2fd94 WatchSource:0}: Error finding container 9842f30779bce8aae4fdd54b3ee8d28e70d7be8d0f84e4eb7fda18ac0ff2fd94: Status 404 returned error can't find the container with id 9842f30779bce8aae4fdd54b3ee8d28e70d7be8d0f84e4eb7fda18ac0ff2fd94 Jun 08 16:54:46.160992 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:46.160966 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ndhp7" Jun 08 16:54:46.307148 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:46.307123 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-ndhp7"] Jun 08 16:54:46.309231 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:54:46.309205 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0721dcf8_5d3d_40c7_a3b0_6becfc02928e.slice/crio-184645ce4ded93456637956824aebcf8903c004afc6e0c0ad3d2bd16a7ab2a93 WatchSource:0}: Error finding container 184645ce4ded93456637956824aebcf8903c004afc6e0c0ad3d2bd16a7ab2a93: Status 404 returned error can't find the container with id 184645ce4ded93456637956824aebcf8903c004afc6e0c0ad3d2bd16a7ab2a93 Jun 08 16:54:46.509524 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:46.509431 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ndhp7" event={"ID":"0721dcf8-5d3d-40c7-a3b0-6becfc02928e","Type":"ContainerStarted","Data":"184645ce4ded93456637956824aebcf8903c004afc6e0c0ad3d2bd16a7ab2a93"} Jun 08 16:54:46.510869 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:46.510846 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d96d8d54c-lgmtf" event={"ID":"15336702-cb9e-4cd9-b595-e70a19398b9c","Type":"ContainerStarted","Data":"e5d57efa5a1e18a1c9fe64bb26371b6cefc1a51697e3942ddb56347ef862d9f0"} Jun 08 16:54:46.510961 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:46.510883 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d96d8d54c-lgmtf" event={"ID":"15336702-cb9e-4cd9-b595-e70a19398b9c","Type":"ContainerStarted","Data":"9842f30779bce8aae4fdd54b3ee8d28e70d7be8d0f84e4eb7fda18ac0ff2fd94"} Jun 08 16:54:46.535876 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:46.535825 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d96d8d54c-lgmtf" podStartSLOduration=1.5358059389999998 podStartE2EDuration="1.535805939s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:54:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:54:46.535567066 +0000 UTC m=+438.432344537" watchObservedRunningTime="2026-06-08 16:54:46.535805939 +0000 UTC m=+438.432583440" Jun 08 16:54:47.734073 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:47.734035 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:54:47.835517 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:47.835476 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:54:54.409071 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:54.409031 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:54:54.663976 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:54.663872 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:54:55.597122 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:55.596796 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rtj6p"] Jun 08 16:54:55.597122 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:55.597042 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rtj6p" podUID="879be250-b655-45e9-8161-52c7f1b3ee99" containerName="manager" containerID="cri-o://b3a8b20e670de4ae83a23ac5165aa9b58d4fccfced812603f20aea542a64914d" gracePeriod=2 Jun 08 16:54:55.604296 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:55.604191 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rtj6p"] Jun 08 16:54:55.627141 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:55.627112 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xf5kh"] Jun 08 16:54:55.627651 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:55.627632 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="879be250-b655-45e9-8161-52c7f1b3ee99" containerName="manager" Jun 08 16:54:55.627728 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:55.627655 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="879be250-b655-45e9-8161-52c7f1b3ee99" containerName="manager" Jun 08 16:54:55.627781 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:55.627762 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="879be250-b655-45e9-8161-52c7f1b3ee99" containerName="manager" Jun 08 16:54:55.631561 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:55.631531 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xf5kh" Jun 08 16:54:55.650330 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:55.649519 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xf5kh"] Jun 08 16:54:55.670111 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:54:55.670073 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rtj6p\" is forbidden: User \"system:node:ip-10-0-135-83.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-83.ec2.internal' and this object" podUID="879be250-b655-45e9-8161-52c7f1b3ee99" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rtj6p" Jun 08 16:54:55.750613 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:55.750572 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58gj4\" (UniqueName: \"kubernetes.io/projected/9000554a-194b-43e9-ae77-ce0395a69675-kube-api-access-58gj4\") pod \"limitador-operator-controller-manager-859d7b78bd-xf5kh\" (UID: \"9000554a-194b-43e9-ae77-ce0395a69675\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xf5kh" Jun 08 16:54:55.852126 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:55.852045 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58gj4\" (UniqueName: \"kubernetes.io/projected/9000554a-194b-43e9-ae77-ce0395a69675-kube-api-access-58gj4\") pod \"limitador-operator-controller-manager-859d7b78bd-xf5kh\" (UID: \"9000554a-194b-43e9-ae77-ce0395a69675\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xf5kh" Jun 08 16:54:55.863968 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:55.863943 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58gj4\" (UniqueName: \"kubernetes.io/projected/9000554a-194b-43e9-ae77-ce0395a69675-kube-api-access-58gj4\") pod \"limitador-operator-controller-manager-859d7b78bd-xf5kh\" (UID: \"9000554a-194b-43e9-ae77-ce0395a69675\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xf5kh" Jun 08 16:54:55.957127 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:55.957087 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d96d8d54c-lgmtf" Jun 08 16:54:55.957336 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:55.957184 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d96d8d54c-lgmtf" Jun 08 16:54:55.962641 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:55.962619 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d96d8d54c-lgmtf" Jun 08 16:54:55.972994 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:55.972967 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xf5kh" Jun 08 16:54:55.984480 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:54:55.984448 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rtj6p\" is forbidden: User \"system:node:ip-10-0-135-83.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-83.ec2.internal' and this object" podUID="879be250-b655-45e9-8161-52c7f1b3ee99" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rtj6p" Jun 08 16:54:56.573364 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:56.573331 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d96d8d54c-lgmtf" Jun 08 16:54:56.730293 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:56.730230 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75cf68bd55-cxgv8"] Jun 08 16:54:57.069055 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:57.069016 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:54:57.235841 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:57.235797 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:54:59.025809 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:59.025770 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:54:59.143225 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:54:59.143194 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:55:03.831085 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:03.831045 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:55:03.935635 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:03.935598 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:55:04.065385 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:04.065346 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:55:04.165568 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:04.165448 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:55:06.662065 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:06.662029 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:55:06.759518 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:06.759483 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:55:09.299790 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:09.299762 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xf5kh"] Jun 08 16:55:09.301489 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:55:09.301465 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9000554a_194b_43e9_ae77_ce0395a69675.slice/crio-e42cb74ed44fcbd888885ac97f9a1586d51f72f4f2d147de9f887a7a3da06b74 WatchSource:0}: Error finding container e42cb74ed44fcbd888885ac97f9a1586d51f72f4f2d147de9f887a7a3da06b74: Status 404 returned error can't find the container with id e42cb74ed44fcbd888885ac97f9a1586d51f72f4f2d147de9f887a7a3da06b74 Jun 08 16:55:09.303793 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:09.303776 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rtj6p" Jun 08 16:55:09.306131 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:55:09.306099 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rtj6p\" is forbidden: User \"system:node:ip-10-0-135-83.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-83.ec2.internal' and this object" podUID="879be250-b655-45e9-8161-52c7f1b3ee99" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rtj6p" Jun 08 16:55:09.375744 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:09.375713 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4xbk6\" (UniqueName: \"kubernetes.io/projected/879be250-b655-45e9-8161-52c7f1b3ee99-kube-api-access-4xbk6\") pod \"879be250-b655-45e9-8161-52c7f1b3ee99\" (UID: \"879be250-b655-45e9-8161-52c7f1b3ee99\") " Jun 08 16:55:09.377742 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:09.377713 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/879be250-b655-45e9-8161-52c7f1b3ee99-kube-api-access-4xbk6" (OuterVolumeSpecName: "kube-api-access-4xbk6") pod "879be250-b655-45e9-8161-52c7f1b3ee99" (UID: "879be250-b655-45e9-8161-52c7f1b3ee99"). InnerVolumeSpecName "kube-api-access-4xbk6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 16:55:09.476879 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:09.476787 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4xbk6\" (UniqueName: \"kubernetes.io/projected/879be250-b655-45e9-8161-52c7f1b3ee99-kube-api-access-4xbk6\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 16:55:09.644231 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:09.644188 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ndhp7" event={"ID":"0721dcf8-5d3d-40c7-a3b0-6becfc02928e","Type":"ContainerStarted","Data":"a0de312b52f0edb3a470fa05efd0be189fc6853daf503e3863b74c76d6b08f8a"} Jun 08 16:55:09.645780 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:09.645755 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xf5kh" event={"ID":"9000554a-194b-43e9-ae77-ce0395a69675","Type":"ContainerStarted","Data":"37b4c35e4f0e89ee3d35463bdd9f01da7ce734a233d86d1375985f0f40ea8d2f"} Jun 08 16:55:09.645913 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:09.645803 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xf5kh" event={"ID":"9000554a-194b-43e9-ae77-ce0395a69675","Type":"ContainerStarted","Data":"e42cb74ed44fcbd888885ac97f9a1586d51f72f4f2d147de9f887a7a3da06b74"} Jun 08 16:55:09.645913 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:09.645842 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xf5kh" Jun 08 16:55:09.646598 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:55:09.646576 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rtj6p\" is forbidden: User \"system:node:ip-10-0-135-83.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-83.ec2.internal' and this object" podUID="879be250-b655-45e9-8161-52c7f1b3ee99" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rtj6p" Jun 08 16:55:09.647100 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:09.647082 2579 generic.go:356] "Generic (PLEG): container finished" podID="879be250-b655-45e9-8161-52c7f1b3ee99" containerID="b3a8b20e670de4ae83a23ac5165aa9b58d4fccfced812603f20aea542a64914d" exitCode=0 Jun 08 16:55:09.647177 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:09.647117 2579 scope.go:117] "RemoveContainer" containerID="b3a8b20e670de4ae83a23ac5165aa9b58d4fccfced812603f20aea542a64914d" Jun 08 16:55:09.647177 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:09.647119 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rtj6p" Jun 08 16:55:09.655970 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:09.655954 2579 scope.go:117] "RemoveContainer" containerID="b3a8b20e670de4ae83a23ac5165aa9b58d4fccfced812603f20aea542a64914d" Jun 08 16:55:09.656224 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:55:09.656205 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3a8b20e670de4ae83a23ac5165aa9b58d4fccfced812603f20aea542a64914d\": container with ID starting with b3a8b20e670de4ae83a23ac5165aa9b58d4fccfced812603f20aea542a64914d not found: ID does not exist" containerID="b3a8b20e670de4ae83a23ac5165aa9b58d4fccfced812603f20aea542a64914d" Jun 08 16:55:09.656327 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:09.656232 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3a8b20e670de4ae83a23ac5165aa9b58d4fccfced812603f20aea542a64914d"} err="failed to get container status \"b3a8b20e670de4ae83a23ac5165aa9b58d4fccfced812603f20aea542a64914d\": rpc error: code = NotFound desc = could not find container \"b3a8b20e670de4ae83a23ac5165aa9b58d4fccfced812603f20aea542a64914d\": container with ID starting with b3a8b20e670de4ae83a23ac5165aa9b58d4fccfced812603f20aea542a64914d not found: ID does not exist" Jun 08 16:55:09.667719 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:09.667680 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ndhp7" podStartSLOduration=1.7378171629999999 podStartE2EDuration="24.667668481s" totalImagesPullingTime="22.929851318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:54:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:55:09.666074139 +0000 UTC m=+461.562851617" watchObservedRunningTime="2026-06-08 16:55:09.667668481 +0000 UTC m=+461.564445955" Jun 08 16:55:09.668334 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:55:09.668312 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rtj6p\" is forbidden: User \"system:node:ip-10-0-135-83.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-83.ec2.internal' and this object" podUID="879be250-b655-45e9-8161-52c7f1b3ee99" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rtj6p" Jun 08 16:55:09.692390 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:09.692337 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xf5kh" podStartSLOduration=14.692319402 podStartE2EDuration="14.692319402s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:54:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:55:09.689787441 +0000 UTC m=+461.586564917" watchObservedRunningTime="2026-06-08 16:55:09.692319402 +0000 UTC m=+461.589096878" Jun 08 16:55:10.529493 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:10.529412 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="879be250-b655-45e9-8161-52c7f1b3ee99" path="/var/lib/kubelet/pods/879be250-b655-45e9-8161-52c7f1b3ee99/volumes" Jun 08 16:55:13.184585 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:13.184550 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:55:13.392390 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:13.392346 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:55:20.654568 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:20.654529 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xf5kh" Jun 08 16:55:21.755124 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:21.755062 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-75cf68bd55-cxgv8" podUID="75f11dfa-0be5-4eab-99ec-d3fd6c866f34" containerName="console" containerID="cri-o://e2f272a7691e3235c7e9777ce279d9184d5f0361a6a4c6a164d1a7180c2d8ad5" gracePeriod=15 Jun 08 16:55:22.016358 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:22.016291 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75cf68bd55-cxgv8" Jun 08 16:55:22.080295 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:22.080263 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/75f11dfa-0be5-4eab-99ec-d3fd6c866f34-oauth-serving-cert\") pod \"75f11dfa-0be5-4eab-99ec-d3fd6c866f34\" (UID: \"75f11dfa-0be5-4eab-99ec-d3fd6c866f34\") " Jun 08 16:55:22.080417 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:22.080319 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/75f11dfa-0be5-4eab-99ec-d3fd6c866f34-service-ca\") pod \"75f11dfa-0be5-4eab-99ec-d3fd6c866f34\" (UID: \"75f11dfa-0be5-4eab-99ec-d3fd6c866f34\") " Jun 08 16:55:22.080468 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:22.080423 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/75f11dfa-0be5-4eab-99ec-d3fd6c866f34-console-oauth-config\") pod \"75f11dfa-0be5-4eab-99ec-d3fd6c866f34\" (UID: \"75f11dfa-0be5-4eab-99ec-d3fd6c866f34\") " Jun 08 16:55:22.080468 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:22.080457 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/75f11dfa-0be5-4eab-99ec-d3fd6c866f34-console-serving-cert\") pod \"75f11dfa-0be5-4eab-99ec-d3fd6c866f34\" (UID: \"75f11dfa-0be5-4eab-99ec-d3fd6c866f34\") " Jun 08 16:55:22.080567 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:22.080493 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wkxkk\" (UniqueName: \"kubernetes.io/projected/75f11dfa-0be5-4eab-99ec-d3fd6c866f34-kube-api-access-wkxkk\") pod \"75f11dfa-0be5-4eab-99ec-d3fd6c866f34\" (UID: \"75f11dfa-0be5-4eab-99ec-d3fd6c866f34\") " Jun 08 16:55:22.080567 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:22.080538 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/75f11dfa-0be5-4eab-99ec-d3fd6c866f34-console-config\") pod \"75f11dfa-0be5-4eab-99ec-d3fd6c866f34\" (UID: \"75f11dfa-0be5-4eab-99ec-d3fd6c866f34\") " Jun 08 16:55:22.080678 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:22.080580 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75f11dfa-0be5-4eab-99ec-d3fd6c866f34-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "75f11dfa-0be5-4eab-99ec-d3fd6c866f34" (UID: "75f11dfa-0be5-4eab-99ec-d3fd6c866f34"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 16:55:22.080678 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:22.080640 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75f11dfa-0be5-4eab-99ec-d3fd6c866f34-service-ca" (OuterVolumeSpecName: "service-ca") pod "75f11dfa-0be5-4eab-99ec-d3fd6c866f34" (UID: "75f11dfa-0be5-4eab-99ec-d3fd6c866f34"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 16:55:22.080784 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:22.080702 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75f11dfa-0be5-4eab-99ec-d3fd6c866f34-trusted-ca-bundle\") pod \"75f11dfa-0be5-4eab-99ec-d3fd6c866f34\" (UID: \"75f11dfa-0be5-4eab-99ec-d3fd6c866f34\") " Jun 08 16:55:22.081012 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:22.080935 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75f11dfa-0be5-4eab-99ec-d3fd6c866f34-console-config" (OuterVolumeSpecName: "console-config") pod "75f11dfa-0be5-4eab-99ec-d3fd6c866f34" (UID: "75f11dfa-0be5-4eab-99ec-d3fd6c866f34"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 16:55:22.081310 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:22.080991 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/75f11dfa-0be5-4eab-99ec-d3fd6c866f34-oauth-serving-cert\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 16:55:22.081310 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:22.081037 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/75f11dfa-0be5-4eab-99ec-d3fd6c866f34-service-ca\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 16:55:22.081310 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:22.081078 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75f11dfa-0be5-4eab-99ec-d3fd6c866f34-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "75f11dfa-0be5-4eab-99ec-d3fd6c866f34" (UID: "75f11dfa-0be5-4eab-99ec-d3fd6c866f34"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 16:55:22.082735 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:22.082714 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75f11dfa-0be5-4eab-99ec-d3fd6c866f34-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "75f11dfa-0be5-4eab-99ec-d3fd6c866f34" (UID: "75f11dfa-0be5-4eab-99ec-d3fd6c866f34"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 16:55:22.082857 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:22.082779 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75f11dfa-0be5-4eab-99ec-d3fd6c866f34-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "75f11dfa-0be5-4eab-99ec-d3fd6c866f34" (UID: "75f11dfa-0be5-4eab-99ec-d3fd6c866f34"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 16:55:22.082857 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:22.082829 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75f11dfa-0be5-4eab-99ec-d3fd6c866f34-kube-api-access-wkxkk" (OuterVolumeSpecName: "kube-api-access-wkxkk") pod "75f11dfa-0be5-4eab-99ec-d3fd6c866f34" (UID: "75f11dfa-0be5-4eab-99ec-d3fd6c866f34"). InnerVolumeSpecName "kube-api-access-wkxkk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 16:55:22.182258 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:22.182216 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/75f11dfa-0be5-4eab-99ec-d3fd6c866f34-console-serving-cert\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 16:55:22.182258 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:22.182254 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wkxkk\" (UniqueName: \"kubernetes.io/projected/75f11dfa-0be5-4eab-99ec-d3fd6c866f34-kube-api-access-wkxkk\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 16:55:22.182258 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:22.182264 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/75f11dfa-0be5-4eab-99ec-d3fd6c866f34-console-config\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 16:55:22.182450 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:22.182273 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75f11dfa-0be5-4eab-99ec-d3fd6c866f34-trusted-ca-bundle\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 16:55:22.182450 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:22.182281 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/75f11dfa-0be5-4eab-99ec-d3fd6c866f34-console-oauth-config\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 16:55:22.712677 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:22.712640 2579 generic.go:356] "Generic (PLEG): container finished" podID="75f11dfa-0be5-4eab-99ec-d3fd6c866f34" containerID="e2f272a7691e3235c7e9777ce279d9184d5f0361a6a4c6a164d1a7180c2d8ad5" exitCode=0 Jun 08 16:55:22.712881 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:22.712690 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75cf68bd55-cxgv8" event={"ID":"75f11dfa-0be5-4eab-99ec-d3fd6c866f34","Type":"ContainerDied","Data":"e2f272a7691e3235c7e9777ce279d9184d5f0361a6a4c6a164d1a7180c2d8ad5"} Jun 08 16:55:22.712881 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:22.712694 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75cf68bd55-cxgv8" Jun 08 16:55:22.712881 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:22.712730 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75cf68bd55-cxgv8" event={"ID":"75f11dfa-0be5-4eab-99ec-d3fd6c866f34","Type":"ContainerDied","Data":"4fa74d87e94bf758aa1386f63aa168e8e984bc77ae494e8bc2c42b79a04c4594"} Jun 08 16:55:22.712881 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:22.712749 2579 scope.go:117] "RemoveContainer" containerID="e2f272a7691e3235c7e9777ce279d9184d5f0361a6a4c6a164d1a7180c2d8ad5" Jun 08 16:55:22.721290 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:22.721268 2579 scope.go:117] "RemoveContainer" containerID="e2f272a7691e3235c7e9777ce279d9184d5f0361a6a4c6a164d1a7180c2d8ad5" Jun 08 16:55:22.721530 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:55:22.721510 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2f272a7691e3235c7e9777ce279d9184d5f0361a6a4c6a164d1a7180c2d8ad5\": container with ID starting with e2f272a7691e3235c7e9777ce279d9184d5f0361a6a4c6a164d1a7180c2d8ad5 not found: ID does not exist" containerID="e2f272a7691e3235c7e9777ce279d9184d5f0361a6a4c6a164d1a7180c2d8ad5" Jun 08 16:55:22.721576 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:22.721540 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2f272a7691e3235c7e9777ce279d9184d5f0361a6a4c6a164d1a7180c2d8ad5"} err="failed to get container status \"e2f272a7691e3235c7e9777ce279d9184d5f0361a6a4c6a164d1a7180c2d8ad5\": rpc error: code = NotFound desc = could not find container \"e2f272a7691e3235c7e9777ce279d9184d5f0361a6a4c6a164d1a7180c2d8ad5\": container with ID starting with e2f272a7691e3235c7e9777ce279d9184d5f0361a6a4c6a164d1a7180c2d8ad5 not found: ID does not exist" Jun 08 16:55:22.742173 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:22.742142 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75cf68bd55-cxgv8"] Jun 08 16:55:22.745436 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:22.745403 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-75cf68bd55-cxgv8"] Jun 08 16:55:24.156490 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:24.156451 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8d59d"] Jun 08 16:55:24.157083 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:24.157063 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75f11dfa-0be5-4eab-99ec-d3fd6c866f34" containerName="console" Jun 08 16:55:24.157123 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:24.157089 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="75f11dfa-0be5-4eab-99ec-d3fd6c866f34" containerName="console" Jun 08 16:55:24.157233 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:24.157220 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="75f11dfa-0be5-4eab-99ec-d3fd6c866f34" containerName="console" Jun 08 16:55:24.160518 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:24.160499 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8d59d" Jun 08 16:55:24.164169 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:24.164147 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-m8mpd\"" Jun 08 16:55:24.176971 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:24.176948 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8d59d"] Jun 08 16:55:24.201487 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:24.201448 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4444ccdf-0e8b-4b6f-bb9c-03864abb8611-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-8d59d\" (UID: \"4444ccdf-0e8b-4b6f-bb9c-03864abb8611\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8d59d" Jun 08 16:55:24.201487 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:24.201491 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4444ccdf-0e8b-4b6f-bb9c-03864abb8611-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-8d59d\" (UID: \"4444ccdf-0e8b-4b6f-bb9c-03864abb8611\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8d59d" Jun 08 16:55:24.201668 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:24.201512 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4444ccdf-0e8b-4b6f-bb9c-03864abb8611-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-8d59d\" (UID: \"4444ccdf-0e8b-4b6f-bb9c-03864abb8611\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8d59d" Jun 08 16:55:24.201668 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:24.201531 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4444ccdf-0e8b-4b6f-bb9c-03864abb8611-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-8d59d\" (UID: \"4444ccdf-0e8b-4b6f-bb9c-03864abb8611\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8d59d" Jun 08 16:55:24.201668 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:24.201586 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nf5sp\" (UniqueName: \"kubernetes.io/projected/4444ccdf-0e8b-4b6f-bb9c-03864abb8611-kube-api-access-nf5sp\") pod \"maas-default-gateway-openshift-default-687ff6996-8d59d\" (UID: \"4444ccdf-0e8b-4b6f-bb9c-03864abb8611\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8d59d" Jun 08 16:55:24.201668 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:24.201620 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4444ccdf-0e8b-4b6f-bb9c-03864abb8611-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-8d59d\" (UID: \"4444ccdf-0e8b-4b6f-bb9c-03864abb8611\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8d59d" Jun 08 16:55:24.201668 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:24.201656 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4444ccdf-0e8b-4b6f-bb9c-03864abb8611-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-8d59d\" (UID: \"4444ccdf-0e8b-4b6f-bb9c-03864abb8611\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8d59d" Jun 08 16:55:24.201817 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:24.201723 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4444ccdf-0e8b-4b6f-bb9c-03864abb8611-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-8d59d\" (UID: \"4444ccdf-0e8b-4b6f-bb9c-03864abb8611\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8d59d" Jun 08 16:55:24.201817 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:24.201754 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4444ccdf-0e8b-4b6f-bb9c-03864abb8611-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-8d59d\" (UID: \"4444ccdf-0e8b-4b6f-bb9c-03864abb8611\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8d59d" Jun 08 16:55:24.210656 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:24.210628 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:55:24.303084 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:24.303045 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4444ccdf-0e8b-4b6f-bb9c-03864abb8611-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-8d59d\" (UID: \"4444ccdf-0e8b-4b6f-bb9c-03864abb8611\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8d59d" Jun 08 16:55:24.303084 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:24.303084 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4444ccdf-0e8b-4b6f-bb9c-03864abb8611-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-8d59d\" (UID: \"4444ccdf-0e8b-4b6f-bb9c-03864abb8611\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8d59d" Jun 08 16:55:24.303331 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:24.303207 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4444ccdf-0e8b-4b6f-bb9c-03864abb8611-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-8d59d\" (UID: \"4444ccdf-0e8b-4b6f-bb9c-03864abb8611\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8d59d" Jun 08 16:55:24.303331 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:24.303284 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4444ccdf-0e8b-4b6f-bb9c-03864abb8611-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-8d59d\" (UID: \"4444ccdf-0e8b-4b6f-bb9c-03864abb8611\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8d59d" Jun 08 16:55:24.303435 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:24.303371 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4444ccdf-0e8b-4b6f-bb9c-03864abb8611-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-8d59d\" (UID: \"4444ccdf-0e8b-4b6f-bb9c-03864abb8611\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8d59d" Jun 08 16:55:24.303435 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:24.303400 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4444ccdf-0e8b-4b6f-bb9c-03864abb8611-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-8d59d\" (UID: \"4444ccdf-0e8b-4b6f-bb9c-03864abb8611\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8d59d" Jun 08 16:55:24.303435 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:24.303430 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4444ccdf-0e8b-4b6f-bb9c-03864abb8611-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-8d59d\" (UID: \"4444ccdf-0e8b-4b6f-bb9c-03864abb8611\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8d59d" Jun 08 16:55:24.303579 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:24.303461 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4444ccdf-0e8b-4b6f-bb9c-03864abb8611-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-8d59d\" (UID: \"4444ccdf-0e8b-4b6f-bb9c-03864abb8611\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8d59d" Jun 08 16:55:24.303579 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:24.303500 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf5sp\" (UniqueName: \"kubernetes.io/projected/4444ccdf-0e8b-4b6f-bb9c-03864abb8611-kube-api-access-nf5sp\") pod \"maas-default-gateway-openshift-default-687ff6996-8d59d\" (UID: \"4444ccdf-0e8b-4b6f-bb9c-03864abb8611\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8d59d" Jun 08 16:55:24.303579 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:24.303524 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4444ccdf-0e8b-4b6f-bb9c-03864abb8611-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-8d59d\" (UID: \"4444ccdf-0e8b-4b6f-bb9c-03864abb8611\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8d59d" Jun 08 16:55:24.303765 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:24.303741 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4444ccdf-0e8b-4b6f-bb9c-03864abb8611-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-8d59d\" (UID: \"4444ccdf-0e8b-4b6f-bb9c-03864abb8611\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8d59d" Jun 08 16:55:24.303947 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:24.303919 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4444ccdf-0e8b-4b6f-bb9c-03864abb8611-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-8d59d\" (UID: \"4444ccdf-0e8b-4b6f-bb9c-03864abb8611\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8d59d" Jun 08 16:55:24.304121 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:24.304098 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4444ccdf-0e8b-4b6f-bb9c-03864abb8611-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-8d59d\" (UID: \"4444ccdf-0e8b-4b6f-bb9c-03864abb8611\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8d59d" Jun 08 16:55:24.304191 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:24.304131 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4444ccdf-0e8b-4b6f-bb9c-03864abb8611-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-8d59d\" (UID: \"4444ccdf-0e8b-4b6f-bb9c-03864abb8611\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8d59d" Jun 08 16:55:24.305545 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:24.305527 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4444ccdf-0e8b-4b6f-bb9c-03864abb8611-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-8d59d\" (UID: \"4444ccdf-0e8b-4b6f-bb9c-03864abb8611\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8d59d" Jun 08 16:55:24.305769 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:24.305750 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4444ccdf-0e8b-4b6f-bb9c-03864abb8611-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-8d59d\" (UID: \"4444ccdf-0e8b-4b6f-bb9c-03864abb8611\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8d59d" Jun 08 16:55:24.320280 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:24.320229 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:55:24.322101 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:24.322081 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4444ccdf-0e8b-4b6f-bb9c-03864abb8611-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-8d59d\" (UID: \"4444ccdf-0e8b-4b6f-bb9c-03864abb8611\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8d59d" Jun 08 16:55:24.322362 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:24.322320 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nf5sp\" (UniqueName: \"kubernetes.io/projected/4444ccdf-0e8b-4b6f-bb9c-03864abb8611-kube-api-access-nf5sp\") pod \"maas-default-gateway-openshift-default-687ff6996-8d59d\" (UID: \"4444ccdf-0e8b-4b6f-bb9c-03864abb8611\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8d59d" Jun 08 16:55:24.471098 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:24.471005 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8d59d" Jun 08 16:55:24.529539 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:24.529495 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75f11dfa-0be5-4eab-99ec-d3fd6c866f34" path="/var/lib/kubelet/pods/75f11dfa-0be5-4eab-99ec-d3fd6c866f34/volumes" Jun 08 16:55:24.614534 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:24.614507 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8d59d"] Jun 08 16:55:24.618101 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:55:24.618077 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4444ccdf_0e8b_4b6f_bb9c_03864abb8611.slice/crio-9195cab8234de813263a401e81d39063a17445ba1158ed7416f137605b72d0e7 WatchSource:0}: Error finding container 9195cab8234de813263a401e81d39063a17445ba1158ed7416f137605b72d0e7: Status 404 returned error can't find the container with id 9195cab8234de813263a401e81d39063a17445ba1158ed7416f137605b72d0e7 Jun 08 16:55:24.620232 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:24.620197 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 08 16:55:24.620232 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:24.620287 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 08 16:55:24.620420 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:24.620318 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 08 16:55:24.726093 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:24.725842 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8d59d" event={"ID":"4444ccdf-0e8b-4b6f-bb9c-03864abb8611","Type":"ContainerStarted","Data":"ccab1c672a42d154a8a4094d37646c2952056856d07938826abcf75627f609cc"} Jun 08 16:55:24.726093 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:24.725904 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8d59d" event={"ID":"4444ccdf-0e8b-4b6f-bb9c-03864abb8611","Type":"ContainerStarted","Data":"9195cab8234de813263a401e81d39063a17445ba1158ed7416f137605b72d0e7"} Jun 08 16:55:24.752291 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:24.752214 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8d59d" podStartSLOduration=0.752194432 podStartE2EDuration="752.194432ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:55:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:55:24.751352181 +0000 UTC m=+476.648129657" watchObservedRunningTime="2026-06-08 16:55:24.752194432 +0000 UTC m=+476.648971906" Jun 08 16:55:25.472048 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:25.472013 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8d59d" Jun 08 16:55:25.476962 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:25.476937 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8d59d" Jun 08 16:55:25.730589 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:25.730511 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8d59d" Jun 08 16:55:25.731420 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:25.731400 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8d59d" Jun 08 16:55:27.333369 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:27.333337 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:55:38.895959 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:38.895920 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:55:39.013694 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:39.013658 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:55:40.048071 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:40.048036 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-6xwv9"] Jun 08 16:55:40.062464 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:40.062438 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6xwv9" Jun 08 16:55:40.066691 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:40.066662 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-6xwv9"] Jun 08 16:55:40.066853 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:40.066831 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-rxt2t\"" Jun 08 16:55:40.120178 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:40.120152 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:55:40.150470 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:40.150441 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jrf4\" (UniqueName: \"kubernetes.io/projected/ca027b38-78c2-41c5-906d-1cdf96dcfe88-kube-api-access-9jrf4\") pod \"authorino-58cd955675-6xwv9\" (UID: \"ca027b38-78c2-41c5-906d-1cdf96dcfe88\") " pod="kuadrant-system/authorino-58cd955675-6xwv9" Jun 08 16:55:40.251565 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:40.251526 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jrf4\" (UniqueName: \"kubernetes.io/projected/ca027b38-78c2-41c5-906d-1cdf96dcfe88-kube-api-access-9jrf4\") pod \"authorino-58cd955675-6xwv9\" (UID: \"ca027b38-78c2-41c5-906d-1cdf96dcfe88\") " pod="kuadrant-system/authorino-58cd955675-6xwv9" Jun 08 16:55:40.252512 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:40.252484 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:55:40.263318 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:40.263290 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jrf4\" (UniqueName: \"kubernetes.io/projected/ca027b38-78c2-41c5-906d-1cdf96dcfe88-kube-api-access-9jrf4\") pod \"authorino-58cd955675-6xwv9\" (UID: \"ca027b38-78c2-41c5-906d-1cdf96dcfe88\") " pod="kuadrant-system/authorino-58cd955675-6xwv9" Jun 08 16:55:40.374382 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:40.374344 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6xwv9" Jun 08 16:55:40.544541 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:40.544513 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-6xwv9"] Jun 08 16:55:40.549206 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:55:40.549183 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podca027b38_78c2_41c5_906d_1cdf96dcfe88.slice/crio-bc05b0141c4e3196e37515d90baecd437c7e292e488a97447a090377a215235a WatchSource:0}: Error finding container bc05b0141c4e3196e37515d90baecd437c7e292e488a97447a090377a215235a: Status 404 returned error can't find the container with id bc05b0141c4e3196e37515d90baecd437c7e292e488a97447a090377a215235a Jun 08 16:55:40.801771 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:40.801688 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6xwv9" event={"ID":"ca027b38-78c2-41c5-906d-1cdf96dcfe88","Type":"ContainerStarted","Data":"bc05b0141c4e3196e37515d90baecd437c7e292e488a97447a090377a215235a"} Jun 08 16:55:44.825375 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:44.825337 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6xwv9" event={"ID":"ca027b38-78c2-41c5-906d-1cdf96dcfe88","Type":"ContainerStarted","Data":"a86b799fb42be1654edb7b5b2fab211a30c9ee8b796b27d87c743d304da9dff6"} Jun 08 16:55:44.843541 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:44.843492 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-6xwv9" podStartSLOduration=1.485187668 podStartE2EDuration="4.843474313s" totalImagesPullingTime="3.358286645s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:55:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:55:44.841765667 +0000 UTC m=+496.738543142" watchObservedRunningTime="2026-06-08 16:55:44.843474313 +0000 UTC m=+496.740251788" Jun 08 16:55:45.089077 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:45.088998 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-6xwv9"] Jun 08 16:55:46.834698 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:46.834651 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-6xwv9" podUID="ca027b38-78c2-41c5-906d-1cdf96dcfe88" containerName="authorino" containerID="cri-o://a86b799fb42be1654edb7b5b2fab211a30c9ee8b796b27d87c743d304da9dff6" gracePeriod=30 Jun 08 16:55:47.085064 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:47.085009 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6xwv9" Jun 08 16:55:47.225210 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:47.225175 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9jrf4\" (UniqueName: \"kubernetes.io/projected/ca027b38-78c2-41c5-906d-1cdf96dcfe88-kube-api-access-9jrf4\") pod \"ca027b38-78c2-41c5-906d-1cdf96dcfe88\" (UID: \"ca027b38-78c2-41c5-906d-1cdf96dcfe88\") " Jun 08 16:55:47.227558 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:47.227528 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca027b38-78c2-41c5-906d-1cdf96dcfe88-kube-api-access-9jrf4" (OuterVolumeSpecName: "kube-api-access-9jrf4") pod "ca027b38-78c2-41c5-906d-1cdf96dcfe88" (UID: "ca027b38-78c2-41c5-906d-1cdf96dcfe88"). InnerVolumeSpecName "kube-api-access-9jrf4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 16:55:47.326371 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:47.326339 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9jrf4\" (UniqueName: \"kubernetes.io/projected/ca027b38-78c2-41c5-906d-1cdf96dcfe88-kube-api-access-9jrf4\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 16:55:47.840965 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:47.840930 2579 generic.go:356] "Generic (PLEG): container finished" podID="ca027b38-78c2-41c5-906d-1cdf96dcfe88" containerID="a86b799fb42be1654edb7b5b2fab211a30c9ee8b796b27d87c743d304da9dff6" exitCode=0 Jun 08 16:55:47.841401 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:47.840988 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6xwv9" Jun 08 16:55:47.841401 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:47.841020 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6xwv9" event={"ID":"ca027b38-78c2-41c5-906d-1cdf96dcfe88","Type":"ContainerDied","Data":"a86b799fb42be1654edb7b5b2fab211a30c9ee8b796b27d87c743d304da9dff6"} Jun 08 16:55:47.841401 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:47.841066 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6xwv9" event={"ID":"ca027b38-78c2-41c5-906d-1cdf96dcfe88","Type":"ContainerDied","Data":"bc05b0141c4e3196e37515d90baecd437c7e292e488a97447a090377a215235a"} Jun 08 16:55:47.841401 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:47.841087 2579 scope.go:117] "RemoveContainer" containerID="a86b799fb42be1654edb7b5b2fab211a30c9ee8b796b27d87c743d304da9dff6" Jun 08 16:55:47.850688 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:47.850667 2579 scope.go:117] "RemoveContainer" containerID="a86b799fb42be1654edb7b5b2fab211a30c9ee8b796b27d87c743d304da9dff6" Jun 08 16:55:47.850942 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:55:47.850923 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a86b799fb42be1654edb7b5b2fab211a30c9ee8b796b27d87c743d304da9dff6\": container with ID starting with a86b799fb42be1654edb7b5b2fab211a30c9ee8b796b27d87c743d304da9dff6 not found: ID does not exist" containerID="a86b799fb42be1654edb7b5b2fab211a30c9ee8b796b27d87c743d304da9dff6" Jun 08 16:55:47.851003 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:47.850955 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a86b799fb42be1654edb7b5b2fab211a30c9ee8b796b27d87c743d304da9dff6"} err="failed to get container status \"a86b799fb42be1654edb7b5b2fab211a30c9ee8b796b27d87c743d304da9dff6\": rpc error: code = NotFound desc = could not find container \"a86b799fb42be1654edb7b5b2fab211a30c9ee8b796b27d87c743d304da9dff6\": container with ID starting with a86b799fb42be1654edb7b5b2fab211a30c9ee8b796b27d87c743d304da9dff6 not found: ID does not exist" Jun 08 16:55:47.864571 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:47.864550 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-6xwv9"] Jun 08 16:55:47.870102 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:47.870076 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-6xwv9"] Jun 08 16:55:48.526940 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:48.526909 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca027b38-78c2-41c5-906d-1cdf96dcfe88" path="/var/lib/kubelet/pods/ca027b38-78c2-41c5-906d-1cdf96dcfe88/volumes" Jun 08 16:55:59.173287 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:55:59.173226 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:56:08.707269 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:56:08.707217 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:56:08.811685 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:56:08.811648 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:56:08.958433 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:56:08.958317 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:56:09.151971 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:56:09.151939 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:56:37.068975 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:56:37.068933 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:56:37.168711 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:56:37.168672 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:56:37.564564 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:56:37.564487 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 16:56:37.564986 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:56:37.564959 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca027b38-78c2-41c5-906d-1cdf96dcfe88" containerName="authorino" Jun 08 16:56:37.564986 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:56:37.564985 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca027b38-78c2-41c5-906d-1cdf96dcfe88" containerName="authorino" Jun 08 16:56:37.565169 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:56:37.565110 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca027b38-78c2-41c5-906d-1cdf96dcfe88" containerName="authorino" Jun 08 16:56:37.571124 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:56:37.571107 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 16:56:37.573768 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:56:37.573750 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 08 16:56:37.575070 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:56:37.575049 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-nx5wl\"" Jun 08 16:56:37.575228 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:56:37.575052 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 08 16:56:37.575370 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:56:37.575092 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 08 16:56:37.577718 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:56:37.577699 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 16:56:37.584470 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:56:37.584448 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkxpv\" (UniqueName: \"kubernetes.io/projected/8cc36c68-45d8-4673-9b48-dc8cbbc963b1-kube-api-access-kkxpv\") pod \"maas-keycloak-0\" (UID: \"8cc36c68-45d8-4673-9b48-dc8cbbc963b1\") " pod="keycloak-system/maas-keycloak-0" Jun 08 16:56:37.685013 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:56:37.684980 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkxpv\" (UniqueName: \"kubernetes.io/projected/8cc36c68-45d8-4673-9b48-dc8cbbc963b1-kube-api-access-kkxpv\") pod \"maas-keycloak-0\" (UID: \"8cc36c68-45d8-4673-9b48-dc8cbbc963b1\") " pod="keycloak-system/maas-keycloak-0" Jun 08 16:56:37.693076 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:56:37.693052 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkxpv\" (UniqueName: \"kubernetes.io/projected/8cc36c68-45d8-4673-9b48-dc8cbbc963b1-kube-api-access-kkxpv\") pod \"maas-keycloak-0\" (UID: \"8cc36c68-45d8-4673-9b48-dc8cbbc963b1\") " pod="keycloak-system/maas-keycloak-0" Jun 08 16:56:37.881586 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:56:37.881553 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 16:56:38.021585 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:56:38.021556 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 16:56:38.091446 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:56:38.091410 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"8cc36c68-45d8-4673-9b48-dc8cbbc963b1","Type":"ContainerStarted","Data":"fdbcfa22c753f1801a57168731744e57916c62223f3bc579a3d3757fdc4087dd"} Jun 08 16:56:44.128287 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:56:44.128205 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"8cc36c68-45d8-4673-9b48-dc8cbbc963b1","Type":"ContainerStarted","Data":"40c88b1651a02f0687409e54ddbade56c4b41d6c3b493acf271c5121c12267a9"} Jun 08 16:56:44.148121 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:56:44.148056 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.710726075 podStartE2EDuration="7.148034711s" totalImagesPullingTime="5.437308636s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:56:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:56:44.144733566 +0000 UTC m=+556.041511044" watchObservedRunningTime="2026-06-08 16:56:44.148034711 +0000 UTC m=+556.044812187" Jun 08 16:56:44.882534 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:56:44.882487 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 08 16:56:44.884412 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:56:44.884368 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8cc36c68-45d8-4673-9b48-dc8cbbc963b1" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 08 16:56:45.882721 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:56:45.882664 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8cc36c68-45d8-4673-9b48-dc8cbbc963b1" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 08 16:56:46.882487 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:56:46.882433 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8cc36c68-45d8-4673-9b48-dc8cbbc963b1" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 08 16:56:47.882072 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:56:47.882021 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 08 16:56:47.882589 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:56:47.882423 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8cc36c68-45d8-4673-9b48-dc8cbbc963b1" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 08 16:56:48.882928 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:56:48.882877 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8cc36c68-45d8-4673-9b48-dc8cbbc963b1" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 08 16:56:49.882063 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:56:49.882002 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8cc36c68-45d8-4673-9b48-dc8cbbc963b1" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 08 16:56:50.882554 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:56:50.882501 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8cc36c68-45d8-4673-9b48-dc8cbbc963b1" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 08 16:56:51.882833 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:56:51.882779 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8cc36c68-45d8-4673-9b48-dc8cbbc963b1" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 08 16:56:52.882087 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:56:52.882036 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8cc36c68-45d8-4673-9b48-dc8cbbc963b1" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 08 16:56:53.882324 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:56:53.882274 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8cc36c68-45d8-4673-9b48-dc8cbbc963b1" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 08 16:56:54.883022 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:56:54.882976 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8cc36c68-45d8-4673-9b48-dc8cbbc963b1" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 08 16:56:55.881943 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:56:55.881898 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8cc36c68-45d8-4673-9b48-dc8cbbc963b1" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 08 16:56:57.008097 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:56:57.008065 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 08 16:56:57.026587 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:56:57.026537 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="8cc36c68-45d8-4673-9b48-dc8cbbc963b1" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 16:57:07.014763 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:07.014720 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 08 16:57:07.670696 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:07.670610 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:57:07.784704 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:07.784669 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:57:07.897504 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:07.897471 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7tglm"] Jun 08 16:57:07.904433 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:07.904413 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-7tglm" Jun 08 16:57:07.907486 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:07.907453 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-rxt2t\"" Jun 08 16:57:07.914106 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:07.909712 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7tglm"] Jun 08 16:57:08.002551 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:08.002461 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqmc9\" (UniqueName: \"kubernetes.io/projected/24c8baa8-6abd-4283-af88-f43146f6c7ba-kube-api-access-pqmc9\") pod \"authorino-5d4b67c446-7tglm\" (UID: \"24c8baa8-6abd-4283-af88-f43146f6c7ba\") " pod="kuadrant-system/authorino-5d4b67c446-7tglm" Jun 08 16:57:08.078949 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:08.078913 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7tglm"] Jun 08 16:57:08.079403 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:57:08.079231 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-pqmc9], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-7tglm" podUID="24c8baa8-6abd-4283-af88-f43146f6c7ba" Jun 08 16:57:08.102888 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:08.102856 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqmc9\" (UniqueName: \"kubernetes.io/projected/24c8baa8-6abd-4283-af88-f43146f6c7ba-kube-api-access-pqmc9\") pod \"authorino-5d4b67c446-7tglm\" (UID: \"24c8baa8-6abd-4283-af88-f43146f6c7ba\") " pod="kuadrant-system/authorino-5d4b67c446-7tglm" Jun 08 16:57:08.103863 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:08.103842 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-s82rr"] Jun 08 16:57:08.107419 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:08.107401 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-s82rr" Jun 08 16:57:08.109721 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:08.109702 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 08 16:57:08.114466 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:08.114446 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-s82rr"] Jun 08 16:57:08.116608 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:08.116581 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqmc9\" (UniqueName: \"kubernetes.io/projected/24c8baa8-6abd-4283-af88-f43146f6c7ba-kube-api-access-pqmc9\") pod \"authorino-5d4b67c446-7tglm\" (UID: \"24c8baa8-6abd-4283-af88-f43146f6c7ba\") " pod="kuadrant-system/authorino-5d4b67c446-7tglm" Jun 08 16:57:08.154262 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:08.154223 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-s82rr"] Jun 08 16:57:08.154534 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:57:08.154513 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-g7cvl tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-g7cvl tls-cert]: context canceled" pod="kuadrant-system/authorino-76877994-s82rr" podUID="b45e1484-65c1-4591-9656-2793d537c713" Jun 08 16:57:08.180156 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:08.180129 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-fb55855c6-tz42l"] Jun 08 16:57:08.183849 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:08.183829 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-fb55855c6-tz42l" Jun 08 16:57:08.192282 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:08.192261 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-fb55855c6-tz42l"] Jun 08 16:57:08.203928 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:08.203902 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5tb5\" (UniqueName: \"kubernetes.io/projected/63bfffa1-1b12-45bb-979d-05959dab51b1-kube-api-access-w5tb5\") pod \"authorino-fb55855c6-tz42l\" (UID: \"63bfffa1-1b12-45bb-979d-05959dab51b1\") " pod="kuadrant-system/authorino-fb55855c6-tz42l" Jun 08 16:57:08.204053 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:08.203933 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/63bfffa1-1b12-45bb-979d-05959dab51b1-tls-cert\") pod \"authorino-fb55855c6-tz42l\" (UID: \"63bfffa1-1b12-45bb-979d-05959dab51b1\") " pod="kuadrant-system/authorino-fb55855c6-tz42l" Jun 08 16:57:08.287005 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:08.286922 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-s82rr" Jun 08 16:57:08.287178 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:08.286922 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-7tglm" Jun 08 16:57:08.293850 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:08.293827 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-s82rr" Jun 08 16:57:08.297189 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:08.297174 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-7tglm" Jun 08 16:57:08.304443 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:08.304413 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pqmc9\" (UniqueName: \"kubernetes.io/projected/24c8baa8-6abd-4283-af88-f43146f6c7ba-kube-api-access-pqmc9\") pod \"24c8baa8-6abd-4283-af88-f43146f6c7ba\" (UID: \"24c8baa8-6abd-4283-af88-f43146f6c7ba\") " Jun 08 16:57:08.304563 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:08.304523 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5tb5\" (UniqueName: \"kubernetes.io/projected/63bfffa1-1b12-45bb-979d-05959dab51b1-kube-api-access-w5tb5\") pod \"authorino-fb55855c6-tz42l\" (UID: \"63bfffa1-1b12-45bb-979d-05959dab51b1\") " pod="kuadrant-system/authorino-fb55855c6-tz42l" Jun 08 16:57:08.304563 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:08.304548 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/63bfffa1-1b12-45bb-979d-05959dab51b1-tls-cert\") pod \"authorino-fb55855c6-tz42l\" (UID: \"63bfffa1-1b12-45bb-979d-05959dab51b1\") " pod="kuadrant-system/authorino-fb55855c6-tz42l" Jun 08 16:57:08.304758 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:08.304737 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b45e1484-65c1-4591-9656-2793d537c713-tls-cert\") pod \"authorino-76877994-s82rr\" (UID: \"b45e1484-65c1-4591-9656-2793d537c713\") " pod="kuadrant-system/authorino-76877994-s82rr" Jun 08 16:57:08.304863 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:08.304843 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7cvl\" (UniqueName: \"kubernetes.io/projected/b45e1484-65c1-4591-9656-2793d537c713-kube-api-access-g7cvl\") pod \"authorino-76877994-s82rr\" (UID: \"b45e1484-65c1-4591-9656-2793d537c713\") " pod="kuadrant-system/authorino-76877994-s82rr" Jun 08 16:57:08.306619 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:08.306593 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24c8baa8-6abd-4283-af88-f43146f6c7ba-kube-api-access-pqmc9" (OuterVolumeSpecName: "kube-api-access-pqmc9") pod "24c8baa8-6abd-4283-af88-f43146f6c7ba" (UID: "24c8baa8-6abd-4283-af88-f43146f6c7ba"). InnerVolumeSpecName "kube-api-access-pqmc9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 16:57:08.307034 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:08.307014 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/63bfffa1-1b12-45bb-979d-05959dab51b1-tls-cert\") pod \"authorino-fb55855c6-tz42l\" (UID: \"63bfffa1-1b12-45bb-979d-05959dab51b1\") " pod="kuadrant-system/authorino-fb55855c6-tz42l" Jun 08 16:57:08.311452 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:08.311429 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5tb5\" (UniqueName: \"kubernetes.io/projected/63bfffa1-1b12-45bb-979d-05959dab51b1-kube-api-access-w5tb5\") pod \"authorino-fb55855c6-tz42l\" (UID: \"63bfffa1-1b12-45bb-979d-05959dab51b1\") " pod="kuadrant-system/authorino-fb55855c6-tz42l" Jun 08 16:57:08.405875 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:08.405843 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b45e1484-65c1-4591-9656-2793d537c713-tls-cert\") pod \"authorino-76877994-s82rr\" (UID: \"b45e1484-65c1-4591-9656-2793d537c713\") " pod="kuadrant-system/authorino-76877994-s82rr" Jun 08 16:57:08.406042 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:08.405900 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7cvl\" (UniqueName: \"kubernetes.io/projected/b45e1484-65c1-4591-9656-2793d537c713-kube-api-access-g7cvl\") pod \"authorino-76877994-s82rr\" (UID: \"b45e1484-65c1-4591-9656-2793d537c713\") " pod="kuadrant-system/authorino-76877994-s82rr" Jun 08 16:57:08.406042 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:08.405970 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pqmc9\" (UniqueName: \"kubernetes.io/projected/24c8baa8-6abd-4283-af88-f43146f6c7ba-kube-api-access-pqmc9\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 16:57:08.408587 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:08.408561 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b45e1484-65c1-4591-9656-2793d537c713-tls-cert\") pod \"authorino-76877994-s82rr\" (UID: \"b45e1484-65c1-4591-9656-2793d537c713\") " pod="kuadrant-system/authorino-76877994-s82rr" Jun 08 16:57:08.413617 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:08.413595 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7cvl\" (UniqueName: \"kubernetes.io/projected/b45e1484-65c1-4591-9656-2793d537c713-kube-api-access-g7cvl\") pod \"authorino-76877994-s82rr\" (UID: \"b45e1484-65c1-4591-9656-2793d537c713\") " pod="kuadrant-system/authorino-76877994-s82rr" Jun 08 16:57:08.493912 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:08.493874 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-fb55855c6-tz42l" Jun 08 16:57:08.506389 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:08.506370 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b45e1484-65c1-4591-9656-2793d537c713-tls-cert\") pod \"b45e1484-65c1-4591-9656-2793d537c713\" (UID: \"b45e1484-65c1-4591-9656-2793d537c713\") " Jun 08 16:57:08.506482 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:08.506402 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7cvl\" (UniqueName: \"kubernetes.io/projected/b45e1484-65c1-4591-9656-2793d537c713-kube-api-access-g7cvl\") pod \"b45e1484-65c1-4591-9656-2793d537c713\" (UID: \"b45e1484-65c1-4591-9656-2793d537c713\") " Jun 08 16:57:08.508582 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:08.508546 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b45e1484-65c1-4591-9656-2793d537c713-kube-api-access-g7cvl" (OuterVolumeSpecName: "kube-api-access-g7cvl") pod "b45e1484-65c1-4591-9656-2793d537c713" (UID: "b45e1484-65c1-4591-9656-2793d537c713"). InnerVolumeSpecName "kube-api-access-g7cvl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 16:57:08.508678 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:08.508587 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b45e1484-65c1-4591-9656-2793d537c713-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "b45e1484-65c1-4591-9656-2793d537c713" (UID: "b45e1484-65c1-4591-9656-2793d537c713"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 16:57:08.608735 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:08.608526 2579 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b45e1484-65c1-4591-9656-2793d537c713-tls-cert\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 16:57:08.608735 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:08.608559 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7cvl\" (UniqueName: \"kubernetes.io/projected/b45e1484-65c1-4591-9656-2793d537c713-kube-api-access-g7cvl\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 16:57:08.630109 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:08.629955 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-fb55855c6-tz42l"] Jun 08 16:57:08.632589 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:57:08.632558 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod63bfffa1_1b12_45bb_979d_05959dab51b1.slice/crio-9f7d12e621b2859ce0ae302aa9fc3c2b2fce9b363bf394a95c94ae918897f6f9 WatchSource:0}: Error finding container 9f7d12e621b2859ce0ae302aa9fc3c2b2fce9b363bf394a95c94ae918897f6f9: Status 404 returned error can't find the container with id 9f7d12e621b2859ce0ae302aa9fc3c2b2fce9b363bf394a95c94ae918897f6f9 Jun 08 16:57:09.293340 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:09.293222 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-fb55855c6-tz42l" event={"ID":"63bfffa1-1b12-45bb-979d-05959dab51b1","Type":"ContainerStarted","Data":"e4130b9448ed1e2a1cb03c1d2cc467a43af0bd656ec4628f04bfed0d009386bc"} Jun 08 16:57:09.293340 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:09.293275 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-s82rr" Jun 08 16:57:09.293340 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:09.293290 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-fb55855c6-tz42l" event={"ID":"63bfffa1-1b12-45bb-979d-05959dab51b1","Type":"ContainerStarted","Data":"9f7d12e621b2859ce0ae302aa9fc3c2b2fce9b363bf394a95c94ae918897f6f9"} Jun 08 16:57:09.293340 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:09.293228 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-7tglm" Jun 08 16:57:09.308904 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:09.308862 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-fb55855c6-tz42l" podStartSLOduration=0.953177125 podStartE2EDuration="1.30884979s" totalImagesPullingTime="355.672665ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:57:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:57:09.30847142 +0000 UTC m=+581.205248905" watchObservedRunningTime="2026-06-08 16:57:09.30884979 +0000 UTC m=+581.205627264" Jun 08 16:57:09.332653 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:09.332626 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7tglm"] Jun 08 16:57:09.339553 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:09.339522 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7tglm"] Jun 08 16:57:09.362426 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:09.362397 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-s82rr"] Jun 08 16:57:09.367961 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:09.367936 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-s82rr"] Jun 08 16:57:10.526538 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:10.526503 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24c8baa8-6abd-4283-af88-f43146f6c7ba" path="/var/lib/kubelet/pods/24c8baa8-6abd-4283-af88-f43146f6c7ba/volumes" Jun 08 16:57:10.526920 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:10.526742 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b45e1484-65c1-4591-9656-2793d537c713" path="/var/lib/kubelet/pods/b45e1484-65c1-4591-9656-2793d537c713/volumes" Jun 08 16:57:12.962624 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:12.962588 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:57:13.063061 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:13.063021 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:57:13.142090 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:13.142051 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:57:13.329343 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:13.329302 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:57:16.226212 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:16.226175 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:57:16.321004 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:16.320961 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:57:16.421074 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:16.421042 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:57:28.489592 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:28.489552 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vkrbj_559d75ed-52d7-4430-8f9f-09a01958d3f4/ovn-acl-logging/0.log" Jun 08 16:57:28.490013 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:28.489928 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vkrbj_559d75ed-52d7-4430-8f9f-09a01958d3f4/ovn-acl-logging/0.log" Jun 08 16:57:30.743691 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:30.743656 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:57:30.845526 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:30.845495 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:57:47.315862 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:47.315764 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:57:47.649271 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:47.649150 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:57:47.750467 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:47.750432 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:57:47.823934 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:47.823892 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:57:47.863223 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:47.863188 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-qhmkz"] Jun 08 16:57:47.866710 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:47.866680 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-qhmkz" Jun 08 16:57:47.869134 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:47.869111 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 08 16:57:47.869307 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:47.869149 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-c2blh\"" Jun 08 16:57:47.876094 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:47.876066 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-qhmkz"] Jun 08 16:57:47.968470 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:47.968378 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnfpx\" (UniqueName: \"kubernetes.io/projected/f941f101-0e5e-4c7a-9ca4-9e8b0041ab1f-kube-api-access-fnfpx\") pod \"payload-processing-7c6c859784-qhmkz\" (UID: \"f941f101-0e5e-4c7a-9ca4-9e8b0041ab1f\") " pod="openshift-ingress/payload-processing-7c6c859784-qhmkz" Jun 08 16:57:48.069669 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:48.069628 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnfpx\" (UniqueName: \"kubernetes.io/projected/f941f101-0e5e-4c7a-9ca4-9e8b0041ab1f-kube-api-access-fnfpx\") pod \"payload-processing-7c6c859784-qhmkz\" (UID: \"f941f101-0e5e-4c7a-9ca4-9e8b0041ab1f\") " pod="openshift-ingress/payload-processing-7c6c859784-qhmkz" Jun 08 16:57:48.077756 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:48.077732 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnfpx\" (UniqueName: \"kubernetes.io/projected/f941f101-0e5e-4c7a-9ca4-9e8b0041ab1f-kube-api-access-fnfpx\") pod \"payload-processing-7c6c859784-qhmkz\" (UID: \"f941f101-0e5e-4c7a-9ca4-9e8b0041ab1f\") " pod="openshift-ingress/payload-processing-7c6c859784-qhmkz" Jun 08 16:57:48.179020 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:48.178990 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-qhmkz" Jun 08 16:57:48.314184 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:48.314161 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-qhmkz"] Jun 08 16:57:48.316259 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:57:48.316213 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf941f101_0e5e_4c7a_9ca4_9e8b0041ab1f.slice/crio-ac69836eef67e7175ca2d84a3b0804f2412dd869cd8079ee91acd87b423ef5c5 WatchSource:0}: Error finding container ac69836eef67e7175ca2d84a3b0804f2412dd869cd8079ee91acd87b423ef5c5: Status 404 returned error can't find the container with id ac69836eef67e7175ca2d84a3b0804f2412dd869cd8079ee91acd87b423ef5c5 Jun 08 16:57:48.318176 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:48.318147 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 16:57:48.483938 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:48.483857 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-qhmkz" event={"ID":"f941f101-0e5e-4c7a-9ca4-9e8b0041ab1f","Type":"ContainerStarted","Data":"ac69836eef67e7175ca2d84a3b0804f2412dd869cd8079ee91acd87b423ef5c5"} Jun 08 16:57:51.501629 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:51.501529 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-qhmkz" event={"ID":"f941f101-0e5e-4c7a-9ca4-9e8b0041ab1f","Type":"ContainerStarted","Data":"b1522a8243a18c3fbb717593f214b4209804dfd9ef820e615bc7505f41865744"} Jun 08 16:57:51.501981 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:51.501681 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-qhmkz" Jun 08 16:57:51.518296 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:51.518229 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7c6c859784-qhmkz" podStartSLOduration=1.7519899159999999 podStartE2EDuration="4.518214005s" totalImagesPullingTime="2.766224089s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:57:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:57:51.516398519 +0000 UTC m=+623.413175993" watchObservedRunningTime="2026-06-08 16:57:51.518214005 +0000 UTC m=+623.414991480" Jun 08 16:57:55.523310 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:55.523286 2579 generic.go:356] "Generic (PLEG): container finished" podID="4444ccdf-0e8b-4b6f-bb9c-03864abb8611" containerID="ccab1c672a42d154a8a4094d37646c2952056856d07938826abcf75627f609cc" exitCode=0 Jun 08 16:57:55.523640 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:55.523361 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8d59d" event={"ID":"4444ccdf-0e8b-4b6f-bb9c-03864abb8611","Type":"ContainerDied","Data":"ccab1c672a42d154a8a4094d37646c2952056856d07938826abcf75627f609cc"} Jun 08 16:57:55.523785 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:55.523762 2579 scope.go:117] "RemoveContainer" containerID="ccab1c672a42d154a8a4094d37646c2952056856d07938826abcf75627f609cc" Jun 08 16:57:55.524847 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:55.524820 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 08 16:57:55.524917 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:55.524895 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 08 16:57:55.524953 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:55.524945 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 08 16:57:55.731226 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:55.731132 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8d59d" Jun 08 16:57:56.530150 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:56.530118 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8d59d" event={"ID":"4444ccdf-0e8b-4b6f-bb9c-03864abb8611","Type":"ContainerStarted","Data":"8ee6fb7a5c92f409e095676a7ced254097272e9074f6a755ed34fb0a3584602b"} Jun 08 16:57:57.471483 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:57.471443 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8d59d" Jun 08 16:57:57.472440 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:57.472409 2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-8d59d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Jun 08 16:57:57.472578 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:57.472471 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8d59d" podUID="4444ccdf-0e8b-4b6f-bb9c-03864abb8611" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Jun 08 16:57:58.471672 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:58.471628 2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-8d59d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Jun 08 16:57:58.472081 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:58.471700 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8d59d" podUID="4444ccdf-0e8b-4b6f-bb9c-03864abb8611" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Jun 08 16:57:58.856355 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:58.856301 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 16:57:58.856619 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:58.856562 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="8cc36c68-45d8-4673-9b48-dc8cbbc963b1" containerName="keycloak" containerID="cri-o://40c88b1651a02f0687409e54ddbade56c4b41d6c3b493acf271c5121c12267a9" gracePeriod=30 Jun 08 16:57:59.472491 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:59.472446 2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-8d59d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Jun 08 16:57:59.472890 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:57:59.472504 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8d59d" podUID="4444ccdf-0e8b-4b6f-bb9c-03864abb8611" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Jun 08 16:58:00.475113 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:00.475083 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8d59d" Jun 08 16:58:00.475522 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:00.475496 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8d59d" Jun 08 16:58:00.476137 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:00.476119 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8d59d" Jun 08 16:58:00.514856 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:00.514837 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 16:58:00.556857 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:00.556773 2579 generic.go:356] "Generic (PLEG): container finished" podID="8cc36c68-45d8-4673-9b48-dc8cbbc963b1" containerID="40c88b1651a02f0687409e54ddbade56c4b41d6c3b493acf271c5121c12267a9" exitCode=143 Jun 08 16:58:00.556857 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:00.556818 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 16:58:00.557055 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:00.556859 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"8cc36c68-45d8-4673-9b48-dc8cbbc963b1","Type":"ContainerDied","Data":"40c88b1651a02f0687409e54ddbade56c4b41d6c3b493acf271c5121c12267a9"} Jun 08 16:58:00.557055 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:00.556920 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"8cc36c68-45d8-4673-9b48-dc8cbbc963b1","Type":"ContainerDied","Data":"fdbcfa22c753f1801a57168731744e57916c62223f3bc579a3d3757fdc4087dd"} Jun 08 16:58:00.557055 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:00.556946 2579 scope.go:117] "RemoveContainer" containerID="40c88b1651a02f0687409e54ddbade56c4b41d6c3b493acf271c5121c12267a9" Jun 08 16:58:00.567905 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:00.567885 2579 scope.go:117] "RemoveContainer" containerID="40c88b1651a02f0687409e54ddbade56c4b41d6c3b493acf271c5121c12267a9" Jun 08 16:58:00.568193 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:58:00.568175 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40c88b1651a02f0687409e54ddbade56c4b41d6c3b493acf271c5121c12267a9\": container with ID starting with 40c88b1651a02f0687409e54ddbade56c4b41d6c3b493acf271c5121c12267a9 not found: ID does not exist" containerID="40c88b1651a02f0687409e54ddbade56c4b41d6c3b493acf271c5121c12267a9" Jun 08 16:58:00.568278 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:00.568209 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40c88b1651a02f0687409e54ddbade56c4b41d6c3b493acf271c5121c12267a9"} err="failed to get container status \"40c88b1651a02f0687409e54ddbade56c4b41d6c3b493acf271c5121c12267a9\": rpc error: code = NotFound desc = could not find container \"40c88b1651a02f0687409e54ddbade56c4b41d6c3b493acf271c5121c12267a9\": container with ID starting with 40c88b1651a02f0687409e54ddbade56c4b41d6c3b493acf271c5121c12267a9 not found: ID does not exist" Jun 08 16:58:00.596411 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:00.596386 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kkxpv\" (UniqueName: \"kubernetes.io/projected/8cc36c68-45d8-4673-9b48-dc8cbbc963b1-kube-api-access-kkxpv\") pod \"8cc36c68-45d8-4673-9b48-dc8cbbc963b1\" (UID: \"8cc36c68-45d8-4673-9b48-dc8cbbc963b1\") " Jun 08 16:58:00.598598 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:00.598572 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cc36c68-45d8-4673-9b48-dc8cbbc963b1-kube-api-access-kkxpv" (OuterVolumeSpecName: "kube-api-access-kkxpv") pod "8cc36c68-45d8-4673-9b48-dc8cbbc963b1" (UID: "8cc36c68-45d8-4673-9b48-dc8cbbc963b1"). InnerVolumeSpecName "kube-api-access-kkxpv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 16:58:00.698071 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:00.698037 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kkxpv\" (UniqueName: \"kubernetes.io/projected/8cc36c68-45d8-4673-9b48-dc8cbbc963b1-kube-api-access-kkxpv\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 16:58:00.878216 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:00.878189 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 16:58:00.882617 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:00.882594 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 16:58:00.901344 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:00.901317 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 16:58:00.901886 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:00.901867 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cc36c68-45d8-4673-9b48-dc8cbbc963b1" containerName="keycloak" Jun 08 16:58:00.901886 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:00.901887 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cc36c68-45d8-4673-9b48-dc8cbbc963b1" containerName="keycloak" Jun 08 16:58:00.902020 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:00.901981 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cc36c68-45d8-4673-9b48-dc8cbbc963b1" containerName="keycloak" Jun 08 16:58:00.909140 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:00.908540 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 16:58:00.911841 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:00.911570 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 08 16:58:00.911841 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:00.911617 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-nx5wl\"" Jun 08 16:58:00.911841 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:00.911709 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 08 16:58:00.911841 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:00.911827 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 08 16:58:00.912135 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:00.911961 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 08 16:58:00.913370 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:00.913347 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 16:58:01.000680 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:01.000636 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/55e80600-007f-4d58-b793-d8c214e86c5b-test-realms\") pod \"maas-keycloak-0\" (UID: \"55e80600-007f-4d58-b793-d8c214e86c5b\") " pod="keycloak-system/maas-keycloak-0" Jun 08 16:58:01.000680 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:01.000682 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8bpz\" (UniqueName: \"kubernetes.io/projected/55e80600-007f-4d58-b793-d8c214e86c5b-kube-api-access-m8bpz\") pod \"maas-keycloak-0\" (UID: \"55e80600-007f-4d58-b793-d8c214e86c5b\") " pod="keycloak-system/maas-keycloak-0" Jun 08 16:58:01.101941 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:01.101906 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/55e80600-007f-4d58-b793-d8c214e86c5b-test-realms\") pod \"maas-keycloak-0\" (UID: \"55e80600-007f-4d58-b793-d8c214e86c5b\") " pod="keycloak-system/maas-keycloak-0" Jun 08 16:58:01.102107 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:01.101947 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8bpz\" (UniqueName: \"kubernetes.io/projected/55e80600-007f-4d58-b793-d8c214e86c5b-kube-api-access-m8bpz\") pod \"maas-keycloak-0\" (UID: \"55e80600-007f-4d58-b793-d8c214e86c5b\") " pod="keycloak-system/maas-keycloak-0" Jun 08 16:58:01.102653 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:01.102632 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/55e80600-007f-4d58-b793-d8c214e86c5b-test-realms\") pod \"maas-keycloak-0\" (UID: \"55e80600-007f-4d58-b793-d8c214e86c5b\") " pod="keycloak-system/maas-keycloak-0" Jun 08 16:58:01.110858 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:01.110833 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8bpz\" (UniqueName: \"kubernetes.io/projected/55e80600-007f-4d58-b793-d8c214e86c5b-kube-api-access-m8bpz\") pod \"maas-keycloak-0\" (UID: \"55e80600-007f-4d58-b793-d8c214e86c5b\") " pod="keycloak-system/maas-keycloak-0" Jun 08 16:58:01.220731 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:01.220641 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 16:58:01.357653 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:01.357622 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 16:58:01.359367 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:58:01.359341 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55e80600_007f_4d58_b793_d8c214e86c5b.slice/crio-2118c303b3183db2ff282787c42c5ad7721650df4360739798f67da7a580e3ec WatchSource:0}: Error finding container 2118c303b3183db2ff282787c42c5ad7721650df4360739798f67da7a580e3ec: Status 404 returned error can't find the container with id 2118c303b3183db2ff282787c42c5ad7721650df4360739798f67da7a580e3ec Jun 08 16:58:01.564129 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:01.564041 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"55e80600-007f-4d58-b793-d8c214e86c5b","Type":"ContainerStarted","Data":"2118c303b3183db2ff282787c42c5ad7721650df4360739798f67da7a580e3ec"} Jun 08 16:58:02.509543 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:02.509509 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-qhmkz" Jun 08 16:58:02.530534 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:02.530493 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8cc36c68-45d8-4673-9b48-dc8cbbc963b1" path="/var/lib/kubelet/pods/8cc36c68-45d8-4673-9b48-dc8cbbc963b1/volumes" Jun 08 16:58:02.573011 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:02.572976 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"55e80600-007f-4d58-b793-d8c214e86c5b","Type":"ContainerStarted","Data":"ba2add620f7c4f2103172d9d0123138fbec02063bcefcfebec811b8836c680f7"} Jun 08 16:58:02.592906 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:02.592839 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=2.2709492989999998 podStartE2EDuration="2.592816935s" totalImagesPullingTime="321.867636ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:58:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:58:02.58997071 +0000 UTC m=+634.486748186" watchObservedRunningTime="2026-06-08 16:58:02.592816935 +0000 UTC m=+634.489594410" Jun 08 16:58:03.221637 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:03.221597 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 08 16:58:03.223713 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:03.223673 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="55e80600-007f-4d58-b793-d8c214e86c5b" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused" Jun 08 16:58:04.221324 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:04.221273 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="55e80600-007f-4d58-b793-d8c214e86c5b" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused" Jun 08 16:58:05.221763 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:05.221717 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="55e80600-007f-4d58-b793-d8c214e86c5b" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused" Jun 08 16:58:06.221806 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:06.221758 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="55e80600-007f-4d58-b793-d8c214e86c5b" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused" Jun 08 16:58:07.221900 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:07.221853 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="55e80600-007f-4d58-b793-d8c214e86c5b" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused" Jun 08 16:58:08.221945 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:08.221894 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="55e80600-007f-4d58-b793-d8c214e86c5b" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused" Jun 08 16:58:09.221657 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:09.221593 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="55e80600-007f-4d58-b793-d8c214e86c5b" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused" Jun 08 16:58:10.221035 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:10.220987 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="55e80600-007f-4d58-b793-d8c214e86c5b" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused" Jun 08 16:58:11.221085 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:11.221043 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 08 16:58:11.221744 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:11.221696 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="55e80600-007f-4d58-b793-d8c214e86c5b" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused" Jun 08 16:58:12.221784 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:12.221732 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="55e80600-007f-4d58-b793-d8c214e86c5b" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused" Jun 08 16:58:13.221989 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:13.221941 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="55e80600-007f-4d58-b793-d8c214e86c5b" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused" Jun 08 16:58:14.221911 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:14.221871 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="55e80600-007f-4d58-b793-d8c214e86c5b" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused" Jun 08 16:58:15.347549 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:15.347499 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 08 16:58:15.364352 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:15.364301 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="55e80600-007f-4d58-b793-d8c214e86c5b" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 16:58:25.354271 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:25.354205 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 08 16:58:26.062010 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:26.061973 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:58:27.344310 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:27.344276 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:58:37.861653 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:37.861616 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-fb55855c6-tz42l"] Jun 08 16:58:37.862218 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:37.861842 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-fb55855c6-tz42l" podUID="63bfffa1-1b12-45bb-979d-05959dab51b1" containerName="authorino" containerID="cri-o://e4130b9448ed1e2a1cb03c1d2cc467a43af0bd656ec4628f04bfed0d009386bc" gracePeriod=30 Jun 08 16:58:38.130188 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:38.130159 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-fb55855c6-tz42l" Jun 08 16:58:38.169537 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:38.169492 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/63bfffa1-1b12-45bb-979d-05959dab51b1-tls-cert\") pod \"63bfffa1-1b12-45bb-979d-05959dab51b1\" (UID: \"63bfffa1-1b12-45bb-979d-05959dab51b1\") " Jun 08 16:58:38.169698 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:38.169568 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w5tb5\" (UniqueName: \"kubernetes.io/projected/63bfffa1-1b12-45bb-979d-05959dab51b1-kube-api-access-w5tb5\") pod \"63bfffa1-1b12-45bb-979d-05959dab51b1\" (UID: \"63bfffa1-1b12-45bb-979d-05959dab51b1\") " Jun 08 16:58:38.171796 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:38.171762 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63bfffa1-1b12-45bb-979d-05959dab51b1-kube-api-access-w5tb5" (OuterVolumeSpecName: "kube-api-access-w5tb5") pod "63bfffa1-1b12-45bb-979d-05959dab51b1" (UID: "63bfffa1-1b12-45bb-979d-05959dab51b1"). InnerVolumeSpecName "kube-api-access-w5tb5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 16:58:38.181216 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:38.181192 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63bfffa1-1b12-45bb-979d-05959dab51b1-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "63bfffa1-1b12-45bb-979d-05959dab51b1" (UID: "63bfffa1-1b12-45bb-979d-05959dab51b1"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 16:58:38.270671 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:38.270636 2579 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/63bfffa1-1b12-45bb-979d-05959dab51b1-tls-cert\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 16:58:38.270671 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:38.270675 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5tb5\" (UniqueName: \"kubernetes.io/projected/63bfffa1-1b12-45bb-979d-05959dab51b1-kube-api-access-w5tb5\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 16:58:38.293496 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:38.293461 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:58:38.392485 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:38.392400 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:58:38.800836 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:38.800732 2579 generic.go:356] "Generic (PLEG): container finished" podID="63bfffa1-1b12-45bb-979d-05959dab51b1" containerID="e4130b9448ed1e2a1cb03c1d2cc467a43af0bd656ec4628f04bfed0d009386bc" exitCode=0 Jun 08 16:58:38.800836 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:38.800782 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-fb55855c6-tz42l" Jun 08 16:58:38.800836 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:38.800822 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-fb55855c6-tz42l" event={"ID":"63bfffa1-1b12-45bb-979d-05959dab51b1","Type":"ContainerDied","Data":"e4130b9448ed1e2a1cb03c1d2cc467a43af0bd656ec4628f04bfed0d009386bc"} Jun 08 16:58:38.801102 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:38.800866 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-fb55855c6-tz42l" event={"ID":"63bfffa1-1b12-45bb-979d-05959dab51b1","Type":"ContainerDied","Data":"9f7d12e621b2859ce0ae302aa9fc3c2b2fce9b363bf394a95c94ae918897f6f9"} Jun 08 16:58:38.801102 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:38.800885 2579 scope.go:117] "RemoveContainer" containerID="e4130b9448ed1e2a1cb03c1d2cc467a43af0bd656ec4628f04bfed0d009386bc" Jun 08 16:58:38.809690 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:38.809671 2579 scope.go:117] "RemoveContainer" containerID="e4130b9448ed1e2a1cb03c1d2cc467a43af0bd656ec4628f04bfed0d009386bc" Jun 08 16:58:38.809921 ip-10-0-135-83 kubenswrapper[2579]: E0608 16:58:38.809903 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4130b9448ed1e2a1cb03c1d2cc467a43af0bd656ec4628f04bfed0d009386bc\": container with ID starting with e4130b9448ed1e2a1cb03c1d2cc467a43af0bd656ec4628f04bfed0d009386bc not found: ID does not exist" containerID="e4130b9448ed1e2a1cb03c1d2cc467a43af0bd656ec4628f04bfed0d009386bc" Jun 08 16:58:38.809967 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:38.809930 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4130b9448ed1e2a1cb03c1d2cc467a43af0bd656ec4628f04bfed0d009386bc"} err="failed to get container status \"e4130b9448ed1e2a1cb03c1d2cc467a43af0bd656ec4628f04bfed0d009386bc\": rpc error: code = NotFound desc = could not find container \"e4130b9448ed1e2a1cb03c1d2cc467a43af0bd656ec4628f04bfed0d009386bc\": container with ID starting with e4130b9448ed1e2a1cb03c1d2cc467a43af0bd656ec4628f04bfed0d009386bc not found: ID does not exist" Jun 08 16:58:38.816496 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:38.816476 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-fb55855c6-tz42l"] Jun 08 16:58:38.818162 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:38.818143 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-fb55855c6-tz42l"] Jun 08 16:58:40.526883 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:40.526848 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63bfffa1-1b12-45bb-979d-05959dab51b1" path="/var/lib/kubelet/pods/63bfffa1-1b12-45bb-979d-05959dab51b1/volumes" Jun 08 16:58:48.069209 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:48.069176 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7n9p2"] Jun 08 16:58:48.069670 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:48.069626 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63bfffa1-1b12-45bb-979d-05959dab51b1" containerName="authorino" Jun 08 16:58:48.069670 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:48.069639 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="63bfffa1-1b12-45bb-979d-05959dab51b1" containerName="authorino" Jun 08 16:58:48.069744 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:48.069704 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="63bfffa1-1b12-45bb-979d-05959dab51b1" containerName="authorino" Jun 08 16:58:48.072850 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:48.072831 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7n9p2" Jun 08 16:58:48.076334 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:48.076309 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 08 16:58:48.076334 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:48.076329 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 08 16:58:48.076542 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:48.076405 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 08 16:58:48.076602 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:48.076545 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-dx9gw\"" Jun 08 16:58:48.083314 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:48.083290 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7n9p2"] Jun 08 16:58:48.102214 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:48.102176 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:58:48.162536 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:48.162490 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e939b22a-7248-41d1-b2cc-b45bc1886f40-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7n9p2\" (UID: \"e939b22a-7248-41d1-b2cc-b45bc1886f40\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7n9p2" Jun 08 16:58:48.162723 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:48.162544 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e939b22a-7248-41d1-b2cc-b45bc1886f40-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7n9p2\" (UID: \"e939b22a-7248-41d1-b2cc-b45bc1886f40\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7n9p2" Jun 08 16:58:48.162723 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:48.162607 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stq4n\" (UniqueName: \"kubernetes.io/projected/e939b22a-7248-41d1-b2cc-b45bc1886f40-kube-api-access-stq4n\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7n9p2\" (UID: \"e939b22a-7248-41d1-b2cc-b45bc1886f40\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7n9p2" Jun 08 16:58:48.162723 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:48.162657 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e939b22a-7248-41d1-b2cc-b45bc1886f40-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7n9p2\" (UID: \"e939b22a-7248-41d1-b2cc-b45bc1886f40\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7n9p2" Jun 08 16:58:48.162723 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:48.162699 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e939b22a-7248-41d1-b2cc-b45bc1886f40-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7n9p2\" (UID: \"e939b22a-7248-41d1-b2cc-b45bc1886f40\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7n9p2" Jun 08 16:58:48.162913 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:48.162787 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e939b22a-7248-41d1-b2cc-b45bc1886f40-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7n9p2\" (UID: \"e939b22a-7248-41d1-b2cc-b45bc1886f40\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7n9p2" Jun 08 16:58:48.263875 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:48.263838 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e939b22a-7248-41d1-b2cc-b45bc1886f40-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7n9p2\" (UID: \"e939b22a-7248-41d1-b2cc-b45bc1886f40\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7n9p2" Jun 08 16:58:48.264085 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:48.263898 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e939b22a-7248-41d1-b2cc-b45bc1886f40-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7n9p2\" (UID: \"e939b22a-7248-41d1-b2cc-b45bc1886f40\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7n9p2" Jun 08 16:58:48.264085 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:48.263933 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e939b22a-7248-41d1-b2cc-b45bc1886f40-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7n9p2\" (UID: \"e939b22a-7248-41d1-b2cc-b45bc1886f40\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7n9p2" Jun 08 16:58:48.264085 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:48.263956 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e939b22a-7248-41d1-b2cc-b45bc1886f40-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7n9p2\" (UID: \"e939b22a-7248-41d1-b2cc-b45bc1886f40\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7n9p2" Jun 08 16:58:48.264085 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:48.263979 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stq4n\" (UniqueName: \"kubernetes.io/projected/e939b22a-7248-41d1-b2cc-b45bc1886f40-kube-api-access-stq4n\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7n9p2\" (UID: \"e939b22a-7248-41d1-b2cc-b45bc1886f40\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7n9p2" Jun 08 16:58:48.264085 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:48.264012 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e939b22a-7248-41d1-b2cc-b45bc1886f40-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7n9p2\" (UID: \"e939b22a-7248-41d1-b2cc-b45bc1886f40\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7n9p2" Jun 08 16:58:48.264430 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:48.264365 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e939b22a-7248-41d1-b2cc-b45bc1886f40-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7n9p2\" (UID: \"e939b22a-7248-41d1-b2cc-b45bc1886f40\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7n9p2" Jun 08 16:58:48.264430 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:48.264408 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e939b22a-7248-41d1-b2cc-b45bc1886f40-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7n9p2\" (UID: \"e939b22a-7248-41d1-b2cc-b45bc1886f40\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7n9p2" Jun 08 16:58:48.264530 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:48.264438 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e939b22a-7248-41d1-b2cc-b45bc1886f40-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7n9p2\" (UID: \"e939b22a-7248-41d1-b2cc-b45bc1886f40\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7n9p2" Jun 08 16:58:48.266446 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:48.266421 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e939b22a-7248-41d1-b2cc-b45bc1886f40-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7n9p2\" (UID: \"e939b22a-7248-41d1-b2cc-b45bc1886f40\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7n9p2" Jun 08 16:58:48.266709 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:48.266692 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e939b22a-7248-41d1-b2cc-b45bc1886f40-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7n9p2\" (UID: \"e939b22a-7248-41d1-b2cc-b45bc1886f40\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7n9p2" Jun 08 16:58:48.272167 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:48.272145 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stq4n\" (UniqueName: \"kubernetes.io/projected/e939b22a-7248-41d1-b2cc-b45bc1886f40-kube-api-access-stq4n\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7n9p2\" (UID: \"e939b22a-7248-41d1-b2cc-b45bc1886f40\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7n9p2" Jun 08 16:58:48.385403 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:48.385322 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7n9p2" Jun 08 16:58:48.523947 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:58:48.523917 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode939b22a_7248_41d1_b2cc_b45bc1886f40.slice/crio-69db84f498a6afbdbbdd9c62b20c04e6277636c1902a0d84bc3415554a9faead WatchSource:0}: Error finding container 69db84f498a6afbdbbdd9c62b20c04e6277636c1902a0d84bc3415554a9faead: Status 404 returned error can't find the container with id 69db84f498a6afbdbbdd9c62b20c04e6277636c1902a0d84bc3415554a9faead Jun 08 16:58:48.527360 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:48.527335 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7n9p2"] Jun 08 16:58:48.851930 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:48.851891 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7n9p2" event={"ID":"e939b22a-7248-41d1-b2cc-b45bc1886f40","Type":"ContainerStarted","Data":"69db84f498a6afbdbbdd9c62b20c04e6277636c1902a0d84bc3415554a9faead"} Jun 08 16:58:52.877740 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:52.877700 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7n9p2" event={"ID":"e939b22a-7248-41d1-b2cc-b45bc1886f40","Type":"ContainerStarted","Data":"cd7c7ee07a8b71365eaefe1e2f6c2a976d0093be3a923ace1fd84f76d565d413"} Jun 08 16:58:53.884830 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:53.884739 2579 generic.go:356] "Generic (PLEG): container finished" podID="e939b22a-7248-41d1-b2cc-b45bc1886f40" containerID="cd7c7ee07a8b71365eaefe1e2f6c2a976d0093be3a923ace1fd84f76d565d413" exitCode=0 Jun 08 16:58:53.884830 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:53.884798 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7n9p2" event={"ID":"e939b22a-7248-41d1-b2cc-b45bc1886f40","Type":"ContainerDied","Data":"cd7c7ee07a8b71365eaefe1e2f6c2a976d0093be3a923ace1fd84f76d565d413"} Jun 08 16:58:55.901015 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:55.900971 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7n9p2" event={"ID":"e939b22a-7248-41d1-b2cc-b45bc1886f40","Type":"ContainerStarted","Data":"ddf654b96f332c67a3f6efdb10d9494d03e75a66b30fd651d68c3f0f73232a4c"} Jun 08 16:58:55.919924 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:55.919878 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7n9p2" podStartSLOduration=1.74162294 podStartE2EDuration="7.919863261s" totalImagesPullingTime="4.953112883s" totalInitContainerRuntime="1.225127438s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:58:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:58:55.917171986 +0000 UTC m=+687.813949463" watchObservedRunningTime="2026-06-08 16:58:55.919863261 +0000 UTC m=+687.816640736" Jun 08 16:58:58.386131 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:58.386083 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7n9p2" Jun 08 16:58:58.386568 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:58.386160 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7n9p2" Jun 08 16:58:58.399155 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:58.399129 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7n9p2" Jun 08 16:58:58.926951 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:58:58.926920 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7n9p2" Jun 08 16:59:05.800718 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:05.800680 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:59:20.386609 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:20.386526 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z64tz"] Jun 08 16:59:20.390276 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:20.390260 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z64tz" Jun 08 16:59:20.392996 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:20.392971 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 08 16:59:20.399302 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:20.399279 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z64tz"] Jun 08 16:59:20.462619 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:20.462589 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/40641043-ba9c-4a02-be9f-2eac7e1fd79f-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-z64tz\" (UID: \"40641043-ba9c-4a02-be9f-2eac7e1fd79f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z64tz" Jun 08 16:59:20.462782 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:20.462624 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zpx4\" (UniqueName: \"kubernetes.io/projected/40641043-ba9c-4a02-be9f-2eac7e1fd79f-kube-api-access-8zpx4\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-z64tz\" (UID: \"40641043-ba9c-4a02-be9f-2eac7e1fd79f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z64tz" Jun 08 16:59:20.462782 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:20.462715 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40641043-ba9c-4a02-be9f-2eac7e1fd79f-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-z64tz\" (UID: \"40641043-ba9c-4a02-be9f-2eac7e1fd79f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z64tz" Jun 08 16:59:20.462860 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:20.462778 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40641043-ba9c-4a02-be9f-2eac7e1fd79f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-z64tz\" (UID: \"40641043-ba9c-4a02-be9f-2eac7e1fd79f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z64tz" Jun 08 16:59:20.462860 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:20.462816 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40641043-ba9c-4a02-be9f-2eac7e1fd79f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-z64tz\" (UID: \"40641043-ba9c-4a02-be9f-2eac7e1fd79f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z64tz" Jun 08 16:59:20.462860 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:20.462846 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40641043-ba9c-4a02-be9f-2eac7e1fd79f-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-z64tz\" (UID: \"40641043-ba9c-4a02-be9f-2eac7e1fd79f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z64tz" Jun 08 16:59:20.473930 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:20.473892 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:59:20.563455 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:20.563344 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40641043-ba9c-4a02-be9f-2eac7e1fd79f-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-z64tz\" (UID: \"40641043-ba9c-4a02-be9f-2eac7e1fd79f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z64tz" Jun 08 16:59:20.563648 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:20.563540 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/40641043-ba9c-4a02-be9f-2eac7e1fd79f-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-z64tz\" (UID: \"40641043-ba9c-4a02-be9f-2eac7e1fd79f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z64tz" Jun 08 16:59:20.563648 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:20.563578 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zpx4\" (UniqueName: \"kubernetes.io/projected/40641043-ba9c-4a02-be9f-2eac7e1fd79f-kube-api-access-8zpx4\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-z64tz\" (UID: \"40641043-ba9c-4a02-be9f-2eac7e1fd79f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z64tz" Jun 08 16:59:20.563777 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:20.563659 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40641043-ba9c-4a02-be9f-2eac7e1fd79f-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-z64tz\" (UID: \"40641043-ba9c-4a02-be9f-2eac7e1fd79f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z64tz" Jun 08 16:59:20.563777 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:20.563720 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40641043-ba9c-4a02-be9f-2eac7e1fd79f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-z64tz\" (UID: \"40641043-ba9c-4a02-be9f-2eac7e1fd79f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z64tz" Jun 08 16:59:20.563777 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:20.563762 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40641043-ba9c-4a02-be9f-2eac7e1fd79f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-z64tz\" (UID: \"40641043-ba9c-4a02-be9f-2eac7e1fd79f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z64tz" Jun 08 16:59:20.564334 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:20.564305 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40641043-ba9c-4a02-be9f-2eac7e1fd79f-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-z64tz\" (UID: \"40641043-ba9c-4a02-be9f-2eac7e1fd79f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z64tz" Jun 08 16:59:20.564453 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:20.564369 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/40641043-ba9c-4a02-be9f-2eac7e1fd79f-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-z64tz\" (UID: \"40641043-ba9c-4a02-be9f-2eac7e1fd79f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z64tz" Jun 08 16:59:20.564523 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:20.564511 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40641043-ba9c-4a02-be9f-2eac7e1fd79f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-z64tz\" (UID: \"40641043-ba9c-4a02-be9f-2eac7e1fd79f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z64tz" Jun 08 16:59:20.566904 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:20.566880 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40641043-ba9c-4a02-be9f-2eac7e1fd79f-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-z64tz\" (UID: \"40641043-ba9c-4a02-be9f-2eac7e1fd79f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z64tz" Jun 08 16:59:20.567176 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:20.567158 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40641043-ba9c-4a02-be9f-2eac7e1fd79f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-z64tz\" (UID: \"40641043-ba9c-4a02-be9f-2eac7e1fd79f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z64tz" Jun 08 16:59:20.571422 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:20.571401 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zpx4\" (UniqueName: \"kubernetes.io/projected/40641043-ba9c-4a02-be9f-2eac7e1fd79f-kube-api-access-8zpx4\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-z64tz\" (UID: \"40641043-ba9c-4a02-be9f-2eac7e1fd79f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z64tz" Jun 08 16:59:20.701863 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:20.701769 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z64tz" Jun 08 16:59:20.835871 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:20.835846 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z64tz"] Jun 08 16:59:20.837987 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:59:20.837957 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40641043_ba9c_4a02_be9f_2eac7e1fd79f.slice/crio-d1e92cec324d69f3fcc27038943ce299904eb3a636ad441a09eb95f597e031de WatchSource:0}: Error finding container d1e92cec324d69f3fcc27038943ce299904eb3a636ad441a09eb95f597e031de: Status 404 returned error can't find the container with id d1e92cec324d69f3fcc27038943ce299904eb3a636ad441a09eb95f597e031de Jun 08 16:59:21.030574 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:21.030484 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z64tz" event={"ID":"40641043-ba9c-4a02-be9f-2eac7e1fd79f","Type":"ContainerStarted","Data":"d78fa63fb21ecde4300c56e64127eaf1bf515734d6d9b7b2584191259075547c"} Jun 08 16:59:21.030574 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:21.030562 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z64tz" event={"ID":"40641043-ba9c-4a02-be9f-2eac7e1fd79f","Type":"ContainerStarted","Data":"d1e92cec324d69f3fcc27038943ce299904eb3a636ad441a09eb95f597e031de"} Jun 08 16:59:31.627378 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:31.627343 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:59:44.813150 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:44.813115 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:59:54.179041 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:54.179004 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-gq466"] Jun 08 16:59:54.182913 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:54.182892 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gq466" Jun 08 16:59:54.185594 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:54.185574 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 08 16:59:54.190945 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:54.190925 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-gq466"] Jun 08 16:59:54.221440 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:54.221390 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:59:54.284569 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:54.284535 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94e6a592-a581-4e38-bbb1-ec1a5ceba095-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-gq466\" (UID: \"94e6a592-a581-4e38-bbb1-ec1a5ceba095\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gq466" Jun 08 16:59:54.284569 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:54.284573 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94e6a592-a581-4e38-bbb1-ec1a5ceba095-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-gq466\" (UID: \"94e6a592-a581-4e38-bbb1-ec1a5ceba095\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gq466" Jun 08 16:59:54.284756 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:54.284718 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfddk\" (UniqueName: \"kubernetes.io/projected/94e6a592-a581-4e38-bbb1-ec1a5ceba095-kube-api-access-dfddk\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-gq466\" (UID: \"94e6a592-a581-4e38-bbb1-ec1a5ceba095\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gq466" Jun 08 16:59:54.284756 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:54.284749 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94e6a592-a581-4e38-bbb1-ec1a5ceba095-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-gq466\" (UID: \"94e6a592-a581-4e38-bbb1-ec1a5ceba095\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gq466" Jun 08 16:59:54.284826 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:54.284774 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/94e6a592-a581-4e38-bbb1-ec1a5ceba095-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-gq466\" (UID: \"94e6a592-a581-4e38-bbb1-ec1a5ceba095\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gq466" Jun 08 16:59:54.284860 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:54.284833 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94e6a592-a581-4e38-bbb1-ec1a5ceba095-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-gq466\" (UID: \"94e6a592-a581-4e38-bbb1-ec1a5ceba095\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gq466" Jun 08 16:59:54.385966 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:54.385924 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfddk\" (UniqueName: \"kubernetes.io/projected/94e6a592-a581-4e38-bbb1-ec1a5ceba095-kube-api-access-dfddk\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-gq466\" (UID: \"94e6a592-a581-4e38-bbb1-ec1a5ceba095\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gq466" Jun 08 16:59:54.385966 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:54.385969 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94e6a592-a581-4e38-bbb1-ec1a5ceba095-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-gq466\" (UID: \"94e6a592-a581-4e38-bbb1-ec1a5ceba095\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gq466" Jun 08 16:59:54.386200 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:54.385994 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/94e6a592-a581-4e38-bbb1-ec1a5ceba095-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-gq466\" (UID: \"94e6a592-a581-4e38-bbb1-ec1a5ceba095\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gq466" Jun 08 16:59:54.386200 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:54.386019 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94e6a592-a581-4e38-bbb1-ec1a5ceba095-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-gq466\" (UID: \"94e6a592-a581-4e38-bbb1-ec1a5ceba095\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gq466" Jun 08 16:59:54.386200 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:54.386046 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94e6a592-a581-4e38-bbb1-ec1a5ceba095-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-gq466\" (UID: \"94e6a592-a581-4e38-bbb1-ec1a5ceba095\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gq466" Jun 08 16:59:54.386200 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:54.386145 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94e6a592-a581-4e38-bbb1-ec1a5ceba095-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-gq466\" (UID: \"94e6a592-a581-4e38-bbb1-ec1a5ceba095\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gq466" Jun 08 16:59:54.386462 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:54.386444 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94e6a592-a581-4e38-bbb1-ec1a5ceba095-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-gq466\" (UID: \"94e6a592-a581-4e38-bbb1-ec1a5ceba095\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gq466" Jun 08 16:59:54.386533 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:54.386512 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/94e6a592-a581-4e38-bbb1-ec1a5ceba095-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-gq466\" (UID: \"94e6a592-a581-4e38-bbb1-ec1a5ceba095\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gq466" Jun 08 16:59:54.386571 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:54.386549 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94e6a592-a581-4e38-bbb1-ec1a5ceba095-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-gq466\" (UID: \"94e6a592-a581-4e38-bbb1-ec1a5ceba095\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gq466" Jun 08 16:59:54.388722 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:54.388695 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94e6a592-a581-4e38-bbb1-ec1a5ceba095-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-gq466\" (UID: \"94e6a592-a581-4e38-bbb1-ec1a5ceba095\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gq466" Jun 08 16:59:54.388841 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:54.388771 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94e6a592-a581-4e38-bbb1-ec1a5ceba095-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-gq466\" (UID: \"94e6a592-a581-4e38-bbb1-ec1a5ceba095\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gq466" Jun 08 16:59:54.393964 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:54.393939 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfddk\" (UniqueName: \"kubernetes.io/projected/94e6a592-a581-4e38-bbb1-ec1a5ceba095-kube-api-access-dfddk\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-gq466\" (UID: \"94e6a592-a581-4e38-bbb1-ec1a5ceba095\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gq466" Jun 08 16:59:54.496712 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:54.496605 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gq466" Jun 08 16:59:54.633663 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:54.633643 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-gq466"] Jun 08 16:59:54.636064 ip-10-0-135-83 kubenswrapper[2579]: W0608 16:59:54.636036 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94e6a592_a581_4e38_bbb1_ec1a5ceba095.slice/crio-80f3ae61989a7391efb3eb6e3e31b9177e3de80d88d01263c32bc7dfaf09cfd5 WatchSource:0}: Error finding container 80f3ae61989a7391efb3eb6e3e31b9177e3de80d88d01263c32bc7dfaf09cfd5: Status 404 returned error can't find the container with id 80f3ae61989a7391efb3eb6e3e31b9177e3de80d88d01263c32bc7dfaf09cfd5 Jun 08 16:59:55.213801 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:55.213760 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gq466" event={"ID":"94e6a592-a581-4e38-bbb1-ec1a5ceba095","Type":"ContainerStarted","Data":"981b3ccd95d8b454f27bf53c16872cb90de5daa188bfba4d79aa4096fa640658"} Jun 08 16:59:55.214322 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:55.213826 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gq466" event={"ID":"94e6a592-a581-4e38-bbb1-ec1a5ceba095","Type":"ContainerStarted","Data":"80f3ae61989a7391efb3eb6e3e31b9177e3de80d88d01263c32bc7dfaf09cfd5"} Jun 08 16:59:57.907332 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:57.907289 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 16:59:58.229847 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:58.229754 2579 generic.go:356] "Generic (PLEG): container finished" podID="94e6a592-a581-4e38-bbb1-ec1a5ceba095" containerID="981b3ccd95d8b454f27bf53c16872cb90de5daa188bfba4d79aa4096fa640658" exitCode=0 Jun 08 16:59:58.229847 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:58.229830 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gq466" event={"ID":"94e6a592-a581-4e38-bbb1-ec1a5ceba095","Type":"ContainerDied","Data":"981b3ccd95d8b454f27bf53c16872cb90de5daa188bfba4d79aa4096fa640658"} Jun 08 16:59:59.236764 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:59.236731 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gq466" event={"ID":"94e6a592-a581-4e38-bbb1-ec1a5ceba095","Type":"ContainerStarted","Data":"b74c289ff1206a6a3b1a1a19603fd879a45cf8c7229e7b1eb5ff665de5303a93"} Jun 08 16:59:59.256328 ip-10-0-135-83 kubenswrapper[2579]: I0608 16:59:59.256270 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gq466" podStartSLOduration=1.88367247 podStartE2EDuration="5.256254195s" totalImagesPullingTime="212.513597ms" totalInitContainerRuntime="3.160068128s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:59:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:59:59.253440101 +0000 UTC m=+751.150217577" watchObservedRunningTime="2026-06-08 16:59:59.256254195 +0000 UTC m=+751.153031666" Jun 08 17:00:04.497048 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:00:04.497016 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gq466" Jun 08 17:00:04.497474 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:00:04.497075 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gq466" Jun 08 17:00:04.509435 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:00:04.509410 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gq466" Jun 08 17:00:05.277867 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:00:05.277837 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gq466" Jun 08 17:00:14.313407 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:00:14.313320 2579 generic.go:356] "Generic (PLEG): container finished" podID="40641043-ba9c-4a02-be9f-2eac7e1fd79f" containerID="d78fa63fb21ecde4300c56e64127eaf1bf515734d6d9b7b2584191259075547c" exitCode=0 Jun 08 17:00:14.313407 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:00:14.313392 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z64tz" event={"ID":"40641043-ba9c-4a02-be9f-2eac7e1fd79f","Type":"ContainerDied","Data":"d78fa63fb21ecde4300c56e64127eaf1bf515734d6d9b7b2584191259075547c"} Jun 08 17:00:17.820552 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:00:17.820518 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:00:17.871486 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:00:17.871458 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:00:27.382011 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:00:27.381983 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z64tz" event={"ID":"40641043-ba9c-4a02-be9f-2eac7e1fd79f","Type":"ContainerStarted","Data":"9a0d18d6732f562dd91769ba9f9e11ea6fce1af8465c486e1b6124a538f5fcfa"} Jun 08 17:00:27.402950 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:00:27.402896 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z64tz" podStartSLOduration=1.473239243 podStartE2EDuration="1m7.40288215s" totalImagesPullingTime="12.954741621s" totalInitContainerRuntime="52.974901286s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:59:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 17:00:27.401470949 +0000 UTC m=+779.298248424" watchObservedRunningTime="2026-06-08 17:00:27.40288215 +0000 UTC m=+779.299659624" Jun 08 17:00:30.702121 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:00:30.702083 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z64tz" Jun 08 17:00:30.702676 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:00:30.702187 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z64tz" Jun 08 17:00:30.714044 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:00:30.714019 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z64tz" Jun 08 17:00:31.414939 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:00:31.414913 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z64tz" Jun 08 17:00:51.472591 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:00:51.472497 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:00:51.568851 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:00:51.568813 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:00:52.541930 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:00:52.541893 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:00:52.640749 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:00:52.640715 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:01:48.466877 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:01:48.466841 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:02:15.893013 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:02:15.892967 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:02:19.139530 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:02:19.139491 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:02:20.535307 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:02:20.535269 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:02:28.523630 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:02:28.523586 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vkrbj_559d75ed-52d7-4430-8f9f-09a01958d3f4/ovn-acl-logging/0.log" Jun 08 17:02:28.524188 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:02:28.524160 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vkrbj_559d75ed-52d7-4430-8f9f-09a01958d3f4/ovn-acl-logging/0.log" Jun 08 17:03:02.451736 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:03:02.451694 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:03:02.554010 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:03:02.553975 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:03:10.944362 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:03:10.944324 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:03:16.738038 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:03:16.737992 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:03:16.838381 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:03:16.838341 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:03:23.300546 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:03:23.300506 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:03:23.402021 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:03:23.401979 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:03:48.843345 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:03:48.843263 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:03:50.009254 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:03:50.009201 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:04:12.774746 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:04:12.774700 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:04:18.472321 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:04:18.472281 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:04:18.519652 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:04:18.519617 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:04:18.602295 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:04:18.602214 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:04:18.697856 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:04:18.697819 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:04:18.815325 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:04:18.815293 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:04:18.915214 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:04:18.915173 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:04:35.293541 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:04:35.293502 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:04:35.403916 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:04:35.403876 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:04:35.507460 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:04:35.507419 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:04:41.094733 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:04:41.094691 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:04:41.211346 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:04:41.211321 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:04:49.230068 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:04:49.230023 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:04:49.330479 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:04:49.330447 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:04:49.430691 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:04:49.430661 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:04:49.534035 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:04:49.533961 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:05:05.934002 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:05:05.933962 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:05:06.055889 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:05:06.055852 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:05:06.161476 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:05:06.161441 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:05:11.924026 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:05:11.923989 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:05:11.977361 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:05:11.977325 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:05:32.194916 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:05:32.194870 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:05:32.293989 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:05:32.293958 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:05:32.394773 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:05:32.394729 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:05:37.988002 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:05:37.987960 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:05:38.202231 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:05:38.202188 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:05:38.271081 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:05:38.270988 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:05:38.414061 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:05:38.414021 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:05:44.154475 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:05:44.154435 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:05:44.253897 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:05:44.253852 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:07:00.983627 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:07:00.983523 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:07:28.560719 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:07:28.560694 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vkrbj_559d75ed-52d7-4430-8f9f-09a01958d3f4/ovn-acl-logging/0.log" Jun 08 17:07:28.561337 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:07:28.561314 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vkrbj_559d75ed-52d7-4430-8f9f-09a01958d3f4/ovn-acl-logging/0.log" Jun 08 17:09:03.823225 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:09:03.823183 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:10:29.963043 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:10:29.963005 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:10:30.015569 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:10:30.015532 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:12:28.593082 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:12:28.593052 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vkrbj_559d75ed-52d7-4430-8f9f-09a01958d3f4/ovn-acl-logging/0.log" Jun 08 17:12:28.594064 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:12:28.594047 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vkrbj_559d75ed-52d7-4430-8f9f-09a01958d3f4/ovn-acl-logging/0.log" Jun 08 17:12:28.605894 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:12:28.605863 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:12:52.352694 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:12:52.352656 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:12:52.407424 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:12:52.407390 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:16:14.987532 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:16:14.987495 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:17:28.625128 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:17:28.625099 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vkrbj_559d75ed-52d7-4430-8f9f-09a01958d3f4/ovn-acl-logging/0.log" Jun 08 17:17:28.628598 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:17:28.628577 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vkrbj_559d75ed-52d7-4430-8f9f-09a01958d3f4/ovn-acl-logging/0.log" Jun 08 17:19:48.371992 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:19:48.371943 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:19:48.458253 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:19:48.458211 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:20:46.469901 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:20:46.469850 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:22:28.657548 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:22:28.657518 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vkrbj_559d75ed-52d7-4430-8f9f-09a01958d3f4/ovn-acl-logging/0.log" Jun 08 17:22:28.662769 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:22:28.662745 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vkrbj_559d75ed-52d7-4430-8f9f-09a01958d3f4/ovn-acl-logging/0.log" Jun 08 17:22:40.278264 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:22:40.278205 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:22:45.617709 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:22:45.617549 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:23:09.893025 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:09.892985 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:23:23.046915 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:23.046835 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:23:24.719128 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:24.719096 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:23:24.834866 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:24.834831 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:23:24.954892 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:24.954795 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:23:26.464067 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:26.464033 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:23:28.233444 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:28.233408 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:23:30.958588 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:30.958548 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:23:31.163697 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:31.163657 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:23:31.264821 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:31.264731 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:23:32.686475 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:32.686431 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:23:36.996906 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:36.996872 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:23:37.062903 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:37.062868 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:23:37.159470 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:37.159443 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k"] Jun 08 17:23:37.163160 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:37.163143 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k" Jun 08 17:23:37.165564 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:37.165539 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-1d5734c8-openshift-default-dockercfg-xtphx\"" Jun 08 17:23:37.173269 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:37.173227 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k"] Jun 08 17:23:37.199686 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:37.199651 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:23:37.252701 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:37.252608 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:23:37.260107 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:37.260076 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1-credential-socket\") pod \"e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k\" (UID: \"6adc9b30-050d-4b9f-965a-d6d4dc3b4da1\") " pod="openshift-ingress/e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k" Jun 08 17:23:37.260230 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:37.260122 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1-workload-socket\") pod \"e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k\" (UID: \"6adc9b30-050d-4b9f-965a-d6d4dc3b4da1\") " pod="openshift-ingress/e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k" Jun 08 17:23:37.260310 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:37.260222 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1-istio-podinfo\") pod \"e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k\" (UID: \"6adc9b30-050d-4b9f-965a-d6d4dc3b4da1\") " pod="openshift-ingress/e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k" Jun 08 17:23:37.260310 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:37.260297 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1-istio-token\") pod \"e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k\" (UID: \"6adc9b30-050d-4b9f-965a-d6d4dc3b4da1\") " pod="openshift-ingress/e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k" Jun 08 17:23:37.260387 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:37.260347 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1-istiod-ca-cert\") pod \"e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k\" (UID: \"6adc9b30-050d-4b9f-965a-d6d4dc3b4da1\") " pod="openshift-ingress/e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k" Jun 08 17:23:37.260431 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:37.260407 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1-istio-envoy\") pod \"e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k\" (UID: \"6adc9b30-050d-4b9f-965a-d6d4dc3b4da1\") " pod="openshift-ingress/e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k" Jun 08 17:23:37.260486 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:37.260439 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1-workload-certs\") pod \"e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k\" (UID: \"6adc9b30-050d-4b9f-965a-d6d4dc3b4da1\") " pod="openshift-ingress/e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k" Jun 08 17:23:37.260585 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:37.260559 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxdtp\" (UniqueName: \"kubernetes.io/projected/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1-kube-api-access-cxdtp\") pod \"e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k\" (UID: \"6adc9b30-050d-4b9f-965a-d6d4dc3b4da1\") " pod="openshift-ingress/e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k" Jun 08 17:23:37.260713 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:37.260616 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1-istio-data\") pod \"e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k\" (UID: \"6adc9b30-050d-4b9f-965a-d6d4dc3b4da1\") " pod="openshift-ingress/e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k" Jun 08 17:23:37.361384 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:37.361354 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1-workload-socket\") pod \"e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k\" (UID: \"6adc9b30-050d-4b9f-965a-d6d4dc3b4da1\") " pod="openshift-ingress/e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k" Jun 08 17:23:37.361577 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:37.361396 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1-istio-podinfo\") pod \"e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k\" (UID: \"6adc9b30-050d-4b9f-965a-d6d4dc3b4da1\") " pod="openshift-ingress/e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k" Jun 08 17:23:37.361577 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:37.361413 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1-istio-token\") pod \"e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k\" (UID: \"6adc9b30-050d-4b9f-965a-d6d4dc3b4da1\") " pod="openshift-ingress/e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k" Jun 08 17:23:37.361577 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:37.361441 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1-istiod-ca-cert\") pod \"e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k\" (UID: \"6adc9b30-050d-4b9f-965a-d6d4dc3b4da1\") " pod="openshift-ingress/e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k" Jun 08 17:23:37.361577 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:37.361461 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1-istio-envoy\") pod \"e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k\" (UID: \"6adc9b30-050d-4b9f-965a-d6d4dc3b4da1\") " pod="openshift-ingress/e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k" Jun 08 17:23:37.361577 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:37.361482 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1-workload-certs\") pod \"e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k\" (UID: \"6adc9b30-050d-4b9f-965a-d6d4dc3b4da1\") " pod="openshift-ingress/e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k" Jun 08 17:23:37.361577 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:37.361541 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxdtp\" (UniqueName: \"kubernetes.io/projected/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1-kube-api-access-cxdtp\") pod \"e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k\" (UID: \"6adc9b30-050d-4b9f-965a-d6d4dc3b4da1\") " pod="openshift-ingress/e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k" Jun 08 17:23:37.361903 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:37.361584 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1-istio-data\") pod \"e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k\" (UID: \"6adc9b30-050d-4b9f-965a-d6d4dc3b4da1\") " pod="openshift-ingress/e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k" Jun 08 17:23:37.361903 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:37.361644 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1-credential-socket\") pod \"e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k\" (UID: \"6adc9b30-050d-4b9f-965a-d6d4dc3b4da1\") " pod="openshift-ingress/e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k" Jun 08 17:23:37.361903 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:37.361821 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1-workload-socket\") pod \"e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k\" (UID: \"6adc9b30-050d-4b9f-965a-d6d4dc3b4da1\") " pod="openshift-ingress/e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k" Jun 08 17:23:37.362063 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:37.362033 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1-workload-certs\") pod \"e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k\" (UID: \"6adc9b30-050d-4b9f-965a-d6d4dc3b4da1\") " pod="openshift-ingress/e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k" Jun 08 17:23:37.362063 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:37.362041 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1-credential-socket\") pod \"e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k\" (UID: \"6adc9b30-050d-4b9f-965a-d6d4dc3b4da1\") " pod="openshift-ingress/e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k" Jun 08 17:23:37.362372 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:37.362226 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1-istiod-ca-cert\") pod \"e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k\" (UID: \"6adc9b30-050d-4b9f-965a-d6d4dc3b4da1\") " pod="openshift-ingress/e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k" Jun 08 17:23:37.362372 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:37.362278 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1-istio-data\") pod \"e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k\" (UID: \"6adc9b30-050d-4b9f-965a-d6d4dc3b4da1\") " pod="openshift-ingress/e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k" Jun 08 17:23:37.363779 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:37.363756 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1-istio-envoy\") pod \"e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k\" (UID: \"6adc9b30-050d-4b9f-965a-d6d4dc3b4da1\") " pod="openshift-ingress/e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k" Jun 08 17:23:37.364056 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:37.364038 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1-istio-podinfo\") pod \"e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k\" (UID: \"6adc9b30-050d-4b9f-965a-d6d4dc3b4da1\") " pod="openshift-ingress/e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k" Jun 08 17:23:37.365053 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:37.365025 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:23:37.378551 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:37.378527 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxdtp\" (UniqueName: \"kubernetes.io/projected/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1-kube-api-access-cxdtp\") pod \"e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k\" (UID: \"6adc9b30-050d-4b9f-965a-d6d4dc3b4da1\") " pod="openshift-ingress/e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k" Jun 08 17:23:37.382371 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:37.382350 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1-istio-token\") pod \"e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k\" (UID: \"6adc9b30-050d-4b9f-965a-d6d4dc3b4da1\") " pod="openshift-ingress/e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k" Jun 08 17:23:37.467841 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:37.467817 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:23:37.475983 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:37.475960 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k" Jun 08 17:23:37.619659 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:37.619630 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k"] Jun 08 17:23:37.621153 ip-10-0-135-83 kubenswrapper[2579]: W0608 17:23:37.621123 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6adc9b30_050d_4b9f_965a_d6d4dc3b4da1.slice/crio-a3371af7737a50d44067b44ec1894dc68fa7de02f6fbec02ae2bb66325fa92c3 WatchSource:0}: Error finding container a3371af7737a50d44067b44ec1894dc68fa7de02f6fbec02ae2bb66325fa92c3: Status 404 returned error can't find the container with id a3371af7737a50d44067b44ec1894dc68fa7de02f6fbec02ae2bb66325fa92c3 Jun 08 17:23:37.623263 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:37.623213 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 08 17:23:37.623333 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:37.623301 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 08 17:23:37.623378 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:37.623331 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 08 17:23:38.583029 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:38.582991 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k" event={"ID":"6adc9b30-050d-4b9f-965a-d6d4dc3b4da1","Type":"ContainerStarted","Data":"38ed8888628d581fc3d81ce22e2171dd7301d88dbf393b6b329141652e95674b"} Jun 08 17:23:38.583439 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:38.583046 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k" event={"ID":"6adc9b30-050d-4b9f-965a-d6d4dc3b4da1","Type":"ContainerStarted","Data":"a3371af7737a50d44067b44ec1894dc68fa7de02f6fbec02ae2bb66325fa92c3"} Jun 08 17:23:38.604849 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:38.604802 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k" podStartSLOduration=1.604788783 podStartE2EDuration="1.604788783s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 17:23:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 17:23:38.604272049 +0000 UTC m=+2170.501049525" watchObservedRunningTime="2026-06-08 17:23:38.604788783 +0000 UTC m=+2170.501566258" Jun 08 17:23:39.476120 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:39.476084 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k" Jun 08 17:23:39.480784 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:39.480762 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k" Jun 08 17:23:39.588136 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:39.588094 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k" Jun 08 17:23:39.589181 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:39.589162 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k" Jun 08 17:23:40.438376 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:40.438333 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:23:43.439730 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:43.439695 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:23:44.578030 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:44.577991 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k"] Jun 08 17:23:44.578492 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:44.578219 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k" podUID="6adc9b30-050d-4b9f-965a-d6d4dc3b4da1" containerName="istio-proxy" containerID="cri-o://38ed8888628d581fc3d81ce22e2171dd7301d88dbf393b6b329141652e95674b" gracePeriod=30 Jun 08 17:23:44.593757 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:44.593727 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:23:44.694830 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:44.694790 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:23:45.925008 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:45.924972 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:23:49.845009 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:49.844947 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k" Jun 08 17:23:49.881505 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:49.881479 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1-istiod-ca-cert\") pod \"6adc9b30-050d-4b9f-965a-d6d4dc3b4da1\" (UID: \"6adc9b30-050d-4b9f-965a-d6d4dc3b4da1\") " Jun 08 17:23:49.881664 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:49.881532 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cxdtp\" (UniqueName: \"kubernetes.io/projected/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1-kube-api-access-cxdtp\") pod \"6adc9b30-050d-4b9f-965a-d6d4dc3b4da1\" (UID: \"6adc9b30-050d-4b9f-965a-d6d4dc3b4da1\") " Jun 08 17:23:49.881664 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:49.881574 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1-istio-token\") pod \"6adc9b30-050d-4b9f-965a-d6d4dc3b4da1\" (UID: \"6adc9b30-050d-4b9f-965a-d6d4dc3b4da1\") " Jun 08 17:23:49.881664 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:49.881630 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1-istio-envoy\") pod \"6adc9b30-050d-4b9f-965a-d6d4dc3b4da1\" (UID: \"6adc9b30-050d-4b9f-965a-d6d4dc3b4da1\") " Jun 08 17:23:49.881844 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:49.881811 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1-workload-socket\") pod \"6adc9b30-050d-4b9f-965a-d6d4dc3b4da1\" (UID: \"6adc9b30-050d-4b9f-965a-d6d4dc3b4da1\") " Jun 08 17:23:49.881908 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:49.881852 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1-workload-certs\") pod \"6adc9b30-050d-4b9f-965a-d6d4dc3b4da1\" (UID: \"6adc9b30-050d-4b9f-965a-d6d4dc3b4da1\") " Jun 08 17:23:49.881908 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:49.881871 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6adc9b30-050d-4b9f-965a-d6d4dc3b4da1" (UID: "6adc9b30-050d-4b9f-965a-d6d4dc3b4da1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 17:23:49.882017 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:49.881955 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1-credential-socket\") pod \"6adc9b30-050d-4b9f-965a-d6d4dc3b4da1\" (UID: \"6adc9b30-050d-4b9f-965a-d6d4dc3b4da1\") " Jun 08 17:23:49.882017 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:49.881988 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1-istio-data\") pod \"6adc9b30-050d-4b9f-965a-d6d4dc3b4da1\" (UID: \"6adc9b30-050d-4b9f-965a-d6d4dc3b4da1\") " Jun 08 17:23:49.882166 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:49.882139 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6adc9b30-050d-4b9f-965a-d6d4dc3b4da1" (UID: "6adc9b30-050d-4b9f-965a-d6d4dc3b4da1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 17:23:49.882353 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:49.882275 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6adc9b30-050d-4b9f-965a-d6d4dc3b4da1" (UID: "6adc9b30-050d-4b9f-965a-d6d4dc3b4da1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 17:23:49.882611 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:49.882454 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6adc9b30-050d-4b9f-965a-d6d4dc3b4da1" (UID: "6adc9b30-050d-4b9f-965a-d6d4dc3b4da1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 17:23:49.882611 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:49.882505 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1-istio-data" (OuterVolumeSpecName: "istio-data") pod "6adc9b30-050d-4b9f-965a-d6d4dc3b4da1" (UID: "6adc9b30-050d-4b9f-965a-d6d4dc3b4da1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 17:23:49.882730 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:49.882651 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1-istio-podinfo\") pod \"6adc9b30-050d-4b9f-965a-d6d4dc3b4da1\" (UID: \"6adc9b30-050d-4b9f-965a-d6d4dc3b4da1\") " Jun 08 17:23:49.883102 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:49.883014 2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1-workload-socket\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 17:23:49.883102 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:49.883038 2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1-workload-certs\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 17:23:49.883102 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:49.883054 2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1-credential-socket\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 17:23:49.883102 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:49.883067 2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1-istio-data\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 17:23:49.883102 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:49.883081 2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1-istiod-ca-cert\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 17:23:49.884359 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:49.884330 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1-istio-token" (OuterVolumeSpecName: "istio-token") pod "6adc9b30-050d-4b9f-965a-d6d4dc3b4da1" (UID: "6adc9b30-050d-4b9f-965a-d6d4dc3b4da1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 17:23:49.884527 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:49.884334 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6adc9b30-050d-4b9f-965a-d6d4dc3b4da1" (UID: "6adc9b30-050d-4b9f-965a-d6d4dc3b4da1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 17:23:49.884601 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:49.884559 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1-kube-api-access-cxdtp" (OuterVolumeSpecName: "kube-api-access-cxdtp") pod "6adc9b30-050d-4b9f-965a-d6d4dc3b4da1" (UID: "6adc9b30-050d-4b9f-965a-d6d4dc3b4da1"). InnerVolumeSpecName "kube-api-access-cxdtp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 17:23:49.884959 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:49.884934 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6adc9b30-050d-4b9f-965a-d6d4dc3b4da1" (UID: "6adc9b30-050d-4b9f-965a-d6d4dc3b4da1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 08 17:23:49.984371 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:49.984335 2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1-istio-podinfo\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 17:23:49.984371 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:49.984371 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cxdtp\" (UniqueName: \"kubernetes.io/projected/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1-kube-api-access-cxdtp\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 17:23:49.984592 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:49.984386 2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1-istio-token\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 17:23:49.984592 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:49.984396 2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1-istio-envoy\") on node \"ip-10-0-135-83.ec2.internal\" DevicePath \"\"" Jun 08 17:23:50.645208 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:50.645172 2579 generic.go:356] "Generic (PLEG): container finished" podID="6adc9b30-050d-4b9f-965a-d6d4dc3b4da1" containerID="38ed8888628d581fc3d81ce22e2171dd7301d88dbf393b6b329141652e95674b" exitCode=0 Jun 08 17:23:50.645426 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:50.645226 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k" event={"ID":"6adc9b30-050d-4b9f-965a-d6d4dc3b4da1","Type":"ContainerDied","Data":"38ed8888628d581fc3d81ce22e2171dd7301d88dbf393b6b329141652e95674b"} Jun 08 17:23:50.645426 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:50.645276 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k" Jun 08 17:23:50.645426 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:50.645330 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k" event={"ID":"6adc9b30-050d-4b9f-965a-d6d4dc3b4da1","Type":"ContainerDied","Data":"a3371af7737a50d44067b44ec1894dc68fa7de02f6fbec02ae2bb66325fa92c3"} Jun 08 17:23:50.645426 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:50.645368 2579 scope.go:117] "RemoveContainer" containerID="38ed8888628d581fc3d81ce22e2171dd7301d88dbf393b6b329141652e95674b" Jun 08 17:23:50.654960 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:50.654936 2579 scope.go:117] "RemoveContainer" containerID="38ed8888628d581fc3d81ce22e2171dd7301d88dbf393b6b329141652e95674b" Jun 08 17:23:50.655232 ip-10-0-135-83 kubenswrapper[2579]: E0608 17:23:50.655206 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38ed8888628d581fc3d81ce22e2171dd7301d88dbf393b6b329141652e95674b\": container with ID starting with 38ed8888628d581fc3d81ce22e2171dd7301d88dbf393b6b329141652e95674b not found: ID does not exist" containerID="38ed8888628d581fc3d81ce22e2171dd7301d88dbf393b6b329141652e95674b" Jun 08 17:23:50.655347 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:50.655255 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38ed8888628d581fc3d81ce22e2171dd7301d88dbf393b6b329141652e95674b"} err="failed to get container status \"38ed8888628d581fc3d81ce22e2171dd7301d88dbf393b6b329141652e95674b\": rpc error: code = NotFound desc = could not find container \"38ed8888628d581fc3d81ce22e2171dd7301d88dbf393b6b329141652e95674b\": container with ID starting with 38ed8888628d581fc3d81ce22e2171dd7301d88dbf393b6b329141652e95674b not found: ID does not exist" Jun 08 17:23:50.666745 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:50.666724 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k"] Jun 08 17:23:50.675194 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:50.675173 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-1d5734c8-openshift-default-7b8c5d58fb-c497k"] Jun 08 17:23:51.018652 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:51.018617 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:23:51.137022 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:51.136985 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:23:52.527933 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:23:52.527898 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6adc9b30-050d-4b9f-965a-d6d4dc3b4da1" path="/var/lib/kubelet/pods/6adc9b30-050d-4b9f-965a-d6d4dc3b4da1/volumes" Jun 08 17:24:01.808803 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:01.808772 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-79f58678bc-nmb7b_fc28443b-3645-4597-a075-ded4a47b7cdb/nginx/0.log" Jun 08 17:24:03.053203 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:03.053168 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-558f5cf56d-ltdnl_05c816cb-1aa9-4950-bbbd-1fd5bf2e0b19/copy-manifests/0.log" Jun 08 17:24:03.060699 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:03.060659 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-558f5cf56d-ltdnl_05c816cb-1aa9-4950-bbbd-1fd5bf2e0b19/manager/0.log" Jun 08 17:24:04.614850 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:04.614816 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-v58v9_e2c2ec56-00f6-4565-8ffb-30f9ece43cb2/manager/0.log" Jun 08 17:24:04.826551 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:04.826524 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-ndhp7_0721dcf8-5d3d-40c7-a3b0-6becfc02928e/kuadrant-console-plugin/0.log" Jun 08 17:24:04.954270 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:04.954170 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-x4d99_e90d64ac-7e00-4119-9b96-223ef1f3b443/registry-server/0.log" Jun 08 17:24:05.320321 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:05.320295 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-xf5kh_9000554a-194b-43e9-ae77-ce0395a69675/manager/0.log" Jun 08 17:24:05.644009 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:05.643924 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795z7247_d55ef0d8-7737-4a48-886c-247bd9b4ba0f/istio-proxy/0.log" Jun 08 17:24:06.086068 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:06.086041 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-8d59d_4444ccdf-0e8b-4b6f-bb9c-03864abb8611/istio-proxy/1.log" Jun 08 17:24:06.325010 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:06.324976 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-qhmkz_f941f101-0e5e-4c7a-9ca4-9e8b0041ab1f/payload-processing/0.log" Jun 08 17:24:06.433802 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:06.433718 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-557dd576b7-t4q2j_f9358ada-e6bb-40f0-a5ce-b8e2ecce889f/router/0.log" Jun 08 17:24:06.762278 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:06.762185 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-7n9p2_e939b22a-7248-41d1-b2cc-b45bc1886f40/storage-initializer/0.log" Jun 08 17:24:06.768893 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:06.768872 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-7n9p2_e939b22a-7248-41d1-b2cc-b45bc1886f40/main/0.log" Jun 08 17:24:06.987621 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:06.987596 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-z64tz_40641043-ba9c-4a02-be9f-2eac7e1fd79f/storage-initializer/0.log" Jun 08 17:24:06.996719 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:06.996697 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-z64tz_40641043-ba9c-4a02-be9f-2eac7e1fd79f/main/0.log" Jun 08 17:24:07.216977 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:07.216941 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-gq466_94e6a592-a581-4e38-bbb1-ec1a5ceba095/main/0.log" Jun 08 17:24:07.222872 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:07.222854 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-gq466_94e6a592-a581-4e38-bbb1-ec1a5ceba095/storage-initializer/0.log" Jun 08 17:24:11.450779 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:11.450741 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:24:11.539047 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:11.538997 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" limit=1024 Jun 08 17:24:14.498666 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:14.498638 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8d9t8_5ee7062a-14dc-4eba-8adb-3c93000940f1/global-pull-secret-syncer/0.log" Jun 08 17:24:14.631881 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:14.631843 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-92hf8_7ebab24f-4a53-4e31-bff3-c20586cf3da6/konnectivity-agent/0.log" Jun 08 17:24:14.778647 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:14.778559 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-83.ec2.internal_9aa4eed84fc7574a1d3167c11c94bf11/haproxy/0.log" Jun 08 17:24:19.269540 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:19.269455 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-v58v9_e2c2ec56-00f6-4565-8ffb-30f9ece43cb2/manager/0.log" Jun 08 17:24:19.326032 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:19.326005 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-ndhp7_0721dcf8-5d3d-40c7-a3b0-6becfc02928e/kuadrant-console-plugin/0.log" Jun 08 17:24:19.375672 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:19.375645 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-x4d99_e90d64ac-7e00-4119-9b96-223ef1f3b443/registry-server/0.log" Jun 08 17:24:19.610554 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:19.610521 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-xf5kh_9000554a-194b-43e9-ae77-ce0395a69675/manager/0.log" Jun 08 17:24:21.312558 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:21.312525 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_992c5885-aa97-4d83-89ee-1e4c35e5602c/alertmanager/0.log" Jun 08 17:24:21.335516 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:21.335489 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_992c5885-aa97-4d83-89ee-1e4c35e5602c/config-reloader/0.log" Jun 08 17:24:21.362172 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:21.362152 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_992c5885-aa97-4d83-89ee-1e4c35e5602c/kube-rbac-proxy-web/0.log" Jun 08 17:24:21.382590 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:21.382569 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_992c5885-aa97-4d83-89ee-1e4c35e5602c/kube-rbac-proxy/0.log" Jun 08 17:24:21.414828 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:21.414799 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_992c5885-aa97-4d83-89ee-1e4c35e5602c/kube-rbac-proxy-metric/0.log" Jun 08 17:24:21.480398 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:21.480380 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_992c5885-aa97-4d83-89ee-1e4c35e5602c/prom-label-proxy/0.log" Jun 08 17:24:21.551507 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:21.551490 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_992c5885-aa97-4d83-89ee-1e4c35e5602c/init-config-reloader/0.log" Jun 08 17:24:21.642211 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:21.642185 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-d956z_37610212-ce3b-459a-9d75-2a949e72aab5/kube-state-metrics/0.log" Jun 08 17:24:21.658448 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:21.658422 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-d956z_37610212-ce3b-459a-9d75-2a949e72aab5/kube-rbac-proxy-main/0.log" Jun 08 17:24:21.686800 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:21.686778 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-d956z_37610212-ce3b-459a-9d75-2a949e72aab5/kube-rbac-proxy-self/0.log" Jun 08 17:24:21.766749 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:21.766724 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-rf6jk_9c94da77-3591-40a6-90f1-ab02631e4cec/monitoring-plugin/0.log" Jun 08 17:24:21.995627 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:21.995543 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vcsbd_5fff9157-6f59-44bd-bb68-d83f5fb56328/node-exporter/0.log" Jun 08 17:24:22.016410 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:22.016385 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vcsbd_5fff9157-6f59-44bd-bb68-d83f5fb56328/kube-rbac-proxy/0.log" Jun 08 17:24:22.039280 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:22.039258 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vcsbd_5fff9157-6f59-44bd-bb68-d83f5fb56328/init-textfile/0.log" Jun 08 17:24:22.407301 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:22.407271 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-7cfcr_82d39be1-b24a-4012-9f6a-4af36f8ac4c5/prometheus-operator/0.log" Jun 08 17:24:22.426920 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:22.426892 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-7cfcr_82d39be1-b24a-4012-9f6a-4af36f8ac4c5/kube-rbac-proxy/0.log" Jun 08 17:24:22.451720 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:22.451698 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-bbvrx_59c46146-5fe0-4d6e-a29e-1a007d518010/prometheus-operator-admission-webhook/0.log" Jun 08 17:24:22.569639 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:22.569619 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6685bf9566-m6m5j_5e80641a-da35-4c3e-b8d1-5823cb3c2969/thanos-query/0.log" Jun 08 17:24:22.592910 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:22.592894 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6685bf9566-m6m5j_5e80641a-da35-4c3e-b8d1-5823cb3c2969/kube-rbac-proxy-web/0.log" Jun 08 17:24:22.615317 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:22.615292 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6685bf9566-m6m5j_5e80641a-da35-4c3e-b8d1-5823cb3c2969/kube-rbac-proxy/0.log" Jun 08 17:24:22.636323 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:22.636301 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6685bf9566-m6m5j_5e80641a-da35-4c3e-b8d1-5823cb3c2969/prom-label-proxy/0.log" Jun 08 17:24:22.657767 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:22.657742 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6685bf9566-m6m5j_5e80641a-da35-4c3e-b8d1-5823cb3c2969/kube-rbac-proxy-rules/0.log" Jun 08 17:24:22.681358 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:22.681335 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6685bf9566-m6m5j_5e80641a-da35-4c3e-b8d1-5823cb3c2969/kube-rbac-proxy-metrics/0.log" Jun 08 17:24:24.125018 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:24.124990 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-qndcr_afe50c9a-e17c-4e7c-9426-50e526b0aedc/networking-console-plugin/0.log" Jun 08 17:24:25.408854 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:25.408815 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-d96d8d54c-lgmtf_15336702-cb9e-4cd9-b595-e70a19398b9c/console/0.log" Jun 08 17:24:25.447316 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:25.447284 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-nhlg6_f81b9a94-06d5-40af-9188-bc24b482e22a/download-server/0.log" Jun 08 17:24:26.612290 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:26.612254 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zck4q/perf-node-gather-daemonset-hql4l"] Jun 08 17:24:26.613892 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:26.613865 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6adc9b30-050d-4b9f-965a-d6d4dc3b4da1" containerName="istio-proxy" Jun 08 17:24:26.614089 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:26.614074 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6adc9b30-050d-4b9f-965a-d6d4dc3b4da1" containerName="istio-proxy" Jun 08 17:24:26.614433 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:26.614415 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6adc9b30-050d-4b9f-965a-d6d4dc3b4da1" containerName="istio-proxy" Jun 08 17:24:26.619491 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:26.619469 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zck4q/perf-node-gather-daemonset-hql4l" Jun 08 17:24:26.623168 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:26.623143 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zck4q/perf-node-gather-daemonset-hql4l"] Jun 08 17:24:26.623325 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:26.623299 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zck4q\"/\"openshift-service-ca.crt\"" Jun 08 17:24:26.623394 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:26.623303 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zck4q\"/\"kube-root-ca.crt\"" Jun 08 17:24:26.624308 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:26.624286 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-zck4q\"/\"default-dockercfg-265qh\"" Jun 08 17:24:26.726395 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:26.726353 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvnrn\" (UniqueName: \"kubernetes.io/projected/af716b41-24c0-410a-b435-a9cd943c62fe-kube-api-access-qvnrn\") pod \"perf-node-gather-daemonset-hql4l\" (UID: \"af716b41-24c0-410a-b435-a9cd943c62fe\") " pod="openshift-must-gather-zck4q/perf-node-gather-daemonset-hql4l" Jun 08 17:24:26.726590 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:26.726420 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/af716b41-24c0-410a-b435-a9cd943c62fe-podres\") pod \"perf-node-gather-daemonset-hql4l\" (UID: \"af716b41-24c0-410a-b435-a9cd943c62fe\") " pod="openshift-must-gather-zck4q/perf-node-gather-daemonset-hql4l" Jun 08 17:24:26.726590 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:26.726462 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/af716b41-24c0-410a-b435-a9cd943c62fe-lib-modules\") pod \"perf-node-gather-daemonset-hql4l\" (UID: \"af716b41-24c0-410a-b435-a9cd943c62fe\") " pod="openshift-must-gather-zck4q/perf-node-gather-daemonset-hql4l" Jun 08 17:24:26.726590 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:26.726524 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/af716b41-24c0-410a-b435-a9cd943c62fe-sys\") pod \"perf-node-gather-daemonset-hql4l\" (UID: \"af716b41-24c0-410a-b435-a9cd943c62fe\") " pod="openshift-must-gather-zck4q/perf-node-gather-daemonset-hql4l" Jun 08 17:24:26.726590 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:26.726542 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/af716b41-24c0-410a-b435-a9cd943c62fe-proc\") pod \"perf-node-gather-daemonset-hql4l\" (UID: \"af716b41-24c0-410a-b435-a9cd943c62fe\") " pod="openshift-must-gather-zck4q/perf-node-gather-daemonset-hql4l" Jun 08 17:24:26.827063 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:26.827029 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/af716b41-24c0-410a-b435-a9cd943c62fe-sys\") pod \"perf-node-gather-daemonset-hql4l\" (UID: \"af716b41-24c0-410a-b435-a9cd943c62fe\") " pod="openshift-must-gather-zck4q/perf-node-gather-daemonset-hql4l" Jun 08 17:24:26.827063 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:26.827067 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/af716b41-24c0-410a-b435-a9cd943c62fe-proc\") pod \"perf-node-gather-daemonset-hql4l\" (UID: \"af716b41-24c0-410a-b435-a9cd943c62fe\") " pod="openshift-must-gather-zck4q/perf-node-gather-daemonset-hql4l" Jun 08 17:24:26.827318 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:26.827103 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvnrn\" (UniqueName: \"kubernetes.io/projected/af716b41-24c0-410a-b435-a9cd943c62fe-kube-api-access-qvnrn\") pod \"perf-node-gather-daemonset-hql4l\" (UID: \"af716b41-24c0-410a-b435-a9cd943c62fe\") " pod="openshift-must-gather-zck4q/perf-node-gather-daemonset-hql4l" Jun 08 17:24:26.827318 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:26.827149 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/af716b41-24c0-410a-b435-a9cd943c62fe-podres\") pod \"perf-node-gather-daemonset-hql4l\" (UID: \"af716b41-24c0-410a-b435-a9cd943c62fe\") " pod="openshift-must-gather-zck4q/perf-node-gather-daemonset-hql4l" Jun 08 17:24:26.827318 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:26.827168 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/af716b41-24c0-410a-b435-a9cd943c62fe-sys\") pod \"perf-node-gather-daemonset-hql4l\" (UID: \"af716b41-24c0-410a-b435-a9cd943c62fe\") " pod="openshift-must-gather-zck4q/perf-node-gather-daemonset-hql4l" Jun 08 17:24:26.827318 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:26.827176 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/af716b41-24c0-410a-b435-a9cd943c62fe-proc\") pod \"perf-node-gather-daemonset-hql4l\" (UID: \"af716b41-24c0-410a-b435-a9cd943c62fe\") " pod="openshift-must-gather-zck4q/perf-node-gather-daemonset-hql4l" Jun 08 17:24:26.827318 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:26.827172 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/af716b41-24c0-410a-b435-a9cd943c62fe-lib-modules\") pod \"perf-node-gather-daemonset-hql4l\" (UID: \"af716b41-24c0-410a-b435-a9cd943c62fe\") " pod="openshift-must-gather-zck4q/perf-node-gather-daemonset-hql4l" Jun 08 17:24:26.827318 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:26.827311 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/af716b41-24c0-410a-b435-a9cd943c62fe-podres\") pod \"perf-node-gather-daemonset-hql4l\" (UID: \"af716b41-24c0-410a-b435-a9cd943c62fe\") " pod="openshift-must-gather-zck4q/perf-node-gather-daemonset-hql4l" Jun 08 17:24:26.827527 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:26.827314 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/af716b41-24c0-410a-b435-a9cd943c62fe-lib-modules\") pod \"perf-node-gather-daemonset-hql4l\" (UID: \"af716b41-24c0-410a-b435-a9cd943c62fe\") " pod="openshift-must-gather-zck4q/perf-node-gather-daemonset-hql4l" Jun 08 17:24:26.837840 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:26.837813 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvnrn\" (UniqueName: \"kubernetes.io/projected/af716b41-24c0-410a-b435-a9cd943c62fe-kube-api-access-qvnrn\") pod \"perf-node-gather-daemonset-hql4l\" (UID: \"af716b41-24c0-410a-b435-a9cd943c62fe\") " pod="openshift-must-gather-zck4q/perf-node-gather-daemonset-hql4l" Jun 08 17:24:26.932395 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:26.932290 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zck4q/perf-node-gather-daemonset-hql4l" Jun 08 17:24:27.066530 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:27.066502 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zck4q/perf-node-gather-daemonset-hql4l"] Jun 08 17:24:27.068799 ip-10-0-135-83 kubenswrapper[2579]: W0608 17:24:27.068765 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podaf716b41_24c0_410a_b435_a9cd943c62fe.slice/crio-d7cc03d2514e9df41cd3090177a012377208e2e7bafed6f42275d67fef845814 WatchSource:0}: Error finding container d7cc03d2514e9df41cd3090177a012377208e2e7bafed6f42275d67fef845814: Status 404 returned error can't find the container with id d7cc03d2514e9df41cd3090177a012377208e2e7bafed6f42275d67fef845814 Jun 08 17:24:27.390439 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:27.390413 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-k75p9_39f5a916-a88c-4539-a49d-ac446548636f/dns/0.log" Jun 08 17:24:27.409639 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:27.409614 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-k75p9_39f5a916-a88c-4539-a49d-ac446548636f/kube-rbac-proxy/0.log" Jun 08 17:24:27.521772 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:27.521734 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9bmtp_2d4b91d7-69b6-4cb8-821c-6313ccdae4fe/dns-node-resolver/0.log" Jun 08 17:24:27.836906 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:27.836871 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zck4q/perf-node-gather-daemonset-hql4l" event={"ID":"af716b41-24c0-410a-b435-a9cd943c62fe","Type":"ContainerStarted","Data":"56da6a88c2ec1db107ecf7bf8f33ef0a6db76aad71e6fdb08d564e1b41ed36d9"} Jun 08 17:24:27.837330 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:27.836924 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zck4q/perf-node-gather-daemonset-hql4l" event={"ID":"af716b41-24c0-410a-b435-a9cd943c62fe","Type":"ContainerStarted","Data":"d7cc03d2514e9df41cd3090177a012377208e2e7bafed6f42275d67fef845814"} Jun 08 17:24:27.837330 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:27.836947 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-zck4q/perf-node-gather-daemonset-hql4l" Jun 08 17:24:27.854710 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:27.854663 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-zck4q/perf-node-gather-daemonset-hql4l" podStartSLOduration=1.8546485860000002 podStartE2EDuration="1.854648586s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 17:24:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 17:24:27.852606369 +0000 UTC m=+2219.749383840" watchObservedRunningTime="2026-06-08 17:24:27.854648586 +0000 UTC m=+2219.751426061" Jun 08 17:24:28.153832 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:28.153752 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5ddbb49fbf-qjj6g_11a6db22-9ea7-42cd-87c6-f990e78a244f/registry/0.log" Jun 08 17:24:28.207757 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:28.207724 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jvrlj_5690029c-2d74-407e-9f78-f55d7a9d216b/node-ca/0.log" Jun 08 17:24:29.171577 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:29.171541 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795z7247_d55ef0d8-7737-4a48-886c-247bd9b4ba0f/istio-proxy/0.log" Jun 08 17:24:29.312704 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:29.312662 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-8d59d_4444ccdf-0e8b-4b6f-bb9c-03864abb8611/istio-proxy/0.log" Jun 08 17:24:29.375489 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:29.375454 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-8d59d_4444ccdf-0e8b-4b6f-bb9c-03864abb8611/istio-proxy/1.log" Jun 08 17:24:29.538144 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:29.538057 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-qhmkz_f941f101-0e5e-4c7a-9ca4-9e8b0041ab1f/payload-processing/0.log" Jun 08 17:24:29.563092 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:29.563064 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-557dd576b7-t4q2j_f9358ada-e6bb-40f0-a5ce-b8e2ecce889f/router/0.log" Jun 08 17:24:30.223266 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:30.223210 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pjgts_0015697c-c802-48e9-8fba-511d0f7be4e7/serve-healthcheck-canary/0.log" Jun 08 17:24:30.780182 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:30.780143 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-6k567_d71f42f1-6fe5-4ee6-a40c-4f1095961288/insights-operator/0.log" Jun 08 17:24:30.784096 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:30.784073 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-6k567_d71f42f1-6fe5-4ee6-a40c-4f1095961288/insights-operator/1.log" Jun 08 17:24:30.956187 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:30.956160 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x5q95_b15be71f-f411-4891-93a4-60fcd2a2422d/kube-rbac-proxy/0.log" Jun 08 17:24:30.975942 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:30.975916 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x5q95_b15be71f-f411-4891-93a4-60fcd2a2422d/exporter/0.log" Jun 08 17:24:30.995916 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:30.995893 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x5q95_b15be71f-f411-4891-93a4-60fcd2a2422d/extractor/0.log" Jun 08 17:24:33.208689 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:33.208657 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-79f58678bc-nmb7b_fc28443b-3645-4597-a075-ded4a47b7cdb/nginx/0.log" Jun 08 17:24:33.847036 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:33.847001 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-558f5cf56d-ltdnl_05c816cb-1aa9-4950-bbbd-1fd5bf2e0b19/manager/0.log" Jun 08 17:24:33.853144 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:33.853119 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-zck4q/perf-node-gather-daemonset-hql4l" Jun 08 17:24:33.865351 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:33.865330 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-558f5cf56d-ltdnl_05c816cb-1aa9-4950-bbbd-1fd5bf2e0b19/copy-manifests/0.log" Jun 08 17:24:35.440738 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:35.440708 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6687c84fb8-cmmw8_5da85637-5118-444b-8b17-3909630af819/manager/0.log" Jun 08 17:24:39.502679 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:39.502642 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795z7247_d55ef0d8-7737-4a48-886c-247bd9b4ba0f/istio-proxy/0.log" Jun 08 17:24:39.611076 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:39.611044 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-8d59d_4444ccdf-0e8b-4b6f-bb9c-03864abb8611/istio-proxy/0.log" Jun 08 17:24:39.676683 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:39.676647 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-8d59d_4444ccdf-0e8b-4b6f-bb9c-03864abb8611/istio-proxy/1.log" Jun 08 17:24:39.828054 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:39.828024 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-qhmkz_f941f101-0e5e-4c7a-9ca4-9e8b0041ab1f/payload-processing/0.log" Jun 08 17:24:39.839425 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:39.839402 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-557dd576b7-t4q2j_f9358ada-e6bb-40f0-a5ce-b8e2ecce889f/router/0.log" Jun 08 17:24:40.964824 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:40.964792 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795z7247_d55ef0d8-7737-4a48-886c-247bd9b4ba0f/istio-proxy/0.log" Jun 08 17:24:41.068356 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:41.068324 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-8d59d_4444ccdf-0e8b-4b6f-bb9c-03864abb8611/istio-proxy/0.log" Jun 08 17:24:41.132747 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:41.132710 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-8d59d_4444ccdf-0e8b-4b6f-bb9c-03864abb8611/istio-proxy/1.log" Jun 08 17:24:41.282751 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:41.282655 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-qhmkz_f941f101-0e5e-4c7a-9ca4-9e8b0041ab1f/payload-processing/0.log" Jun 08 17:24:41.297122 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:41.297091 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-557dd576b7-t4q2j_f9358ada-e6bb-40f0-a5ce-b8e2ecce889f/router/0.log" Jun 08 17:24:42.735777 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:42.735745 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-4lzgx_cb99c500-61a5-432d-93dc-24d07ebd5c1a/kube-multus/0.log" Jun 08 17:24:42.955725 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:42.955650 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tpm7n_a00cfd6c-ccf8-4a08-94d8-1d08c4233bef/kube-multus-additional-cni-plugins/0.log" Jun 08 17:24:42.976115 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:42.976087 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tpm7n_a00cfd6c-ccf8-4a08-94d8-1d08c4233bef/egress-router-binary-copy/0.log" Jun 08 17:24:42.998119 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:42.998084 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795z7247_d55ef0d8-7737-4a48-886c-247bd9b4ba0f/istio-proxy/0.log" Jun 08 17:24:43.000123 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:43.000095 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tpm7n_a00cfd6c-ccf8-4a08-94d8-1d08c4233bef/cni-plugins/0.log" Jun 08 17:24:43.022030 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:43.022003 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tpm7n_a00cfd6c-ccf8-4a08-94d8-1d08c4233bef/bond-cni-plugin/0.log" Jun 08 17:24:43.044198 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:43.044169 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tpm7n_a00cfd6c-ccf8-4a08-94d8-1d08c4233bef/routeoverride-cni/0.log" Jun 08 17:24:43.063798 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:43.063772 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tpm7n_a00cfd6c-ccf8-4a08-94d8-1d08c4233bef/whereabouts-cni-bincopy/0.log" Jun 08 17:24:43.082735 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:43.082707 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tpm7n_a00cfd6c-ccf8-4a08-94d8-1d08c4233bef/whereabouts-cni/0.log" Jun 08 17:24:43.093199 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:43.093161 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-8d59d_4444ccdf-0e8b-4b6f-bb9c-03864abb8611/istio-proxy/0.log" Jun 08 17:24:43.157230 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:43.157193 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-8d59d_4444ccdf-0e8b-4b6f-bb9c-03864abb8611/istio-proxy/1.log" Jun 08 17:24:43.300222 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:43.300130 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-qhmkz_f941f101-0e5e-4c7a-9ca4-9e8b0041ab1f/payload-processing/0.log" Jun 08 17:24:43.307255 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:43.307221 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-52225_cc8ed935-c565-44cd-93bf-b2699dd09b1b/network-metrics-daemon/0.log" Jun 08 17:24:43.313648 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:43.313626 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-557dd576b7-t4q2j_f9358ada-e6bb-40f0-a5ce-b8e2ecce889f/router/0.log" Jun 08 17:24:43.324476 ip-10-0-135-83 kubenswrapper[2579]: I0608 17:24:43.324454 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-52225_cc8ed935-c565-44cd-93bf-b2699dd09b1b/kube-rbac-proxy/0.log"